2024-04-16T15:41:51.284 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-16T15:41:51.284 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/data-scan} --owner scheduled_leonidus@teuthology --name leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi --archive /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658194 --verbose -- /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658194/orig.config.yaml 2024-04-16T15:41:51.333 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-16T15:41:51.427 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658194 branch: wip-lusov-shared-log-segment description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/data-scan} email: null first_in_suite: false job_id: '7658194' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-lusov-shared-log-segment ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds debug zombie log segments: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - bad backtrace - object missing on disk - error reading table object - error reading sessionmap - unmatched fragstat - unmatched rstat - was unreadable, recreating it now - Scrub error on inode - Metadata damage detected - inconsistent rstat on inode - Error recovering journal sha1: c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 subvolume_version: 1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-lusov-shared-log-segment sha1: c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f owner: scheduled_leonidus@teuthology priority: 150 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 2402 sha1: c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f sleep_before_teardown: 0 subset: 111/111111 suite: fs suite_branch: wip-lusov-shared-log-segment suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi132.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAGj1FBv5Iz75YFDuKEeyyv9NisIeN5NXdeIU6xePcTbrrspfcfZHUhQoySDhYSrWiff4Iq9J99v+k6vPUzdFKs= smithi179.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHGVpO59jxMDWCP3+d0/e01NXo1IE7S+xrBA/n/ovpbSdnwveoUOXumEksFbgCLNGQEvKpCY6McCzibhsq/UleA= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_data_scan teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 6c637841c215537a4502385240412f1966e0faab timestamp: 2024-04-16_12:36:42 tube: smithi user: leonidus verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-16T15:41:51.428 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa; will attempt to use it 2024-04-16T15:41:51.428 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks 2024-04-16T15:41:51.429 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-16T15:41:51.430 INFO:teuthology.task.internal:Checking packages... 2024-04-16T15:41:51.457 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f' 2024-04-16T15:41:51.457 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-16T15:41:51.457 INFO:teuthology.packaging:ref: None 2024-04-16T15:41:51.457 INFO:teuthology.packaging:tag: None 2024-04-16T15:41:51.457 INFO:teuthology.packaging:branch: wip-lusov-shared-log-segment 2024-04-16T15:41:51.458 INFO:teuthology.packaging:sha1: c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f 2024-04-16T15:41:51.458 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-lusov-shared-log-segment 2024-04-16T15:41:51.690 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2868.gc3c87ed0 2024-04-16T15:41:51.692 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-16T15:41:51.700 INFO:teuthology.task.internal:no buildpackages task found 2024-04-16T15:41:51.701 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-16T15:41:51.714 INFO:teuthology.task.internal:Saving configuration 2024-04-16T15:41:51.732 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-16T15:41:51.738 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-16T15:41:51.763 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi132.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658194', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-16 15:36:49.190889', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAGj1FBv5Iz75YFDuKEeyyv9NisIeN5NXdeIU6xePcTbrrspfcfZHUhQoySDhYSrWiff4Iq9J99v+k6vPUzdFKs='} 2024-04-16T15:41:51.788 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi179.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658194', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-16 15:36:49.189330', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHGVpO59jxMDWCP3+d0/e01NXo1IE7S+xrBA/n/ovpbSdnwveoUOXumEksFbgCLNGQEvKpCY6McCzibhsq/UleA='} 2024-04-16T15:41:51.789 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-16T15:41:51.794 INFO:teuthology.task.internal:roles: ubuntu@smithi132.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-04-16T15:41:51.794 INFO:teuthology.task.internal:roles: ubuntu@smithi179.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-04-16T15:41:51.794 INFO:teuthology.run_tasks:Running task console_log... 2024-04-16T15:41:51.868 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3505b12160>, signals=[15]) 2024-04-16T15:41:51.869 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-16T15:41:51.874 INFO:teuthology.task.internal:Opening connections... 2024-04-16T15:41:51.875 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi132.front.sepia.ceph.com 2024-04-16T15:41:51.877 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T15:41:51.968 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi179.front.sepia.ceph.com 2024-04-16T15:41:51.969 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T15:41:52.060 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-16T15:41:52.066 DEBUG:teuthology.orchestra.run.smithi132:> uname -m 2024-04-16T15:41:52.083 INFO:teuthology.orchestra.run.smithi132.stdout:x86_64 2024-04-16T15:41:52.084 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2024-04-16T15:41:52.144 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="CentOS Stream" 2024-04-16T15:41:52.144 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="9" 2024-04-16T15:41:52.144 INFO:teuthology.orchestra.run.smithi132.stdout:ID="centos" 2024-04-16T15:41:52.144 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="rhel fedora" 2024-04-16T15:41:52.144 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="9" 2024-04-16T15:41:52.144 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el9" 2024-04-16T15:41:52.144 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-16T15:41:52.144 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31" 2024-04-16T15:41:52.144 INFO:teuthology.orchestra.run.smithi132.stdout:LOGO="fedora-logo-icon" 2024-04-16T15:41:52.144 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-16T15:41:52.144 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://centos.org/" 2024-04-16T15:41:52.144 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-16T15:41:52.144 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-16T15:41:52.145 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-16T15:41:52.146 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2024-04-16T15:41:52.182 DEBUG:teuthology.orchestra.run.smithi179:> uname -m 2024-04-16T15:41:52.200 INFO:teuthology.orchestra.run.smithi179.stdout:x86_64 2024-04-16T15:41:52.201 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2024-04-16T15:41:52.258 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="CentOS Stream" 2024-04-16T15:41:52.258 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="9" 2024-04-16T15:41:52.258 INFO:teuthology.orchestra.run.smithi179.stdout:ID="centos" 2024-04-16T15:41:52.258 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="rhel fedora" 2024-04-16T15:41:52.258 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="9" 2024-04-16T15:41:52.258 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el9" 2024-04-16T15:41:52.258 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-16T15:41:52.258 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31" 2024-04-16T15:41:52.258 INFO:teuthology.orchestra.run.smithi179.stdout:LOGO="fedora-logo-icon" 2024-04-16T15:41:52.258 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-16T15:41:52.259 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://centos.org/" 2024-04-16T15:41:52.259 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-16T15:41:52.259 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-16T15:41:52.259 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-16T15:41:52.259 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2024-04-16T15:41:52.283 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-16T15:41:52.292 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-16T15:41:52.311 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-16T15:41:52.312 DEBUG:teuthology.orchestra.run.smithi132:> test '!' -e /home/ubuntu/cephtest 2024-04-16T15:41:52.314 DEBUG:teuthology.orchestra.run.smithi179:> test '!' -e /home/ubuntu/cephtest 2024-04-16T15:41:52.331 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-16T15:41:52.337 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-16T15:41:52.337 DEBUG:teuthology.orchestra.run.smithi132:> test -z $(ls -A /var/lib/ceph) 2024-04-16T15:41:52.374 DEBUG:teuthology.orchestra.run.smithi179:> test -z $(ls -A /var/lib/ceph) 2024-04-16T15:41:52.473 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-16T15:41:52.527 INFO:teuthology.run_tasks:Running task kernel... 2024-04-16T15:41:52.548 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-04-16T15:41:52.548 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-04-16T15:41:52.549 DEBUG:teuthology.orchestra.run.smithi132:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-16T15:41:52.549 DEBUG:teuthology.orchestra.run.smithi179:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-16T15:41:52.564 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T15:41:52.565 DEBUG:teuthology.orchestra.run.smithi132:> uname -r 2024-04-16T15:41:52.566 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T15:41:52.567 DEBUG:teuthology.orchestra.run.smithi179:> uname -r 2024-04-16T15:41:52.625 INFO:teuthology.orchestra.run.smithi179.stdout:5.14.0-361.el9.x86_64 2024-04-16T15:41:52.625 INFO:teuthology.task.kernel:Running kernel on smithi179: 5.14.0-361.el9.x86_64 2024-04-16T15:41:52.625 DEBUG:teuthology.orchestra.run.smithi179:> sudo yum install -y kernel 2024-04-16T15:41:52.626 INFO:teuthology.orchestra.run.smithi132.stdout:5.14.0-361.el9.x86_64 2024-04-16T15:41:52.626 INFO:teuthology.task.kernel:Running kernel on smithi132: 5.14.0-361.el9.x86_64 2024-04-16T15:41:52.627 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum install -y kernel 2024-04-16T15:41:54.767 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS-9 - AppStream 13 MB/s | 6.7 MB 00:00 2024-04-16T15:41:54.826 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS-9 - AppStream 12 MB/s | 6.7 MB 00:00 2024-04-16T15:41:56.367 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS-9 - BaseOS 4.3 MB/s | 2.0 MB 00:00 2024-04-16T15:41:56.459 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS-9 - BaseOS 3.9 MB/s | 2.0 MB 00:00 2024-04-16T15:41:57.292 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.0 MB 00:00 2024-04-16T15:41:58.266 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - BaseOS 5.5 MB/s | 8.0 MB 00:01 2024-04-16T15:41:59.110 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - AppStream 27 MB/s | 19 MB 00:00 2024-04-16T15:42:02.992 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - AppStream 5.3 MB/s | 19 MB 00:03 2024-04-16T15:42:03.211 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.2 MB 00:00 2024-04-16T15:42:05.011 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - Extras packages 24 kB/s | 16 kB 00:00 2024-04-16T15:42:06.013 INFO:teuthology.orchestra.run.smithi179.stdout:Extra Packages for Enterprise Linux 24 MB/s | 21 MB 00:00 2024-04-16T15:42:07.218 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - CRB 9.8 MB/s | 6.2 MB 00:00 2024-04-16T15:42:09.102 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - Extras packages 23 kB/s | 16 kB 00:00 2024-04-16T15:42:10.715 INFO:teuthology.orchestra.run.smithi132.stdout:Extra Packages for Enterprise Linux 14 MB/s | 21 MB 00:01 2024-04-16T15:42:11.021 INFO:teuthology.orchestra.run.smithi179.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-04-16T15:42:13.437 INFO:teuthology.orchestra.run.smithi179.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-16T15:42:13.437 INFO:teuthology.orchestra.run.smithi179.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-04-16T15:42:13.532 INFO:teuthology.orchestra.run.smithi179.stdout:Dependencies resolved. 2024-04-16T15:42:13.537 INFO:teuthology.orchestra.run.smithi179.stdout:================================================================================ 2024-04-16T15:42:13.537 INFO:teuthology.orchestra.run.smithi179.stdout: Package Arch Version Repository Size 2024-04-16T15:42:13.537 INFO:teuthology.orchestra.run.smithi179.stdout:================================================================================ 2024-04-16T15:42:13.537 INFO:teuthology.orchestra.run.smithi179.stdout:Installing: 2024-04-16T15:42:13.537 INFO:teuthology.orchestra.run.smithi179.stdout: kernel x86_64 5.14.0-438.el9 CentOS-BaseOS 277 k 2024-04-16T15:42:13.537 INFO:teuthology.orchestra.run.smithi179.stdout:Installing dependencies: 2024-04-16T15:42:13.537 INFO:teuthology.orchestra.run.smithi179.stdout: kernel-core x86_64 5.14.0-438.el9 CentOS-BaseOS 15 M 2024-04-16T15:42:13.537 INFO:teuthology.orchestra.run.smithi179.stdout: kernel-modules x86_64 5.14.0-438.el9 CentOS-BaseOS 34 M 2024-04-16T15:42:13.537 INFO:teuthology.orchestra.run.smithi179.stdout: kernel-modules-core x86_64 5.14.0-438.el9 CentOS-BaseOS 28 M 2024-04-16T15:42:13.537 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-16T15:42:13.538 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction Summary 2024-04-16T15:42:13.538 INFO:teuthology.orchestra.run.smithi179.stdout:================================================================================ 2024-04-16T15:42:13.538 INFO:teuthology.orchestra.run.smithi179.stdout:Install 4 Packages 2024-04-16T15:42:13.538 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-16T15:42:13.538 INFO:teuthology.orchestra.run.smithi179.stdout:Total download size: 77 M 2024-04-16T15:42:13.538 INFO:teuthology.orchestra.run.smithi179.stdout:Installed size: 123 M 2024-04-16T15:42:13.539 INFO:teuthology.orchestra.run.smithi179.stdout:Downloading Packages: 2024-04-16T15:42:13.732 INFO:teuthology.orchestra.run.smithi179.stdout:(1/4): kernel-5.14.0-438.el9.x86_64.rpm 1.4 MB/s | 277 kB 00:00 2024-04-16T15:42:14.733 INFO:teuthology.orchestra.run.smithi179.stdout:(2/4): kernel-core-5.14.0-438.el9.x86_64.rpm 13 MB/s | 15 MB 00:01 2024-04-16T15:42:15.740 INFO:teuthology.orchestra.run.smithi179.stdout:(3/4): kernel-modules-5.14.0-438.el9.x86_64.rpm 15 MB/s | 34 MB 00:02 2024-04-16T15:42:15.837 INFO:teuthology.orchestra.run.smithi132.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-04-16T15:42:16.349 INFO:teuthology.orchestra.run.smithi179.stdout:(4/4): kernel-modules-core-5.14.0-438.el9.x86_6 11 MB/s | 28 MB 00:02 2024-04-16T15:42:16.353 INFO:teuthology.orchestra.run.smithi179.stdout:-------------------------------------------------------------------------------- 2024-04-16T15:42:16.353 INFO:teuthology.orchestra.run.smithi179.stdout:Total 27 MB/s | 77 MB 00:02 2024-04-16T15:42:16.353 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction check 2024-04-16T15:42:16.735 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction check succeeded. 2024-04-16T15:42:16.735 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction test 2024-04-16T15:42:17.562 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction test succeeded. 2024-04-16T15:42:17.562 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction 2024-04-16T15:42:18.210 INFO:teuthology.orchestra.run.smithi132.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-16T15:42:18.210 INFO:teuthology.orchestra.run.smithi132.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-04-16T15:42:18.299 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-04-16T15:42:18.306 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-16T15:42:18.306 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repository Size 2024-04-16T15:42:18.306 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-16T15:42:18.306 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2024-04-16T15:42:18.306 INFO:teuthology.orchestra.run.smithi132.stdout: kernel x86_64 5.14.0-438.el9 CentOS-BaseOS 277 k 2024-04-16T15:42:18.306 INFO:teuthology.orchestra.run.smithi132.stdout:Installing dependencies: 2024-04-16T15:42:18.306 INFO:teuthology.orchestra.run.smithi132.stdout: kernel-core x86_64 5.14.0-438.el9 CentOS-BaseOS 15 M 2024-04-16T15:42:18.306 INFO:teuthology.orchestra.run.smithi132.stdout: kernel-modules x86_64 5.14.0-438.el9 CentOS-BaseOS 34 M 2024-04-16T15:42:18.306 INFO:teuthology.orchestra.run.smithi132.stdout: kernel-modules-core x86_64 5.14.0-438.el9 CentOS-BaseOS 28 M 2024-04-16T15:42:18.306 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:42:18.306 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2024-04-16T15:42:18.306 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-16T15:42:18.307 INFO:teuthology.orchestra.run.smithi132.stdout:Install 4 Packages 2024-04-16T15:42:18.307 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:42:18.307 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 77 M 2024-04-16T15:42:18.307 INFO:teuthology.orchestra.run.smithi132.stdout:Installed size: 123 M 2024-04-16T15:42:18.307 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2024-04-16T15:42:18.471 INFO:teuthology.orchestra.run.smithi132.stdout:(1/4): kernel-5.14.0-438.el9.x86_64.rpm 1.7 MB/s | 277 kB 00:00 2024-04-16T15:42:19.105 INFO:teuthology.orchestra.run.smithi132.stdout:(2/4): kernel-core-5.14.0-438.el9.x86_64.rpm 19 MB/s | 15 MB 00:00 2024-04-16T15:42:19.882 INFO:teuthology.orchestra.run.smithi179.stdout: Preparing : 1/1 2024-04-16T15:42:19.913 INFO:teuthology.orchestra.run.smithi132.stdout:(3/4): kernel-modules-core-5.14.0-438.el9.x86_6 19 MB/s | 28 MB 00:01 2024-04-16T15:42:20.222 INFO:teuthology.orchestra.run.smithi132.stdout:(4/4): kernel-modules-5.14.0-438.el9.x86_64.rpm 18 MB/s | 34 MB 00:01 2024-04-16T15:42:20.225 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2024-04-16T15:42:20.226 INFO:teuthology.orchestra.run.smithi132.stdout:Total 40 MB/s | 77 MB 00:01 2024-04-16T15:42:20.226 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2024-04-16T15:42:20.490 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : kernel-modules-core-5.14.0-438.el9.x86_64 1/4 2024-04-16T15:42:20.578 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-16T15:42:20.581 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2024-04-16T15:42:20.581 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2024-04-16T15:42:21.442 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2024-04-16T15:42:21.443 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2024-04-16T15:42:23.342 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-16T15:42:23.478 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-16T15:42:23.748 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2024-04-16T15:42:24.342 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : kernel-modules-core-5.14.0-438.el9.x86_64 1/4 2024-04-16T15:42:24.432 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-16T15:42:27.158 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-16T15:42:27.295 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-16T15:42:28.173 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-16T15:42:28.212 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : kernel-5.14.0-438.el9.x86_64 4/4 2024-04-16T15:42:31.972 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-16T15:42:32.014 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : kernel-5.14.0-438.el9.x86_64 4/4 2024-04-16T15:42:32.973 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: kernel-modules-core-5.14.0-438.el9.x86_64 4/4 2024-04-16T15:42:36.759 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: kernel-modules-core-5.14.0-438.el9.x86_64 4/4 2024-04-16T15:43:02.665 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: kernel-core-5.14.0-438.el9.x86_64 4/4 2024-04-16T15:43:02.665 INFO:teuthology.orchestra.run.smithi179.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-16T15:43:02.665 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-16T15:43:02.709 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: kernel-modules-5.14.0-438.el9.x86_64 4/4 2024-04-16T15:43:03.151 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: kernel-5.14.0-438.el9.x86_64 4/4 2024-04-16T15:43:03.151 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : kernel-5.14.0-438.el9.x86_64 1/4 2024-04-16T15:43:03.151 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-16T15:43:03.151 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-16T15:43:03.568 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : kernel-modules-core-5.14.0-438.el9.x86_64 4/4 2024-04-16T15:43:03.569 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-16T15:43:03.569 INFO:teuthology.orchestra.run.smithi179.stdout:Installed: 2024-04-16T15:43:03.569 INFO:teuthology.orchestra.run.smithi179.stdout: kernel-5.14.0-438.el9.x86_64 2024-04-16T15:43:03.569 INFO:teuthology.orchestra.run.smithi179.stdout: kernel-core-5.14.0-438.el9.x86_64 2024-04-16T15:43:03.569 INFO:teuthology.orchestra.run.smithi179.stdout: kernel-modules-5.14.0-438.el9.x86_64 2024-04-16T15:43:03.569 INFO:teuthology.orchestra.run.smithi179.stdout: kernel-modules-core-5.14.0-438.el9.x86_64 2024-04-16T15:43:03.569 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-16T15:43:03.569 INFO:teuthology.orchestra.run.smithi179.stdout:Complete! 2024-04-16T15:43:03.893 DEBUG:teuthology.orchestra.run.smithi179:> rpm -q kernel | sort -rV | head -n 1 2024-04-16T15:43:03.991 INFO:teuthology.orchestra.run.smithi179.stdout:kernel-5.14.0-438.el9.x86_64 2024-04-16T15:43:03.991 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-438.el9.x86_64 2024-04-16T15:43:03.991 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-438.el9.x86_64 2024-04-16T15:43:03.991 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-16T15:43:03.991 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-16T15:43:03.991 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-04-16T15:43:03.992 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi179.front.sepia.ceph.com, path=None, version=distro) 2024-04-16T15:43:03.992 DEBUG:teuthology.orchestra.run.smithi179:> rpm -q kernel | sort -rV | head -n 1 2024-04-16T15:43:04.072 INFO:teuthology.orchestra.run.smithi179.stdout:kernel-5.14.0-438.el9.x86_64 2024-04-16T15:43:04.072 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-438.el9.x86_64 2024-04-16T15:43:04.072 DEBUG:teuthology.orchestra.run.smithi179:> sudo rpm -qi grub2-tools 2024-04-16T15:43:04.111 INFO:teuthology.orchestra.run.smithi179.stdout:Name : grub2-tools 2024-04-16T15:43:04.111 INFO:teuthology.orchestra.run.smithi179.stdout:Epoch : 1 2024-04-16T15:43:04.111 INFO:teuthology.orchestra.run.smithi179.stdout:Version : 2.06 2024-04-16T15:43:04.111 INFO:teuthology.orchestra.run.smithi179.stdout:Release : 68.el9 2024-04-16T15:43:04.111 INFO:teuthology.orchestra.run.smithi179.stdout:Architecture: x86_64 2024-04-16T15:43:04.111 INFO:teuthology.orchestra.run.smithi179.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-16T15:43:04.112 INFO:teuthology.orchestra.run.smithi179.stdout:Group : Unspecified 2024-04-16T15:43:04.112 INFO:teuthology.orchestra.run.smithi179.stdout:Size : 8264254 2024-04-16T15:43:04.112 INFO:teuthology.orchestra.run.smithi179.stdout:License : GPLv3+ 2024-04-16T15:43:04.112 INFO:teuthology.orchestra.run.smithi179.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-16T15:43:04.112 INFO:teuthology.orchestra.run.smithi179.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-16T15:43:04.112 INFO:teuthology.orchestra.run.smithi179.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-16T15:43:04.112 INFO:teuthology.orchestra.run.smithi179.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-16T15:43:04.112 INFO:teuthology.orchestra.run.smithi179.stdout:Packager : builder@centos.org 2024-04-16T15:43:04.112 INFO:teuthology.orchestra.run.smithi179.stdout:Vendor : CentOS 2024-04-16T15:43:04.113 INFO:teuthology.orchestra.run.smithi179.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-16T15:43:04.113 INFO:teuthology.orchestra.run.smithi179.stdout:Summary : Support tools for GRUB. 2024-04-16T15:43:04.113 INFO:teuthology.orchestra.run.smithi179.stdout:Description : 2024-04-16T15:43:04.113 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-16T15:43:04.114 INFO:teuthology.orchestra.run.smithi179.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-16T15:43:04.114 INFO:teuthology.orchestra.run.smithi179.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-16T15:43:04.114 INFO:teuthology.orchestra.run.smithi179.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-16T15:43:04.114 INFO:teuthology.orchestra.run.smithi179.stdout:hardware devices. 2024-04-16T15:43:04.114 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-16T15:43:04.114 INFO:teuthology.orchestra.run.smithi179.stdout:This subpackage provides tools for support of all platforms. 2024-04-16T15:43:04.115 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-16T15:43:04.115 INFO:teuthology.task.kernel:Updating grub on smithi179 to boot 5.14.0-438.el9.x86_64 2024-04-16T15:43:04.115 DEBUG:teuthology.orchestra.run.smithi179:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-16T15:43:04.738 INFO:teuthology.orchestra.run.smithi179.stderr:Generating grub configuration file ... 2024-04-16T15:43:06.145 INFO:teuthology.orchestra.run.smithi179.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-16T15:43:06.180 INFO:teuthology.orchestra.run.smithi179.stderr:done 2024-04-16T15:43:06.183 DEBUG:teuthology.orchestra.run.smithi179:> mktemp 2024-04-16T15:43:06.198 INFO:teuthology.orchestra.run.smithi179.stdout:/tmp/tmp.dwNXBwVxTr 2024-04-16T15:43:06.198 DEBUG:teuthology.orchestra.run.smithi179:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.dwNXBwVxTr 2024-04-16T15:43:06.267 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0666 /tmp/tmp.dwNXBwVxTr 2024-04-16T15:43:06.410 DEBUG:teuthology.orchestra.remote:smithi179:/tmp/tmp.dwNXBwVxTr is 6KB 2024-04-16T15:43:06.460 DEBUG:teuthology.orchestra.run.smithi179:> rm -fr /tmp/tmp.dwNXBwVxTr 2024-04-16T15:43:06.475 DEBUG:teuthology.orchestra.run.smithi179:> sudo /bin/ls /boot/loader/entries || true 2024-04-16T15:43:06.515 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: kernel-core-5.14.0-438.el9.x86_64 4/4 2024-04-16T15:43:06.515 INFO:teuthology.orchestra.run.smithi132.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-16T15:43:06.515 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:43:06.539 INFO:teuthology.orchestra.run.smithi179.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-16T15:43:06.539 INFO:teuthology.orchestra.run.smithi179.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-16T15:43:06.539 INFO:teuthology.orchestra.run.smithi179.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-16T15:43:06.540 INFO:teuthology.orchestra.run.smithi179.stdout:15949e3c88704300882482eddfd7baae-5.14.0-438.el9.x86_64.conf 2024-04-16T15:43:06.541 DEBUG:teuthology.orchestra.run.smithi179:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-438.el9.x86_64 2024-04-16T15:43:06.558 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: kernel-modules-5.14.0-438.el9.x86_64 4/4 2024-04-16T15:43:06.692 DEBUG:teuthology.orchestra.run.smithi179:> sudo shutdown -r now 2024-04-16T15:43:06.905 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: kernel-5.14.0-438.el9.x86_64 4/4 2024-04-16T15:43:06.905 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : kernel-5.14.0-438.el9.x86_64 1/4 2024-04-16T15:43:06.905 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-16T15:43:06.906 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-16T15:43:07.331 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : kernel-modules-core-5.14.0-438.el9.x86_64 4/4 2024-04-16T15:43:07.332 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:43:07.332 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2024-04-16T15:43:07.332 INFO:teuthology.orchestra.run.smithi132.stdout: kernel-5.14.0-438.el9.x86_64 2024-04-16T15:43:07.332 INFO:teuthology.orchestra.run.smithi132.stdout: kernel-core-5.14.0-438.el9.x86_64 2024-04-16T15:43:07.332 INFO:teuthology.orchestra.run.smithi132.stdout: kernel-modules-5.14.0-438.el9.x86_64 2024-04-16T15:43:07.332 INFO:teuthology.orchestra.run.smithi132.stdout: kernel-modules-core-5.14.0-438.el9.x86_64 2024-04-16T15:43:07.332 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:43:07.332 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-04-16T15:43:07.662 DEBUG:teuthology.orchestra.run.smithi132:> rpm -q kernel | sort -rV | head -n 1 2024-04-16T15:43:07.764 INFO:teuthology.orchestra.run.smithi132.stdout:kernel-5.14.0-438.el9.x86_64 2024-04-16T15:43:07.764 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-438.el9.x86_64 2024-04-16T15:43:07.764 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-438.el9.x86_64 2024-04-16T15:43:07.765 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-16T15:43:07.765 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-16T15:43:07.765 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-16T15:43:07.765 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi132.front.sepia.ceph.com, path=None, version=distro) 2024-04-16T15:43:07.765 DEBUG:teuthology.orchestra.run.smithi132:> rpm -q kernel | sort -rV | head -n 1 2024-04-16T15:43:07.846 INFO:teuthology.orchestra.run.smithi132.stdout:kernel-5.14.0-438.el9.x86_64 2024-04-16T15:43:07.846 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-438.el9.x86_64 2024-04-16T15:43:07.846 DEBUG:teuthology.orchestra.run.smithi132:> sudo rpm -qi grub2-tools 2024-04-16T15:43:07.891 INFO:teuthology.orchestra.run.smithi132.stdout:Name : grub2-tools 2024-04-16T15:43:07.891 INFO:teuthology.orchestra.run.smithi132.stdout:Epoch : 1 2024-04-16T15:43:07.891 INFO:teuthology.orchestra.run.smithi132.stdout:Version : 2.06 2024-04-16T15:43:07.892 INFO:teuthology.orchestra.run.smithi132.stdout:Release : 68.el9 2024-04-16T15:43:07.892 INFO:teuthology.orchestra.run.smithi132.stdout:Architecture: x86_64 2024-04-16T15:43:07.892 INFO:teuthology.orchestra.run.smithi132.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-16T15:43:07.892 INFO:teuthology.orchestra.run.smithi132.stdout:Group : Unspecified 2024-04-16T15:43:07.892 INFO:teuthology.orchestra.run.smithi132.stdout:Size : 8264254 2024-04-16T15:43:07.892 INFO:teuthology.orchestra.run.smithi132.stdout:License : GPLv3+ 2024-04-16T15:43:07.892 INFO:teuthology.orchestra.run.smithi132.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-16T15:43:07.892 INFO:teuthology.orchestra.run.smithi132.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-16T15:43:07.892 INFO:teuthology.orchestra.run.smithi132.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-16T15:43:07.892 INFO:teuthology.orchestra.run.smithi132.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-16T15:43:07.892 INFO:teuthology.orchestra.run.smithi132.stdout:Packager : builder@centos.org 2024-04-16T15:43:07.892 INFO:teuthology.orchestra.run.smithi132.stdout:Vendor : CentOS 2024-04-16T15:43:07.892 INFO:teuthology.orchestra.run.smithi132.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-16T15:43:07.892 INFO:teuthology.orchestra.run.smithi132.stdout:Summary : Support tools for GRUB. 2024-04-16T15:43:07.893 INFO:teuthology.orchestra.run.smithi132.stdout:Description : 2024-04-16T15:43:07.893 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:43:07.893 INFO:teuthology.orchestra.run.smithi132.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-16T15:43:07.893 INFO:teuthology.orchestra.run.smithi132.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-16T15:43:07.893 INFO:teuthology.orchestra.run.smithi132.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-16T15:43:07.893 INFO:teuthology.orchestra.run.smithi132.stdout:hardware devices. 2024-04-16T15:43:07.893 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:43:07.893 INFO:teuthology.orchestra.run.smithi132.stdout:This subpackage provides tools for support of all platforms. 2024-04-16T15:43:07.894 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-16T15:43:07.894 INFO:teuthology.task.kernel:Updating grub on smithi132 to boot 5.14.0-438.el9.x86_64 2024-04-16T15:43:07.895 DEBUG:teuthology.orchestra.run.smithi132:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-16T15:43:08.468 INFO:teuthology.orchestra.run.smithi132.stderr:Generating grub configuration file ... 2024-04-16T15:43:09.934 INFO:teuthology.orchestra.run.smithi132.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-16T15:43:09.971 INFO:teuthology.orchestra.run.smithi132.stderr:done 2024-04-16T15:43:09.973 DEBUG:teuthology.orchestra.run.smithi132:> mktemp 2024-04-16T15:43:09.988 INFO:teuthology.orchestra.run.smithi132.stdout:/tmp/tmp.eswA6LZetX 2024-04-16T15:43:09.988 DEBUG:teuthology.orchestra.run.smithi132:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.eswA6LZetX 2024-04-16T15:43:10.056 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 0666 /tmp/tmp.eswA6LZetX 2024-04-16T15:43:10.193 DEBUG:teuthology.orchestra.remote:smithi132:/tmp/tmp.eswA6LZetX is 6KB 2024-04-16T15:43:10.242 DEBUG:teuthology.orchestra.run.smithi132:> rm -fr /tmp/tmp.eswA6LZetX 2024-04-16T15:43:10.256 DEBUG:teuthology.orchestra.run.smithi132:> sudo /bin/ls /boot/loader/entries || true 2024-04-16T15:43:10.321 INFO:teuthology.orchestra.run.smithi132.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-16T15:43:10.321 INFO:teuthology.orchestra.run.smithi132.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-16T15:43:10.321 INFO:teuthology.orchestra.run.smithi132.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-16T15:43:10.321 INFO:teuthology.orchestra.run.smithi132.stdout:15949e3c88704300882482eddfd7baae-5.14.0-438.el9.x86_64.conf 2024-04-16T15:43:10.322 DEBUG:teuthology.orchestra.run.smithi132:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-438.el9.x86_64 2024-04-16T15:43:10.461 DEBUG:teuthology.orchestra.run.smithi132:> sudo shutdown -r now 2024-04-16T15:43:36.722 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-04-16T15:43:36.722 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-04-16T15:43:36.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T15:43:40.466 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-16T15:43:40.466 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2024-04-16T15:43:40.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T15:44:36.771 DEBUG:teuthology.orchestra.remote:timed out 2024-04-16T15:44:40.473 DEBUG:teuthology.orchestra.remote:timed out 2024-04-16T15:44:45.777 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-04-16T15:44:45.778 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T15:44:46.482 DEBUG:teuthology.orchestra.run.smithi179:> true 2024-04-16T15:44:46.923 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-04-16T15:44:46.923 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-438.el9.x86_64"... 2024-04-16T15:44:46.923 DEBUG:teuthology.orchestra.run.smithi179:> uname -r 2024-04-16T15:44:46.938 INFO:teuthology.orchestra.run.smithi179.stdout:5.14.0-438.el9.x86_64 2024-04-16T15:44:46.938 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-438.el9.x86_64 vs 5.14.0-438.el9.x86_64 2024-04-16T15:44:46.938 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-16T15:44:46.938 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-16T15:44:47.940 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-16T15:44:47.940 DEBUG:teuthology.orchestra.run.smithi179:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-16T15:44:47.997 INFO:teuthology.orchestra.run.smithi179.stdout:ttyS1 2024-04-16T15:44:48.042 DEBUG:teuthology.parallel:result is None 2024-04-16T15:44:49.474 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2024-04-16T15:44:49.475 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T15:44:49.958 DEBUG:teuthology.orchestra.run.smithi132:> true 2024-04-16T15:44:50.426 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi132.front.sepia.ceph.com' 2024-04-16T15:44:50.426 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-438.el9.x86_64"... 2024-04-16T15:44:50.427 DEBUG:teuthology.orchestra.run.smithi132:> uname -r 2024-04-16T15:44:50.441 INFO:teuthology.orchestra.run.smithi132.stdout:5.14.0-438.el9.x86_64 2024-04-16T15:44:50.441 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-438.el9.x86_64 vs 5.14.0-438.el9.x86_64 2024-04-16T15:44:50.442 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-16T15:44:50.442 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-16T15:44:51.442 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-16T15:44:51.443 DEBUG:teuthology.orchestra.run.smithi132:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-16T15:44:51.497 INFO:teuthology.orchestra.run.smithi132.stdout:ttyS1 2024-04-16T15:44:51.544 DEBUG:teuthology.parallel:result is None 2024-04-16T15:44:51.545 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-16T15:44:51.555 INFO:teuthology.task.internal:Creating test directory... 2024-04-16T15:44:51.555 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-16T15:44:51.557 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-16T15:44:51.573 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-16T15:44:51.584 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-16T15:44:51.599 INFO:teuthology.task.internal:Creating archive directory... 2024-04-16T15:44:51.600 DEBUG:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-16T15:44:51.616 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-16T15:44:51.641 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-16T15:44:51.652 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-16T15:44:51.652 DEBUG:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-16T15:44:51.678 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-16T15:44:51.707 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-16T15:44:51.711 INFO:teuthology.orchestra.run.smithi132.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-16T15:44:51.721 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-16T15:44:51.725 INFO:teuthology.orchestra.run.smithi132.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-16T15:44:51.727 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-16T15:44:51.733 INFO:teuthology.task.internal:Configuring sudo... 2024-04-16T15:44:51.733 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-16T15:44:51.773 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-16T15:44:51.801 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-16T15:44:51.812 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-16T15:44:51.812 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-16T15:44:51.846 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-16T15:44:51.864 DEBUG:teuthology.orchestra.run.smithi132:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-16T15:44:51.946 DEBUG:teuthology.orchestra.run.smithi132:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-16T15:44:51.999 DEBUG:teuthology.orchestra.run.smithi132:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-16T15:44:52.085 DEBUG:teuthology.orchestra.run.smithi132:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-16T15:44:52.133 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-16T15:44:52.133 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-16T15:44:52.206 DEBUG:teuthology.orchestra.run.smithi179:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-16T15:44:52.260 DEBUG:teuthology.orchestra.run.smithi179:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-16T15:44:52.344 DEBUG:teuthology.orchestra.run.smithi179:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-16T15:44:52.397 DEBUG:teuthology.orchestra.run.smithi179:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-16T15:44:52.466 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-16T15:44:52.466 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-16T15:44:52.511 DEBUG:teuthology.orchestra.run.smithi132:> sudo service rsyslog restart 2024-04-16T15:44:52.513 DEBUG:teuthology.orchestra.run.smithi179:> sudo service rsyslog restart 2024-04-16T15:44:52.557 INFO:teuthology.orchestra.run.smithi132.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-16T15:44:52.625 INFO:teuthology.orchestra.run.smithi179.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-16T15:44:53.059 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-16T15:44:53.067 INFO:teuthology.task.internal:Starting timer... 2024-04-16T15:44:53.067 INFO:teuthology.run_tasks:Running task pcp... 2024-04-16T15:44:53.080 INFO:teuthology.run_tasks:Running task selinux... 2024-04-16T15:44:53.092 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-16T15:44:53.092 DEBUG:teuthology.orchestra.run.smithi132:> sudo service auditd rotate 2024-04-16T15:44:53.152 INFO:teuthology.orchestra.run.smithi132.stdout:Rotating logs: 2024-04-16T15:44:53.153 DEBUG:teuthology.orchestra.run.smithi179:> sudo service auditd rotate 2024-04-16T15:44:53.231 INFO:teuthology.orchestra.run.smithi179.stdout:Rotating logs: 2024-04-16T15:44:53.233 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-16T15:44:53.233 DEBUG:teuthology.orchestra.run.smithi132:> /usr/sbin/getenforce 2024-04-16T15:44:53.255 INFO:teuthology.orchestra.run.smithi132.stdout:Permissive 2024-04-16T15:44:53.256 DEBUG:teuthology.orchestra.run.smithi179:> /usr/sbin/getenforce 2024-04-16T15:44:53.285 INFO:teuthology.orchestra.run.smithi179.stdout:Permissive 2024-04-16T15:44:53.285 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi132.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi179.front.sepia.ceph.com': 'permissive'} 2024-04-16T15:44:53.286 DEBUG:teuthology.orchestra.run.smithi132:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-16T15:44:53.329 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T15:44:53.329 DEBUG:teuthology.orchestra.run.smithi179:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-16T15:44:53.358 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T15:44:53.359 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-16T15:44:53.359 DEBUG:teuthology.orchestra.run.smithi132:> sudo /usr/sbin/setenforce permissive 2024-04-16T15:44:53.424 DEBUG:teuthology.orchestra.run.smithi179:> sudo /usr/sbin/setenforce permissive 2024-04-16T15:44:53.471 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-16T15:44:53.480 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-16T15:44:53.490 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-16T15:44:53.639 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-16T15:44:53.669 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-16T15:44:53.671 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi132.front.sepia.ceph.com,smithi179.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-16T15:49:17.085 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi132.front.sepia.ceph.com'), Remote(name='ubuntu@smithi179.front.sepia.ceph.com')] 2024-04-16T15:49:17.086 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2024-04-16T15:49:17.088 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T15:49:17.179 DEBUG:teuthology.orchestra.run.smithi132:> true 2024-04-16T15:49:17.257 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi132.front.sepia.ceph.com' 2024-04-16T15:49:17.258 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-04-16T15:49:17.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T15:49:17.350 DEBUG:teuthology.orchestra.run.smithi179:> true 2024-04-16T15:49:17.430 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-04-16T15:49:17.430 INFO:teuthology.run_tasks:Running task clock... 2024-04-16T15:49:17.441 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-16T15:49:17.442 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-16T15:49:17.442 DEBUG:teuthology.orchestra.run.smithi132:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-16T15:49:17.445 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-16T15:49:17.445 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-16T15:49:17.475 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-16T15:49:17.492 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-16T15:49:17.502 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-16T15:49:17.519 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-16T15:49:17.523 INFO:teuthology.orchestra.run.smithi132.stderr:sudo: ntpd: command not found 2024-04-16T15:49:17.538 INFO:teuthology.orchestra.run.smithi132.stdout:506 Cannot talk to daemon 2024-04-16T15:49:17.550 INFO:teuthology.orchestra.run.smithi179.stderr:sudo: ntpd: command not found 2024-04-16T15:49:17.555 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-16T15:49:17.564 INFO:teuthology.orchestra.run.smithi179.stdout:506 Cannot talk to daemon 2024-04-16T15:49:17.572 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-16T15:49:17.581 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-16T15:49:17.599 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-16T15:49:17.628 INFO:teuthology.orchestra.run.smithi132.stderr:bash: line 1: ntpq: command not found 2024-04-16T15:49:17.631 INFO:teuthology.orchestra.run.smithi132.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-16T15:49:17.631 INFO:teuthology.orchestra.run.smithi132.stdout:=============================================================================== 2024-04-16T15:49:17.631 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T15:49:17.631 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T15:49:17.631 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T15:49:17.631 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T15:49:17.651 INFO:teuthology.orchestra.run.smithi179.stderr:bash: line 1: ntpq: command not found 2024-04-16T15:49:17.653 INFO:teuthology.orchestra.run.smithi179.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-16T15:49:17.654 INFO:teuthology.orchestra.run.smithi179.stdout:=============================================================================== 2024-04-16T15:49:17.654 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T15:49:17.654 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T15:49:17.654 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T15:49:17.654 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T15:49:17.655 INFO:teuthology.run_tasks:Running task install... 2024-04-16T15:49:17.665 DEBUG:teuthology.task.install:project ceph 2024-04-16T15:49:17.665 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f'}} 2024-04-16T15:49:17.665 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f'} 2024-04-16T15:49:17.665 INFO:teuthology.task.install:Using flavor: default 2024-04-16T15:49:17.671 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-16T15:49:17.672 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-16T15:49:17.672 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f', 'tag': None, 'wait_for_package': False} 2024-04-16T15:49:17.673 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f 2024-04-16T15:49:17.675 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f', 'tag': None, 'wait_for_package': False} 2024-04-16T15:49:17.675 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f 2024-04-16T15:49:17.825 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-lusov-shared-log-segment/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/centos/9/flavors/default/ 2024-04-16T15:49:17.825 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2868.gc3c87ed0 2024-04-16T15:49:17.916 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-lusov-shared-log-segment/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/centos/9/flavors/default/ 2024-04-16T15:49:17.916 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2868.gc3c87ed0 2024-04-16T15:49:17.940 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-lusov-shared-log-segment/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-lusov-shared-log-segment/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-lusov-shared-log-segment/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-16T15:49:17.940 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-16T15:49:17.940 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-16T15:49:17.970 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-16T15:49:17.971 DEBUG:teuthology.orchestra.run.smithi132:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-16T15:49:18.040 DEBUG:teuthology.orchestra.run.smithi132:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-16T15:49:18.100 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-lusov-shared-log-segment/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-lusov-shared-log-segment/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-lusov-shared-log-segment/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-16T15:49:18.100 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-16T15:49:18.100 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-16T15:49:18.123 DEBUG:teuthology.orchestra.run.smithi132:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-16T15:49:18.131 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-16T15:49:18.131 DEBUG:teuthology.orchestra.run.smithi179:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-16T15:49:18.191 INFO:teuthology.orchestra.run.smithi132.stdout:check_obsoletes = 1 2024-04-16T15:49:18.193 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum clean all 2024-04-16T15:49:18.201 DEBUG:teuthology.orchestra.run.smithi179:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-16T15:49:18.284 DEBUG:teuthology.orchestra.run.smithi179:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-16T15:49:18.351 INFO:teuthology.orchestra.run.smithi179.stdout:check_obsoletes = 1 2024-04-16T15:49:18.353 DEBUG:teuthology.orchestra.run.smithi179:> sudo yum clean all 2024-04-16T15:49:18.439 INFO:teuthology.orchestra.run.smithi132.stdout:74 files removed 2024-04-16T15:49:18.466 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-16T15:49:18.594 INFO:teuthology.orchestra.run.smithi179.stdout:74 files removed 2024-04-16T15:49:18.621 DEBUG:teuthology.orchestra.run.smithi179:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-16T15:49:19.264 INFO:teuthology.orchestra.run.smithi132.stdout:ceph packages for x86_64 170 kB/s | 83 kB 00:00 2024-04-16T15:49:19.341 INFO:teuthology.orchestra.run.smithi179.stdout:ceph packages for x86_64 201 kB/s | 83 kB 00:00 2024-04-16T15:49:19.664 INFO:teuthology.orchestra.run.smithi132.stdout:ceph noarch packages 33 kB/s | 11 kB 00:00 2024-04-16T15:49:19.733 INFO:teuthology.orchestra.run.smithi179.stdout:ceph noarch packages 34 kB/s | 11 kB 00:00 2024-04-16T15:49:20.023 INFO:teuthology.orchestra.run.smithi132.stdout:ceph source packages 5.9 kB/s | 1.9 kB 00:00 2024-04-16T15:49:20.159 INFO:teuthology.orchestra.run.smithi179.stdout:ceph source packages 4.9 kB/s | 1.9 kB 00:00 2024-04-16T15:49:20.911 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS-9 - AppStream 9.4 MB/s | 6.7 MB 00:00 2024-04-16T15:49:20.984 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS-9 - AppStream 7.3 MB/s | 6.7 MB 00:00 2024-04-16T15:49:22.639 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS-9 - BaseOS 3.3 MB/s | 2.0 MB 00:00 2024-04-16T15:49:22.660 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS-9 - BaseOS 3.5 MB/s | 2.0 MB 00:00 2024-04-16T15:49:23.708 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.0 MB 00:00 2024-04-16T15:49:25.535 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - AppStream 26 MB/s | 19 MB 00:00 2024-04-16T15:49:25.660 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - BaseOS 3.0 MB/s | 8.0 MB 00:02 2024-04-16T15:49:29.486 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.2 MB 00:00 2024-04-16T15:49:29.636 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - AppStream 6.6 MB/s | 19 MB 00:02 2024-04-16T15:49:31.178 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - Extras packages 31 kB/s | 16 kB 00:00 2024-04-16T15:49:32.729 INFO:teuthology.orchestra.run.smithi132.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-04-16T15:49:33.654 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.2 MB 00:00 2024-04-16T15:49:35.321 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - Extras packages 49 kB/s | 16 kB 00:00 2024-04-16T15:49:37.581 INFO:teuthology.orchestra.run.smithi179.stdout:Extra Packages for Enterprise Linux 9.8 MB/s | 21 MB 00:02 2024-04-16T15:49:37.904 INFO:teuthology.orchestra.run.smithi132.stdout:lab-extras 46 kB/s | 1.7 kB 00:00 2024-04-16T15:49:40.699 INFO:teuthology.orchestra.run.smithi132.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-16T15:49:40.700 INFO:teuthology.orchestra.run.smithi132.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-16T15:49:40.712 INFO:teuthology.orchestra.run.smithi132.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-04-16T15:49:40.713 INFO:teuthology.orchestra.run.smithi132.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-16T15:49:40.714 INFO:teuthology.orchestra.run.smithi132.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-04-16T15:49:40.715 INFO:teuthology.orchestra.run.smithi132.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-04-16T15:49:40.717 INFO:teuthology.orchestra.run.smithi132.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-16T15:49:40.719 INFO:teuthology.orchestra.run.smithi132.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-04-16T15:49:40.720 INFO:teuthology.orchestra.run.smithi132.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-04-16T15:49:40.799 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-04-16T15:49:40.815 INFO:teuthology.orchestra.run.smithi132.stdout:============================================================================================ 2024-04-16T15:49:40.816 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repository Size 2024-04-16T15:49:40.816 INFO:teuthology.orchestra.run.smithi132.stdout:============================================================================================ 2024-04-16T15:49:40.816 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2024-04-16T15:49:40.816 INFO:teuthology.orchestra.run.smithi132.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-04-16T15:49:40.816 INFO:teuthology.orchestra.run.smithi132.stdout: ceph x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 6.6 k 2024-04-16T15:49:40.816 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-base x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 5.4 M 2024-04-16T15:49:40.816 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-fuse x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 890 k 2024-04-16T15:49:40.816 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 145 k 2024-04-16T15:49:40.816 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 1.5 M 2024-04-16T15:49:40.816 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 142 k 2024-04-16T15:49:40.816 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 3.5 M 2024-04-16T15:49:40.816 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 7.4 M 2024-04-16T15:49:40.816 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-rook noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 49 k 2024-04-16T15:49:40.817 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-radosgw x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 10 M 2024-04-16T15:49:40.817 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-test x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 49 M 2024-04-16T15:49:40.817 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-volume noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 264 k 2024-04-16T15:49:40.817 INFO:teuthology.orchestra.run.smithi132.stdout: cephadm noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 762 k 2024-04-16T15:49:40.817 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-mirror x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 225 k 2024-04-16T15:49:40.817 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-shell x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 27 k 2024-04-16T15:49:40.817 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-top noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 18 k 2024-04-16T15:49:40.817 INFO:teuthology.orchestra.run.smithi132.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-16T15:49:40.817 INFO:teuthology.orchestra.run.smithi132.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-04-16T15:49:40.817 INFO:teuthology.orchestra.run.smithi132.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-04-16T15:49:40.817 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs-devel x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 32 k 2024-04-16T15:49:40.817 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs2 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 746 k 2024-04-16T15:49:40.817 INFO:teuthology.orchestra.run.smithi132.stdout: librados-devel x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 127 k 2024-04-16T15:49:40.817 INFO:teuthology.orchestra.run.smithi132.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-04-16T15:49:40.818 INFO:teuthology.orchestra.run.smithi132.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-16T15:49:40.818 INFO:teuthology.orchestra.run.smithi132.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-16T15:49:40.818 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql x86_64 13.14-1.el9 CentOS-AppStream 1.5 M 2024-04-16T15:49:40.818 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-contrib x86_64 13.14-1.el9 CentOS-AppStream 817 k 2024-04-16T15:49:40.818 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-server x86_64 13.14-1.el9 CentOS-AppStream 5.7 M 2024-04-16T15:49:40.818 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cephfs x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 161 k 2024-04-16T15:49:40.818 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rados x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 320 k 2024-04-16T15:49:40.818 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rbd x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 298 k 2024-04-16T15:49:40.818 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rgw x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 99 k 2024-04-16T15:49:40.818 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-fuse x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 85 k 2024-04-16T15:49:40.818 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-mirror x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 3.1 M 2024-04-16T15:49:40.818 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-nbd x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 170 k 2024-04-16T15:49:40.818 INFO:teuthology.orchestra.run.smithi132.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-16T15:49:40.819 INFO:teuthology.orchestra.run.smithi132.stdout:Upgrading: 2024-04-16T15:49:40.819 INFO:teuthology.orchestra.run.smithi132.stdout: NetworkManager x86_64 1:1.47.4-1.el9 CentOS-BaseOS 2.3 M 2024-04-16T15:49:40.819 INFO:teuthology.orchestra.run.smithi132.stdout: NetworkManager-libnm x86_64 1:1.47.4-1.el9 CentOS-BaseOS 1.8 M 2024-04-16T15:49:40.819 INFO:teuthology.orchestra.run.smithi132.stdout: NetworkManager-team x86_64 1:1.47.4-1.el9 CentOS-BaseOS 41 k 2024-04-16T15:49:40.819 INFO:teuthology.orchestra.run.smithi132.stdout: NetworkManager-tui x86_64 1:1.47.4-1.el9 CentOS-BaseOS 248 k 2024-04-16T15:49:40.819 INFO:teuthology.orchestra.run.smithi132.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-04-16T15:49:40.819 INFO:teuthology.orchestra.run.smithi132.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-04-16T15:49:40.819 INFO:teuthology.orchestra.run.smithi132.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-04-16T15:49:40.819 INFO:teuthology.orchestra.run.smithi132.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-04-16T15:49:40.819 INFO:teuthology.orchestra.run.smithi132.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-04-16T15:49:40.819 INFO:teuthology.orchestra.run.smithi132.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-04-16T15:49:40.819 INFO:teuthology.orchestra.run.smithi132.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-04-16T15:49:40.819 INFO:teuthology.orchestra.run.smithi132.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-04-16T15:49:40.819 INFO:teuthology.orchestra.run.smithi132.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-04-16T15:49:40.820 INFO:teuthology.orchestra.run.smithi132.stdout: librados2 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 3.4 M 2024-04-16T15:49:40.820 INFO:teuthology.orchestra.run.smithi132.stdout: librbd1 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 3.1 M 2024-04-16T15:49:40.820 INFO:teuthology.orchestra.run.smithi132.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-04-16T15:49:40.820 INFO:teuthology.orchestra.run.smithi132.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-04-16T15:49:40.820 INFO:teuthology.orchestra.run.smithi132.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-04-16T15:49:40.820 INFO:teuthology.orchestra.run.smithi132.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-04-16T15:49:40.820 INFO:teuthology.orchestra.run.smithi132.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-04-16T15:49:40.820 INFO:teuthology.orchestra.run.smithi132.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-04-16T15:49:40.820 INFO:teuthology.orchestra.run.smithi132.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-04-16T15:49:40.820 INFO:teuthology.orchestra.run.smithi132.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-04-16T15:49:40.820 INFO:teuthology.orchestra.run.smithi132.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-04-16T15:49:40.820 INFO:teuthology.orchestra.run.smithi132.stdout:Installing dependencies: 2024-04-16T15:49:40.820 INFO:teuthology.orchestra.run.smithi132.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-16T15:49:40.820 INFO:teuthology.orchestra.run.smithi132.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-04-16T15:49:40.821 INFO:teuthology.orchestra.run.smithi132.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-04-16T15:49:40.821 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-common x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 21 M 2024-04-16T15:49:40.821 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 34 k 2024-04-16T15:49:40.821 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mds x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 2.4 M 2024-04-16T15:49:40.821 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 249 k 2024-04-16T15:49:40.821 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mon x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 4.7 M 2024-04-16T15:49:40.821 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-osd x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 17 M 2024-04-16T15:49:40.821 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 16 k 2024-04-16T15:49:40.821 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-selinux x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 25 k 2024-04-16T15:49:40.821 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-04-16T15:49:40.821 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-04-16T15:49:40.821 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-04-16T15:49:40.821 INFO:teuthology.orchestra.run.smithi132.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-04-16T15:49:40.821 INFO:teuthology.orchestra.run.smithi132.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-16T15:49:40.822 INFO:teuthology.orchestra.run.smithi132.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-16T15:49:40.822 INFO:teuthology.orchestra.run.smithi132.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-16T15:49:40.822 INFO:teuthology.orchestra.run.smithi132.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-16T15:49:40.822 INFO:teuthology.orchestra.run.smithi132.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-16T15:49:40.822 INFO:teuthology.orchestra.run.smithi132.stdout: libcephsqlite x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 163 k 2024-04-16T15:49:40.822 INFO:teuthology.orchestra.run.smithi132.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-16T15:49:40.822 INFO:teuthology.orchestra.run.smithi132.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-16T15:49:40.822 INFO:teuthology.orchestra.run.smithi132.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-04-16T15:49:40.822 INFO:teuthology.orchestra.run.smithi132.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-16T15:49:40.822 INFO:teuthology.orchestra.run.smithi132.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-04-16T15:49:40.822 INFO:teuthology.orchestra.run.smithi132.stdout: libradosstriper1 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 500 k 2024-04-16T15:49:40.823 INFO:teuthology.orchestra.run.smithi132.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-04-16T15:49:40.823 INFO:teuthology.orchestra.run.smithi132.stdout: librgw2 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 5.2 M 2024-04-16T15:49:40.823 INFO:teuthology.orchestra.run.smithi132.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-16T15:49:40.823 INFO:teuthology.orchestra.run.smithi132.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-04-16T15:49:40.823 INFO:teuthology.orchestra.run.smithi132.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-04-16T15:49:40.823 INFO:teuthology.orchestra.run.smithi132.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-04-16T15:49:40.823 INFO:teuthology.orchestra.run.smithi132.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-16T15:49:40.823 INFO:teuthology.orchestra.run.smithi132.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-16T15:49:40.823 INFO:teuthology.orchestra.run.smithi132.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-04-16T15:49:40.823 INFO:teuthology.orchestra.run.smithi132.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-04-16T15:49:40.823 INFO:teuthology.orchestra.run.smithi132.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-04-16T15:49:40.823 INFO:teuthology.orchestra.run.smithi132.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-16T15:49:40.824 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-private-libs x86_64 13.14-1.el9 CentOS-AppStream 132 k 2024-04-16T15:49:40.824 INFO:teuthology.orchestra.run.smithi132.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-04-16T15:49:40.824 INFO:teuthology.orchestra.run.smithi132.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-16T15:49:40.824 INFO:teuthology.orchestra.run.smithi132.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-16T15:49:40.824 INFO:teuthology.orchestra.run.smithi132.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-04-16T15:49:40.824 INFO:teuthology.orchestra.run.smithi132.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-04-16T15:49:40.824 INFO:teuthology.orchestra.run.smithi132.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-16T15:49:40.824 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-16T15:49:40.824 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-argparse x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 45 k 2024-04-16T15:49:40.824 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-common x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 135 k 2024-04-16T15:49:40.824 INFO:teuthology.orchestra.run.smithi132.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-16T15:49:40.824 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-04-16T15:49:40.824 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-16T15:49:40.824 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-16T15:49:40.824 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-16T15:49:40.825 INFO:teuthology.orchestra.run.smithi132.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-16T15:49:40.825 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-04-16T15:49:40.825 INFO:teuthology.orchestra.run.smithi132.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-16T15:49:40.825 INFO:teuthology.orchestra.run.smithi132.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-16T15:49:40.825 INFO:teuthology.orchestra.run.smithi132.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-16T15:49:40.825 INFO:teuthology.orchestra.run.smithi132.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-16T15:49:40.825 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-16T15:49:40.825 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-16T15:49:40.825 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-16T15:49:40.825 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-16T15:49:40.825 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-16T15:49:40.825 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-16T15:49:40.826 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-04-16T15:49:40.826 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-04-16T15:49:40.826 INFO:teuthology.orchestra.run.smithi132.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-16T15:49:40.826 INFO:teuthology.orchestra.run.smithi132.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-16T15:49:40.826 INFO:teuthology.orchestra.run.smithi132.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-04-16T15:49:40.826 INFO:teuthology.orchestra.run.smithi132.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-04-16T15:49:40.826 INFO:teuthology.orchestra.run.smithi132.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-16T15:49:40.826 INFO:teuthology.orchestra.run.smithi132.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-16T15:49:40.826 INFO:teuthology.orchestra.run.smithi132.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-04-16T15:49:40.826 INFO:teuthology.orchestra.run.smithi132.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-04-16T15:49:40.826 INFO:teuthology.orchestra.run.smithi132.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-04-16T15:49:40.826 INFO:teuthology.orchestra.run.smithi132.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-04-16T15:49:40.827 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-16T15:49:40.827 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-04-16T15:49:40.827 INFO:teuthology.orchestra.run.smithi132.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-16T15:49:40.827 INFO:teuthology.orchestra.run.smithi132.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-04-16T15:49:40.827 INFO:teuthology.orchestra.run.smithi132.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-04-16T15:49:40.827 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-16T15:49:40.827 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-04-16T15:49:40.827 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-04-16T15:49:40.827 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-04-16T15:49:40.827 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-16T15:49:40.827 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-04-16T15:49:40.827 INFO:teuthology.orchestra.run.smithi132.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-16T15:49:40.827 INFO:teuthology.orchestra.run.smithi132.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-16T15:49:40.828 INFO:teuthology.orchestra.run.smithi132.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-04-16T15:49:40.828 INFO:teuthology.orchestra.run.smithi132.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-16T15:49:40.828 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-16T15:49:40.828 INFO:teuthology.orchestra.run.smithi132.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-04-16T15:49:40.828 INFO:teuthology.orchestra.run.smithi132.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-16T15:49:40.828 INFO:teuthology.orchestra.run.smithi132.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-04-16T15:49:40.828 INFO:teuthology.orchestra.run.smithi132.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-16T15:49:40.828 INFO:teuthology.orchestra.run.smithi132.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-04-16T15:49:40.828 INFO:teuthology.orchestra.run.smithi132.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-04-16T15:49:40.828 INFO:teuthology.orchestra.run.smithi132.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-16T15:49:40.828 INFO:teuthology.orchestra.run.smithi132.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-16T15:49:40.829 INFO:teuthology.orchestra.run.smithi132.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-16T15:49:40.829 INFO:teuthology.orchestra.run.smithi132.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-16T15:49:40.829 INFO:teuthology.orchestra.run.smithi132.stdout: qatlib x86_64 24.02.0-1.el9 CentOS-AppStream 220 k 2024-04-16T15:49:40.829 INFO:teuthology.orchestra.run.smithi132.stdout: qatzip-libs x86_64 1.2.0-1.el9 CentOS-AppStream 46 k 2024-04-16T15:49:40.829 INFO:teuthology.orchestra.run.smithi132.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-16T15:49:40.829 INFO:teuthology.orchestra.run.smithi132.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-04-16T15:49:40.829 INFO:teuthology.orchestra.run.smithi132.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-16T15:49:40.829 INFO:teuthology.orchestra.run.smithi132.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-04-16T15:49:40.829 INFO:teuthology.orchestra.run.smithi132.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-04-16T15:49:40.829 INFO:teuthology.orchestra.run.smithi132.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-04-16T15:49:40.829 INFO:teuthology.orchestra.run.smithi132.stdout:Installing weak dependencies: 2024-04-16T15:49:40.829 INFO:teuthology.orchestra.run.smithi132.stdout: qatlib-service x86_64 24.02.0-1.el9 CentOS-AppStream 35 k 2024-04-16T15:49:40.830 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:49:40.830 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2024-04-16T15:49:40.830 INFO:teuthology.orchestra.run.smithi132.stdout:============================================================================================ 2024-04-16T15:49:40.830 INFO:teuthology.orchestra.run.smithi132.stdout:Install 150 Packages 2024-04-16T15:49:40.830 INFO:teuthology.orchestra.run.smithi132.stdout:Upgrade 24 Packages 2024-04-16T15:49:40.830 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:49:40.830 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 228 M 2024-04-16T15:49:40.831 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2024-04-16T15:49:42.089 INFO:teuthology.orchestra.run.smithi132.stdout:(1/174): ceph-19.0.0-2868.gc3c87ed0.el9.x86_64. 27 kB/s | 6.6 kB 00:00 2024-04-16T15:49:42.715 INFO:teuthology.orchestra.run.smithi179.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-04-16T15:49:42.856 INFO:teuthology.orchestra.run.smithi132.stdout:(2/174): ceph-fuse-19.0.0-2868.gc3c87ed0.el9.x8 1.1 MB/s | 890 kB 00:00 2024-04-16T15:49:43.073 INFO:teuthology.orchestra.run.smithi132.stdout:(3/174): ceph-common-19.0.0-2868.gc3c87ed0.el9. 17 MB/s | 21 MB 00:01 2024-04-16T15:49:43.098 INFO:teuthology.orchestra.run.smithi132.stdout:(4/174): ceph-immutable-object-cache-19.0.0-286 599 kB/s | 145 kB 00:00 2024-04-16T15:49:43.223 INFO:teuthology.orchestra.run.smithi132.stdout:(5/174): ceph-mds-19.0.0-2868.gc3c87ed0.el9.x86 16 MB/s | 2.4 MB 00:00 2024-04-16T15:49:43.490 INFO:teuthology.orchestra.run.smithi132.stdout:(6/174): ceph-mon-19.0.0-2868.gc3c87ed0.el9.x86 18 MB/s | 4.7 MB 00:00 2024-04-16T15:49:43.790 INFO:teuthology.orchestra.run.smithi132.stdout:(7/174): ceph-mgr-19.0.0-2868.gc3c87ed0.el9.x86 2.2 MB/s | 1.5 MB 00:00 2024-04-16T15:49:44.374 INFO:teuthology.orchestra.run.smithi132.stdout:(8/174): ceph-osd-19.0.0-2868.gc3c87ed0.el9.x86 19 MB/s | 17 MB 00:00 2024-04-16T15:49:44.424 INFO:teuthology.orchestra.run.smithi132.stdout:(9/174): ceph-selinux-19.0.0-2868.gc3c87ed0.el9 508 kB/s | 25 kB 00:00 2024-04-16T15:49:44.616 INFO:teuthology.orchestra.run.smithi132.stdout:(10/174): ceph-base-19.0.0-2868.gc3c87ed0.el9.x 1.9 MB/s | 5.4 MB 00:02 2024-04-16T15:49:44.725 INFO:teuthology.orchestra.run.smithi132.stdout:(11/174): cephfs-mirror-19.0.0-2868.gc3c87ed0.e 2.0 MB/s | 225 kB 00:00 2024-04-16T15:49:44.842 INFO:teuthology.orchestra.run.smithi132.stdout:(12/174): cephfs-shell-19.0.0-2868.gc3c87ed0.el 231 kB/s | 27 kB 00:00 2024-04-16T15:49:44.950 INFO:teuthology.orchestra.run.smithi132.stdout:(13/174): libcephfs-devel-19.0.0-2868.gc3c87ed0 293 kB/s | 32 kB 00:00 2024-04-16T15:49:45.251 INFO:teuthology.orchestra.run.smithi132.stdout:(14/174): libcephfs2-19.0.0-2868.gc3c87ed0.el9. 2.4 MB/s | 746 kB 00:00 2024-04-16T15:49:45.351 INFO:teuthology.orchestra.run.smithi132.stdout:(15/174): libcephsqlite-19.0.0-2868.gc3c87ed0.e 1.6 MB/s | 163 kB 00:00 2024-04-16T15:49:45.452 INFO:teuthology.orchestra.run.smithi132.stdout:(16/174): librados-devel-19.0.0-2868.gc3c87ed0. 1.2 MB/s | 127 kB 00:00 2024-04-16T15:49:45.462 INFO:teuthology.orchestra.run.smithi179.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-16T15:49:45.463 INFO:teuthology.orchestra.run.smithi179.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-16T15:49:45.477 INFO:teuthology.orchestra.run.smithi179.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-04-16T15:49:45.478 INFO:teuthology.orchestra.run.smithi179.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-16T15:49:45.479 INFO:teuthology.orchestra.run.smithi179.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-04-16T15:49:45.480 INFO:teuthology.orchestra.run.smithi179.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-04-16T15:49:45.482 INFO:teuthology.orchestra.run.smithi179.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-16T15:49:45.485 INFO:teuthology.orchestra.run.smithi179.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-04-16T15:49:45.486 INFO:teuthology.orchestra.run.smithi179.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-04-16T15:49:45.566 INFO:teuthology.orchestra.run.smithi179.stdout:Dependencies resolved. 2024-04-16T15:49:45.584 INFO:teuthology.orchestra.run.smithi179.stdout:============================================================================================ 2024-04-16T15:49:45.584 INFO:teuthology.orchestra.run.smithi179.stdout: Package Arch Version Repository Size 2024-04-16T15:49:45.584 INFO:teuthology.orchestra.run.smithi179.stdout:============================================================================================ 2024-04-16T15:49:45.585 INFO:teuthology.orchestra.run.smithi179.stdout:Installing: 2024-04-16T15:49:45.585 INFO:teuthology.orchestra.run.smithi179.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-04-16T15:49:45.585 INFO:teuthology.orchestra.run.smithi179.stdout: ceph x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 6.6 k 2024-04-16T15:49:45.585 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-base x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 5.4 M 2024-04-16T15:49:45.585 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-fuse x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 890 k 2024-04-16T15:49:45.585 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 145 k 2024-04-16T15:49:45.585 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 1.5 M 2024-04-16T15:49:45.585 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 142 k 2024-04-16T15:49:45.585 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 3.5 M 2024-04-16T15:49:45.585 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 7.4 M 2024-04-16T15:49:45.586 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-rook noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 49 k 2024-04-16T15:49:45.586 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-radosgw x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 10 M 2024-04-16T15:49:45.586 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-test x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 49 M 2024-04-16T15:49:45.586 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-volume noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 264 k 2024-04-16T15:49:45.586 INFO:teuthology.orchestra.run.smithi179.stdout: cephadm noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 762 k 2024-04-16T15:49:45.586 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-mirror x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 225 k 2024-04-16T15:49:45.586 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-shell x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 27 k 2024-04-16T15:49:45.586 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-top noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 18 k 2024-04-16T15:49:45.586 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-16T15:49:45.586 INFO:teuthology.orchestra.run.smithi179.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-04-16T15:49:45.587 INFO:teuthology.orchestra.run.smithi179.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-04-16T15:49:45.587 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs-devel x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 32 k 2024-04-16T15:49:45.587 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs2 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 746 k 2024-04-16T15:49:45.587 INFO:teuthology.orchestra.run.smithi179.stdout: librados-devel x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 127 k 2024-04-16T15:49:45.587 INFO:teuthology.orchestra.run.smithi179.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-04-16T15:49:45.587 INFO:teuthology.orchestra.run.smithi179.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-16T15:49:45.587 INFO:teuthology.orchestra.run.smithi179.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-16T15:49:45.587 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql x86_64 13.14-1.el9 CentOS-AppStream 1.5 M 2024-04-16T15:49:45.587 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-contrib x86_64 13.14-1.el9 CentOS-AppStream 817 k 2024-04-16T15:49:45.587 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-server x86_64 13.14-1.el9 CentOS-AppStream 5.7 M 2024-04-16T15:49:45.587 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cephfs x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 161 k 2024-04-16T15:49:45.588 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rados x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 320 k 2024-04-16T15:49:45.588 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rbd x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 298 k 2024-04-16T15:49:45.588 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rgw x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 99 k 2024-04-16T15:49:45.588 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-fuse x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 85 k 2024-04-16T15:49:45.588 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-mirror x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 3.1 M 2024-04-16T15:49:45.588 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-nbd x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 170 k 2024-04-16T15:49:45.588 INFO:teuthology.orchestra.run.smithi179.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-16T15:49:45.588 INFO:teuthology.orchestra.run.smithi179.stdout:Upgrading: 2024-04-16T15:49:45.588 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager x86_64 1:1.47.4-1.el9 CentOS-BaseOS 2.3 M 2024-04-16T15:49:45.588 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-libnm x86_64 1:1.47.4-1.el9 CentOS-BaseOS 1.8 M 2024-04-16T15:49:45.588 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-team x86_64 1:1.47.4-1.el9 CentOS-BaseOS 41 k 2024-04-16T15:49:45.588 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-tui x86_64 1:1.47.4-1.el9 CentOS-BaseOS 248 k 2024-04-16T15:49:45.589 INFO:teuthology.orchestra.run.smithi179.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-04-16T15:49:45.589 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-04-16T15:49:45.589 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-04-16T15:49:45.589 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-04-16T15:49:45.589 INFO:teuthology.orchestra.run.smithi179.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-04-16T15:49:45.589 INFO:teuthology.orchestra.run.smithi179.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-04-16T15:49:45.589 INFO:teuthology.orchestra.run.smithi179.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-04-16T15:49:45.589 INFO:teuthology.orchestra.run.smithi179.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-04-16T15:49:45.589 INFO:teuthology.orchestra.run.smithi179.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-04-16T15:49:45.589 INFO:teuthology.orchestra.run.smithi179.stdout: librados2 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 3.4 M 2024-04-16T15:49:45.589 INFO:teuthology.orchestra.run.smithi179.stdout: librbd1 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 3.1 M 2024-04-16T15:49:45.589 INFO:teuthology.orchestra.run.smithi179.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-04-16T15:49:45.590 INFO:teuthology.orchestra.run.smithi179.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-04-16T15:49:45.590 INFO:teuthology.orchestra.run.smithi179.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-04-16T15:49:45.590 INFO:teuthology.orchestra.run.smithi179.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-04-16T15:49:45.590 INFO:teuthology.orchestra.run.smithi179.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-04-16T15:49:45.590 INFO:teuthology.orchestra.run.smithi179.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-04-16T15:49:45.590 INFO:teuthology.orchestra.run.smithi179.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-04-16T15:49:45.590 INFO:teuthology.orchestra.run.smithi179.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-04-16T15:49:45.590 INFO:teuthology.orchestra.run.smithi179.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-04-16T15:49:45.590 INFO:teuthology.orchestra.run.smithi179.stdout:Installing dependencies: 2024-04-16T15:49:45.590 INFO:teuthology.orchestra.run.smithi179.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-16T15:49:45.590 INFO:teuthology.orchestra.run.smithi179.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-04-16T15:49:45.590 INFO:teuthology.orchestra.run.smithi179.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-04-16T15:49:45.590 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-common x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 21 M 2024-04-16T15:49:45.591 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 34 k 2024-04-16T15:49:45.591 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mds x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 2.4 M 2024-04-16T15:49:45.591 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 249 k 2024-04-16T15:49:45.591 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mon x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 4.7 M 2024-04-16T15:49:45.591 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-osd x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 17 M 2024-04-16T15:49:45.591 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 16 k 2024-04-16T15:49:45.591 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-selinux x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 25 k 2024-04-16T15:49:45.591 INFO:teuthology.orchestra.run.smithi179.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-04-16T15:49:45.591 INFO:teuthology.orchestra.run.smithi179.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-04-16T15:49:45.591 INFO:teuthology.orchestra.run.smithi179.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-04-16T15:49:45.591 INFO:teuthology.orchestra.run.smithi179.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-04-16T15:49:45.591 INFO:teuthology.orchestra.run.smithi179.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-16T15:49:45.592 INFO:teuthology.orchestra.run.smithi179.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-16T15:49:45.592 INFO:teuthology.orchestra.run.smithi179.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-16T15:49:45.592 INFO:teuthology.orchestra.run.smithi179.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-16T15:49:45.592 INFO:teuthology.orchestra.run.smithi179.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-16T15:49:45.592 INFO:teuthology.orchestra.run.smithi179.stdout: libcephsqlite x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 163 k 2024-04-16T15:49:45.592 INFO:teuthology.orchestra.run.smithi179.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-16T15:49:45.592 INFO:teuthology.orchestra.run.smithi179.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-16T15:49:45.592 INFO:teuthology.orchestra.run.smithi179.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-04-16T15:49:45.592 INFO:teuthology.orchestra.run.smithi179.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-16T15:49:45.592 INFO:teuthology.orchestra.run.smithi179.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-04-16T15:49:45.592 INFO:teuthology.orchestra.run.smithi179.stdout: libradosstriper1 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 500 k 2024-04-16T15:49:45.592 INFO:teuthology.orchestra.run.smithi179.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-04-16T15:49:45.592 INFO:teuthology.orchestra.run.smithi179.stdout: librgw2 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 5.2 M 2024-04-16T15:49:45.592 INFO:teuthology.orchestra.run.smithi179.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-16T15:49:45.593 INFO:teuthology.orchestra.run.smithi179.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-04-16T15:49:45.593 INFO:teuthology.orchestra.run.smithi179.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-04-16T15:49:45.593 INFO:teuthology.orchestra.run.smithi179.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-04-16T15:49:45.593 INFO:teuthology.orchestra.run.smithi179.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-16T15:49:45.593 INFO:teuthology.orchestra.run.smithi179.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-16T15:49:45.593 INFO:teuthology.orchestra.run.smithi179.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-04-16T15:49:45.593 INFO:teuthology.orchestra.run.smithi179.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-04-16T15:49:45.593 INFO:teuthology.orchestra.run.smithi179.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-04-16T15:49:45.593 INFO:teuthology.orchestra.run.smithi179.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-16T15:49:45.593 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-private-libs x86_64 13.14-1.el9 CentOS-AppStream 132 k 2024-04-16T15:49:45.593 INFO:teuthology.orchestra.run.smithi179.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-04-16T15:49:45.593 INFO:teuthology.orchestra.run.smithi179.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-16T15:49:45.593 INFO:teuthology.orchestra.run.smithi179.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-16T15:49:45.594 INFO:teuthology.orchestra.run.smithi179.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-04-16T15:49:45.594 INFO:teuthology.orchestra.run.smithi179.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-04-16T15:49:45.594 INFO:teuthology.orchestra.run.smithi179.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-16T15:49:45.594 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-16T15:49:45.594 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-argparse x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 45 k 2024-04-16T15:49:45.594 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-common x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 135 k 2024-04-16T15:49:45.594 INFO:teuthology.orchestra.run.smithi179.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-16T15:49:45.594 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-04-16T15:49:45.594 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-16T15:49:45.594 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-16T15:49:45.594 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-16T15:49:45.594 INFO:teuthology.orchestra.run.smithi179.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-16T15:49:45.594 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-04-16T15:49:45.595 INFO:teuthology.orchestra.run.smithi179.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-16T15:49:45.595 INFO:teuthology.orchestra.run.smithi179.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-16T15:49:45.595 INFO:teuthology.orchestra.run.smithi179.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-16T15:49:45.595 INFO:teuthology.orchestra.run.smithi179.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-16T15:49:45.595 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-16T15:49:45.595 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-16T15:49:45.595 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-16T15:49:45.595 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-16T15:49:45.595 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-16T15:49:45.595 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-16T15:49:45.595 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-04-16T15:49:45.595 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-04-16T15:49:45.595 INFO:teuthology.orchestra.run.smithi179.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-16T15:49:45.596 INFO:teuthology.orchestra.run.smithi179.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-16T15:49:45.596 INFO:teuthology.orchestra.run.smithi179.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-04-16T15:49:45.596 INFO:teuthology.orchestra.run.smithi179.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-04-16T15:49:45.596 INFO:teuthology.orchestra.run.smithi179.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-16T15:49:45.596 INFO:teuthology.orchestra.run.smithi179.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-16T15:49:45.596 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-04-16T15:49:45.596 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-04-16T15:49:45.596 INFO:teuthology.orchestra.run.smithi179.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-04-16T15:49:45.596 INFO:teuthology.orchestra.run.smithi179.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-04-16T15:49:45.596 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-16T15:49:45.596 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-04-16T15:49:45.596 INFO:teuthology.orchestra.run.smithi179.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-16T15:49:45.597 INFO:teuthology.orchestra.run.smithi179.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-04-16T15:49:45.597 INFO:teuthology.orchestra.run.smithi179.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-04-16T15:49:45.597 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-16T15:49:45.597 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-04-16T15:49:45.597 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-04-16T15:49:45.597 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-04-16T15:49:45.597 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-16T15:49:45.597 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-04-16T15:49:45.597 INFO:teuthology.orchestra.run.smithi179.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-16T15:49:45.597 INFO:teuthology.orchestra.run.smithi179.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-16T15:49:45.597 INFO:teuthology.orchestra.run.smithi179.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-04-16T15:49:45.597 INFO:teuthology.orchestra.run.smithi179.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-16T15:49:45.597 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-16T15:49:45.597 INFO:teuthology.orchestra.run.smithi179.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-04-16T15:49:45.598 INFO:teuthology.orchestra.run.smithi179.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-16T15:49:45.598 INFO:teuthology.orchestra.run.smithi179.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-04-16T15:49:45.598 INFO:teuthology.orchestra.run.smithi179.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-16T15:49:45.598 INFO:teuthology.orchestra.run.smithi179.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-04-16T15:49:45.598 INFO:teuthology.orchestra.run.smithi179.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-04-16T15:49:45.598 INFO:teuthology.orchestra.run.smithi179.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-16T15:49:45.598 INFO:teuthology.orchestra.run.smithi179.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-16T15:49:45.598 INFO:teuthology.orchestra.run.smithi179.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-16T15:49:45.598 INFO:teuthology.orchestra.run.smithi179.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-16T15:49:45.598 INFO:teuthology.orchestra.run.smithi179.stdout: qatlib x86_64 24.02.0-1.el9 CentOS-AppStream 220 k 2024-04-16T15:49:45.598 INFO:teuthology.orchestra.run.smithi179.stdout: qatzip-libs x86_64 1.2.0-1.el9 CentOS-AppStream 46 k 2024-04-16T15:49:45.598 INFO:teuthology.orchestra.run.smithi179.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-16T15:49:45.598 INFO:teuthology.orchestra.run.smithi179.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-04-16T15:49:45.598 INFO:teuthology.orchestra.run.smithi179.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-16T15:49:45.599 INFO:teuthology.orchestra.run.smithi179.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-04-16T15:49:45.599 INFO:teuthology.orchestra.run.smithi179.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-04-16T15:49:45.599 INFO:teuthology.orchestra.run.smithi179.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-04-16T15:49:45.599 INFO:teuthology.orchestra.run.smithi179.stdout:Installing weak dependencies: 2024-04-16T15:49:45.599 INFO:teuthology.orchestra.run.smithi179.stdout: qatlib-service x86_64 24.02.0-1.el9 CentOS-AppStream 35 k 2024-04-16T15:49:45.599 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-16T15:49:45.599 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction Summary 2024-04-16T15:49:45.599 INFO:teuthology.orchestra.run.smithi179.stdout:============================================================================================ 2024-04-16T15:49:45.599 INFO:teuthology.orchestra.run.smithi179.stdout:Install 150 Packages 2024-04-16T15:49:45.599 INFO:teuthology.orchestra.run.smithi179.stdout:Upgrade 24 Packages 2024-04-16T15:49:45.599 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-16T15:49:45.600 INFO:teuthology.orchestra.run.smithi179.stdout:Total download size: 228 M 2024-04-16T15:49:45.600 INFO:teuthology.orchestra.run.smithi179.stdout:Downloading Packages: 2024-04-16T15:49:45.651 INFO:teuthology.orchestra.run.smithi132.stdout:(17/174): libradosstriper1-19.0.0-2868.gc3c87ed 2.4 MB/s | 500 kB 00:00 2024-04-16T15:49:46.958 INFO:teuthology.orchestra.run.smithi179.stdout:(1/174): ceph-19.0.0-2868.gc3c87ed0.el9.x86_64. 20 kB/s | 6.6 kB 00:00 2024-04-16T15:49:47.052 INFO:teuthology.orchestra.run.smithi132.stdout:(18/174): ceph-test-19.0.0-2868.gc3c87ed0.el9.x 18 MB/s | 49 MB 00:02 2024-04-16T15:49:47.158 INFO:teuthology.orchestra.run.smithi179.stdout:(2/174): ceph-fuse-19.0.0-2868.gc3c87ed0.el9.x8 4.4 MB/s | 890 kB 00:00 2024-04-16T15:49:47.168 INFO:teuthology.orchestra.run.smithi132.stdout:(19/174): ceph-radosgw-19.0.0-2868.gc3c87ed0.el 3.0 MB/s | 10 MB 00:03 2024-04-16T15:49:47.194 INFO:teuthology.orchestra.run.smithi132.stdout:(20/174): python3-ceph-argparse-19.0.0-2868.gc3 318 kB/s | 45 kB 00:00 2024-04-16T15:49:47.208 INFO:teuthology.orchestra.run.smithi179.stdout:(3/174): ceph-immutable-object-cache-19.0.0-286 2.8 MB/s | 145 kB 00:00 2024-04-16T15:49:47.269 INFO:teuthology.orchestra.run.smithi132.stdout:(21/174): librgw2-19.0.0-2868.gc3c87ed0.el9.x86 3.2 MB/s | 5.2 MB 00:01 2024-04-16T15:49:47.294 INFO:teuthology.orchestra.run.smithi132.stdout:(22/174): python3-ceph-common-19.0.0-2868.gc3c8 1.1 MB/s | 135 kB 00:00 2024-04-16T15:49:47.319 INFO:teuthology.orchestra.run.smithi132.stdout:(23/174): python3-cephfs-19.0.0-2868.gc3c87ed0. 1.3 MB/s | 161 kB 00:00 2024-04-16T15:49:47.367 INFO:teuthology.orchestra.run.smithi179.stdout:(4/174): ceph-mds-19.0.0-2868.gc3c87ed0.el9.x86 15 MB/s | 2.4 MB 00:00 2024-04-16T15:49:47.370 INFO:teuthology.orchestra.run.smithi132.stdout:(24/174): python3-rgw-19.0.0-2868.gc3c87ed0.el9 1.9 MB/s | 99 kB 00:00 2024-04-16T15:49:47.462 INFO:teuthology.orchestra.run.smithi132.stdout:(25/174): rbd-fuse-19.0.0-2868.gc3c87ed0.el9.x8 934 kB/s | 85 kB 00:00 2024-04-16T15:49:47.487 INFO:teuthology.orchestra.run.smithi132.stdout:(26/174): python3-rados-19.0.0-2868.gc3c87ed0.e 1.4 MB/s | 320 kB 00:00 2024-04-16T15:49:47.500 INFO:teuthology.orchestra.run.smithi179.stdout:(5/174): ceph-mgr-19.0.0-2868.gc3c87ed0.el9.x86 11 MB/s | 1.5 MB 00:00 2024-04-16T15:49:47.512 INFO:teuthology.orchestra.run.smithi132.stdout:(27/174): python3-rbd-19.0.0-2868.gc3c87ed0.el9 1.3 MB/s | 298 kB 00:00 2024-04-16T15:49:47.596 INFO:teuthology.orchestra.run.smithi132.stdout:(28/174): rbd-nbd-19.0.0-2868.gc3c87ed0.el9.x86 1.5 MB/s | 170 kB 00:00 2024-04-16T15:49:47.730 INFO:teuthology.orchestra.run.smithi132.stdout:(29/174): rbd-mirror-19.0.0-2868.gc3c87ed0.el9. 12 MB/s | 3.1 MB 00:00 2024-04-16T15:49:47.755 INFO:teuthology.orchestra.run.smithi132.stdout:(30/174): ceph-mgr-cephadm-19.0.0-2868.gc3c87ed 897 kB/s | 142 kB 00:00 2024-04-16T15:49:47.835 INFO:teuthology.orchestra.run.smithi179.stdout:(6/174): ceph-mon-19.0.0-2868.gc3c87ed0.el9.x86 14 MB/s | 4.7 MB 00:00 2024-04-16T15:49:47.905 INFO:teuthology.orchestra.run.smithi132.stdout:(31/174): ceph-grafana-dashboards-19.0.0-2868.g 87 kB/s | 34 kB 00:00 2024-04-16T15:49:48.189 INFO:teuthology.orchestra.run.smithi132.stdout:(32/174): ceph-mgr-dashboard-19.0.0-2868.gc3c87 7.7 MB/s | 3.5 MB 00:00 2024-04-16T15:49:48.264 INFO:teuthology.orchestra.run.smithi132.stdout:(33/174): ceph-mgr-rook-19.0.0-2868.gc3c87ed0.e 659 kB/s | 49 kB 00:00 2024-04-16T15:49:48.339 INFO:teuthology.orchestra.run.smithi132.stdout:(34/174): ceph-prometheus-alerts-19.0.0-2868.gc 220 kB/s | 16 kB 00:00 2024-04-16T15:49:48.364 INFO:teuthology.orchestra.run.smithi132.stdout:(35/174): ceph-mgr-modules-core-19.0.0-2868.gc3 542 kB/s | 249 kB 00:00 2024-04-16T15:49:48.423 INFO:teuthology.orchestra.run.smithi132.stdout:(36/174): ceph-volume-19.0.0-2868.gc3c87ed0.el9 3.1 MB/s | 264 kB 00:00 2024-04-16T15:49:48.490 INFO:teuthology.orchestra.run.smithi132.stdout:(37/174): cephfs-top-19.0.0-2868.gc3c87ed0.el9. 274 kB/s | 18 kB 00:00 2024-04-16T15:49:48.649 INFO:teuthology.orchestra.run.smithi132.stdout:(38/174): automake-1.16.2-8.el9.noarch.rpm 4.1 MB/s | 662 kB 00:00 2024-04-16T15:49:48.707 INFO:teuthology.orchestra.run.smithi132.stdout:(39/174): bison-3.7.4-5.el9.x86_64.rpm 15 MB/s | 920 kB 00:00 2024-04-16T15:49:48.741 INFO:teuthology.orchestra.run.smithi132.stdout:(40/174): boost-program-options-1.75.0-8.el9.x8 3.1 MB/s | 106 kB 00:00 2024-04-16T15:49:48.774 INFO:teuthology.orchestra.run.smithi132.stdout:(41/174): cephadm-19.0.0-2868.gc3c87ed0.el9.noa 1.8 MB/s | 762 kB 00:00 2024-04-16T15:49:48.800 INFO:teuthology.orchestra.run.smithi132.stdout:(42/174): flex-2.6.4-9.el9.x86_64.rpm 5.1 MB/s | 307 kB 00:00 2024-04-16T15:49:48.825 INFO:teuthology.orchestra.run.smithi132.stdout:(43/174): flexiblas-3.0.4-8.el9.x86_64.rpm 633 kB/s | 32 kB 00:00 2024-04-16T15:49:48.909 INFO:teuthology.orchestra.run.smithi132.stdout:(44/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 28 MB/s | 3.0 MB 00:00 2024-04-16T15:49:48.934 INFO:teuthology.orchestra.run.smithi132.stdout:(45/174): flexiblas-openblas-openmp-3.0.4-8.el9 160 kB/s | 17 kB 00:00 2024-04-16T15:49:48.951 INFO:teuthology.orchestra.run.smithi179.stdout:(7/174): ceph-osd-19.0.0-2868.gc3c87ed0.el9.x86 15 MB/s | 17 MB 00:01 2024-04-16T15:49:48.959 INFO:teuthology.orchestra.run.smithi132.stdout:(46/174): libaio-devel-0.3.111-13.el9.x86_64.rp 201 kB/s | 10 kB 00:00 2024-04-16T15:49:48.984 INFO:teuthology.orchestra.run.smithi132.stdout:(47/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 159 kB 00:00 2024-04-16T15:49:49.010 INFO:teuthology.orchestra.run.smithi132.stdout:(48/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 882 kB/s | 44 kB 00:00 2024-04-16T15:49:49.042 INFO:teuthology.orchestra.run.smithi132.stdout:(49/174): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2024-04-16T15:49:49.069 INFO:teuthology.orchestra.run.smithi132.stdout:(50/174): libtool-2.4.6-45.el9.x86_64.rpm 9.8 MB/s | 578 kB 00:00 2024-04-16T15:49:49.111 INFO:teuthology.orchestra.run.smithi132.stdout:(51/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 625 kB/s | 46 kB 00:00 2024-04-16T15:49:49.136 INFO:teuthology.orchestra.run.smithi132.stdout:(52/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.2 MB/s | 282 kB 00:00 2024-04-16T15:49:49.161 INFO:teuthology.orchestra.run.smithi132.stdout:(53/174): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2024-04-16T15:49:49.186 INFO:teuthology.orchestra.run.smithi132.stdout:(54/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.2 MB/s | 217 kB 00:00 2024-04-16T15:49:49.212 INFO:teuthology.orchestra.run.smithi132.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 686 kB/s | 34 kB 00:00 2024-04-16T15:49:49.312 INFO:teuthology.orchestra.run.smithi132.stdout:(56/174): ceph-mgr-diskprediction-local-19.0.0- 4.8 MB/s | 7.4 MB 00:01 2024-04-16T15:49:49.379 INFO:teuthology.orchestra.run.smithi132.stdout:(57/174): openblas-openmp-0.3.21-2.el9.x86_64.r 25 MB/s | 4.7 MB 00:00 2024-04-16T15:49:49.421 INFO:teuthology.orchestra.run.smithi132.stdout:(58/174): postgresql-13.14-1.el9.x86_64.rpm 7.4 MB/s | 1.5 MB 00:00 2024-04-16T15:49:49.446 INFO:teuthology.orchestra.run.smithi132.stdout:(59/174): postgresql-contrib-13.14-1.el9.x86_64 6.1 MB/s | 817 kB 00:00 2024-04-16T15:49:49.471 INFO:teuthology.orchestra.run.smithi132.stdout:(60/174): postgresql-private-libs-13.14-1.el9.x 1.4 MB/s | 132 kB 00:00 2024-04-16T15:49:49.547 INFO:teuthology.orchestra.run.smithi132.stdout:(61/174): protobuf-3.14.0-13.el9.x86_64.rpm 10 MB/s | 1.0 MB 00:00 2024-04-16T15:49:49.672 INFO:teuthology.orchestra.run.smithi132.stdout:(62/174): postgresql-server-13.14-1.el9.x86_64. 25 MB/s | 5.7 MB 00:00 2024-04-16T15:49:49.697 INFO:teuthology.orchestra.run.smithi132.stdout:(63/174): python3-attrs-20.3.0-7.el9.noarch.rpm 344 kB/s | 78 kB 00:00 2024-04-16T15:49:49.789 INFO:teuthology.orchestra.run.smithi132.stdout:(64/174): python3-babel-2.9.1-2.el9.noarch.rpm 24 MB/s | 5.8 MB 00:00 2024-04-16T15:49:49.801 INFO:teuthology.orchestra.run.smithi179.stdout:(8/174): ceph-radosgw-19.0.0-2868.gc3c87ed0.el9 12 MB/s | 10 MB 00:00 2024-04-16T15:49:49.814 INFO:teuthology.orchestra.run.smithi132.stdout:(65/174): python3-jsonpatch-1.21-16.el9.noarch. 175 kB/s | 24 kB 00:00 2024-04-16T15:49:49.843 INFO:teuthology.orchestra.run.smithi132.stdout:(66/174): python3-jsonpointer-2.0-4.el9.noarch. 129 kB/s | 18 kB 00:00 2024-04-16T15:49:49.843 INFO:teuthology.orchestra.run.smithi179.stdout:(9/174): ceph-selinux-19.0.0-2868.gc3c87ed0.el9 609 kB/s | 25 kB 00:00 2024-04-16T15:49:49.864 INFO:teuthology.orchestra.run.smithi132.stdout:(67/174): python3-mako-1.1.4-6.el9.noarch.rpm 2.8 MB/s | 144 kB 00:00 2024-04-16T15:49:49.890 INFO:teuthology.orchestra.run.smithi132.stdout:(68/174): python3-markupsafe-1.1.1-12.el9.x86_6 420 kB/s | 32 kB 00:00 2024-04-16T15:49:50.007 INFO:teuthology.orchestra.run.smithi132.stdout:(69/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 29 MB/s | 4.8 MB 00:00 2024-04-16T15:49:50.032 INFO:teuthology.orchestra.run.smithi132.stdout:(70/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.5 MB/s | 217 kB 00:00 2024-04-16T15:49:50.057 INFO:teuthology.orchestra.run.smithi132.stdout:(71/174): python3-oauthlib-3.1.1-5.el9.noarch.r 1.0 MB/s | 174 kB 00:00 2024-04-16T15:49:50.082 INFO:teuthology.orchestra.run.smithi132.stdout:(72/174): python3-packaging-20.9-5.el9.noarch.r 913 kB/s | 69 kB 00:00 2024-04-16T15:49:50.108 INFO:teuthology.orchestra.run.smithi132.stdout:(73/174): python3-prettytable-0.7.2-27.el9.noar 819 kB/s | 41 kB 00:00 2024-04-16T15:49:50.133 INFO:teuthology.orchestra.run.smithi132.stdout:(74/174): python3-protobuf-3.14.0-13.el9.noarch 3.1 MB/s | 238 kB 00:00 2024-04-16T15:49:50.158 INFO:teuthology.orchestra.run.smithi132.stdout:(75/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 132 kB 00:00 2024-04-16T15:49:50.175 INFO:teuthology.orchestra.run.smithi132.stdout:(76/174): python3-pytz-2021.1-5.el9.noarch.rpm 1.1 MB/s | 47 kB 00:00 2024-04-16T15:49:50.201 INFO:teuthology.orchestra.run.smithi132.stdout:(77/174): python3-pyasn1-modules-0.4.8-6.el9.no 3.1 MB/s | 211 kB 00:00 2024-04-16T15:49:50.217 INFO:teuthology.orchestra.run.smithi132.stdout:(78/174): python3-requests-oauthlib-1.3.0-12.el 732 kB/s | 43 kB 00:00 2024-04-16T15:49:50.476 INFO:teuthology.orchestra.run.smithi132.stdout:(79/174): python3-toml-0.10.2-6.el9.noarch.rpm 151 kB/s | 39 kB 00:00 2024-04-16T15:49:50.493 INFO:teuthology.orchestra.run.smithi132.stdout:(80/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 150 kB/s | 41 kB 00:00 2024-04-16T15:49:50.643 INFO:teuthology.orchestra.run.smithi132.stdout:(81/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 34 MB/s | 16 MB 00:00 2024-04-16T15:49:50.670 INFO:teuthology.orchestra.run.smithi132.stdout:(82/174): qatlib-24.02.0-1.el9.x86_64.rpm 1.1 MB/s | 220 kB 00:00 2024-04-16T15:49:50.685 INFO:teuthology.orchestra.run.smithi132.stdout:(83/174): qatlib-service-24.02.0-1.el9.x86_64.r 182 kB/s | 35 kB 00:00 2024-04-16T15:49:50.719 INFO:teuthology.orchestra.run.smithi132.stdout:(84/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 925 kB/s | 46 kB 00:00 2024-04-16T15:49:50.744 INFO:teuthology.orchestra.run.smithi132.stdout:(85/174): socat-1.7.4.1-5.el9.x86_64.rpm 3.9 MB/s | 300 kB 00:00 2024-04-16T15:49:50.769 INFO:teuthology.orchestra.run.smithi132.stdout:(86/174): uuid-1.6.2-55.el9.x86_64.rpm 671 kB/s | 56 kB 00:00 2024-04-16T15:49:50.803 INFO:teuthology.orchestra.run.smithi132.stdout:(87/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 749 kB/s | 63 kB 00:00 2024-04-16T15:49:50.828 INFO:teuthology.orchestra.run.smithi132.stdout:(88/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 525 kB/s | 44 kB 00:00 2024-04-16T15:49:50.879 INFO:teuthology.orchestra.run.smithi132.stdout:(89/174): fuse-2.9.9-15.el9.x86_64.rpm 725 kB/s | 79 kB 00:00 2024-04-16T15:49:50.904 INFO:teuthology.orchestra.run.smithi132.stdout:(90/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.1 MB/s | 241 kB 00:00 2024-04-16T15:49:50.938 INFO:teuthology.orchestra.run.smithi132.stdout:(91/174): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.1 MB 00:00 2024-04-16T15:49:50.963 INFO:teuthology.orchestra.run.smithi132.stdout:(92/174): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 103 kB 00:00 2024-04-16T15:49:50.988 INFO:teuthology.orchestra.run.smithi132.stdout:(93/174): python3-pycparser-2.20-6.el9.noarch.r 1.5 MB/s | 124 kB 00:00 2024-04-16T15:49:51.013 INFO:teuthology.orchestra.run.smithi132.stdout:(94/174): python3-urllib3-1.26.5-5.el9.noarch.r 2.4 MB/s | 187 kB 00:00 2024-04-16T15:49:51.122 INFO:teuthology.orchestra.run.smithi132.stdout:(95/174): jq-1.6-16.el9.x86_64.rpm 1.2 MB/s | 187 kB 00:00 2024-04-16T15:49:51.147 INFO:teuthology.orchestra.run.smithi132.stdout:(96/174): libquadmath-11.4.1-3.el9.x86_64.rpm 1.4 MB/s | 195 kB 00:00 2024-04-16T15:49:51.239 INFO:teuthology.orchestra.run.smithi132.stdout:(97/174): python3-requests-2.25.1-8.el9.noarch. 1.0 MB/s | 125 kB 00:00 2024-04-16T15:49:51.264 INFO:teuthology.orchestra.run.smithi132.stdout:(98/174): elfutils-libelf-devel-0.190-2.el9.x86 184 kB/s | 21 kB 00:00 2024-04-16T15:49:51.289 INFO:teuthology.orchestra.run.smithi132.stdout:(99/174): libgfortran-11.4.1-3.el9.x86_64.rpm 2.6 MB/s | 803 kB 00:00 2024-04-16T15:49:51.356 INFO:teuthology.orchestra.run.smithi132.stdout:(100/174): libuuid-devel-2.37.4-18.el9.x86_64.r 217 kB/s | 25 kB 00:00 2024-04-16T15:49:51.590 INFO:teuthology.orchestra.run.smithi132.stdout:(101/174): python3-jinja2-2.11.3-5.el9.noarch.r 1.0 MB/s | 248 kB 00:00 2024-04-16T15:49:51.624 INFO:teuthology.orchestra.run.smithi132.stdout:(102/174): python3-devel-3.9.17-2.el9.x86_64.rp 735 kB/s | 245 kB 00:00 2024-04-16T15:49:51.658 INFO:teuthology.orchestra.run.smithi132.stdout:(103/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.4 MB/s | 94 kB 00:00 2024-04-16T15:49:51.683 INFO:teuthology.orchestra.run.smithi132.stdout:(104/174): lua-devel-5.4.4-4.el9.x86_64.rpm 380 kB/s | 22 kB 00:00 2024-04-16T15:49:51.816 INFO:teuthology.orchestra.run.smithi132.stdout:(105/174): protobuf-compiler-3.14.0-13.el9.x86_ 5.3 MB/s | 863 kB 00:00 2024-04-16T15:49:51.942 INFO:teuthology.orchestra.run.smithi132.stdout:(106/174): abseil-cpp-20211102.0-3.el9.x86_64.r 2.1 MB/s | 548 kB 00:00 2024-04-16T15:49:51.992 INFO:teuthology.orchestra.run.smithi132.stdout:(107/174): gperftools-libs-2.9.1-2.el9.x86_64.r 1.7 MB/s | 309 kB 00:00 2024-04-16T15:49:52.017 INFO:teuthology.orchestra.run.smithi132.stdout:(108/174): grpc-data-1.46.7-10.el9.noarch.rpm 258 kB/s | 19 kB 00:00 2024-04-16T15:49:52.059 INFO:teuthology.orchestra.run.smithi132.stdout:(109/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 625 kB/s | 26 kB 00:00 2024-04-16T15:49:52.109 INFO:teuthology.orchestra.run.smithi132.stdout:(110/174): liboath-2.6.7-2.el9.x86_64.rpm 974 kB/s | 49 kB 00:00 2024-04-16T15:49:52.160 INFO:teuthology.orchestra.run.smithi132.stdout:(111/174): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-04-16T15:49:52.210 INFO:teuthology.orchestra.run.smithi132.stdout:(112/174): luarocks-3.9.2-1.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-04-16T15:49:52.302 INFO:teuthology.orchestra.run.smithi132.stdout:(113/174): libarrow-9.0.0-10.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-04-16T15:49:52.369 INFO:teuthology.orchestra.run.smithi132.stdout:(114/174): python3-asyncssh-2.13.2-5.el9.noarch 8.1 MB/s | 548 kB 00:00 2024-04-16T15:49:52.394 INFO:teuthology.orchestra.run.smithi132.stdout:(115/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 4.5 MB/s | 838 kB 00:00 2024-04-16T15:49:52.419 INFO:teuthology.orchestra.run.smithi132.stdout:(116/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 865 kB/s | 43 kB 00:00 2024-04-16T15:49:52.426 INFO:teuthology.orchestra.run.smithi179.stdout:(10/174): ceph-base-19.0.0-2868.gc3c87ed0.el9.x 947 kB/s | 5.4 MB 00:05 2024-04-16T15:49:52.445 INFO:teuthology.orchestra.run.smithi132.stdout:(117/174): python3-cachetools-4.2.4-1.el9.noarc 643 kB/s | 32 kB 00:00 2024-04-16T15:49:52.470 INFO:teuthology.orchestra.run.smithi132.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 298 kB/s | 15 kB 00:00 2024-04-16T15:49:52.495 INFO:teuthology.orchestra.run.smithi132.stdout:(119/174): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-04-16T15:49:52.521 INFO:teuthology.orchestra.run.smithi132.stdout:(120/174): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-04-16T15:49:52.563 INFO:teuthology.orchestra.run.smithi132.stdout:(121/174): python3-colorama-0.4.4-12.el9.noarch 845 kB/s | 35 kB 00:00 2024-04-16T15:49:52.588 INFO:teuthology.orchestra.run.smithi132.stdout:(122/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.2 MB/s | 303 kB 00:00 2024-04-16T15:49:52.613 INFO:teuthology.orchestra.run.smithi132.stdout:(123/174): python3-google-auth-2.28.2-1.el9.noa 3.9 MB/s | 203 kB 00:00 2024-04-16T15:49:52.655 INFO:teuthology.orchestra.run.smithi132.stdout:(124/174): python3-grpcio-tools-1.46.7-10.el9.x 3.4 MB/s | 144 kB 00:00 2024-04-16T15:49:52.668 INFO:teuthology.orchestra.run.smithi179.stdout:(11/174): cephfs-mirror-19.0.0-2868.gc3c87ed0.e 931 kB/s | 225 kB 00:00 2024-04-16T15:49:52.697 INFO:teuthology.orchestra.run.smithi132.stdout:(125/174): python3-jaraco-8.2.1-3.el9.noarch.rp 258 kB/s | 11 kB 00:00 2024-04-16T15:49:52.739 INFO:teuthology.orchestra.run.smithi132.stdout:(126/174): python3-jaraco-classes-3.2.1-5.el9.n 424 kB/s | 18 kB 00:00 2024-04-16T15:49:52.760 INFO:teuthology.orchestra.run.smithi179.stdout:(12/174): cephfs-shell-19.0.0-2868.gc3c87ed0.el 295 kB/s | 27 kB 00:00 2024-04-16T15:49:52.798 INFO:teuthology.orchestra.run.smithi132.stdout:(127/174): openssl-devel-3.0.7-27.el9.x86_64.rp 2.7 MB/s | 4.1 MB 00:01 2024-04-16T15:49:52.823 INFO:teuthology.orchestra.run.smithi132.stdout:(128/174): python3-jaraco-collections-3.0.0-8.e 277 kB/s | 23 kB 00:00 2024-04-16T15:49:52.865 INFO:teuthology.orchestra.run.smithi132.stdout:(129/174): python3-jaraco-text-3.2.0-6.el9.noar 475 kB/s | 20 kB 00:00 2024-04-16T15:49:52.877 INFO:teuthology.orchestra.run.smithi179.stdout:(13/174): libcephfs-devel-19.0.0-2868.gc3c87ed0 272 kB/s | 32 kB 00:00 2024-04-16T15:49:52.898 INFO:teuthology.orchestra.run.smithi132.stdout:(130/174): python3-jaraco-functools-3.5.0-2.el9 193 kB/s | 19 kB 00:00 2024-04-16T15:49:52.957 INFO:teuthology.orchestra.run.smithi132.stdout:(131/174): python3-kubernetes-26.1.0-2.el9.noar 11 MB/s | 1.0 MB 00:00 2024-04-16T15:49:52.982 INFO:teuthology.orchestra.run.smithi132.stdout:(132/174): python3-logutils-0.3.5-21.el9.noarch 555 kB/s | 46 kB 00:00 2024-04-16T15:49:53.008 INFO:teuthology.orchestra.run.smithi132.stdout:(133/174): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-04-16T15:49:53.049 INFO:teuthology.orchestra.run.smithi132.stdout:(134/174): python3-grpcio-1.46.7-10.el9.x86_64. 4.4 MB/s | 2.0 MB 00:00 2024-04-16T15:49:53.075 INFO:teuthology.orchestra.run.smithi132.stdout:(135/174): python3-natsort-7.1.1-5.el9.noarch.r 625 kB/s | 58 kB 00:00 2024-04-16T15:49:53.100 INFO:teuthology.orchestra.run.smithi132.stdout:(136/174): python3-portend-3.1.0-2.el9.noarch.r 326 kB/s | 16 kB 00:00 2024-04-16T15:49:53.117 INFO:teuthology.orchestra.run.smithi132.stdout:(137/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.1 MB/s | 90 kB 00:00 2024-04-16T15:49:53.142 INFO:teuthology.orchestra.run.smithi132.stdout:(138/174): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2024-04-16T15:49:53.168 INFO:teuthology.orchestra.run.smithi132.stdout:(139/174): python3-pyperclip-1.8.2-2.el9.noarch 421 kB/s | 28 kB 00:00 2024-04-16T15:49:53.193 INFO:teuthology.orchestra.run.smithi132.stdout:(140/174): python3-repoze-lru-0.7-16.el9.noarch 409 kB/s | 31 kB 00:00 2024-04-16T15:49:53.218 INFO:teuthology.orchestra.run.smithi132.stdout:(141/174): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-04-16T15:49:53.243 INFO:teuthology.orchestra.run.smithi132.stdout:(142/174): python3-tempora-5.0.0-2.el9.noarch.r 715 kB/s | 36 kB 00:00 2024-04-16T15:49:53.269 INFO:teuthology.orchestra.run.smithi132.stdout:(143/174): python3-rsa-4.9-2.el9.noarch.rpm 784 kB/s | 59 kB 00:00 2024-04-16T15:49:53.294 INFO:teuthology.orchestra.run.smithi132.stdout:(144/174): python3-typing-extensions-4.4.0-2.el 676 kB/s | 51 kB 00:00 2024-04-16T15:49:53.319 INFO:teuthology.orchestra.run.smithi132.stdout:(145/174): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-04-16T15:49:53.345 INFO:teuthology.orchestra.run.smithi132.stdout:(146/174): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-04-16T15:49:53.370 INFO:teuthology.orchestra.run.smithi132.stdout:(147/174): python3-zc-lockfile-2.0-10.el9.noarc 397 kB/s | 20 kB 00:00 2024-04-16T15:49:53.395 INFO:teuthology.orchestra.run.smithi132.stdout:(148/174): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2024-04-16T15:49:53.420 INFO:teuthology.orchestra.run.smithi132.stdout:(149/174): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-04-16T15:49:53.537 INFO:teuthology.orchestra.run.smithi132.stdout:(150/174): thrift-0.15.0-2.el9.x86_64.rpm 9.5 MB/s | 1.6 MB 00:00 2024-04-16T15:49:53.577 INFO:teuthology.orchestra.run.smithi179.stdout:(14/174): libcephfs2-19.0.0-2868.gc3c87ed0.el9. 1.0 MB/s | 746 kB 00:00 2024-04-16T15:49:53.637 INFO:teuthology.orchestra.run.smithi132.stdout:(151/174): NetworkManager-1.47.4-1.el9.x86_64.r 23 MB/s | 2.3 MB 00:00 2024-04-16T15:49:53.729 INFO:teuthology.orchestra.run.smithi132.stdout:(152/174): NetworkManager-libnm-1.47.4-1.el9.x8 20 MB/s | 1.8 MB 00:00 2024-04-16T15:49:53.763 INFO:teuthology.orchestra.run.smithi132.stdout:(153/174): NetworkManager-team-1.47.4-1.el9.x86 1.2 MB/s | 41 kB 00:00 2024-04-16T15:49:53.803 INFO:teuthology.orchestra.run.smithi179.stdout:(15/174): libcephsqlite-19.0.0-2868.gc3c87ed0.e 727 kB/s | 163 kB 00:00 2024-04-16T15:49:53.805 INFO:teuthology.orchestra.run.smithi132.stdout:(154/174): NetworkManager-tui-1.47.4-1.el9.x86_ 5.8 MB/s | 248 kB 00:00 2024-04-16T15:49:53.847 INFO:teuthology.orchestra.run.smithi132.stdout:(155/174): xfsdump-3.1.12-4.el9.x86_64.rpm 7.5 MB/s | 321 kB 00:00 2024-04-16T15:49:53.947 INFO:teuthology.orchestra.run.smithi132.stdout:(156/174): acl-2.3.1-4.el9.x86_64.rpm 714 kB/s | 71 kB 00:00 2024-04-16T15:49:53.981 INFO:teuthology.orchestra.run.smithi132.stdout:(157/174): elfutils-debuginfod-client-0.190-2.e 1.1 MB/s | 36 kB 00:00 2024-04-16T15:49:54.073 INFO:teuthology.orchestra.run.smithi132.stdout:(158/174): elfutils-libelf-0.190-2.el9.x86_64.r 2.0 MB/s | 192 kB 00:00 2024-04-16T15:49:54.094 INFO:teuthology.orchestra.run.smithi179.stdout:(16/174): librados-devel-19.0.0-2868.gc3c87ed0. 435 kB/s | 127 kB 00:00 2024-04-16T15:49:54.123 INFO:teuthology.orchestra.run.smithi132.stdout:(159/174): elfutils-libs-0.190-2.el9.x86_64.rpm 5.0 MB/s | 256 kB 00:00 2024-04-16T15:49:54.165 INFO:teuthology.orchestra.run.smithi132.stdout:(160/174): libacl-2.3.1-4.el9.x86_64.rpm 550 kB/s | 23 kB 00:00 2024-04-16T15:49:54.495 INFO:teuthology.orchestra.run.smithi179.stdout:(17/174): libradosstriper1-19.0.0-2868.gc3c87ed 1.2 MB/s | 500 kB 00:00 2024-04-16T15:49:54.540 INFO:teuthology.orchestra.run.smithi132.stdout:(161/174): libblkid-2.37.4-18.el9.x86_64.rpm 289 kB/s | 108 kB 00:00 2024-04-16T15:49:54.865 INFO:teuthology.orchestra.run.smithi132.stdout:(162/174): libfdisk-2.37.4-18.el9.x86_64.rpm 477 kB/s | 155 kB 00:00 2024-04-16T15:49:54.916 INFO:teuthology.orchestra.run.smithi132.stdout:(163/174): libmount-2.37.4-18.el9.x86_64.rpm 2.7 MB/s | 136 kB 00:00 2024-04-16T15:49:54.966 INFO:teuthology.orchestra.run.smithi132.stdout:(164/174): libsmartcols-2.37.4-18.el9.x86_64.rp 1.3 MB/s | 64 kB 00:00 2024-04-16T15:49:55.016 INFO:teuthology.orchestra.run.smithi132.stdout:(165/174): libuuid-2.37.4-18.el9.x86_64.rpm 571 kB/s | 29 kB 00:00 2024-04-16T15:49:55.096 INFO:teuthology.orchestra.run.smithi179.stdout:(18/174): ceph-test-19.0.0-2868.gc3c87ed0.el9.x 9.2 MB/s | 49 MB 00:05 2024-04-16T15:49:55.100 INFO:teuthology.orchestra.run.smithi132.stdout:(166/174): librados2-19.0.0-2868.gc3c87ed0.el9. 2.0 MB/s | 3.4 MB 00:01 2024-04-16T15:49:55.159 INFO:teuthology.orchestra.run.smithi132.stdout:(167/174): openssl-3.0.7-27.el9.x86_64.rpm 8.5 MB/s | 1.2 MB 00:00 2024-04-16T15:49:55.171 INFO:teuthology.orchestra.run.smithi179.stdout:(19/174): python3-ceph-argparse-19.0.0-2868.gc3 606 kB/s | 45 kB 00:00 2024-04-16T15:49:55.246 INFO:teuthology.orchestra.run.smithi179.stdout:(20/174): python3-ceph-common-19.0.0-2868.gc3c8 1.8 MB/s | 135 kB 00:00 2024-04-16T15:49:55.259 INFO:teuthology.orchestra.run.smithi132.stdout:(168/174): util-linux-2.37.4-18.el9.x86_64.rpm 23 MB/s | 2.3 MB 00:00 2024-04-16T15:49:55.318 INFO:teuthology.orchestra.run.smithi132.stdout:(169/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 9.9 MB/s | 2.2 MB 00:00 2024-04-16T15:49:55.321 INFO:teuthology.orchestra.run.smithi179.stdout:(21/174): python3-cephfs-19.0.0-2868.gc3c87ed0. 2.1 MB/s | 161 kB 00:00 2024-04-16T15:49:55.343 INFO:teuthology.orchestra.run.smithi132.stdout:(170/174): util-linux-core-2.37.4-18.el9.x86_64 5.4 MB/s | 465 kB 00:00 2024-04-16T15:49:55.368 INFO:teuthology.orchestra.run.smithi132.stdout:(171/174): util-linux-user-2.37.4-18.el9.x86_64 621 kB/s | 31 kB 00:00 2024-04-16T15:49:55.405 INFO:teuthology.orchestra.run.smithi179.stdout:(22/174): python3-rados-19.0.0-2868.gc3c87ed0.e 3.8 MB/s | 320 kB 00:00 2024-04-16T15:49:55.460 INFO:teuthology.orchestra.run.smithi132.stdout:(172/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 9.2 MB/s | 1.1 MB 00:00 2024-04-16T15:49:55.463 INFO:teuthology.orchestra.run.smithi179.stdout:(23/174): python3-rbd-19.0.0-2868.gc3c87ed0.el9 5.0 MB/s | 298 kB 00:00 2024-04-16T15:49:55.485 INFO:teuthology.orchestra.run.smithi132.stdout:(173/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 636 kB/s | 74 kB 00:00 2024-04-16T15:49:55.522 INFO:teuthology.orchestra.run.smithi179.stdout:(24/174): python3-rgw-19.0.0-2868.gc3c87ed0.el9 1.7 MB/s | 99 kB 00:00 2024-04-16T15:49:55.606 INFO:teuthology.orchestra.run.smithi179.stdout:(25/174): rbd-fuse-19.0.0-2868.gc3c87ed0.el9.x8 1.0 MB/s | 85 kB 00:00 2024-04-16T15:49:56.114 INFO:teuthology.orchestra.run.smithi179.stdout:(26/174): rbd-mirror-19.0.0-2868.gc3c87ed0.el9. 6.1 MB/s | 3.1 MB 00:00 2024-04-16T15:49:56.215 INFO:teuthology.orchestra.run.smithi179.stdout:(27/174): rbd-nbd-19.0.0-2868.gc3c87ed0.el9.x86 1.7 MB/s | 170 kB 00:00 2024-04-16T15:49:56.298 INFO:teuthology.orchestra.run.smithi179.stdout:(28/174): ceph-grafana-dashboards-19.0.0-2868.g 411 kB/s | 34 kB 00:00 2024-04-16T15:49:56.382 INFO:teuthology.orchestra.run.smithi179.stdout:(29/174): ceph-mgr-cephadm-19.0.0-2868.gc3c87ed 1.7 MB/s | 142 kB 00:00 2024-04-16T15:49:56.890 INFO:teuthology.orchestra.run.smithi179.stdout:(30/174): ceph-mgr-dashboard-19.0.0-2868.gc3c87 7.0 MB/s | 3.5 MB 00:00 2024-04-16T15:49:57.616 INFO:teuthology.orchestra.run.smithi179.stdout:(31/174): ceph-mgr-diskprediction-local-19.0.0- 10 MB/s | 7.4 MB 00:00 2024-04-16T15:49:57.683 INFO:teuthology.orchestra.run.smithi179.stdout:(32/174): ceph-mgr-modules-core-19.0.0-2868.gc3 3.7 MB/s | 249 kB 00:00 2024-04-16T15:49:57.725 INFO:teuthology.orchestra.run.smithi179.stdout:(33/174): ceph-mgr-rook-19.0.0-2868.gc3c87ed0.e 1.2 MB/s | 49 kB 00:00 2024-04-16T15:49:57.767 INFO:teuthology.orchestra.run.smithi179.stdout:(34/174): ceph-prometheus-alerts-19.0.0-2868.gc 397 kB/s | 16 kB 00:00 2024-04-16T15:49:57.842 INFO:teuthology.orchestra.run.smithi179.stdout:(35/174): ceph-volume-19.0.0-2868.gc3c87ed0.el9 3.4 MB/s | 264 kB 00:00 2024-04-16T15:49:57.944 INFO:teuthology.orchestra.run.smithi132.stdout:(174/174): librbd1-19.0.0-2868.gc3c87ed0.el9.x8 711 kB/s | 3.1 MB 00:04 2024-04-16T15:49:57.948 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2024-04-16T15:49:57.948 INFO:teuthology.orchestra.run.smithi132.stdout:Total 13 MB/s | 228 MB 00:17 2024-04-16T15:49:57.959 INFO:teuthology.orchestra.run.smithi179.stdout:(36/174): cephadm-19.0.0-2868.gc3c87ed0.el9.noa 6.4 MB/s | 762 kB 00:00 2024-04-16T15:49:58.026 INFO:teuthology.orchestra.run.smithi179.stdout:(37/174): cephfs-top-19.0.0-2868.gc3c87ed0.el9. 274 kB/s | 18 kB 00:00 2024-04-16T15:49:58.276 INFO:teuthology.orchestra.run.smithi179.stdout:(38/174): automake-1.16.2-8.el9.noarch.rpm 2.6 MB/s | 662 kB 00:00 2024-04-16T15:49:58.328 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2024-04-16T15:49:58.452 INFO:teuthology.orchestra.run.smithi179.stdout:(39/174): bison-3.7.4-5.el9.x86_64.rpm 5.1 MB/s | 920 kB 00:00 2024-04-16T15:49:58.494 INFO:teuthology.orchestra.run.smithi179.stdout:(40/174): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 106 kB 00:00 2024-04-16T15:49:58.544 INFO:teuthology.orchestra.run.smithi179.stdout:(41/174): flex-2.6.4-9.el9.x86_64.rpm 6.0 MB/s | 307 kB 00:00 2024-04-16T15:49:58.586 INFO:teuthology.orchestra.run.smithi179.stdout:(42/174): flexiblas-3.0.4-8.el9.x86_64.rpm 755 kB/s | 32 kB 00:00 2024-04-16T15:49:58.603 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2024-04-16T15:49:58.603 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2024-04-16T15:49:58.703 INFO:teuthology.orchestra.run.smithi179.stdout:(43/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 26 MB/s | 3.0 MB 00:00 2024-04-16T15:49:58.737 INFO:teuthology.orchestra.run.smithi179.stdout:(44/174): flexiblas-openblas-openmp-3.0.4-8.el9 515 kB/s | 17 kB 00:00 2024-04-16T15:49:58.770 INFO:teuthology.orchestra.run.smithi179.stdout:(45/174): libaio-devel-0.3.111-13.el9.x86_64.rp 301 kB/s | 10 kB 00:00 2024-04-16T15:49:58.804 INFO:teuthology.orchestra.run.smithi179.stdout:(46/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 4.7 MB/s | 159 kB 00:00 2024-04-16T15:49:58.837 INFO:teuthology.orchestra.run.smithi179.stdout:(47/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2024-04-16T15:49:58.879 INFO:teuthology.orchestra.run.smithi179.stdout:(48/174): librdkafka-1.6.1-102.el9.x86_64.rpm 16 MB/s | 661 kB 00:00 2024-04-16T15:49:58.921 INFO:teuthology.orchestra.run.smithi179.stdout:(49/174): libtool-2.4.6-45.el9.x86_64.rpm 14 MB/s | 578 kB 00:00 2024-04-16T15:49:58.955 INFO:teuthology.orchestra.run.smithi179.stdout:(50/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 46 kB 00:00 2024-04-16T15:49:58.997 INFO:teuthology.orchestra.run.smithi179.stdout:(51/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.6 MB/s | 282 kB 00:00 2024-04-16T15:49:59.039 INFO:teuthology.orchestra.run.smithi179.stdout:(52/174): lua-5.4.4-4.el9.x86_64.rpm 4.4 MB/s | 187 kB 00:00 2024-04-16T15:49:59.150 INFO:teuthology.orchestra.run.smithi179.stdout:(53/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.9 MB/s | 217 kB 00:00 2024-04-16T15:49:59.215 INFO:teuthology.orchestra.run.smithi179.stdout:(54/174): librgw2-19.0.0-2868.gc3c87ed0.el9.x86 1.1 MB/s | 5.2 MB 00:04 2024-04-16T15:49:59.240 INFO:teuthology.orchestra.run.smithi179.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 379 kB/s | 34 kB 00:00 2024-04-16T15:49:59.374 INFO:teuthology.orchestra.run.smithi179.stdout:(56/174): openblas-openmp-0.3.21-2.el9.x86_64.r 30 MB/s | 4.7 MB 00:00 2024-04-16T15:49:59.407 INFO:teuthology.orchestra.run.smithi179.stdout:(57/174): postgresql-13.14-1.el9.x86_64.rpm 9.2 MB/s | 1.5 MB 00:00 2024-04-16T15:49:59.441 INFO:teuthology.orchestra.run.smithi179.stdout:(58/174): postgresql-contrib-13.14-1.el9.x86_64 12 MB/s | 817 kB 00:00 2024-04-16T15:49:59.466 INFO:teuthology.orchestra.run.smithi179.stdout:(59/174): postgresql-private-libs-13.14-1.el9.x 2.3 MB/s | 132 kB 00:00 2024-04-16T15:49:59.600 INFO:teuthology.orchestra.run.smithi179.stdout:(60/174): postgresql-server-13.14-1.el9.x86_64. 36 MB/s | 5.7 MB 00:00 2024-04-16T15:49:59.634 INFO:teuthology.orchestra.run.smithi179.stdout:(61/174): protobuf-3.14.0-13.el9.x86_64.rpm 6.1 MB/s | 1.0 MB 00:00 2024-04-16T15:49:59.659 INFO:teuthology.orchestra.run.smithi179.stdout:(62/174): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 78 kB 00:00 2024-04-16T15:49:59.801 INFO:teuthology.orchestra.run.smithi179.stdout:(63/174): python3-babel-2.9.1-2.el9.noarch.rpm 35 MB/s | 5.8 MB 00:00 2024-04-16T15:49:59.826 INFO:teuthology.orchestra.run.smithi179.stdout:(64/174): python3-jsonpatch-1.21-16.el9.noarch. 147 kB/s | 24 kB 00:00 2024-04-16T15:49:59.868 INFO:teuthology.orchestra.run.smithi179.stdout:(65/174): python3-jsonpointer-2.0-4.el9.noarch. 436 kB/s | 18 kB 00:00 2024-04-16T15:49:59.893 INFO:teuthology.orchestra.run.smithi179.stdout:(66/174): python3-mako-1.1.4-6.el9.noarch.rpm 2.1 MB/s | 144 kB 00:00 2024-04-16T15:49:59.935 INFO:teuthology.orchestra.run.smithi179.stdout:(67/174): python3-markupsafe-1.1.1-12.el9.x86_6 473 kB/s | 32 kB 00:00 2024-04-16T15:50:00.027 INFO:teuthology.orchestra.run.smithi179.stdout:(68/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 36 MB/s | 4.8 MB 00:00 2024-04-16T15:50:00.061 INFO:teuthology.orchestra.run.smithi179.stdout:(69/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.7 MB/s | 217 kB 00:00 2024-04-16T15:50:00.086 INFO:teuthology.orchestra.run.smithi179.stdout:(70/174): python3-oauthlib-3.1.1-5.el9.noarch.r 2.9 MB/s | 174 kB 00:00 2024-04-16T15:50:00.112 INFO:teuthology.orchestra.run.smithi179.stdout:(71/174): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 69 kB 00:00 2024-04-16T15:50:00.137 INFO:teuthology.orchestra.run.smithi179.stdout:(72/174): python3-prettytable-0.7.2-27.el9.noar 824 kB/s | 41 kB 00:00 2024-04-16T15:50:00.162 INFO:teuthology.orchestra.run.smithi179.stdout:(73/174): python3-protobuf-3.14.0-13.el9.noarch 4.6 MB/s | 238 kB 00:00 2024-04-16T15:50:00.196 INFO:teuthology.orchestra.run.smithi179.stdout:(74/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.2 MB/s | 132 kB 00:00 2024-04-16T15:50:00.230 INFO:teuthology.orchestra.run.smithi179.stdout:(75/174): python3-pyasn1-modules-0.4.8-6.el9.no 3.1 MB/s | 211 kB 00:00 2024-04-16T15:50:00.255 INFO:teuthology.orchestra.run.smithi179.stdout:(76/174): python3-pytz-2021.1-5.el9.noarch.rpm 811 kB/s | 47 kB 00:00 2024-04-16T15:50:00.280 INFO:teuthology.orchestra.run.smithi179.stdout:(77/174): python3-requests-oauthlib-1.3.0-12.el 853 kB/s | 43 kB 00:00 2024-04-16T15:50:00.464 INFO:teuthology.orchestra.run.smithi179.stdout:(78/174): python3-toml-0.10.2-6.el9.noarch.rpm 212 kB/s | 39 kB 00:00 2024-04-16T15:50:00.600 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2024-04-16T15:50:00.600 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2024-04-16T15:50:00.647 INFO:teuthology.orchestra.run.smithi179.stdout:(79/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 40 MB/s | 16 MB 00:00 2024-04-16T15:50:00.673 INFO:teuthology.orchestra.run.smithi179.stdout:(80/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 198 kB/s | 41 kB 00:00 2024-04-16T15:50:00.698 INFO:teuthology.orchestra.run.smithi179.stdout:(81/174): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2024-04-16T15:50:00.723 INFO:teuthology.orchestra.run.smithi179.stdout:(82/174): qatlib-service-24.02.0-1.el9.x86_64.r 699 kB/s | 35 kB 00:00 2024-04-16T15:50:00.748 INFO:teuthology.orchestra.run.smithi179.stdout:(83/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 923 kB/s | 46 kB 00:00 2024-04-16T15:50:00.774 INFO:teuthology.orchestra.run.smithi179.stdout:(84/174): socat-1.7.4.1-5.el9.x86_64.rpm 5.8 MB/s | 300 kB 00:00 2024-04-16T15:50:00.799 INFO:teuthology.orchestra.run.smithi179.stdout:(85/174): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 56 kB 00:00 2024-04-16T15:50:00.824 INFO:teuthology.orchestra.run.smithi179.stdout:(86/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 63 kB 00:00 2024-04-16T15:50:00.849 INFO:teuthology.orchestra.run.smithi179.stdout:(87/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 881 kB/s | 44 kB 00:00 2024-04-16T15:50:00.875 INFO:teuthology.orchestra.run.smithi179.stdout:(88/174): fuse-2.9.9-15.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2024-04-16T15:50:00.908 INFO:teuthology.orchestra.run.smithi179.stdout:(89/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.0 MB/s | 241 kB 00:00 2024-04-16T15:50:00.942 INFO:teuthology.orchestra.run.smithi179.stdout:(90/174): python3-cryptography-36.0.1-4.el9.x86 17 MB/s | 1.1 MB 00:00 2024-04-16T15:50:00.968 INFO:teuthology.orchestra.run.smithi179.stdout:(91/174): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 103 kB 00:00 2024-04-16T15:50:00.993 INFO:teuthology.orchestra.run.smithi179.stdout:(92/174): python3-pycparser-2.20-6.el9.noarch.r 2.4 MB/s | 124 kB 00:00 2024-04-16T15:50:01.018 INFO:teuthology.orchestra.run.smithi179.stdout:(93/174): python3-urllib3-1.26.5-5.el9.noarch.r 3.7 MB/s | 187 kB 00:00 2024-04-16T15:50:01.177 INFO:teuthology.orchestra.run.smithi179.stdout:(94/174): jq-1.6-16.el9.x86_64.rpm 1.0 MB/s | 187 kB 00:00 2024-04-16T15:50:01.219 INFO:teuthology.orchestra.run.smithi179.stdout:(95/174): libquadmath-11.4.1-3.el9.x86_64.rpm 4.6 MB/s | 195 kB 00:00 2024-04-16T15:50:01.278 INFO:teuthology.orchestra.run.smithi179.stdout:(96/174): libgfortran-11.4.1-3.el9.x86_64.rpm 3.0 MB/s | 803 kB 00:00 2024-04-16T15:50:01.303 INFO:teuthology.orchestra.run.smithi179.stdout:(97/174): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-04-16T15:50:01.362 INFO:teuthology.orchestra.run.smithi179.stdout:(98/174): elfutils-libelf-devel-0.190-2.el9.x86 257 kB/s | 21 kB 00:00 2024-04-16T15:50:01.387 INFO:teuthology.orchestra.run.smithi179.stdout:(99/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 304 kB/s | 25 kB 00:00 2024-04-16T15:50:01.479 INFO:teuthology.orchestra.run.smithi179.stdout:(100/174): python3-devel-3.9.17-2.el9.x86_64.rp 2.6 MB/s | 245 kB 00:00 2024-04-16T15:50:01.529 INFO:teuthology.orchestra.run.smithi179.stdout:(101/174): python3-jinja2-2.11.3-5.el9.noarch.r 4.9 MB/s | 248 kB 00:00 2024-04-16T15:50:01.596 INFO:teuthology.orchestra.run.smithi179.stdout:(102/174): openssl-devel-3.0.7-27.el9.x86_64.rp 18 MB/s | 4.1 MB 00:00 2024-04-16T15:50:01.621 INFO:teuthology.orchestra.run.smithi179.stdout:(103/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.0 MB/s | 94 kB 00:00 2024-04-16T15:50:01.747 INFO:teuthology.orchestra.run.smithi179.stdout:(104/174): lua-devel-5.4.4-4.el9.x86_64.rpm 148 kB/s | 22 kB 00:00 2024-04-16T15:50:02.130 INFO:teuthology.orchestra.run.smithi179.stdout:(105/174): protobuf-compiler-3.14.0-13.el9.x86_ 1.7 MB/s | 863 kB 00:00 2024-04-16T15:50:02.339 INFO:teuthology.orchestra.run.smithi179.stdout:(106/174): abseil-cpp-20211102.0-3.el9.x86_64.r 926 kB/s | 548 kB 00:00 2024-04-16T15:50:02.597 INFO:teuthology.orchestra.run.smithi179.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 75 kB/s | 19 kB 00:00 2024-04-16T15:50:02.639 INFO:teuthology.orchestra.run.smithi179.stdout:(108/174): gperftools-libs-2.9.1-2.el9.x86_64.r 607 kB/s | 309 kB 00:00 2024-04-16T15:50:02.906 INFO:teuthology.orchestra.run.smithi179.stdout:(109/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 97 kB/s | 26 kB 00:00 2024-04-16T15:50:03.248 INFO:teuthology.orchestra.run.smithi179.stdout:(110/174): liboath-2.6.7-2.el9.x86_64.rpm 142 kB/s | 49 kB 00:00 2024-04-16T15:50:03.473 INFO:teuthology.orchestra.run.smithi179.stdout:(111/174): libarrow-9.0.0-10.el9.x86_64.rpm 5.0 MB/s | 4.4 MB 00:00 2024-04-16T15:50:03.599 INFO:teuthology.orchestra.run.smithi179.stdout:(112/174): libunwind-1.6.2-1.el9.x86_64.rpm 192 kB/s | 67 kB 00:00 2024-04-16T15:50:03.899 INFO:teuthology.orchestra.run.smithi179.stdout:(113/174): luarocks-3.9.2-1.el9.noarch.rpm 355 kB/s | 151 kB 00:00 2024-04-16T15:50:04.402 INFO:teuthology.orchestra.run.smithi179.stdout:(114/174): ceph-common-19.0.0-2868.gc3c87ed0.el 1.2 MB/s | 21 MB 00:17 2024-04-16T15:50:04.600 INFO:teuthology.orchestra.run.smithi179.stdout:(115/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 837 kB/s | 838 kB 00:01 2024-04-16T15:50:04.750 INFO:teuthology.orchestra.run.smithi179.stdout:(116/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 125 kB/s | 43 kB 00:00 2024-04-16T15:50:04.775 INFO:teuthology.orchestra.run.smithi179.stdout:(117/174): python3-asyncssh-2.13.2-5.el9.noarch 626 kB/s | 548 kB 00:00 2024-04-16T15:50:04.876 INFO:teuthology.orchestra.run.smithi179.stdout:(118/174): python3-cachetools-4.2.4-1.el9.noarc 117 kB/s | 32 kB 00:00 2024-04-16T15:50:05.018 INFO:teuthology.orchestra.run.smithi179.stdout:(119/174): python3-certifi-2021.10.8-2.el9.noar 56 kB/s | 15 kB 00:00 2024-04-16T15:50:05.226 INFO:teuthology.orchestra.run.smithi179.stdout:(120/174): python3-cheroot-8.6.0-4.el9.noarch.r 381 kB/s | 172 kB 00:00 2024-04-16T15:50:05.385 INFO:teuthology.orchestra.run.smithi179.stdout:(121/174): python3-cherrypy-18.6.1-2.el9.noarch 705 kB/s | 358 kB 00:00 2024-04-16T15:50:05.493 INFO:teuthology.orchestra.run.smithi179.stdout:(122/174): python3-colorama-0.4.4-12.el9.noarch 132 kB/s | 35 kB 00:00 2024-04-16T15:50:05.518 INFO:teuthology.orchestra.run.smithi179.stdout:(123/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 605 kB/s | 303 kB 00:00 2024-04-16T15:50:05.886 INFO:teuthology.orchestra.run.smithi179.stdout:(124/174): python3-google-auth-2.28.2-1.el9.noa 405 kB/s | 203 kB 00:00 2024-04-16T15:50:05.944 INFO:teuthology.orchestra.run.smithi179.stdout:(125/174): python3-grpcio-tools-1.46.7-10.el9.x 339 kB/s | 144 kB 00:00 2024-04-16T15:50:06.070 INFO:teuthology.orchestra.run.smithi179.stdout:(126/174): python3-jaraco-8.2.1-3.el9.noarch.rp 58 kB/s | 11 kB 00:00 2024-04-16T15:50:06.212 INFO:teuthology.orchestra.run.smithi179.stdout:(127/174): python3-jaraco-classes-3.2.1-5.el9.n 66 kB/s | 18 kB 00:00 2024-04-16T15:50:06.270 INFO:teuthology.orchestra.run.smithi179.stdout:(128/174): python3-grpcio-1.46.7-10.el9.x86_64. 2.6 MB/s | 2.0 MB 00:00 2024-04-16T15:50:06.337 INFO:teuthology.orchestra.run.smithi179.stdout:(129/174): python3-jaraco-collections-3.0.0-8.e 87 kB/s | 23 kB 00:00 2024-04-16T15:50:06.479 INFO:teuthology.orchestra.run.smithi179.stdout:(130/174): python3-jaraco-functools-3.5.0-2.el9 73 kB/s | 19 kB 00:00 2024-04-16T15:50:06.538 INFO:teuthology.orchestra.run.smithi179.stdout:(131/174): python3-jaraco-text-3.2.0-6.el9.noar 74 kB/s | 20 kB 00:00 2024-04-16T15:50:06.821 INFO:teuthology.orchestra.run.smithi179.stdout:(132/174): python3-logutils-0.3.5-21.el9.noarch 135 kB/s | 46 kB 00:00 2024-04-16T15:50:06.888 INFO:teuthology.orchestra.run.smithi179.stdout:(133/174): python3-more-itertools-8.12.0-2.el9. 225 kB/s | 79 kB 00:00 2024-04-16T15:50:07.022 INFO:teuthology.orchestra.run.smithi179.stdout:(134/174): python3-kubernetes-26.1.0-2.el9.noar 1.5 MB/s | 1.0 MB 00:00 2024-04-16T15:50:07.172 INFO:teuthology.orchestra.run.smithi179.stdout:(135/174): python3-natsort-7.1.1-5.el9.noarch.r 164 kB/s | 58 kB 00:00 2024-04-16T15:50:07.389 INFO:teuthology.orchestra.run.smithi179.stdout:(136/174): python3-portend-3.1.0-2.el9.noarch.r 45 kB/s | 16 kB 00:00 2024-04-16T15:50:07.497 INFO:teuthology.orchestra.run.smithi179.stdout:(137/174): python3-pecan-1.4.2-3.el9.noarch.rpm 447 kB/s | 272 kB 00:00 2024-04-16T15:50:07.531 INFO:teuthology.orchestra.run.smithi179.stdout:(138/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 251 kB/s | 90 kB 00:00 2024-04-16T15:50:07.648 INFO:teuthology.orchestra.run.smithi179.stdout:(139/174): python3-pyperclip-1.8.2-2.el9.noarch 109 kB/s | 28 kB 00:00 2024-04-16T15:50:07.765 INFO:teuthology.orchestra.run.smithi179.stdout:(140/174): python3-repoze-lru-0.7-16.el9.noarch 115 kB/s | 31 kB 00:00 2024-04-16T15:50:07.804 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2024-04-16T15:50:07.890 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-04-16T15:50:07.925 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-04-16T15:50:07.971 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-16T15:50:07.973 INFO:teuthology.orchestra.run.smithi179.stdout:(141/174): python3-routes-2.5.1-5.el9.noarch.rp 426 kB/s | 188 kB 00:00 2024-04-16T15:50:07.981 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-16T15:50:07.990 INFO:teuthology.orchestra.run.smithi179.stdout:(142/174): python3-rsa-4.9-2.el9.noarch.rpm 173 kB/s | 59 kB 00:00 2024-04-16T15:50:08.024 INFO:teuthology.orchestra.run.smithi179.stdout:(143/174): python3-tempora-5.0.0-2.el9.noarch.r 138 kB/s | 36 kB 00:00 2024-04-16T15:50:08.031 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-04-16T15:50:08.084 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-04-16T15:50:08.117 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-04-16T15:50:08.142 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-04-16T15:50:08.190 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-04-16T15:50:08.316 INFO:teuthology.orchestra.run.smithi179.stdout:(144/174): python3-typing-extensions-4.4.0-2.el 149 kB/s | 51 kB 00:00 2024-04-16T15:50:08.449 INFO:teuthology.orchestra.run.smithi179.stdout:(145/174): python3-websocket-client-1.2.3-2.el9 211 kB/s | 90 kB 00:00 2024-04-16T15:50:08.493 INFO:teuthology.orchestra.run.smithi179.stdout:(146/174): python3-webob-1.8.7-6.el9.noarch.rpm 459 kB/s | 230 kB 00:00 2024-04-16T15:50:08.537 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-04-16T15:50:08.590 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : librados2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 10/198 2024-04-16T15:50:08.717 INFO:teuthology.orchestra.run.smithi179.stdout:(147/174): python3-zc-lockfile-2.0-10.el9.noarc 75 kB/s | 20 kB 00:00 2024-04-16T15:50:08.718 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librados2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 10/198 2024-04-16T15:50:08.750 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libcephfs2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 11/198 2024-04-16T15:50:08.842 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libcephfs2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 11/198 2024-04-16T15:50:08.871 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-rados-2:19.0.0-2868.gc3c87ed0.el9.x86_64 12/198 2024-04-16T15:50:08.908 INFO:teuthology.orchestra.run.smithi179.stdout:(148/174): python3-werkzeug-2.0.3-3.el9.1.noarc 721 kB/s | 427 kB 00:00 2024-04-16T15:50:08.910 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-04-16T15:50:08.992 INFO:teuthology.orchestra.run.smithi179.stdout:(149/174): re2-20211101-3.el9.x86_64.rpm 383 kB/s | 192 kB 00:00 2024-04-16T15:50:09.105 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-04-16T15:50:09.161 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-04-16T15:50:09.188 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libcephsqlite-2:19.0.0-2868.gc3c87ed0.el9.x86_64 16/198 2024-04-16T15:50:09.251 INFO:teuthology.orchestra.run.smithi179.stdout:(150/174): librados2-19.0.0-2868.gc3c87ed0.el9. 9.9 MB/s | 3.4 MB 00:00 2024-04-16T15:50:09.308 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2868.gc3c87ed0.el9.x86_64 16/198 2024-04-16T15:50:09.331 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libradosstriper1-2:19.0.0-2868.gc3c87ed0.el9.x86 17/198 2024-04-16T15:50:09.404 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2868.gc3c87ed0.el9.x86 17/198 2024-04-16T15:50:09.443 INFO:teuthology.orchestra.run.smithi179.stdout:(151/174): NetworkManager-1.47.4-1.el9.x86_64.r 12 MB/s | 2.3 MB 00:00 2024-04-16T15:50:09.443 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-04-16T15:50:09.466 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-16T15:50:09.482 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-16T15:50:09.526 INFO:teuthology.orchestra.run.smithi179.stdout:(152/174): NetworkManager-libnm-1.47.4-1.el9.x8 22 MB/s | 1.8 MB 00:00 2024-04-16T15:50:09.568 INFO:teuthology.orchestra.run.smithi179.stdout:(153/174): NetworkManager-team-1.47.4-1.el9.x86 973 kB/s | 41 kB 00:00 2024-04-16T15:50:09.611 INFO:teuthology.orchestra.run.smithi179.stdout:(154/174): NetworkManager-tui-1.47.4-1.el9.x86_ 5.8 MB/s | 248 kB 00:00 2024-04-16T15:50:09.652 INFO:teuthology.orchestra.run.smithi179.stdout:(155/174): thrift-0.15.0-2.el9.x86_64.rpm 1.7 MB/s | 1.6 MB 00:00 2024-04-16T15:50:09.676 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-16T15:50:09.678 INFO:teuthology.orchestra.run.smithi179.stdout:(156/174): xfsdump-3.1.12-4.el9.x86_64.rpm 4.7 MB/s | 321 kB 00:00 2024-04-16T15:50:09.706 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-16T15:50:09.745 INFO:teuthology.orchestra.run.smithi179.stdout:(157/174): elfutils-debuginfod-client-0.190-2.e 547 kB/s | 36 kB 00:00 2024-04-16T15:50:09.746 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-04-16T15:50:09.841 INFO:teuthology.orchestra.run.smithi179.stdout:(158/174): elfutils-libelf-0.190-2.el9.x86_64.r 2.0 MB/s | 192 kB 00:00 2024-04-16T15:50:09.904 INFO:teuthology.orchestra.run.smithi179.stdout:(159/174): elfutils-libs-0.190-2.el9.x86_64.rpm 4.0 MB/s | 256 kB 00:00 2024-04-16T15:50:09.927 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-04-16T15:50:09.946 INFO:teuthology.orchestra.run.smithi179.stdout:(160/174): libacl-2.3.1-4.el9.x86_64.rpm 552 kB/s | 23 kB 00:00 2024-04-16T15:50:09.996 INFO:teuthology.orchestra.run.smithi179.stdout:(161/174): libblkid-2.37.4-18.el9.x86_64.rpm 2.1 MB/s | 108 kB 00:00 2024-04-16T15:50:10.038 INFO:teuthology.orchestra.run.smithi179.stdout:(162/174): libfdisk-2.37.4-18.el9.x86_64.rpm 3.6 MB/s | 155 kB 00:00 2024-04-16T15:50:10.066 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-16T15:50:10.080 INFO:teuthology.orchestra.run.smithi179.stdout:(163/174): libmount-2.37.4-18.el9.x86_64.rpm 3.2 MB/s | 136 kB 00:00 2024-04-16T15:50:10.122 INFO:teuthology.orchestra.run.smithi179.stdout:(164/174): libsmartcols-2.37.4-18.el9.x86_64.rp 1.5 MB/s | 64 kB 00:00 2024-04-16T15:50:10.126 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-16T15:50:10.164 INFO:teuthology.orchestra.run.smithi179.stdout:(165/174): libuuid-2.37.4-18.el9.x86_64.rpm 693 kB/s | 29 kB 00:00 2024-04-16T15:50:10.189 INFO:teuthology.orchestra.run.smithi179.stdout:(166/174): acl-2.3.1-4.el9.x86_64.rpm 133 kB/s | 71 kB 00:00 2024-04-16T15:50:10.238 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-16T15:50:10.248 INFO:teuthology.orchestra.run.smithi179.stdout:(167/174): openssl-3.0.7-27.el9.x86_64.rpm 14 MB/s | 1.2 MB 00:00 2024-04-16T15:50:10.294 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-16T15:50:10.340 INFO:teuthology.orchestra.run.smithi179.stdout:(168/174): util-linux-2.37.4-18.el9.x86_64.rpm 25 MB/s | 2.3 MB 00:00 2024-04-16T15:50:10.382 INFO:teuthology.orchestra.run.smithi179.stdout:(169/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 11 MB/s | 2.2 MB 00:00 2024-04-16T15:50:10.424 INFO:teuthology.orchestra.run.smithi179.stdout:(170/174): util-linux-user-2.37.4-18.el9.x86_64 747 kB/s | 31 kB 00:00 2024-04-16T15:50:10.482 INFO:teuthology.orchestra.run.smithi179.stdout:(171/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 18 MB/s | 1.1 MB 00:00 2024-04-16T15:50:10.505 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-16T15:50:10.571 INFO:teuthology.orchestra.run.smithi179.stdout:(172/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 847 kB/s | 74 kB 00:00 2024-04-16T15:50:10.604 INFO:teuthology.orchestra.run.smithi179.stdout:(173/174): util-linux-core-2.37.4-18.el9.x86_64 1.7 MB/s | 465 kB 00:00 2024-04-16T15:50:10.616 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-04-16T15:50:10.704 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-04-16T15:50:10.734 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-04-16T15:50:10.762 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-04-16T15:50:10.804 INFO:teuthology.orchestra.run.smithi179.stdout:(174/174): librbd1-19.0.0-2868.gc3c87ed0.el9.x8 1.7 MB/s | 3.1 MB 00:01 2024-04-16T15:50:10.805 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-04-16T15:50:10.809 INFO:teuthology.orchestra.run.smithi179.stdout:-------------------------------------------------------------------------------- 2024-04-16T15:50:10.810 INFO:teuthology.orchestra.run.smithi179.stdout:Total 9.0 MB/s | 228 MB 00:25 2024-04-16T15:50:10.870 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-04-16T15:50:10.925 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-04-16T15:50:10.962 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-04-16T15:50:11.027 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-04-16T15:50:11.062 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-04-16T15:50:11.105 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-04-16T15:50:11.138 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-04-16T15:50:11.166 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-04-16T15:50:11.192 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction check 2024-04-16T15:50:11.236 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-04-16T15:50:11.263 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-ceph-common-2:19.0.0-2868.gc3c87ed0.el9. 39/198 2024-04-16T15:50:11.298 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-ceph-argparse-2:19.0.0-2868.gc3c87ed0.el 40/198 2024-04-16T15:50:11.326 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cephfs-2:19.0.0-2868.gc3c87ed0.el9.x86_6 41/198 2024-04-16T15:50:11.396 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-04-16T15:50:11.441 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-04-16T15:50:11.466 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction check succeeded. 2024-04-16T15:50:11.466 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction test 2024-04-16T15:50:11.515 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-04-16T15:50:11.648 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-04-16T15:50:11.693 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-04-16T15:50:12.204 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-04-16T15:50:12.280 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-04-16T15:50:12.360 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-04-16T15:50:12.409 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-16T15:50:12.418 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-16T15:50:12.450 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-04-16T15:50:12.498 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-04-16T15:50:12.536 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librados-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_6 53/198 2024-04-16T15:50:12.567 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-04-16T15:50:12.842 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-04-16T15:50:13.056 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-04-16T15:50:13.135 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-04-16T15:50:13.179 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-04-16T15:50:13.502 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-04-16T15:50:13.507 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction test succeeded. 2024-04-16T15:50:13.508 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction 2024-04-16T15:50:13.567 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-04-16T15:50:13.614 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-04-16T15:50:13.678 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-04-16T15:50:13.708 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-04-16T15:50:13.745 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-04-16T15:50:13.791 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-04-16T15:50:13.827 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-04-16T15:50:13.870 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-04-16T15:50:13.912 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-04-16T15:50:14.045 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-04-16T15:50:14.093 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-04-16T15:50:14.123 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-04-16T15:50:14.165 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-04-16T15:50:14.258 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-04-16T15:50:14.298 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-04-16T15:50:14.339 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-04-16T15:50:14.364 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-04-16T15:50:14.414 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-04-16T15:50:14.492 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-04-16T15:50:14.614 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-04-16T15:50:14.713 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-04-16T15:50:14.764 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-04-16T15:50:14.812 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-04-16T15:50:14.868 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-04-16T15:50:15.050 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-04-16T15:50:15.093 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-04-16T15:50:15.221 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-04-16T15:50:15.259 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 87/198 2024-04-16T15:50:15.290 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-04-16T15:50:15.321 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-04-16T15:50:15.349 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-04-16T15:50:15.375 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-04-16T15:50:15.414 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-04-16T15:50:15.445 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-04-16T15:50:15.475 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-04-16T15:50:15.560 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-04-16T15:50:15.594 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-04-16T15:50:15.627 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-04-16T15:50:15.669 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-04-16T15:50:15.704 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-04-16T15:50:15.784 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-04-16T15:50:15.875 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-04-16T15:50:15.918 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-04-16T15:50:15.949 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-04-16T15:50:15.997 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-04-16T15:50:16.093 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-04-16T15:50:16.142 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-04-16T15:50:16.871 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-04-16T15:50:16.924 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-04-16T15:50:16.957 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-04-16T15:50:17.006 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-04-16T15:50:17.092 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-04-16T15:50:17.128 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-04-16T15:50:17.304 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-04-16T15:50:17.334 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-04-16T15:50:17.412 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-04-16T15:50:18.047 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-04-16T15:50:18.156 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-04-16T15:50:19.378 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-04-16T15:50:19.479 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-04-16T15:50:19.508 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-04-16T15:50:19.539 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-04-16T15:50:19.566 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-04-16T15:50:19.878 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-04-16T15:50:19.913 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : librbd1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 124/198 2024-04-16T15:50:19.995 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librbd1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 124/198 2024-04-16T15:50:20.018 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-rbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 125/198 2024-04-16T15:50:20.054 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-04-16T15:50:20.526 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-04-16T15:50:20.608 INFO:teuthology.orchestra.run.smithi179.stdout: Preparing : 1/1 2024-04-16T15:50:20.701 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-04-16T15:50:20.736 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-04-16T15:50:20.782 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-16T15:50:20.783 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librgw2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 128/198 2024-04-16T15:50:20.792 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-16T15:50:20.832 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-04-16T15:50:20.900 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-04-16T15:50:20.938 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librgw2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 128/198 2024-04-16T15:50:20.944 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-04-16T15:50:20.968 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-rgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 129/198 2024-04-16T15:50:20.978 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-04-16T15:50:21.023 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-04-16T15:50:21.352 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-04-16T15:50:21.420 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : librados2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 10/198 2024-04-16T15:50:21.524 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librados2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 10/198 2024-04-16T15:50:21.555 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libcephfs2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 11/198 2024-04-16T15:50:21.630 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libcephfs2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 11/198 2024-04-16T15:50:21.659 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rados-2:19.0.0-2868.gc3c87ed0.el9.x86_64 12/198 2024-04-16T15:50:21.701 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-04-16T15:50:21.906 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-04-16T15:50:21.960 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-04-16T15:50:21.989 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libcephsqlite-2:19.0.0-2868.gc3c87ed0.el9.x86_64 16/198 2024-04-16T15:50:22.074 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2868.gc3c87ed0.el9.x86_64 16/198 2024-04-16T15:50:22.106 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libradosstriper1-2:19.0.0-2868.gc3c87ed0.el9.x86 17/198 2024-04-16T15:50:22.171 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2868.gc3c87ed0.el9.x86 17/198 2024-04-16T15:50:22.218 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-04-16T15:50:22.249 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-16T15:50:22.265 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-16T15:50:22.459 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-16T15:50:22.501 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-16T15:50:22.554 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-04-16T15:50:22.735 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-04-16T15:50:22.864 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-16T15:50:22.907 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-16T15:50:23.010 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-16T15:50:23.109 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-16T15:50:23.247 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 130/198 2024-04-16T15:50:23.281 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 130/198 2024-04-16T15:50:23.340 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-16T15:50:23.448 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-04-16T15:50:23.550 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-04-16T15:50:23.585 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-04-16T15:50:23.624 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-04-16T15:50:23.660 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-04-16T15:50:23.732 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-04-16T15:50:23.787 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-04-16T15:50:23.822 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 130/198 2024-04-16T15:50:23.825 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-04-16T15:50:23.860 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-base-2:19.0.0-2868.gc3c87ed0.el9.x86_64 131/198 2024-04-16T15:50:23.890 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-04-16T15:50:23.934 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-04-16T15:50:23.951 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-base-2:19.0.0-2868.gc3c87ed0.el9.x86_64 131/198 2024-04-16T15:50:23.951 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-16T15:50:23.951 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-16T15:50:23.952 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:50:23.985 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-04-16T15:50:23.986 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-selinux-2:19.0.0-2868.gc3c87ed0.el9.x86_64 132/198 2024-04-16T15:50:24.018 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-04-16T15:50:24.046 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-04-16T15:50:24.115 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-04-16T15:50:24.151 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-ceph-common-2:19.0.0-2868.gc3c87ed0.el9. 39/198 2024-04-16T15:50:24.194 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-ceph-argparse-2:19.0.0-2868.gc3c87ed0.el 40/198 2024-04-16T15:50:24.223 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cephfs-2:19.0.0-2868.gc3c87ed0.el9.x86_6 41/198 2024-04-16T15:50:24.291 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-04-16T15:50:24.346 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-04-16T15:50:24.420 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-04-16T15:50:24.553 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-04-16T15:50:24.616 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-04-16T15:50:25.152 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-04-16T15:50:25.244 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-04-16T15:50:25.329 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-04-16T15:50:25.381 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-16T15:50:25.395 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-16T15:50:25.431 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-04-16T15:50:25.478 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-04-16T15:50:25.525 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librados-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_6 53/198 2024-04-16T15:50:25.564 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-04-16T15:50:25.823 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-04-16T15:50:26.024 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-04-16T15:50:26.107 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-04-16T15:50:26.150 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-04-16T15:50:26.297 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-04-16T15:50:26.354 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-04-16T15:50:26.408 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-04-16T15:50:26.474 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-04-16T15:50:26.504 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-04-16T15:50:26.541 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-04-16T15:50:26.588 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-04-16T15:50:26.648 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-04-16T15:50:26.700 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-04-16T15:50:26.743 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-04-16T15:50:26.876 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-04-16T15:50:26.939 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-04-16T15:50:26.978 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-04-16T15:50:27.020 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-04-16T15:50:27.114 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-04-16T15:50:27.153 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-04-16T15:50:27.193 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-04-16T15:50:27.219 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-04-16T15:50:27.244 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-04-16T15:50:27.323 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-04-16T15:50:27.442 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-04-16T15:50:27.556 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-04-16T15:50:27.602 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-04-16T15:50:27.675 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-04-16T15:50:27.731 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-04-16T15:50:27.927 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-04-16T15:50:27.981 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-04-16T15:50:28.110 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-04-16T15:50:28.171 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 87/198 2024-04-16T15:50:28.203 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-04-16T15:50:28.234 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-04-16T15:50:28.262 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-04-16T15:50:28.296 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-04-16T15:50:28.335 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-04-16T15:50:28.375 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-04-16T15:50:28.413 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-04-16T15:50:28.489 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-04-16T15:50:28.524 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-04-16T15:50:28.558 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-04-16T15:50:28.599 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-04-16T15:50:28.633 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-04-16T15:50:28.723 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-04-16T15:50:28.813 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-04-16T15:50:28.874 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-04-16T15:50:28.914 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-04-16T15:50:28.960 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-04-16T15:50:29.057 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-04-16T15:50:29.115 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-04-16T15:50:29.842 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-04-16T15:50:29.887 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-04-16T15:50:29.921 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-04-16T15:50:29.986 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-04-16T15:50:30.065 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-04-16T15:50:30.097 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-04-16T15:50:30.274 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-04-16T15:50:30.303 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-04-16T15:50:30.381 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-04-16T15:50:31.033 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-04-16T15:50:31.141 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-04-16T15:50:32.356 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-04-16T15:50:32.437 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-04-16T15:50:32.468 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-04-16T15:50:32.499 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-04-16T15:50:32.527 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-04-16T15:50:32.847 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-04-16T15:50:32.882 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : librbd1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 124/198 2024-04-16T15:50:32.972 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librbd1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 124/198 2024-04-16T15:50:33.003 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 125/198 2024-04-16T15:50:33.040 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-04-16T15:50:33.510 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-04-16T15:50:33.543 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librgw2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 128/198 2024-04-16T15:50:33.598 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librgw2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 128/198 2024-04-16T15:50:33.628 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 129/198 2024-04-16T15:50:35.898 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 130/198 2024-04-16T15:50:35.933 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 130/198 2024-04-16T15:50:36.030 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2868.gc3c87ed0.el9.x86_64 132/198 2024-04-16T15:50:36.031 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /sys 2024-04-16T15:50:36.031 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /proc 2024-04-16T15:50:36.031 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /mnt 2024-04-16T15:50:36.031 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /var/tmp 2024-04-16T15:50:36.031 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /home 2024-04-16T15:50:36.031 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /root 2024-04-16T15:50:36.031 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /tmp 2024-04-16T15:50:36.031 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:50:36.193 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-volume-2:19.0.0-2868.gc3c87ed0.el9.noarch 133/198 2024-04-16T15:50:36.208 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-volume-2:19.0.0-2868.gc3c87ed0.el9.noarch 133/198 2024-04-16T15:50:36.209 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T15:50:36.209 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-16T15:50:36.209 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:50:36.482 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 130/198 2024-04-16T15:50:36.520 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-base-2:19.0.0-2868.gc3c87ed0.el9.x86_64 131/198 2024-04-16T15:50:36.593 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-base-2:19.0.0-2868.gc3c87ed0.el9.x86_64 131/198 2024-04-16T15:50:36.594 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-16T15:50:36.594 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-16T15:50:36.594 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-16T15:50:36.629 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-selinux-2:19.0.0-2868.gc3c87ed0.el9.x86_64 132/198 2024-04-16T15:50:37.696 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-osd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 134/198 2024-04-16T15:50:37.723 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-osd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 134/198 2024-04-16T15:50:37.723 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T15:50:37.723 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-16T15:50:37.723 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-16T15:50:37.723 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-16T15:50:37.724 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:50:37.947 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mds-2:19.0.0-2868.gc3c87ed0.el9.x86_64 135/198 2024-04-16T15:50:37.970 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mds-2:19.0.0-2868.gc3c87ed0.el9.x86_64 135/198 2024-04-16T15:50:37.970 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T15:50:37.970 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-16T15:50:37.970 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-16T15:50:37.970 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-16T15:50:37.971 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:50:38.406 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mon-2:19.0.0-2868.gc3c87ed0.el9.x86_64 136/198 2024-04-16T15:50:38.429 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mon-2:19.0.0-2868.gc3c87ed0.el9.x86_64 136/198 2024-04-16T15:50:38.429 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T15:50:38.429 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-16T15:50:38.429 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-16T15:50:38.429 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-16T15:50:38.429 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:50:38.516 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-04-16T15:50:38.894 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 138/198 2024-04-16T15:50:38.923 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 138/198 2024-04-16T15:50:38.958 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2868.gc3c87ed0.e 139/198 2024-04-16T15:50:39.016 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2868.gc3c87ed0. 140/198 2024-04-16T15:50:39.046 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2868.gc3c87ed0.el9.noa 141/198 2024-04-16T15:50:40.085 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2868.gc3c87ed0.el9.noa 141/198 2024-04-16T15:50:40.123 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2868.gc3c87ed0.el9.n 142/198 2024-04-16T15:50:41.093 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2868.gc3c87ed0.el9.n 142/198 2024-04-16T15:50:41.123 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2868.gc3c 143/198 2024-04-16T15:50:41.224 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2868.gc3c 143/198 2024-04-16T15:50:41.386 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2868.gc3c87ed0.el 144/198 2024-04-16T15:50:41.417 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-2:19.0.0-2868.gc3c87ed0.el9.x86_64 145/198 2024-04-16T15:50:41.440 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2868.gc3c87ed0.el9.x86_64 145/198 2024-04-16T15:50:41.441 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T15:50:41.441 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-16T15:50:41.441 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-16T15:50:41.441 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-16T15:50:41.441 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:50:41.493 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-rook-2:19.0.0-2868.gc3c87ed0.el9.noarch 146/198 2024-04-16T15:50:41.504 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2868.gc3c87ed0.el9.noarch 146/198 2024-04-16T15:50:41.557 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-2:19.0.0-2868.gc3c87ed0.el9.x86_64 147/198 2024-04-16T15:50:42.442 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-04-16T15:50:42.478 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-radosgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 149/198 2024-04-16T15:50:42.501 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 149/198 2024-04-16T15:50:42.501 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T15:50:42.501 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-16T15:50:42.501 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-16T15:50:42.501 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-16T15:50:42.502 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:50:42.554 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2868.gc3c87 150/198 2024-04-16T15:50:42.576 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2868.gc3c87 150/198 2024-04-16T15:50:42.576 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T15:50:42.576 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-16T15:50:42.577 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:50:42.621 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : cephfs-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 151/198 2024-04-16T15:50:42.644 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 151/198 2024-04-16T15:50:42.644 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T15:50:42.644 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-16T15:50:42.645 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-16T15:50:42.645 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-16T15:50:42.645 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:50:42.947 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : rbd-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 152/198 2024-04-16T15:50:42.970 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 152/198 2024-04-16T15:50:42.970 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T15:50:42.970 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-16T15:50:42.970 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-16T15:50:42.970 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-16T15:50:42.971 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:50:47.526 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-test-2:19.0.0-2868.gc3c87ed0.el9.x86_64 153/198 2024-04-16T15:50:47.567 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : rbd-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 154/198 2024-04-16T15:50:47.598 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : rbd-nbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 155/198 2024-04-16T15:50:47.625 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-04-16T15:50:47.805 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : cephfs-shell-2:19.0.0-2868.gc3c87ed0.el9.x86_64 157/198 2024-04-16T15:50:47.916 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 158/198 2024-04-16T15:50:47.956 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 159/198 2024-04-16T15:50:48.018 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-04-16T15:50:48.065 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-04-16T15:50:48.100 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-04-16T15:50:48.124 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libcephfs-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_ 163/198 2024-04-16T15:50:48.156 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-04-16T15:50:48.186 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : NetworkManager-team-1:1.47.4-1.el9.x86_64 165/198 2024-04-16T15:50:48.249 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : NetworkManager-tui-1:1.47.4-1.el9.x86_64 166/198 2024-04-16T15:50:48.325 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-04-16T15:50:48.332 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2868.gc3c87ed0.el9.x86_64 132/198 2024-04-16T15:50:48.332 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /sys 2024-04-16T15:50:48.332 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /proc 2024-04-16T15:50:48.332 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /mnt 2024-04-16T15:50:48.332 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /var/tmp 2024-04-16T15:50:48.332 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /home 2024-04-16T15:50:48.333 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /root 2024-04-16T15:50:48.333 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /tmp 2024-04-16T15:50:48.333 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-16T15:50:48.361 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-04-16T15:50:48.491 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-volume-2:19.0.0-2868.gc3c87ed0.el9.noarch 133/198 2024-04-16T15:50:48.508 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-volume-2:19.0.0-2868.gc3c87ed0.el9.noarch 133/198 2024-04-16T15:50:48.508 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T15:50:48.508 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-16T15:50:48.508 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-16T15:50:48.878 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-16T15:50:48.918 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-16T15:50:48.939 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-16T15:50:49.756 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : cephfs-top-2:19.0.0-2868.gc3c87ed0.el9.noarch 170/198 2024-04-16T15:50:49.838 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-04-16T15:50:49.880 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-04-16T15:50:49.974 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-04-16T15:50:49.985 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-osd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 134/198 2024-04-16T15:50:50.009 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-04-16T15:50:50.012 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-osd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 134/198 2024-04-16T15:50:50.012 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T15:50:50.012 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-16T15:50:50.012 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-16T15:50:50.012 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-16T15:50:50.013 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-16T15:50:50.034 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-04-16T15:50:50.059 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-04-16T15:50:50.086 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-04-16T15:50:50.086 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-16T15:50:50.182 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-16T15:50:50.220 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-04-16T15:50:50.220 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-16T15:50:50.245 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mds-2:19.0.0-2868.gc3c87ed0.el9.x86_64 135/198 2024-04-16T15:50:50.269 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mds-2:19.0.0-2868.gc3c87ed0.el9.x86_64 135/198 2024-04-16T15:50:50.269 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T15:50:50.269 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-16T15:50:50.269 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-16T15:50:50.269 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-16T15:50:50.269 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-16T15:50:50.305 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-16T15:50:50.331 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-04-16T15:50:50.364 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-04-16T15:50:50.389 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-04-16T15:50:50.418 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-04-16T15:50:50.450 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-04-16T15:50:50.487 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-04-16T15:50:50.519 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-04-16T15:50:50.545 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-04-16T15:50:50.570 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-04-16T15:50:50.595 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-04-16T15:50:50.612 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-04-16T15:50:50.618 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-16T15:50:50.619 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-16T15:50:50.722 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mon-2:19.0.0-2868.gc3c87ed0.el9.x86_64 136/198 2024-04-16T15:50:50.746 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mon-2:19.0.0-2868.gc3c87ed0.el9.x86_64 136/198 2024-04-16T15:50:50.746 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T15:50:50.746 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-16T15:50:50.746 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-16T15:50:50.746 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-16T15:50:50.746 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-16T15:50:50.799 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-16T15:50:50.799 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-16T15:50:50.840 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-04-16T15:50:50.881 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-16T15:50:50.912 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-04-16T15:50:50.939 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-04-16T15:50:50.965 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-04-16T15:50:50.990 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-04-16T15:50:51.048 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-16T15:50:51.238 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 138/198 2024-04-16T15:50:51.264 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 138/198 2024-04-16T15:50:51.304 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2868.gc3c87ed0.e 139/198 2024-04-16T15:50:51.366 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2868.gc3c87ed0. 140/198 2024-04-16T15:50:51.396 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2868.gc3c87ed0.el9.noa 141/198 2024-04-16T15:50:52.438 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2868.gc3c87ed0.el9.noa 141/198 2024-04-16T15:50:52.472 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2868.gc3c87ed0.el9.n 142/198 2024-04-16T15:50:53.442 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2868.gc3c87ed0.el9.n 142/198 2024-04-16T15:50:53.464 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2868.gc3c 143/198 2024-04-16T15:50:53.566 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2868.gc3c 143/198 2024-04-16T15:50:53.736 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2868.gc3c87ed0.el 144/198 2024-04-16T15:50:53.775 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-2:19.0.0-2868.gc3c87ed0.el9.x86_64 145/198 2024-04-16T15:50:53.798 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2868.gc3c87ed0.el9.x86_64 145/198 2024-04-16T15:50:53.799 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T15:50:53.799 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-16T15:50:53.799 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-16T15:50:53.799 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-16T15:50:53.799 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-16T15:50:53.850 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-rook-2:19.0.0-2868.gc3c87ed0.el9.noarch 146/198 2024-04-16T15:50:53.862 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2868.gc3c87ed0.el9.noarch 146/198 2024-04-16T15:50:53.910 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-2:19.0.0-2868.gc3c87ed0.el9.x86_64 147/198 2024-04-16T15:50:54.798 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-04-16T15:50:54.838 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-radosgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 149/198 2024-04-16T15:50:54.862 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 149/198 2024-04-16T15:50:54.862 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T15:50:54.862 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-16T15:50:54.862 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-16T15:50:54.862 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-16T15:50:54.862 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-16T15:50:54.905 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2868.gc3c87 150/198 2024-04-16T15:50:54.928 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2868.gc3c87 150/198 2024-04-16T15:50:54.928 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T15:50:54.928 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-16T15:50:54.928 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-16T15:50:54.972 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : cephfs-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 151/198 2024-04-16T15:50:54.996 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 151/198 2024-04-16T15:50:54.996 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T15:50:54.996 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-16T15:50:54.996 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-16T15:50:54.996 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-16T15:50:54.996 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-16T15:50:55.315 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : rbd-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 152/198 2024-04-16T15:50:55.338 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 152/198 2024-04-16T15:50:55.338 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T15:50:55.338 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-16T15:50:55.339 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-16T15:50:55.339 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-16T15:50:55.339 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-16T15:50:56.611 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-16T15:50:56.611 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-2:19.0.0-2868.gc3c87ed0.el9.x86_64 1/198 2024-04-16T15:50:56.611 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-base-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2/198 2024-04-16T15:50:56.611 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 3/198 2024-04-16T15:50:56.612 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 4/198 2024-04-16T15:50:56.612 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2868.gc3c87 5/198 2024-04-16T15:50:56.612 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mds-2:19.0.0-2868.gc3c87ed0.el9.x86_64 6/198 2024-04-16T15:50:56.612 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-2:19.0.0-2868.gc3c87ed0.el9.x86_64 7/198 2024-04-16T15:50:56.612 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mon-2:19.0.0-2868.gc3c87ed0.el9.x86_64 8/198 2024-04-16T15:50:56.612 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-osd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 9/198 2024-04-16T15:50:56.612 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-radosgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 10/198 2024-04-16T15:50:56.612 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-selinux-2:19.0.0-2868.gc3c87ed0.el9.x86_64 11/198 2024-04-16T15:50:56.612 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-test-2:19.0.0-2868.gc3c87ed0.el9.x86_64 12/198 2024-04-16T15:50:56.612 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : cephfs-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 13/198 2024-04-16T15:50:56.613 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : cephfs-shell-2:19.0.0-2868.gc3c87ed0.el9.x86_64 14/198 2024-04-16T15:50:56.613 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libcephfs-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_ 15/198 2024-04-16T15:50:56.613 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libcephfs2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 16/198 2024-04-16T15:50:56.613 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libcephsqlite-2:19.0.0-2868.gc3c87ed0.el9.x86_64 17/198 2024-04-16T15:50:56.613 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librados-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_6 18/198 2024-04-16T15:50:56.613 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libradosstriper1-2:19.0.0-2868.gc3c87ed0.el9.x86 19/198 2024-04-16T15:50:56.613 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librgw2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 20/198 2024-04-16T15:50:56.613 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2868.gc3c87ed0.el 21/198 2024-04-16T15:50:56.613 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-ceph-common-2:19.0.0-2868.gc3c87ed0.el9. 22/198 2024-04-16T15:50:56.614 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cephfs-2:19.0.0-2868.gc3c87ed0.el9.x86_6 23/198 2024-04-16T15:50:56.614 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-rados-2:19.0.0-2868.gc3c87ed0.el9.x86_64 24/198 2024-04-16T15:50:56.614 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-rbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 25/198 2024-04-16T15:50:56.614 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-rgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 26/198 2024-04-16T15:50:56.614 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : rbd-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 27/198 2024-04-16T15:50:56.614 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : rbd-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 28/198 2024-04-16T15:50:56.614 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : rbd-nbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 29/198 2024-04-16T15:50:56.614 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2868.gc3c87ed0. 30/198 2024-04-16T15:50:56.614 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2868.gc3c87ed0.el9.noa 31/198 2024-04-16T15:50:56.614 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2868.gc3c87ed0.el9.n 32/198 2024-04-16T15:50:56.615 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2868.gc3c 33/198 2024-04-16T15:50:56.615 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2868.gc3c87ed0.el 34/198 2024-04-16T15:50:56.615 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2868.gc3c87ed0.el9.noarch 35/198 2024-04-16T15:50:56.615 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2868.gc3c87ed0.e 36/198 2024-04-16T15:50:56.615 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-volume-2:19.0.0-2868.gc3c87ed0.el9.noarch 37/198 2024-04-16T15:50:56.615 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 38/198 2024-04-16T15:50:56.615 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : cephfs-top-2:19.0.0-2868.gc3c87ed0.el9.noarch 39/198 2024-04-16T15:50:56.615 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-04-16T15:50:56.615 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-04-16T15:50:56.616 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-04-16T15:50:56.616 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-04-16T15:50:56.616 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-04-16T15:50:56.616 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-04-16T15:50:56.616 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-04-16T15:50:56.616 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-04-16T15:50:56.616 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-04-16T15:50:56.616 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-04-16T15:50:56.616 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-04-16T15:50:56.616 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-04-16T15:50:56.616 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-04-16T15:50:56.616 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-04-16T15:50:56.617 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-04-16T15:50:56.617 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-04-16T15:50:56.617 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-04-16T15:50:56.617 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-04-16T15:50:56.617 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : postgresql-13.14-1.el9.x86_64 58/198 2024-04-16T15:50:56.617 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 59/198 2024-04-16T15:50:56.617 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 60/198 2024-04-16T15:50:56.617 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 61/198 2024-04-16T15:50:56.617 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-04-16T15:50:56.617 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-04-16T15:50:56.617 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-04-16T15:50:56.617 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-04-16T15:50:56.618 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-04-16T15:50:56.618 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-04-16T15:50:56.618 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-04-16T15:50:56.618 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-04-16T15:50:56.618 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-04-16T15:50:56.618 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-04-16T15:50:56.618 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-04-16T15:50:56.619 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-04-16T15:50:56.619 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-04-16T15:50:56.619 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-04-16T15:50:56.619 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-04-16T15:50:56.619 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-04-16T15:50:56.619 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-04-16T15:50:56.619 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-04-16T15:50:56.619 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-04-16T15:50:56.619 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-04-16T15:50:56.619 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 82/198 2024-04-16T15:50:56.620 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 83/198 2024-04-16T15:50:56.620 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 84/198 2024-04-16T15:50:56.620 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 85/198 2024-04-16T15:50:56.620 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 86/198 2024-04-16T15:50:56.620 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 87/198 2024-04-16T15:50:56.620 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 88/198 2024-04-16T15:50:56.620 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 89/198 2024-04-16T15:50:56.620 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 90/198 2024-04-16T15:50:56.621 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 91/198 2024-04-16T15:50:56.621 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-ply-3.11-14.el9.noarch 92/198 2024-04-16T15:50:56.621 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 93/198 2024-04-16T15:50:56.621 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 94/198 2024-04-16T15:50:56.621 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : jq-1.6-16.el9.x86_64 95/198 2024-04-16T15:50:56.621 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 96/198 2024-04-16T15:50:56.621 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 97/198 2024-04-16T15:50:56.621 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 98/198 2024-04-16T15:50:56.621 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 99/198 2024-04-16T15:50:56.621 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 100/198 2024-04-16T15:50:56.622 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 101/198 2024-04-16T15:50:56.622 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 102/198 2024-04-16T15:50:56.622 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 103/198 2024-04-16T15:50:56.622 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-04-16T15:50:56.622 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-04-16T15:50:56.622 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-04-16T15:50:56.622 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-04-16T15:50:56.622 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-04-16T15:50:56.623 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-04-16T15:50:56.623 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-04-16T15:50:56.623 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-04-16T15:50:56.623 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-04-16T15:50:56.623 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-04-16T15:50:56.623 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-04-16T15:50:56.623 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-04-16T15:50:56.623 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-04-16T15:50:56.623 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-04-16T15:50:56.624 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-04-16T15:50:56.624 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-04-16T15:50:56.624 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-04-16T15:50:56.624 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-04-16T15:50:56.624 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-04-16T15:50:56.624 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-04-16T15:50:56.624 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-04-16T15:50:56.624 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-04-16T15:50:56.624 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-04-16T15:50:56.625 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-04-16T15:50:56.625 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-04-16T15:50:56.625 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-04-16T15:50:56.625 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-04-16T15:50:56.625 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-04-16T15:50:56.625 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-04-16T15:50:56.625 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-04-16T15:50:56.625 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-04-16T15:50:56.625 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-04-16T15:50:56.625 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-04-16T15:50:56.626 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-04-16T15:50:56.626 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-04-16T15:50:56.626 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-04-16T15:50:56.626 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-04-16T15:50:56.626 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-04-16T15:50:56.626 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-04-16T15:50:56.626 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-04-16T15:50:56.626 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-04-16T15:50:56.626 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-04-16T15:50:56.626 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-04-16T15:50:56.627 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-04-16T15:50:56.627 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-04-16T15:50:56.627 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-04-16T15:50:56.627 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-04-16T15:50:56.627 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librados2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 151/198 2024-04-16T15:50:56.627 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-04-16T15:50:56.627 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librbd1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 153/198 2024-04-16T15:50:56.627 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-04-16T15:50:56.627 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 155/198 2024-04-16T15:50:56.628 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 156/198 2024-04-16T15:50:56.628 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 157/198 2024-04-16T15:50:56.628 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/198 2024-04-16T15:50:56.628 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 159/198 2024-04-16T15:50:56.628 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 160/198 2024-04-16T15:50:56.628 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 161/198 2024-04-16T15:50:56.628 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 162/198 2024-04-16T15:50:56.628 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 163/198 2024-04-16T15:50:56.629 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 164/198 2024-04-16T15:50:56.629 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-04-16T15:50:56.629 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-04-16T15:50:56.630 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-04-16T15:50:56.630 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-04-16T15:50:56.630 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-04-16T15:50:56.630 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-04-16T15:50:56.630 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-04-16T15:50:56.630 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-04-16T15:50:56.630 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-04-16T15:50:56.630 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-04-16T15:50:56.630 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-04-16T15:50:56.630 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-04-16T15:50:56.631 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-04-16T15:50:56.631 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-04-16T15:50:56.631 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-04-16T15:50:56.631 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-04-16T15:50:56.631 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-04-16T15:50:56.631 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-04-16T15:50:56.631 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-04-16T15:50:56.631 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-04-16T15:50:56.631 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-04-16T15:50:56.631 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-04-16T15:50:56.631 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-04-16T15:50:56.631 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-04-16T15:50:56.631 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-04-16T15:50:56.631 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-04-16T15:50:56.632 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-04-16T15:50:56.632 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-04-16T15:50:56.632 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-04-16T15:50:56.632 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-04-16T15:50:56.632 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-04-16T15:50:56.632 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-04-16T15:50:56.632 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-04-16T15:50:59.831 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-04-16T15:50:59.832 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:50:59.832 INFO:teuthology.orchestra.run.smithi132.stdout:Upgraded: 2024-04-16T15:50:59.832 INFO:teuthology.orchestra.run.smithi132.stdout: NetworkManager-1:1.47.4-1.el9.x86_64 2024-04-16T15:50:59.832 INFO:teuthology.orchestra.run.smithi132.stdout: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 2024-04-16T15:50:59.832 INFO:teuthology.orchestra.run.smithi132.stdout: NetworkManager-team-1:1.47.4-1.el9.x86_64 2024-04-16T15:50:59.832 INFO:teuthology.orchestra.run.smithi132.stdout: NetworkManager-tui-1:1.47.4-1.el9.x86_64 2024-04-16T15:50:59.833 INFO:teuthology.orchestra.run.smithi132.stdout: acl-2.3.1-4.el9.x86_64 2024-04-16T15:50:59.833 INFO:teuthology.orchestra.run.smithi132.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-04-16T15:50:59.833 INFO:teuthology.orchestra.run.smithi132.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-04-16T15:50:59.833 INFO:teuthology.orchestra.run.smithi132.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-04-16T15:50:59.833 INFO:teuthology.orchestra.run.smithi132.stdout: libacl-2.3.1-4.el9.x86_64 2024-04-16T15:50:59.834 INFO:teuthology.orchestra.run.smithi132.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-04-16T15:50:59.834 INFO:teuthology.orchestra.run.smithi132.stdout: libblkid-2.37.4-18.el9.x86_64 2024-04-16T15:50:59.834 INFO:teuthology.orchestra.run.smithi132.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-04-16T15:50:59.834 INFO:teuthology.orchestra.run.smithi132.stdout: libmount-2.37.4-18.el9.x86_64 2024-04-16T15:50:59.834 INFO:teuthology.orchestra.run.smithi132.stdout: librados2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:50:59.834 INFO:teuthology.orchestra.run.smithi132.stdout: librbd1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:50:59.834 INFO:teuthology.orchestra.run.smithi132.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-04-16T15:50:59.835 INFO:teuthology.orchestra.run.smithi132.stdout: libuuid-2.37.4-18.el9.x86_64 2024-04-16T15:50:59.835 INFO:teuthology.orchestra.run.smithi132.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-04-16T15:50:59.835 INFO:teuthology.orchestra.run.smithi132.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-04-16T15:50:59.835 INFO:teuthology.orchestra.run.smithi132.stdout: util-linux-2.37.4-18.el9.x86_64 2024-04-16T15:50:59.835 INFO:teuthology.orchestra.run.smithi132.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-04-16T15:50:59.835 INFO:teuthology.orchestra.run.smithi132.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-04-16T15:50:59.835 INFO:teuthology.orchestra.run.smithi132.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-04-16T15:50:59.835 INFO:teuthology.orchestra.run.smithi132.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-04-16T15:50:59.836 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2024-04-16T15:50:59.836 INFO:teuthology.orchestra.run.smithi132.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-16T15:50:59.836 INFO:teuthology.orchestra.run.smithi132.stdout: automake-1.16.2-8.el9.noarch 2024-04-16T15:50:59.836 INFO:teuthology.orchestra.run.smithi132.stdout: bison-3.7.4-5.el9.x86_64 2024-04-16T15:50:59.836 INFO:teuthology.orchestra.run.smithi132.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-16T15:50:59.836 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:50:59.836 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-base-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:50:59.836 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:50:59.837 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:50:59.837 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-grafana-dashboards-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T15:50:59.837 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-immutable-object-cache-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:50:59.837 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mds-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:50:59.837 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:50:59.837 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T15:50:59.837 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-dashboard-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T15:50:59.837 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T15:50:59.838 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-modules-core-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T15:50:59.838 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-rook-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T15:50:59.838 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mon-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:50:59.838 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-osd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:50:59.838 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-prometheus-alerts-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T15:50:59.838 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-radosgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:50:59.839 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-selinux-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:50:59.839 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-test-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:50:59.839 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-volume-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T15:50:59.839 INFO:teuthology.orchestra.run.smithi132.stdout: cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T15:50:59.839 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:50:59.839 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-shell-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:50:59.839 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-top-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T15:50:59.839 INFO:teuthology.orchestra.run.smithi132.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-16T15:50:59.839 INFO:teuthology.orchestra.run.smithi132.stdout: flex-2.6.4-9.el9.x86_64 2024-04-16T15:50:59.839 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-16T15:50:59.839 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-16T15:50:59.839 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-16T15:50:59.839 INFO:teuthology.orchestra.run.smithi132.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-16T15:50:59.839 INFO:teuthology.orchestra.run.smithi132.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-16T15:50:59.840 INFO:teuthology.orchestra.run.smithi132.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-16T15:50:59.840 INFO:teuthology.orchestra.run.smithi132.stdout: jq-1.6-16.el9.x86_64 2024-04-16T15:50:59.840 INFO:teuthology.orchestra.run.smithi132.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-16T15:50:59.840 INFO:teuthology.orchestra.run.smithi132.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-16T15:50:59.840 INFO:teuthology.orchestra.run.smithi132.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-16T15:50:59.840 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:50:59.840 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:50:59.840 INFO:teuthology.orchestra.run.smithi132.stdout: libcephsqlite-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:50:59.840 INFO:teuthology.orchestra.run.smithi132.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-16T15:50:59.840 INFO:teuthology.orchestra.run.smithi132.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-16T15:50:59.840 INFO:teuthology.orchestra.run.smithi132.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-16T15:50:59.840 INFO:teuthology.orchestra.run.smithi132.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-16T15:50:59.840 INFO:teuthology.orchestra.run.smithi132.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-16T15:50:59.840 INFO:teuthology.orchestra.run.smithi132.stdout: librados-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:50:59.841 INFO:teuthology.orchestra.run.smithi132.stdout: libradosstriper1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:50:59.841 INFO:teuthology.orchestra.run.smithi132.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-16T15:50:59.841 INFO:teuthology.orchestra.run.smithi132.stdout: librgw2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:50:59.841 INFO:teuthology.orchestra.run.smithi132.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-16T15:50:59.841 INFO:teuthology.orchestra.run.smithi132.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-16T15:50:59.841 INFO:teuthology.orchestra.run.smithi132.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-16T15:50:59.841 INFO:teuthology.orchestra.run.smithi132.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-16T15:50:59.841 INFO:teuthology.orchestra.run.smithi132.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-16T15:50:59.841 INFO:teuthology.orchestra.run.smithi132.stdout: lua-5.4.4-4.el9.x86_64 2024-04-16T15:50:59.841 INFO:teuthology.orchestra.run.smithi132.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-16T15:50:59.841 INFO:teuthology.orchestra.run.smithi132.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-16T15:50:59.841 INFO:teuthology.orchestra.run.smithi132.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-16T15:50:59.841 INFO:teuthology.orchestra.run.smithi132.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-16T15:50:59.841 INFO:teuthology.orchestra.run.smithi132.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-16T15:50:59.842 INFO:teuthology.orchestra.run.smithi132.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-16T15:50:59.842 INFO:teuthology.orchestra.run.smithi132.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-16T15:50:59.842 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-13.14-1.el9.x86_64 2024-04-16T15:50:59.842 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-16T15:50:59.842 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-16T15:50:59.842 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-16T15:50:59.842 INFO:teuthology.orchestra.run.smithi132.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-16T15:50:59.842 INFO:teuthology.orchestra.run.smithi132.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-16T15:50:59.842 INFO:teuthology.orchestra.run.smithi132.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-16T15:50:59.842 INFO:teuthology.orchestra.run.smithi132.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-16T15:50:59.842 INFO:teuthology.orchestra.run.smithi132.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-16T15:50:59.842 INFO:teuthology.orchestra.run.smithi132.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-16T15:50:59.842 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-16T15:50:59.843 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-argparse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:50:59.843 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:50:59.843 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cephfs-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:50:59.843 INFO:teuthology.orchestra.run.smithi132.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-16T15:50:59.843 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-16T15:50:59.843 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-16T15:50:59.843 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-16T15:50:59.843 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-16T15:50:59.843 INFO:teuthology.orchestra.run.smithi132.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-16T15:50:59.843 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-16T15:50:59.843 INFO:teuthology.orchestra.run.smithi132.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-16T15:50:59.843 INFO:teuthology.orchestra.run.smithi132.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-16T15:50:59.843 INFO:teuthology.orchestra.run.smithi132.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-16T15:50:59.843 INFO:teuthology.orchestra.run.smithi132.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-16T15:50:59.844 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-16T15:50:59.844 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-16T15:50:59.844 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-16T15:50:59.844 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-16T15:50:59.844 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-16T15:50:59.844 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-16T15:50:59.844 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-16T15:50:59.844 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-16T15:50:59.844 INFO:teuthology.orchestra.run.smithi132.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-16T15:50:59.844 INFO:teuthology.orchestra.run.smithi132.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-16T15:50:59.844 INFO:teuthology.orchestra.run.smithi132.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-16T15:50:59.844 INFO:teuthology.orchestra.run.smithi132.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-16T15:50:59.844 INFO:teuthology.orchestra.run.smithi132.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-16T15:50:59.844 INFO:teuthology.orchestra.run.smithi132.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-16T15:50:59.844 INFO:teuthology.orchestra.run.smithi132.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-16T15:50:59.845 INFO:teuthology.orchestra.run.smithi132.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-16T15:50:59.845 INFO:teuthology.orchestra.run.smithi132.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-16T15:50:59.845 INFO:teuthology.orchestra.run.smithi132.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-16T15:50:59.845 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-16T15:50:59.845 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ply-3.11-14.el9.noarch 2024-04-16T15:50:59.845 INFO:teuthology.orchestra.run.smithi132.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-16T15:50:59.845 INFO:teuthology.orchestra.run.smithi132.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-16T15:50:59.845 INFO:teuthology.orchestra.run.smithi132.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-16T15:50:59.845 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-16T15:50:59.845 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-16T15:50:59.845 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-16T15:50:59.845 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-16T15:50:59.845 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-16T15:50:59.846 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-16T15:50:59.846 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rados-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:50:59.846 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:50:59.846 INFO:teuthology.orchestra.run.smithi132.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-16T15:50:59.846 INFO:teuthology.orchestra.run.smithi132.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-16T15:50:59.846 INFO:teuthology.orchestra.run.smithi132.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-16T15:50:59.846 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:50:59.846 INFO:teuthology.orchestra.run.smithi132.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-16T15:50:59.846 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-16T15:50:59.846 INFO:teuthology.orchestra.run.smithi132.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-16T15:50:59.846 INFO:teuthology.orchestra.run.smithi132.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-16T15:50:59.846 INFO:teuthology.orchestra.run.smithi132.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-16T15:50:59.846 INFO:teuthology.orchestra.run.smithi132.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-16T15:50:59.847 INFO:teuthology.orchestra.run.smithi132.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-16T15:50:59.847 INFO:teuthology.orchestra.run.smithi132.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-16T15:50:59.847 INFO:teuthology.orchestra.run.smithi132.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-16T15:50:59.847 INFO:teuthology.orchestra.run.smithi132.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-16T15:50:59.847 INFO:teuthology.orchestra.run.smithi132.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-16T15:50:59.847 INFO:teuthology.orchestra.run.smithi132.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-16T15:50:59.847 INFO:teuthology.orchestra.run.smithi132.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-16T15:50:59.847 INFO:teuthology.orchestra.run.smithi132.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-16T15:50:59.847 INFO:teuthology.orchestra.run.smithi132.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-16T15:50:59.847 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:50:59.847 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:50:59.847 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-nbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:50:59.847 INFO:teuthology.orchestra.run.smithi132.stdout: re2-1:20211101-3.el9.x86_64 2024-04-16T15:50:59.847 INFO:teuthology.orchestra.run.smithi132.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-16T15:50:59.848 INFO:teuthology.orchestra.run.smithi132.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-16T15:50:59.848 INFO:teuthology.orchestra.run.smithi132.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-16T15:50:59.848 INFO:teuthology.orchestra.run.smithi132.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-16T15:50:59.848 INFO:teuthology.orchestra.run.smithi132.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-16T15:50:59.848 INFO:teuthology.orchestra.run.smithi132.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-04-16T15:50:59.848 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:50:59.848 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-04-16T15:50:59.911 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-test-2:19.0.0-2868.gc3c87ed0.el9.x86_64 153/198 2024-04-16T15:50:59.961 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : rbd-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 154/198 2024-04-16T15:50:59.992 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : rbd-nbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 155/198 2024-04-16T15:51:00.027 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-04-16T15:51:00.210 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : cephfs-shell-2:19.0.0-2868.gc3c87ed0.el9.x86_64 157/198 2024-04-16T15:51:00.318 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 158/198 2024-04-16T15:51:00.324 DEBUG:teuthology.parallel:result is None 2024-04-16T15:51:00.358 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 159/198 2024-04-16T15:51:00.417 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-04-16T15:51:00.483 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-04-16T15:51:00.535 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-04-16T15:51:00.568 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libcephfs-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_ 163/198 2024-04-16T15:51:00.616 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-04-16T15:51:00.654 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : NetworkManager-team-1:1.47.4-1.el9.x86_64 165/198 2024-04-16T15:51:00.710 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : NetworkManager-tui-1:1.47.4-1.el9.x86_64 166/198 2024-04-16T15:51:00.769 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-04-16T15:51:00.803 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-04-16T15:51:01.412 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-16T15:51:01.451 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-16T15:51:01.473 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-16T15:51:02.311 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : cephfs-top-2:19.0.0-2868.gc3c87ed0.el9.noarch 170/198 2024-04-16T15:51:02.396 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-04-16T15:51:02.437 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-04-16T15:51:02.527 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-04-16T15:51:02.566 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-04-16T15:51:02.591 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-04-16T15:51:02.617 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-04-16T15:51:02.643 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-04-16T15:51:02.643 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-16T15:51:02.731 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-16T15:51:02.761 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-04-16T15:51:02.761 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-16T15:51:02.845 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-16T15:51:02.881 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-04-16T15:51:02.921 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-04-16T15:51:02.947 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-04-16T15:51:02.972 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-04-16T15:51:03.025 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-04-16T15:51:03.070 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-04-16T15:51:03.110 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-04-16T15:51:03.136 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-04-16T15:51:03.161 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-04-16T15:51:03.186 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-04-16T15:51:03.211 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-04-16T15:51:03.218 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-16T15:51:03.218 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-16T15:51:03.406 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-16T15:51:03.406 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-16T15:51:03.490 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-16T15:51:03.522 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-04-16T15:51:03.556 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-04-16T15:51:03.582 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-04-16T15:51:03.607 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-04-16T15:51:03.673 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-16T15:51:09.345 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-16T15:51:09.345 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-2:19.0.0-2868.gc3c87ed0.el9.x86_64 1/198 2024-04-16T15:51:09.345 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-base-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2/198 2024-04-16T15:51:09.345 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 3/198 2024-04-16T15:51:09.345 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 4/198 2024-04-16T15:51:09.345 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2868.gc3c87 5/198 2024-04-16T15:51:09.345 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mds-2:19.0.0-2868.gc3c87ed0.el9.x86_64 6/198 2024-04-16T15:51:09.345 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-2:19.0.0-2868.gc3c87ed0.el9.x86_64 7/198 2024-04-16T15:51:09.345 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mon-2:19.0.0-2868.gc3c87ed0.el9.x86_64 8/198 2024-04-16T15:51:09.346 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-osd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 9/198 2024-04-16T15:51:09.346 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-radosgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 10/198 2024-04-16T15:51:09.346 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-selinux-2:19.0.0-2868.gc3c87ed0.el9.x86_64 11/198 2024-04-16T15:51:09.346 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-test-2:19.0.0-2868.gc3c87ed0.el9.x86_64 12/198 2024-04-16T15:51:09.346 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : cephfs-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 13/198 2024-04-16T15:51:09.346 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : cephfs-shell-2:19.0.0-2868.gc3c87ed0.el9.x86_64 14/198 2024-04-16T15:51:09.346 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libcephfs-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_ 15/198 2024-04-16T15:51:09.346 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libcephfs2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 16/198 2024-04-16T15:51:09.346 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libcephsqlite-2:19.0.0-2868.gc3c87ed0.el9.x86_64 17/198 2024-04-16T15:51:09.346 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librados-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_6 18/198 2024-04-16T15:51:09.346 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libradosstriper1-2:19.0.0-2868.gc3c87ed0.el9.x86 19/198 2024-04-16T15:51:09.346 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librgw2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 20/198 2024-04-16T15:51:09.346 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2868.gc3c87ed0.el 21/198 2024-04-16T15:51:09.346 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-ceph-common-2:19.0.0-2868.gc3c87ed0.el9. 22/198 2024-04-16T15:51:09.347 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cephfs-2:19.0.0-2868.gc3c87ed0.el9.x86_6 23/198 2024-04-16T15:51:09.347 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rados-2:19.0.0-2868.gc3c87ed0.el9.x86_64 24/198 2024-04-16T15:51:09.347 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 25/198 2024-04-16T15:51:09.347 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 26/198 2024-04-16T15:51:09.347 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : rbd-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 27/198 2024-04-16T15:51:09.363 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : rbd-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 28/198 2024-04-16T15:51:09.363 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : rbd-nbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 29/198 2024-04-16T15:51:09.363 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2868.gc3c87ed0. 30/198 2024-04-16T15:51:09.363 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2868.gc3c87ed0.el9.noa 31/198 2024-04-16T15:51:09.363 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2868.gc3c87ed0.el9.n 32/198 2024-04-16T15:51:09.363 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2868.gc3c 33/198 2024-04-16T15:51:09.363 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2868.gc3c87ed0.el 34/198 2024-04-16T15:51:09.363 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2868.gc3c87ed0.el9.noarch 35/198 2024-04-16T15:51:09.363 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2868.gc3c87ed0.e 36/198 2024-04-16T15:51:09.363 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-volume-2:19.0.0-2868.gc3c87ed0.el9.noarch 37/198 2024-04-16T15:51:09.363 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 38/198 2024-04-16T15:51:09.364 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : cephfs-top-2:19.0.0-2868.gc3c87ed0.el9.noarch 39/198 2024-04-16T15:51:09.364 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-04-16T15:51:09.364 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-04-16T15:51:09.364 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-04-16T15:51:09.364 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-04-16T15:51:09.364 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-04-16T15:51:09.364 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-04-16T15:51:09.364 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-04-16T15:51:09.364 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-04-16T15:51:09.364 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-04-16T15:51:09.364 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-04-16T15:51:09.364 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-04-16T15:51:09.364 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-04-16T15:51:09.364 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-04-16T15:51:09.365 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-04-16T15:51:09.365 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-04-16T15:51:09.365 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-04-16T15:51:09.365 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-04-16T15:51:09.365 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-04-16T15:51:09.365 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : postgresql-13.14-1.el9.x86_64 58/198 2024-04-16T15:51:09.365 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 59/198 2024-04-16T15:51:09.365 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 60/198 2024-04-16T15:51:09.365 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 61/198 2024-04-16T15:51:09.365 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-04-16T15:51:09.365 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-04-16T15:51:09.366 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-04-16T15:51:09.366 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-04-16T15:51:09.366 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-04-16T15:51:09.366 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-04-16T15:51:09.366 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-04-16T15:51:09.366 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-04-16T15:51:09.366 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-04-16T15:51:09.366 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-04-16T15:51:09.366 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-04-16T15:51:09.366 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-04-16T15:51:09.366 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-04-16T15:51:09.366 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-04-16T15:51:09.366 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-04-16T15:51:09.367 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-04-16T15:51:09.367 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-04-16T15:51:09.367 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-04-16T15:51:09.367 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-04-16T15:51:09.367 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-04-16T15:51:09.367 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 82/198 2024-04-16T15:51:09.367 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 83/198 2024-04-16T15:51:09.367 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 84/198 2024-04-16T15:51:09.367 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 85/198 2024-04-16T15:51:09.367 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 86/198 2024-04-16T15:51:09.367 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 87/198 2024-04-16T15:51:09.367 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 88/198 2024-04-16T15:51:09.367 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 89/198 2024-04-16T15:51:09.367 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 90/198 2024-04-16T15:51:09.367 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 91/198 2024-04-16T15:51:09.368 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-ply-3.11-14.el9.noarch 92/198 2024-04-16T15:51:09.368 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 93/198 2024-04-16T15:51:09.368 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 94/198 2024-04-16T15:51:09.368 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : jq-1.6-16.el9.x86_64 95/198 2024-04-16T15:51:09.368 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 96/198 2024-04-16T15:51:09.368 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 97/198 2024-04-16T15:51:09.368 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 98/198 2024-04-16T15:51:09.368 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 99/198 2024-04-16T15:51:09.368 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 100/198 2024-04-16T15:51:09.368 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 101/198 2024-04-16T15:51:09.368 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 102/198 2024-04-16T15:51:09.368 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 103/198 2024-04-16T15:51:09.368 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-04-16T15:51:09.368 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-04-16T15:51:09.369 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-04-16T15:51:09.369 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-04-16T15:51:09.369 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-04-16T15:51:09.369 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-04-16T15:51:09.369 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-04-16T15:51:09.369 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-04-16T15:51:09.369 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-04-16T15:51:09.369 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-04-16T15:51:09.369 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-04-16T15:51:09.369 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-04-16T15:51:09.369 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-04-16T15:51:09.369 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-04-16T15:51:09.369 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-04-16T15:51:09.369 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-04-16T15:51:09.370 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-04-16T15:51:09.370 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-04-16T15:51:09.370 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-04-16T15:51:09.370 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-04-16T15:51:09.370 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-04-16T15:51:09.370 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-04-16T15:51:09.370 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-04-16T15:51:09.370 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-04-16T15:51:09.370 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-04-16T15:51:09.370 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-04-16T15:51:09.370 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-04-16T15:51:09.370 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-04-16T15:51:09.370 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-04-16T15:51:09.370 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-04-16T15:51:09.370 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-04-16T15:51:09.371 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-04-16T15:51:09.371 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-04-16T15:51:09.371 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-04-16T15:51:09.371 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-04-16T15:51:09.371 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-04-16T15:51:09.371 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-04-16T15:51:09.371 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-04-16T15:51:09.371 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-04-16T15:51:09.371 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-04-16T15:51:09.371 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-04-16T15:51:09.371 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-04-16T15:51:09.371 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-04-16T15:51:09.371 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-04-16T15:51:09.371 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-04-16T15:51:09.372 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-04-16T15:51:09.372 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-04-16T15:51:09.372 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librados2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 151/198 2024-04-16T15:51:09.372 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-04-16T15:51:09.372 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librbd1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 153/198 2024-04-16T15:51:09.372 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-04-16T15:51:09.372 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 155/198 2024-04-16T15:51:09.372 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 156/198 2024-04-16T15:51:09.372 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 157/198 2024-04-16T15:51:09.372 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/198 2024-04-16T15:51:09.372 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 159/198 2024-04-16T15:51:09.372 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 160/198 2024-04-16T15:51:09.372 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 161/198 2024-04-16T15:51:09.372 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 162/198 2024-04-16T15:51:09.373 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 163/198 2024-04-16T15:51:09.373 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 164/198 2024-04-16T15:51:09.373 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-04-16T15:51:09.373 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-04-16T15:51:09.373 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-04-16T15:51:09.373 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-04-16T15:51:09.373 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-04-16T15:51:09.373 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-04-16T15:51:09.373 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-04-16T15:51:09.373 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-04-16T15:51:09.373 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-04-16T15:51:09.373 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-04-16T15:51:09.374 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-04-16T15:51:09.374 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-04-16T15:51:09.374 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-04-16T15:51:09.374 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-04-16T15:51:09.374 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-04-16T15:51:09.374 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-04-16T15:51:09.374 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-04-16T15:51:09.374 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-04-16T15:51:09.374 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-04-16T15:51:09.374 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-04-16T15:51:09.374 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-04-16T15:51:09.374 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-04-16T15:51:09.374 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-04-16T15:51:09.374 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-04-16T15:51:09.375 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-04-16T15:51:09.375 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-04-16T15:51:09.375 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-04-16T15:51:09.375 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-04-16T15:51:09.375 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-04-16T15:51:09.375 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-04-16T15:51:09.375 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-04-16T15:51:09.375 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-04-16T15:51:09.375 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-04-16T15:51:12.392 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-04-16T15:51:12.392 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-16T15:51:12.392 INFO:teuthology.orchestra.run.smithi179.stdout:Upgraded: 2024-04-16T15:51:12.393 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-1:1.47.4-1.el9.x86_64 2024-04-16T15:51:12.393 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 2024-04-16T15:51:12.393 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-team-1:1.47.4-1.el9.x86_64 2024-04-16T15:51:12.393 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-tui-1:1.47.4-1.el9.x86_64 2024-04-16T15:51:12.393 INFO:teuthology.orchestra.run.smithi179.stdout: acl-2.3.1-4.el9.x86_64 2024-04-16T15:51:12.393 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-04-16T15:51:12.393 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-04-16T15:51:12.393 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-04-16T15:51:12.393 INFO:teuthology.orchestra.run.smithi179.stdout: libacl-2.3.1-4.el9.x86_64 2024-04-16T15:51:12.393 INFO:teuthology.orchestra.run.smithi179.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-04-16T15:51:12.393 INFO:teuthology.orchestra.run.smithi179.stdout: libblkid-2.37.4-18.el9.x86_64 2024-04-16T15:51:12.393 INFO:teuthology.orchestra.run.smithi179.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-04-16T15:51:12.393 INFO:teuthology.orchestra.run.smithi179.stdout: libmount-2.37.4-18.el9.x86_64 2024-04-16T15:51:12.393 INFO:teuthology.orchestra.run.smithi179.stdout: librados2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:51:12.394 INFO:teuthology.orchestra.run.smithi179.stdout: librbd1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:51:12.394 INFO:teuthology.orchestra.run.smithi179.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-04-16T15:51:12.394 INFO:teuthology.orchestra.run.smithi179.stdout: libuuid-2.37.4-18.el9.x86_64 2024-04-16T15:51:12.394 INFO:teuthology.orchestra.run.smithi179.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-04-16T15:51:12.394 INFO:teuthology.orchestra.run.smithi179.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-04-16T15:51:12.394 INFO:teuthology.orchestra.run.smithi179.stdout: util-linux-2.37.4-18.el9.x86_64 2024-04-16T15:51:12.394 INFO:teuthology.orchestra.run.smithi179.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-04-16T15:51:12.394 INFO:teuthology.orchestra.run.smithi179.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-04-16T15:51:12.394 INFO:teuthology.orchestra.run.smithi179.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-04-16T15:51:12.394 INFO:teuthology.orchestra.run.smithi179.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-04-16T15:51:12.394 INFO:teuthology.orchestra.run.smithi179.stdout:Installed: 2024-04-16T15:51:12.394 INFO:teuthology.orchestra.run.smithi179.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-16T15:51:12.394 INFO:teuthology.orchestra.run.smithi179.stdout: automake-1.16.2-8.el9.noarch 2024-04-16T15:51:12.395 INFO:teuthology.orchestra.run.smithi179.stdout: bison-3.7.4-5.el9.x86_64 2024-04-16T15:51:12.395 INFO:teuthology.orchestra.run.smithi179.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-16T15:51:12.395 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:51:12.395 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-base-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:51:12.395 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:51:12.395 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:51:12.395 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-grafana-dashboards-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T15:51:12.395 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-immutable-object-cache-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:51:12.395 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mds-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:51:12.395 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:51:12.395 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T15:51:12.395 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-dashboard-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T15:51:12.395 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T15:51:12.395 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-modules-core-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T15:51:12.395 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-rook-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T15:51:12.396 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mon-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:51:12.396 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-osd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:51:12.396 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-prometheus-alerts-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T15:51:12.396 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-radosgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:51:12.396 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-selinux-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:51:12.396 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-test-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:51:12.396 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-volume-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T15:51:12.396 INFO:teuthology.orchestra.run.smithi179.stdout: cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T15:51:12.396 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:51:12.396 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-shell-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:51:12.396 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-top-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T15:51:12.396 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-16T15:51:12.396 INFO:teuthology.orchestra.run.smithi179.stdout: flex-2.6.4-9.el9.x86_64 2024-04-16T15:51:12.396 INFO:teuthology.orchestra.run.smithi179.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-16T15:51:12.397 INFO:teuthology.orchestra.run.smithi179.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-16T15:51:12.397 INFO:teuthology.orchestra.run.smithi179.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-16T15:51:12.397 INFO:teuthology.orchestra.run.smithi179.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-16T15:51:12.397 INFO:teuthology.orchestra.run.smithi179.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-16T15:51:12.397 INFO:teuthology.orchestra.run.smithi179.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-16T15:51:12.397 INFO:teuthology.orchestra.run.smithi179.stdout: jq-1.6-16.el9.x86_64 2024-04-16T15:51:12.397 INFO:teuthology.orchestra.run.smithi179.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-16T15:51:12.397 INFO:teuthology.orchestra.run.smithi179.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-16T15:51:12.397 INFO:teuthology.orchestra.run.smithi179.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-16T15:51:12.397 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:51:12.397 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:51:12.397 INFO:teuthology.orchestra.run.smithi179.stdout: libcephsqlite-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:51:12.397 INFO:teuthology.orchestra.run.smithi179.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-16T15:51:12.397 INFO:teuthology.orchestra.run.smithi179.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-16T15:51:12.397 INFO:teuthology.orchestra.run.smithi179.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-16T15:51:12.398 INFO:teuthology.orchestra.run.smithi179.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-16T15:51:12.398 INFO:teuthology.orchestra.run.smithi179.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-16T15:51:12.398 INFO:teuthology.orchestra.run.smithi179.stdout: librados-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:51:12.398 INFO:teuthology.orchestra.run.smithi179.stdout: libradosstriper1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:51:12.398 INFO:teuthology.orchestra.run.smithi179.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-16T15:51:12.398 INFO:teuthology.orchestra.run.smithi179.stdout: librgw2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:51:12.398 INFO:teuthology.orchestra.run.smithi179.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-16T15:51:12.398 INFO:teuthology.orchestra.run.smithi179.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-16T15:51:12.398 INFO:teuthology.orchestra.run.smithi179.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-16T15:51:12.398 INFO:teuthology.orchestra.run.smithi179.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-16T15:51:12.398 INFO:teuthology.orchestra.run.smithi179.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-16T15:51:12.398 INFO:teuthology.orchestra.run.smithi179.stdout: lua-5.4.4-4.el9.x86_64 2024-04-16T15:51:12.398 INFO:teuthology.orchestra.run.smithi179.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-16T15:51:12.398 INFO:teuthology.orchestra.run.smithi179.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-16T15:51:12.399 INFO:teuthology.orchestra.run.smithi179.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-16T15:51:12.399 INFO:teuthology.orchestra.run.smithi179.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-16T15:51:12.399 INFO:teuthology.orchestra.run.smithi179.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-16T15:51:12.399 INFO:teuthology.orchestra.run.smithi179.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-16T15:51:12.399 INFO:teuthology.orchestra.run.smithi179.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-16T15:51:12.399 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-13.14-1.el9.x86_64 2024-04-16T15:51:12.399 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-16T15:51:12.399 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-16T15:51:12.399 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-16T15:51:12.399 INFO:teuthology.orchestra.run.smithi179.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-16T15:51:12.399 INFO:teuthology.orchestra.run.smithi179.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-16T15:51:12.399 INFO:teuthology.orchestra.run.smithi179.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-16T15:51:12.399 INFO:teuthology.orchestra.run.smithi179.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-16T15:51:12.399 INFO:teuthology.orchestra.run.smithi179.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-16T15:51:12.399 INFO:teuthology.orchestra.run.smithi179.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-16T15:51:12.399 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-16T15:51:12.399 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-argparse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:51:12.400 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:51:12.400 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cephfs-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:51:12.400 INFO:teuthology.orchestra.run.smithi179.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-16T15:51:12.400 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-16T15:51:12.400 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-16T15:51:12.400 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-16T15:51:12.400 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-16T15:51:12.400 INFO:teuthology.orchestra.run.smithi179.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-16T15:51:12.400 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-16T15:51:12.400 INFO:teuthology.orchestra.run.smithi179.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-16T15:51:12.400 INFO:teuthology.orchestra.run.smithi179.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-16T15:51:12.400 INFO:teuthology.orchestra.run.smithi179.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-16T15:51:12.400 INFO:teuthology.orchestra.run.smithi179.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-16T15:51:12.400 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-16T15:51:12.400 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-16T15:51:12.401 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-16T15:51:12.401 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-16T15:51:12.401 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-16T15:51:12.401 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-16T15:51:12.401 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-16T15:51:12.401 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-16T15:51:12.401 INFO:teuthology.orchestra.run.smithi179.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-16T15:51:12.401 INFO:teuthology.orchestra.run.smithi179.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-16T15:51:12.401 INFO:teuthology.orchestra.run.smithi179.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-16T15:51:12.401 INFO:teuthology.orchestra.run.smithi179.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-16T15:51:12.401 INFO:teuthology.orchestra.run.smithi179.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-16T15:51:12.401 INFO:teuthology.orchestra.run.smithi179.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-16T15:51:12.401 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-16T15:51:12.401 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-16T15:51:12.401 INFO:teuthology.orchestra.run.smithi179.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-16T15:51:12.401 INFO:teuthology.orchestra.run.smithi179.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-16T15:51:12.402 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-16T15:51:12.402 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ply-3.11-14.el9.noarch 2024-04-16T15:51:12.402 INFO:teuthology.orchestra.run.smithi179.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-16T15:51:12.402 INFO:teuthology.orchestra.run.smithi179.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-16T15:51:12.402 INFO:teuthology.orchestra.run.smithi179.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-16T15:51:12.402 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-16T15:51:12.402 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-16T15:51:12.402 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-16T15:51:12.402 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-16T15:51:12.402 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-16T15:51:12.402 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-16T15:51:12.402 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rados-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:51:12.402 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:51:12.403 INFO:teuthology.orchestra.run.smithi179.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-16T15:51:12.403 INFO:teuthology.orchestra.run.smithi179.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-16T15:51:12.403 INFO:teuthology.orchestra.run.smithi179.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-16T15:51:12.403 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:51:12.403 INFO:teuthology.orchestra.run.smithi179.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-16T15:51:12.403 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-16T15:51:12.403 INFO:teuthology.orchestra.run.smithi179.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-16T15:51:12.403 INFO:teuthology.orchestra.run.smithi179.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-16T15:51:12.403 INFO:teuthology.orchestra.run.smithi179.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-16T15:51:12.403 INFO:teuthology.orchestra.run.smithi179.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-16T15:51:12.403 INFO:teuthology.orchestra.run.smithi179.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-16T15:51:12.403 INFO:teuthology.orchestra.run.smithi179.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-16T15:51:12.403 INFO:teuthology.orchestra.run.smithi179.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-16T15:51:12.403 INFO:teuthology.orchestra.run.smithi179.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-16T15:51:12.404 INFO:teuthology.orchestra.run.smithi179.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-16T15:51:12.404 INFO:teuthology.orchestra.run.smithi179.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-16T15:51:12.404 INFO:teuthology.orchestra.run.smithi179.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-16T15:51:12.404 INFO:teuthology.orchestra.run.smithi179.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-16T15:51:12.404 INFO:teuthology.orchestra.run.smithi179.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-16T15:51:12.404 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:51:12.404 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:51:12.404 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-nbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:51:12.404 INFO:teuthology.orchestra.run.smithi179.stdout: re2-1:20211101-3.el9.x86_64 2024-04-16T15:51:12.404 INFO:teuthology.orchestra.run.smithi179.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-16T15:51:12.404 INFO:teuthology.orchestra.run.smithi179.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-16T15:51:12.404 INFO:teuthology.orchestra.run.smithi179.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-16T15:51:12.404 INFO:teuthology.orchestra.run.smithi179.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-16T15:51:12.404 INFO:teuthology.orchestra.run.smithi179.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-16T15:51:12.405 INFO:teuthology.orchestra.run.smithi179.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-04-16T15:51:12.405 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-16T15:51:12.405 INFO:teuthology.orchestra.run.smithi179.stdout:Complete! 2024-04-16T15:51:12.885 DEBUG:teuthology.parallel:result is None 2024-04-16T15:51:12.885 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f 2024-04-16T15:51:13.120 DEBUG:teuthology.orchestra.run.smithi132:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-16T15:51:13.146 INFO:teuthology.orchestra.run.smithi132.stdout:19.0.0-2868.gc3c87ed0.el9 2024-04-16T15:51:13.147 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2868.gc3c87ed0.el9 2024-04-16T15:51:13.147 INFO:teuthology.task.install:The correct ceph version 19.0.0-2868.gc3c87ed0 is installed. 2024-04-16T15:51:13.149 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f 2024-04-16T15:51:13.286 DEBUG:teuthology.orchestra.run.smithi179:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-16T15:51:13.309 INFO:teuthology.orchestra.run.smithi179.stdout:19.0.0-2868.gc3c87ed0.el9 2024-04-16T15:51:13.309 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2868.gc3c87ed0.el9 2024-04-16T15:51:13.310 INFO:teuthology.task.install:The correct ceph version 19.0.0-2868.gc3c87ed0 is installed. 2024-04-16T15:51:13.311 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-16T15:51:13.311 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-16T15:51:13.312 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-16T15:51:13.348 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-16T15:51:13.348 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-16T15:51:13.381 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-16T15:51:13.381 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-16T15:51:13.381 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/usr/bin/daemon-helper 2024-04-16T15:51:13.432 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-16T15:51:13.503 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-16T15:51:13.503 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/daemon-helper 2024-04-16T15:51:13.531 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-16T15:51:13.600 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-16T15:51:13.600 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-16T15:51:13.600 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-16T15:51:13.629 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-16T15:51:13.698 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-16T15:51:13.699 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-16T15:51:13.727 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-16T15:51:13.797 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-16T15:51:13.797 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-16T15:51:13.797 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/usr/bin/stdin-killer 2024-04-16T15:51:13.827 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-16T15:51:13.896 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-16T15:51:13.896 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/stdin-killer 2024-04-16T15:51:13.924 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-16T15:51:13.992 INFO:teuthology.run_tasks:Running task ceph... 2024-04-16T15:51:14.079 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-16T15:51:14.079 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 777 /var/log/ceph 2024-04-16T15:51:14.082 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 777 /var/log/ceph 2024-04-16T15:51:14.110 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-16T15:51:14.110 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-16T15:51:14.152 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-16T15:51:14.180 INFO:tasks.ceph:Creating extra log directories... 2024-04-16T15:51:14.180 DEBUG:teuthology.orchestra.run.smithi132:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-16T15:51:14.220 DEBUG:teuthology.orchestra.run.smithi179:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-16T15:51:14.256 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-16T15:51:14.256 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-16T15:51:14.256 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-16T15:51:14.256 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-16T15:51:14.256 DEBUG:teuthology.orchestra.run.smithi132:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-16T15:51:14.301 DEBUG:teuthology.orchestra.run.smithi132:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-16T15:51:14.423 DEBUG:teuthology.orchestra.run.smithi132:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-16T15:51:14.452 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-16T15:51:14.452 DEBUG:teuthology.orchestra.run.smithi179:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-16T15:51:14.468 DEBUG:teuthology.orchestra.run.smithi179:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-16T15:51:14.589 DEBUG:teuthology.orchestra.run.smithi179:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-16T15:51:14.625 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-16T15:51:14.625 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds debug zombie log segments': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'bad backtrace', 'object missing on disk', 'error reading table object', 'error reading sessionmap', 'unmatched fragstat', 'unmatched rstat', 'was unreadable, recreating it now', 'Scrub error on inode', 'Metadata damage detected', 'inconsistent rstat on inode', 'Error recovering journal'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-16T15:51:14.625 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658194', 'branch': 'wip-lusov-shared-log-segment', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/data-scan}', 'email': None, 'first_in_suite': False, 'job_id': '7658194', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-lusov-shared-log-segment'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds debug zombie log segments': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'bad backtrace', 'object missing on disk', 'error reading table object', 'error reading sessionmap', 'unmatched fragstat', 'unmatched rstat', 'was unreadable, recreating it now', 'Scrub error on inode', 'Metadata damage detected', 'inconsistent rstat on inode', 'Error recovering journal'], 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 1, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-lusov-shared-log-segment', 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f'}}, 'owner': 'scheduled_leonidus@teuthology', 'priority': 150, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 2402, 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f', 'sleep_before_teardown': 0, 'subset': '111/111111', 'suite': 'fs', 'suite_branch': 'wip-lusov-shared-log-segment', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi132.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAGj1FBv5Iz75YFDuKEeyyv9NisIeN5NXdeIU6xePcTbrrspfcfZHUhQoySDhYSrWiff4Iq9J99v+k6vPUzdFKs=', 'smithi179.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHGVpO59jxMDWCP3+d0/e01NXo1IE7S+xrBA/n/ovpbSdnwveoUOXumEksFbgCLNGQEvKpCY6McCzibhsq/UleA='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds debug zombie log segments': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'bad backtrace', 'object missing on disk', 'error reading table object', 'error reading sessionmap', 'unmatched fragstat', 'unmatched rstat', 'was unreadable, recreating it now', 'Scrub error on inode', 'Metadata damage detected', 'inconsistent rstat on inode', 'Error recovering journal'], 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_data_scan']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '6c637841c215537a4502385240412f1966e0faab', 'timestamp': '2024-04-16_12:36:42', 'tube': 'smithi', 'user': 'leonidus', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-16T15:51:14.626 DEBUG:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-16T15:51:14.628 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-16T15:51:14.674 DEBUG:teuthology.orchestra.run.smithi132:> sudo install -d -m0777 -- /var/run/ceph 2024-04-16T15:51:14.684 DEBUG:teuthology.orchestra.run.smithi179:> sudo install -d -m0777 -- /var/run/ceph 2024-04-16T15:51:14.742 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-16T15:51:14.743 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/scratch_devs of=/dev/stdout 2024-04-16T15:51:14.766 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-16T15:51:14.767 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_1 2024-04-16T15:51:14.822 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-16T15:51:14.823 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T15:51:14.823 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-04-16T15:51:14.823 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T15:51:14.823 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T15:51:14.823 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2024-04-16 15:50:51.377134993 +0000 2024-04-16T15:51:14.823 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2024-04-16 15:48:48.551864363 +0000 2024-04-16T15:51:14.823 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2024-04-16 15:48:48.551864363 +0000 2024-04-16T15:51:14.823 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: 2024-04-16 15:48:48.551864363 +0000 2024-04-16T15:51:14.823 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-16T15:51:14.890 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2024-04-16T15:51:14.890 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2024-04-16T15:51:14.890 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000184216 s, 2.8 MB/s 2024-04-16T15:51:14.891 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-16T15:51:14.947 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_2 2024-04-16T15:51:15.003 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-16T15:51:15.003 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T15:51:15.003 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-04-16T15:51:15.003 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T15:51:15.003 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T15:51:15.003 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2024-04-16 15:50:51.378134967 +0000 2024-04-16T15:51:15.003 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2024-04-16 15:48:48.902855271 +0000 2024-04-16T15:51:15.004 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2024-04-16 15:48:48.902855271 +0000 2024-04-16T15:51:15.004 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: 2024-04-16 15:48:48.902855271 +0000 2024-04-16T15:51:15.004 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-16T15:51:15.071 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2024-04-16T15:51:15.071 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2024-04-16T15:51:15.071 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000183443 s, 2.8 MB/s 2024-04-16T15:51:15.072 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-16T15:51:15.129 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_3 2024-04-16T15:51:15.184 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-16T15:51:15.185 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T15:51:15.185 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-04-16T15:51:15.185 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T15:51:15.185 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T15:51:15.185 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2024-04-16 15:50:51.378134967 +0000 2024-04-16T15:51:15.185 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2024-04-16 15:48:49.248846309 +0000 2024-04-16T15:51:15.185 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2024-04-16 15:48:49.248846309 +0000 2024-04-16T15:51:15.185 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: 2024-04-16 15:48:49.248846309 +0000 2024-04-16T15:51:15.185 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-16T15:51:15.251 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2024-04-16T15:51:15.252 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2024-04-16T15:51:15.252 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000176103 s, 2.9 MB/s 2024-04-16T15:51:15.253 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-16T15:51:15.309 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_4 2024-04-16T15:51:15.364 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-16T15:51:15.364 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T15:51:15.364 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-04-16T15:51:15.364 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T15:51:15.364 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T15:51:15.364 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2024-04-16 15:50:51.379134941 +0000 2024-04-16T15:51:15.364 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2024-04-16 15:48:49.581837684 +0000 2024-04-16T15:51:15.364 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2024-04-16 15:48:49.581837684 +0000 2024-04-16T15:51:15.364 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: 2024-04-16 15:48:49.581837684 +0000 2024-04-16T15:51:15.365 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-16T15:51:15.431 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2024-04-16T15:51:15.431 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2024-04-16T15:51:15.431 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000238384 s, 2.1 MB/s 2024-04-16T15:51:15.432 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-16T15:51:15.489 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-16T15:51:15.489 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-16T15:51:15.489 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/scratch_devs of=/dev/stdout 2024-04-16T15:51:15.509 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-16T15:51:15.510 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_1 2024-04-16T15:51:15.568 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-16T15:51:15.568 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T15:51:15.568 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-04-16T15:51:15.568 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T15:51:15.569 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T15:51:15.569 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-04-16 15:51:04.030217531 +0000 2024-04-16T15:51:15.569 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-04-16 15:48:48.671396573 +0000 2024-04-16T15:51:15.569 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-04-16 15:48:48.671396573 +0000 2024-04-16T15:51:15.569 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: 2024-04-16 15:48:48.671396573 +0000 2024-04-16T15:51:15.569 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-16T15:51:15.638 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-04-16T15:51:15.639 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-04-16T15:51:15.639 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000272808 s, 1.9 MB/s 2024-04-16T15:51:15.640 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-16T15:51:15.698 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_2 2024-04-16T15:51:15.755 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-16T15:51:15.755 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T15:51:15.755 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-04-16T15:51:15.755 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T15:51:15.755 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T15:51:15.755 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-04-16 15:51:04.030217531 +0000 2024-04-16T15:51:15.755 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-04-16 15:48:49.019388994 +0000 2024-04-16T15:51:15.755 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-04-16 15:48:49.019388994 +0000 2024-04-16T15:51:15.755 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: 2024-04-16 15:48:49.019388994 +0000 2024-04-16T15:51:15.756 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-16T15:51:15.823 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-04-16T15:51:15.823 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-04-16T15:51:15.823 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000205587 s, 2.5 MB/s 2024-04-16T15:51:15.824 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-16T15:51:15.882 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_3 2024-04-16T15:51:15.938 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-16T15:51:15.938 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T15:51:15.938 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-04-16T15:51:15.938 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T15:51:15.938 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T15:51:15.938 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-04-16 15:51:04.031217510 +0000 2024-04-16T15:51:15.938 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-04-16 15:48:49.376381219 +0000 2024-04-16T15:51:15.938 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-04-16 15:48:49.376381219 +0000 2024-04-16T15:51:15.938 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: 2024-04-16 15:48:49.376381219 +0000 2024-04-16T15:51:15.939 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-16T15:51:16.005 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-04-16T15:51:16.005 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-04-16T15:51:16.006 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000192563 s, 2.7 MB/s 2024-04-16T15:51:16.007 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-16T15:51:16.064 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_4 2024-04-16T15:51:16.119 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-16T15:51:16.120 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T15:51:16.120 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-04-16T15:51:16.120 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T15:51:16.120 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T15:51:16.120 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-04-16 15:51:04.031217510 +0000 2024-04-16T15:51:16.120 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-04-16 15:48:49.716373813 +0000 2024-04-16T15:51:16.120 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-04-16 15:48:49.716373813 +0000 2024-04-16T15:51:16.120 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: 2024-04-16 15:48:49.716373813 +0000 2024-04-16T15:51:16.120 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-16T15:51:16.186 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-04-16T15:51:16.187 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-04-16T15:51:16.187 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000163339 s, 3.1 MB/s 2024-04-16T15:51:16.188 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-16T15:51:16.244 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-16T15:51:16.245 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi132.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi179.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-16T15:51:16.245 INFO:tasks.ceph:Generating config... 2024-04-16T15:51:16.246 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-16T15:51:16.246 INFO:tasks.ceph:[client] debug client = 20 2024-04-16T15:51:16.246 INFO:tasks.ceph:[client] debug ms = 1 2024-04-16T15:51:16.246 INFO:tasks.ceph:[client] pid file = 2024-04-16T15:51:16.246 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-16T15:51:16.246 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-16T15:51:16.246 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-16T15:51:16.246 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-16T15:51:16.246 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-16T15:51:16.246 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-16T15:51:16.246 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-16T15:51:16.247 INFO:tasks.ceph:[mds] mds debug zombie log segments = True 2024-04-16T15:51:16.247 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-16T15:51:16.247 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-16T15:51:16.247 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-16T15:51:16.247 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-16T15:51:16.247 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-16T15:51:16.247 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-16T15:51:16.247 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-16T15:51:16.247 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-16T15:51:16.247 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-16T15:51:16.247 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-16T15:51:16.247 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-16T15:51:16.247 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-16T15:51:16.247 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-16T15:51:16.247 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-16T15:51:16.247 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-16T15:51:16.248 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-16T15:51:16.248 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-16T15:51:16.248 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-16T15:51:16.248 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-16T15:51:16.248 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-16T15:51:16.248 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-16T15:51:16.248 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-16T15:51:16.248 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-16T15:51:16.248 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-16T15:51:16.248 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-16T15:51:16.248 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-16T15:51:16.248 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-16T15:51:16.248 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-16T15:51:16.248 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-16T15:51:16.249 INFO:tasks.ceph:Setting up mon.a... 2024-04-16T15:51:16.249 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-16T15:51:16.306 INFO:teuthology.orchestra.run.smithi132.stdout:creating /etc/ceph/ceph.keyring 2024-04-16T15:51:16.308 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-16T15:51:16.355 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-16T15:51:16.383 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.132'), ('mon.b', '172.21.15.179'), ('mon.c', '[v2:172.21.15.179:3301,v1:172.21.15.179:6790]')] 2024-04-16T15:51:16.383 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.132,172.21.15.179,[v2:172.21.15.179:3301,v1:172.21.15.179:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds debug zombie log segments': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-16T15:51:16.384 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-16T15:51:16.384 DEBUG:teuthology.orchestra.run.smithi132:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-16T15:51:16.438 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.132 --add b 172.21.15.179 --addv c '[v2:172.21.15.179:3301,v1:172.21.15.179:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-16T15:51:16.523 INFO:teuthology.orchestra.run.smithi132.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-16T15:51:16.524 INFO:teuthology.orchestra.run.smithi132.stdout:monmaptool: generated fsid 6bdec5d9-f406-43ad-8584-0503b32f6f0d 2024-04-16T15:51:16.524 INFO:teuthology.orchestra.run.smithi132.stdout:setting min_mon_release = quincy 2024-04-16T15:51:16.524 INFO:teuthology.orchestra.run.smithi132.stdout:epoch 0 2024-04-16T15:51:16.524 INFO:teuthology.orchestra.run.smithi132.stdout:fsid 6bdec5d9-f406-43ad-8584-0503b32f6f0d 2024-04-16T15:51:16.524 INFO:teuthology.orchestra.run.smithi132.stdout:last_changed 2024-04-16T15:51:16.525848+0000 2024-04-16T15:51:16.524 INFO:teuthology.orchestra.run.smithi132.stdout:created 2024-04-16T15:51:16.525848+0000 2024-04-16T15:51:16.524 INFO:teuthology.orchestra.run.smithi132.stdout:min_mon_release 17 (quincy) 2024-04-16T15:51:16.524 INFO:teuthology.orchestra.run.smithi132.stdout:election_strategy: 1 2024-04-16T15:51:16.524 INFO:teuthology.orchestra.run.smithi132.stdout:0: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.a 2024-04-16T15:51:16.524 INFO:teuthology.orchestra.run.smithi132.stdout:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-04-16T15:51:16.525 INFO:teuthology.orchestra.run.smithi132.stdout:2: [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] mon.c 2024-04-16T15:51:16.525 INFO:teuthology.orchestra.run.smithi132.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-16T15:51:16.526 DEBUG:teuthology.orchestra.run.smithi132:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-16T15:51:16.540 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 6bdec5d9-f406-43ad-8584-0503b32f6f0d... 2024-04-16T15:51:16.541 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-16T15:51:16.583 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-16T15:51:16.634 INFO:teuthology.orchestra.run.smithi132.stdout:[global] 2024-04-16T15:51:16.634 INFO:teuthology.orchestra.run.smithi132.stdout: chdir = "" 2024-04-16T15:51:16.634 INFO:teuthology.orchestra.run.smithi132.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-16T15:51:16.634 INFO:teuthology.orchestra.run.smithi132.stdout: auth supported = cephx 2024-04-16T15:51:16.634 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:51:16.634 INFO:teuthology.orchestra.run.smithi132.stdout: filestore xattr use omap = true 2024-04-16T15:51:16.634 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:51:16.634 INFO:teuthology.orchestra.run.smithi132.stdout: mon clock drift allowed = 1.000 2024-04-16T15:51:16.635 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:51:16.635 INFO:teuthology.orchestra.run.smithi132.stdout: osd crush chooseleaf type = 0 2024-04-16T15:51:16.635 INFO:teuthology.orchestra.run.smithi132.stdout: auth debug = true 2024-04-16T15:51:16.635 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:51:16.635 INFO:teuthology.orchestra.run.smithi132.stdout: ms die on old message = true 2024-04-16T15:51:16.635 INFO:teuthology.orchestra.run.smithi132.stdout: ms die on bug = true 2024-04-16T15:51:16.635 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:51:16.635 INFO:teuthology.orchestra.run.smithi132.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-16T15:51:16.635 INFO:teuthology.orchestra.run.smithi132.stdout: mon pg warn max object skew = 0 2024-04-16T15:51:16.635 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:51:16.635 INFO:teuthology.orchestra.run.smithi132.stdout: # disable pg_autoscaler by default for new pools 2024-04-16T15:51:16.635 INFO:teuthology.orchestra.run.smithi132.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-16T15:51:16.635 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:51:16.635 INFO:teuthology.orchestra.run.smithi132.stdout: osd pool default size = 2 2024-04-16T15:51:16.636 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:51:16.636 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd allow primary affinity = true 2024-04-16T15:51:16.636 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd allow pg remap = true 2024-04-16T15:51:16.636 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on legacy crush tunables = false 2024-04-16T15:51:16.636 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on crush straw calc version zero = false 2024-04-16T15:51:16.636 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on no sortbitwise = false 2024-04-16T15:51:16.636 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on osd down out interval zero = false 2024-04-16T15:51:16.636 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on too few osds = false 2024-04-16T15:51:16.636 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-16T15:51:16.636 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-16T15:51:16.636 INFO:teuthology.orchestra.run.smithi132.stdout: mon_allow_pool_size_one = true 2024-04-16T15:51:16.636 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:51:16.636 INFO:teuthology.orchestra.run.smithi132.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-16T15:51:16.636 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:51:16.637 INFO:teuthology.orchestra.run.smithi132.stdout: osd default data pool replay window = 5 2024-04-16T15:51:16.637 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:51:16.637 INFO:teuthology.orchestra.run.smithi132.stdout: mon allow pool delete = true 2024-04-16T15:51:16.637 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:51:16.637 INFO:teuthology.orchestra.run.smithi132.stdout: mon cluster log file level = debug 2024-04-16T15:51:16.637 INFO:teuthology.orchestra.run.smithi132.stdout: debug asserts on shutdown = true 2024-04-16T15:51:16.637 INFO:teuthology.orchestra.run.smithi132.stdout: mon health detail to clog = false 2024-04-16T15:51:16.637 INFO:teuthology.orchestra.run.smithi132.stdout: mon host = "172.21.15.132,172.21.15.179,[v2:172.21.15.179:3301,v1:172.21.15.179:6790]" 2024-04-16T15:51:16.637 INFO:teuthology.orchestra.run.smithi132.stdout: fsid = 6bdec5d9-f406-43ad-8584-0503b32f6f0d 2024-04-16T15:51:16.637 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:51:16.637 INFO:teuthology.orchestra.run.smithi132.stdout:[osd] 2024-04-16T15:51:16.637 INFO:teuthology.orchestra.run.smithi132.stdout: osd journal size = 100 2024-04-16T15:51:16.637 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:51:16.637 INFO:teuthology.orchestra.run.smithi132.stdout: osd scrub load threshold = 5.0 2024-04-16T15:51:16.638 INFO:teuthology.orchestra.run.smithi132.stdout: osd scrub max interval = 600 2024-04-16T15:51:16.638 INFO:teuthology.orchestra.run.smithi132.stdout: osd mclock profile = high_recovery_ops 2024-04-16T15:51:16.638 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:51:16.638 INFO:teuthology.orchestra.run.smithi132.stdout: osd recover clone overlap = true 2024-04-16T15:51:16.638 INFO:teuthology.orchestra.run.smithi132.stdout: osd recovery max chunk = 1048576 2024-04-16T15:51:16.638 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:51:16.638 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug shutdown = true 2024-04-16T15:51:16.638 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug op order = true 2024-04-16T15:51:16.638 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug verify stray on activate = true 2024-04-16T15:51:16.638 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug trim objects = true 2024-04-16T15:51:16.638 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:51:16.638 INFO:teuthology.orchestra.run.smithi132.stdout: osd open classes on start = true 2024-04-16T15:51:16.638 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug pg log writeout = true 2024-04-16T15:51:16.638 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:51:16.639 INFO:teuthology.orchestra.run.smithi132.stdout: osd deep scrub update digest min age = 30 2024-04-16T15:51:16.639 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:51:16.639 INFO:teuthology.orchestra.run.smithi132.stdout: osd map max advance = 10 2024-04-16T15:51:16.639 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:51:16.639 INFO:teuthology.orchestra.run.smithi132.stdout: journal zero on create = true 2024-04-16T15:51:16.639 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:51:16.639 INFO:teuthology.orchestra.run.smithi132.stdout: filestore ondisk finisher threads = 3 2024-04-16T15:51:16.639 INFO:teuthology.orchestra.run.smithi132.stdout: filestore apply finisher threads = 3 2024-04-16T15:51:16.639 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:51:16.639 INFO:teuthology.orchestra.run.smithi132.stdout: bdev debug aio = true 2024-04-16T15:51:16.639 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug misdirected ops = true 2024-04-16T15:51:16.639 INFO:teuthology.orchestra.run.smithi132.stdout: bdev async discard = True 2024-04-16T15:51:16.639 INFO:teuthology.orchestra.run.smithi132.stdout: bdev enable discard = True 2024-04-16T15:51:16.640 INFO:teuthology.orchestra.run.smithi132.stdout: bluestore allocator = bitmap 2024-04-16T15:51:16.640 INFO:teuthology.orchestra.run.smithi132.stdout: bluestore block size = 96636764160 2024-04-16T15:51:16.640 INFO:teuthology.orchestra.run.smithi132.stdout: bluestore fsck on mount = True 2024-04-16T15:51:16.640 INFO:teuthology.orchestra.run.smithi132.stdout: debug bluefs = 1/20 2024-04-16T15:51:16.640 INFO:teuthology.orchestra.run.smithi132.stdout: debug bluestore = 1/20 2024-04-16T15:51:16.640 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2024-04-16T15:51:16.640 INFO:teuthology.orchestra.run.smithi132.stdout: debug osd = 20 2024-04-16T15:51:16.640 INFO:teuthology.orchestra.run.smithi132.stdout: debug rocksdb = 4/10 2024-04-16T15:51:16.640 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd backfillfull_ratio = 0.85 2024-04-16T15:51:16.640 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd full ratio = 0.9 2024-04-16T15:51:16.640 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd nearfull ratio = 0.8 2024-04-16T15:51:16.640 INFO:teuthology.orchestra.run.smithi132.stdout: osd failsafe full ratio = 0.95 2024-04-16T15:51:16.640 INFO:teuthology.orchestra.run.smithi132.stdout: osd objectstore = bluestore 2024-04-16T15:51:16.641 INFO:teuthology.orchestra.run.smithi132.stdout: osd op complaint time = 180 2024-04-16T15:51:16.641 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:51:16.641 INFO:teuthology.orchestra.run.smithi132.stdout:[mgr] 2024-04-16T15:51:16.641 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2024-04-16T15:51:16.641 INFO:teuthology.orchestra.run.smithi132.stdout: debug mgr = 20 2024-04-16T15:51:16.641 INFO:teuthology.orchestra.run.smithi132.stdout: debug mon = 20 2024-04-16T15:51:16.641 INFO:teuthology.orchestra.run.smithi132.stdout: debug auth = 20 2024-04-16T15:51:16.641 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min pgs per osd = 4 2024-04-16T15:51:16.641 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min bytes per osd = 10 2024-04-16T15:51:16.641 INFO:teuthology.orchestra.run.smithi132.stdout: mgr/telemetry/nag = false 2024-04-16T15:51:16.641 INFO:teuthology.orchestra.run.smithi132.stdout: debug client = 20 2024-04-16T15:51:16.641 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:51:16.641 INFO:teuthology.orchestra.run.smithi132.stdout:[mon] 2024-04-16T15:51:16.641 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2024-04-16T15:51:16.641 INFO:teuthology.orchestra.run.smithi132.stdout: debug mon = 20 2024-04-16T15:51:16.641 INFO:teuthology.orchestra.run.smithi132.stdout: debug paxos = 20 2024-04-16T15:51:16.642 INFO:teuthology.orchestra.run.smithi132.stdout: debug auth = 20 2024-04-16T15:51:16.642 INFO:teuthology.orchestra.run.smithi132.stdout: mon data avail warn = 5 2024-04-16T15:51:16.642 INFO:teuthology.orchestra.run.smithi132.stdout: mon mgr mkfs grace = 240 2024-04-16T15:51:16.642 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min pgs per osd = 4 2024-04-16T15:51:16.642 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd reporter subtree level = osd 2024-04-16T15:51:16.642 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd prime pg temp = true 2024-04-16T15:51:16.642 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min bytes per osd = 10 2024-04-16T15:51:16.642 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:51:16.642 INFO:teuthology.orchestra.run.smithi132.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-16T15:51:16.642 INFO:teuthology.orchestra.run.smithi132.stdout: auth mon ticket ttl = 660 # 11m 2024-04-16T15:51:16.642 INFO:teuthology.orchestra.run.smithi132.stdout: auth service ticket ttl = 240 # 4m 2024-04-16T15:51:16.642 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:51:16.642 INFO:teuthology.orchestra.run.smithi132.stdout: # don't complain about insecure global_id in the test suite 2024-04-16T15:51:16.643 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-16T15:51:16.643 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-16T15:51:16.643 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:51:16.643 INFO:teuthology.orchestra.run.smithi132.stdout: # 1m isn't quite enough 2024-04-16T15:51:16.643 INFO:teuthology.orchestra.run.smithi132.stdout: mon_down_mkfs_grace = 2m 2024-04-16T15:51:16.643 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:51:16.643 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_filestore_osds = false 2024-04-16T15:51:16.643 INFO:teuthology.orchestra.run.smithi132.stdout: mon down mkfs grace = 300 2024-04-16T15:51:16.643 INFO:teuthology.orchestra.run.smithi132.stdout: mon op complaint time = 120 2024-04-16T15:51:16.643 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:51:16.643 INFO:teuthology.orchestra.run.smithi132.stdout:[client] 2024-04-16T15:51:16.643 INFO:teuthology.orchestra.run.smithi132.stdout: rgw cache enabled = true 2024-04-16T15:51:16.643 INFO:teuthology.orchestra.run.smithi132.stdout: rgw enable ops log = true 2024-04-16T15:51:16.644 INFO:teuthology.orchestra.run.smithi132.stdout: rgw enable usage log = true 2024-04-16T15:51:16.644 INFO:teuthology.orchestra.run.smithi132.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-16T15:51:16.644 INFO:teuthology.orchestra.run.smithi132.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-16T15:51:16.644 INFO:teuthology.orchestra.run.smithi132.stdout: client mount timeout = 600 2024-04-16T15:51:16.644 INFO:teuthology.orchestra.run.smithi132.stdout: debug client = 20 2024-04-16T15:51:16.644 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2024-04-16T15:51:16.644 INFO:teuthology.orchestra.run.smithi132.stdout: pid file = "" 2024-04-16T15:51:16.644 INFO:teuthology.orchestra.run.smithi132.stdout: rados mon op timeout = 900 2024-04-16T15:51:16.644 INFO:teuthology.orchestra.run.smithi132.stdout: rados osd op timeout = 900 2024-04-16T15:51:16.644 INFO:teuthology.orchestra.run.smithi132.stdout:[mon.a] 2024-04-16T15:51:16.644 INFO:teuthology.orchestra.run.smithi132.stdout:[mon.b] 2024-04-16T15:51:16.644 INFO:teuthology.orchestra.run.smithi132.stdout:[mon.c] 2024-04-16T15:51:16.644 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.a] 2024-04-16T15:51:16.644 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.c] 2024-04-16T15:51:16.644 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.b] 2024-04-16T15:51:16.645 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.d] 2024-04-16T15:51:16.645 INFO:teuthology.orchestra.run.smithi132.stdout:[mds] 2024-04-16T15:51:16.645 INFO:teuthology.orchestra.run.smithi132.stdout: debug mds = 20 2024-04-16T15:51:16.645 INFO:teuthology.orchestra.run.smithi132.stdout: debug mds balancer = 20 2024-04-16T15:51:16.645 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2024-04-16T15:51:16.645 INFO:teuthology.orchestra.run.smithi132.stdout: mds debug frag = True 2024-04-16T15:51:16.645 INFO:teuthology.orchestra.run.smithi132.stdout: mds debug scatterstat = True 2024-04-16T15:51:16.645 INFO:teuthology.orchestra.run.smithi132.stdout: mds debug zombie log segments = True 2024-04-16T15:51:16.645 INFO:teuthology.orchestra.run.smithi132.stdout: mds op complaint time = 180 2024-04-16T15:51:16.645 INFO:teuthology.orchestra.run.smithi132.stdout: mds verify scatter = True 2024-04-16T15:51:16.645 INFO:teuthology.orchestra.run.smithi132.stdout: osd op complaint time = 180 2024-04-16T15:51:16.645 INFO:teuthology.orchestra.run.smithi132.stdout: rados mon op timeout = 900 2024-04-16T15:51:16.645 INFO:teuthology.orchestra.run.smithi132.stdout: rados osd op timeout = 900 2024-04-16T15:51:16.646 INFO:teuthology.orchestra.run.smithi179.stdout:[global] 2024-04-16T15:51:16.646 INFO:teuthology.orchestra.run.smithi179.stdout: chdir = "" 2024-04-16T15:51:16.646 INFO:teuthology.orchestra.run.smithi179.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-16T15:51:16.646 INFO:teuthology.orchestra.run.smithi179.stdout: auth supported = cephx 2024-04-16T15:51:16.646 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-16T15:51:16.646 INFO:teuthology.orchestra.run.smithi179.stdout: filestore xattr use omap = true 2024-04-16T15:51:16.646 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-16T15:51:16.646 INFO:teuthology.orchestra.run.smithi179.stdout: mon clock drift allowed = 1.000 2024-04-16T15:51:16.646 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-16T15:51:16.646 INFO:teuthology.orchestra.run.smithi179.stdout: osd crush chooseleaf type = 0 2024-04-16T15:51:16.647 INFO:teuthology.orchestra.run.smithi179.stdout: auth debug = true 2024-04-16T15:51:16.647 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-16T15:51:16.647 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on old message = true 2024-04-16T15:51:16.647 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on bug = true 2024-04-16T15:51:16.647 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-16T15:51:16.647 INFO:teuthology.orchestra.run.smithi179.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-16T15:51:16.647 INFO:teuthology.orchestra.run.smithi179.stdout: mon pg warn max object skew = 0 2024-04-16T15:51:16.647 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-16T15:51:16.647 INFO:teuthology.orchestra.run.smithi179.stdout: # disable pg_autoscaler by default for new pools 2024-04-16T15:51:16.647 INFO:teuthology.orchestra.run.smithi179.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-16T15:51:16.647 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-16T15:51:16.648 INFO:teuthology.orchestra.run.smithi179.stdout: osd pool default size = 2 2024-04-16T15:51:16.648 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-16T15:51:16.648 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd allow primary affinity = true 2024-04-16T15:51:16.648 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd allow pg remap = true 2024-04-16T15:51:16.648 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on legacy crush tunables = false 2024-04-16T15:51:16.648 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on crush straw calc version zero = false 2024-04-16T15:51:16.648 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on no sortbitwise = false 2024-04-16T15:51:16.648 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on osd down out interval zero = false 2024-04-16T15:51:16.648 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on too few osds = false 2024-04-16T15:51:16.648 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-16T15:51:16.648 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-16T15:51:16.648 INFO:teuthology.orchestra.run.smithi179.stdout: mon_allow_pool_size_one = true 2024-04-16T15:51:16.648 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-16T15:51:16.648 INFO:teuthology.orchestra.run.smithi179.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-16T15:51:16.648 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-16T15:51:16.649 INFO:teuthology.orchestra.run.smithi179.stdout: osd default data pool replay window = 5 2024-04-16T15:51:16.649 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-16T15:51:16.649 INFO:teuthology.orchestra.run.smithi179.stdout: mon allow pool delete = true 2024-04-16T15:51:16.649 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-16T15:51:16.649 INFO:teuthology.orchestra.run.smithi179.stdout: mon cluster log file level = debug 2024-04-16T15:51:16.649 INFO:teuthology.orchestra.run.smithi179.stdout: debug asserts on shutdown = true 2024-04-16T15:51:16.649 INFO:teuthology.orchestra.run.smithi179.stdout: mon health detail to clog = false 2024-04-16T15:51:16.649 INFO:teuthology.orchestra.run.smithi179.stdout: mon host = "172.21.15.132,172.21.15.179,[v2:172.21.15.179:3301,v1:172.21.15.179:6790]" 2024-04-16T15:51:16.649 INFO:teuthology.orchestra.run.smithi179.stdout: fsid = 6bdec5d9-f406-43ad-8584-0503b32f6f0d 2024-04-16T15:51:16.649 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-16T15:51:16.649 INFO:teuthology.orchestra.run.smithi179.stdout:[osd] 2024-04-16T15:51:16.649 INFO:teuthology.orchestra.run.smithi179.stdout: osd journal size = 100 2024-04-16T15:51:16.649 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-16T15:51:16.649 INFO:teuthology.orchestra.run.smithi179.stdout: osd scrub load threshold = 5.0 2024-04-16T15:51:16.649 INFO:teuthology.orchestra.run.smithi179.stdout: osd scrub max interval = 600 2024-04-16T15:51:16.650 INFO:teuthology.orchestra.run.smithi179.stdout: osd mclock profile = high_recovery_ops 2024-04-16T15:51:16.650 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-16T15:51:16.650 INFO:teuthology.orchestra.run.smithi179.stdout: osd recover clone overlap = true 2024-04-16T15:51:16.650 INFO:teuthology.orchestra.run.smithi179.stdout: osd recovery max chunk = 1048576 2024-04-16T15:51:16.650 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-16T15:51:16.650 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug shutdown = true 2024-04-16T15:51:16.650 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug op order = true 2024-04-16T15:51:16.650 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug verify stray on activate = true 2024-04-16T15:51:16.650 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug trim objects = true 2024-04-16T15:51:16.650 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-16T15:51:16.650 INFO:teuthology.orchestra.run.smithi179.stdout: osd open classes on start = true 2024-04-16T15:51:16.650 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug pg log writeout = true 2024-04-16T15:51:16.650 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-16T15:51:16.650 INFO:teuthology.orchestra.run.smithi179.stdout: osd deep scrub update digest min age = 30 2024-04-16T15:51:16.651 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-16T15:51:16.651 INFO:teuthology.orchestra.run.smithi179.stdout: osd map max advance = 10 2024-04-16T15:51:16.651 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-16T15:51:16.651 INFO:teuthology.orchestra.run.smithi179.stdout: journal zero on create = true 2024-04-16T15:51:16.651 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-16T15:51:16.651 INFO:teuthology.orchestra.run.smithi179.stdout: filestore ondisk finisher threads = 3 2024-04-16T15:51:16.651 INFO:teuthology.orchestra.run.smithi179.stdout: filestore apply finisher threads = 3 2024-04-16T15:51:16.651 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-16T15:51:16.651 INFO:teuthology.orchestra.run.smithi179.stdout: bdev debug aio = true 2024-04-16T15:51:16.651 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug misdirected ops = true 2024-04-16T15:51:16.651 INFO:teuthology.orchestra.run.smithi179.stdout: bdev async discard = True 2024-04-16T15:51:16.651 INFO:teuthology.orchestra.run.smithi179.stdout: bdev enable discard = True 2024-04-16T15:51:16.651 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore allocator = bitmap 2024-04-16T15:51:16.651 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore block size = 96636764160 2024-04-16T15:51:16.651 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore fsck on mount = True 2024-04-16T15:51:16.652 INFO:teuthology.orchestra.run.smithi179.stdout: debug bluefs = 1/20 2024-04-16T15:51:16.652 INFO:teuthology.orchestra.run.smithi179.stdout: debug bluestore = 1/20 2024-04-16T15:51:16.652 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-04-16T15:51:16.652 INFO:teuthology.orchestra.run.smithi179.stdout: debug osd = 20 2024-04-16T15:51:16.652 INFO:teuthology.orchestra.run.smithi179.stdout: debug rocksdb = 4/10 2024-04-16T15:51:16.652 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd backfillfull_ratio = 0.85 2024-04-16T15:51:16.652 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd full ratio = 0.9 2024-04-16T15:51:16.652 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd nearfull ratio = 0.8 2024-04-16T15:51:16.652 INFO:teuthology.orchestra.run.smithi179.stdout: osd failsafe full ratio = 0.95 2024-04-16T15:51:16.652 INFO:teuthology.orchestra.run.smithi179.stdout: osd objectstore = bluestore 2024-04-16T15:51:16.652 INFO:teuthology.orchestra.run.smithi179.stdout: osd op complaint time = 180 2024-04-16T15:51:16.652 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-16T15:51:16.652 INFO:teuthology.orchestra.run.smithi179.stdout:[mgr] 2024-04-16T15:51:16.652 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-04-16T15:51:16.653 INFO:teuthology.orchestra.run.smithi179.stdout: debug mgr = 20 2024-04-16T15:51:16.653 INFO:teuthology.orchestra.run.smithi179.stdout: debug mon = 20 2024-04-16T15:51:16.653 INFO:teuthology.orchestra.run.smithi179.stdout: debug auth = 20 2024-04-16T15:51:16.653 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min pgs per osd = 4 2024-04-16T15:51:16.653 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min bytes per osd = 10 2024-04-16T15:51:16.653 INFO:teuthology.orchestra.run.smithi179.stdout: mgr/telemetry/nag = false 2024-04-16T15:51:16.653 INFO:teuthology.orchestra.run.smithi179.stdout: debug client = 20 2024-04-16T15:51:16.653 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-16T15:51:16.653 INFO:teuthology.orchestra.run.smithi179.stdout:[mon] 2024-04-16T15:51:16.653 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-04-16T15:51:16.653 INFO:teuthology.orchestra.run.smithi179.stdout: debug mon = 20 2024-04-16T15:51:16.653 INFO:teuthology.orchestra.run.smithi179.stdout: debug paxos = 20 2024-04-16T15:51:16.653 INFO:teuthology.orchestra.run.smithi179.stdout: debug auth = 20 2024-04-16T15:51:16.653 INFO:teuthology.orchestra.run.smithi179.stdout: mon data avail warn = 5 2024-04-16T15:51:16.653 INFO:teuthology.orchestra.run.smithi179.stdout: mon mgr mkfs grace = 240 2024-04-16T15:51:16.654 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min pgs per osd = 4 2024-04-16T15:51:16.654 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd reporter subtree level = osd 2024-04-16T15:51:16.654 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd prime pg temp = true 2024-04-16T15:51:16.654 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min bytes per osd = 10 2024-04-16T15:51:16.654 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-16T15:51:16.654 INFO:teuthology.orchestra.run.smithi179.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-16T15:51:16.654 INFO:teuthology.orchestra.run.smithi179.stdout: auth mon ticket ttl = 660 # 11m 2024-04-16T15:51:16.654 INFO:teuthology.orchestra.run.smithi179.stdout: auth service ticket ttl = 240 # 4m 2024-04-16T15:51:16.654 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-16T15:51:16.654 INFO:teuthology.orchestra.run.smithi179.stdout: # don't complain about insecure global_id in the test suite 2024-04-16T15:51:16.654 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-16T15:51:16.654 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-16T15:51:16.654 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-16T15:51:16.654 INFO:teuthology.orchestra.run.smithi179.stdout: # 1m isn't quite enough 2024-04-16T15:51:16.655 INFO:teuthology.orchestra.run.smithi179.stdout: mon_down_mkfs_grace = 2m 2024-04-16T15:51:16.655 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-16T15:51:16.655 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_filestore_osds = false 2024-04-16T15:51:16.655 INFO:teuthology.orchestra.run.smithi179.stdout: mon down mkfs grace = 300 2024-04-16T15:51:16.655 INFO:teuthology.orchestra.run.smithi179.stdout: mon op complaint time = 120 2024-04-16T15:51:16.655 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-16T15:51:16.655 INFO:teuthology.orchestra.run.smithi179.stdout:[client] 2024-04-16T15:51:16.655 INFO:teuthology.orchestra.run.smithi179.stdout: rgw cache enabled = true 2024-04-16T15:51:16.655 INFO:teuthology.orchestra.run.smithi179.stdout: rgw enable ops log = true 2024-04-16T15:51:16.655 INFO:teuthology.orchestra.run.smithi179.stdout: rgw enable usage log = true 2024-04-16T15:51:16.655 INFO:teuthology.orchestra.run.smithi179.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-16T15:51:16.655 INFO:teuthology.orchestra.run.smithi179.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-16T15:51:16.655 INFO:teuthology.orchestra.run.smithi179.stdout: client mount timeout = 600 2024-04-16T15:51:16.655 INFO:teuthology.orchestra.run.smithi179.stdout: debug client = 20 2024-04-16T15:51:16.655 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-04-16T15:51:16.656 INFO:teuthology.orchestra.run.smithi179.stdout: pid file = "" 2024-04-16T15:51:16.656 INFO:teuthology.orchestra.run.smithi179.stdout: rados mon op timeout = 900 2024-04-16T15:51:16.656 INFO:teuthology.orchestra.run.smithi179.stdout: rados osd op timeout = 900 2024-04-16T15:51:16.656 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.a] 2024-04-16T15:51:16.656 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.b] 2024-04-16T15:51:16.656 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.c] 2024-04-16T15:51:16.656 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.a] 2024-04-16T15:51:16.656 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.c] 2024-04-16T15:51:16.656 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.b] 2024-04-16T15:51:16.656 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.d] 2024-04-16T15:51:16.656 INFO:teuthology.orchestra.run.smithi179.stdout:[mds] 2024-04-16T15:51:16.656 INFO:teuthology.orchestra.run.smithi179.stdout: debug mds = 20 2024-04-16T15:51:16.656 INFO:teuthology.orchestra.run.smithi179.stdout: debug mds balancer = 20 2024-04-16T15:51:16.656 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-04-16T15:51:16.656 INFO:teuthology.orchestra.run.smithi179.stdout: mds debug frag = True 2024-04-16T15:51:16.657 INFO:teuthology.orchestra.run.smithi179.stdout: mds debug scatterstat = True 2024-04-16T15:51:16.657 INFO:teuthology.orchestra.run.smithi179.stdout: mds debug zombie log segments = True 2024-04-16T15:51:16.657 INFO:teuthology.orchestra.run.smithi179.stdout: mds op complaint time = 180 2024-04-16T15:51:16.657 INFO:teuthology.orchestra.run.smithi179.stdout: mds verify scatter = True 2024-04-16T15:51:16.657 INFO:teuthology.orchestra.run.smithi179.stdout: osd op complaint time = 180 2024-04-16T15:51:16.657 INFO:teuthology.orchestra.run.smithi179.stdout: rados mon op timeout = 900 2024-04-16T15:51:16.657 INFO:teuthology.orchestra.run.smithi179.stdout: rados osd op timeout = 900 2024-04-16T15:51:16.658 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-16T15:51:16.659 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-16T15:51:16.716 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-16T15:51:16.716 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-16T15:51:16.716 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-16T15:51:16.732 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-16T15:51:16.732 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-16T15:51:16.787 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi132.front.sepia.ceph.com 2024-04-16T15:51:16.787 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-16T15:51:16.787 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-16T15:51:16.787 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-16T15:51:16.869 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-16T15:51:16.869 DEBUG:teuthology.orchestra.run.smithi132:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-16T15:51:16.924 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi179.front.sepia.ceph.com 2024-04-16T15:51:16.924 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-16T15:51:16.925 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-16T15:51:16.925 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-16T15:51:16.966 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-16T15:51:16.966 DEBUG:teuthology.orchestra.run.smithi179:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-16T15:51:17.022 INFO:tasks.ceph:Setting up mon nodes... 2024-04-16T15:51:17.022 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-16T15:51:17.023 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-16T15:51:17.080 INFO:teuthology.orchestra.run.smithi132.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-16T15:51:17.082 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-16T15:51:17.155 INFO:teuthology.orchestra.run.smithi179.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-16T15:51:17.157 INFO:tasks.ceph:Setting up mds nodes... 2024-04-16T15:51:17.158 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-16T15:51:17.215 INFO:teuthology.orchestra.run.smithi132.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-16T15:51:17.217 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-16T15:51:17.245 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-16T15:51:17.343 INFO:teuthology.orchestra.run.smithi132.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-16T15:51:17.345 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-16T15:51:17.373 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-16T15:51:17.431 INFO:teuthology.orchestra.run.smithi179.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-16T15:51:17.433 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-16T15:51:17.462 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-16T15:51:17.559 INFO:teuthology.orchestra.run.smithi179.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-16T15:51:17.562 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-16T15:51:17.590 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-16T15:51:17.590 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-16T15:51:17.634 INFO:teuthology.orchestra.run.smithi132.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-16T15:51:17.650 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-04-16T15:51:17.693 INFO:teuthology.orchestra.run.smithi132.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-04-16T15:51:17.710 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-16T15:51:17.754 INFO:teuthology.orchestra.run.smithi179.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-16T15:51:17.770 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-04-16T15:51:17.814 INFO:teuthology.orchestra.run.smithi179.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-04-16T15:51:17.830 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-16T15:51:17.830 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi132.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi179.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-16T15:51:17.830 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-16T15:51:17.859 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-16T15:51:17.859 INFO:tasks.ceph:role: osd.0 2024-04-16T15:51:17.859 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi132.front.sepia.ceph.com 2024-04-16T15:51:17.859 DEBUG:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-16T15:51:17.934 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T15:51:17.934 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T15:51:17.934 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T15:51:17.934 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T15:51:17.934 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T15:51:17.934 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2024-04-16T15:51:17.935 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T15:51:17.935 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T15:51:17.935 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T15:51:17.935 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T15:51:18.450 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2024-04-16T15:51:18.452 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2024-04-16T15:51:18.452 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-16T15:51:18.569 DEBUG:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-16T15:51:18.607 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-16T15:51:18.678 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-16T15:51:18.678 INFO:tasks.ceph:role: osd.1 2024-04-16T15:51:18.678 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi132.front.sepia.ceph.com 2024-04-16T15:51:18.678 DEBUG:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-16T15:51:18.755 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T15:51:18.755 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T15:51:18.755 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T15:51:18.755 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T15:51:18.755 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T15:51:18.755 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2024-04-16T15:51:18.755 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T15:51:18.755 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T15:51:18.755 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T15:51:18.756 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T15:51:19.202 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2024-04-16T15:51:19.204 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2024-04-16T15:51:19.204 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-16T15:51:19.305 DEBUG:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-16T15:51:19.339 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-16T15:51:19.408 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-16T15:51:19.408 INFO:tasks.ceph:role: osd.2 2024-04-16T15:51:19.408 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi132.front.sepia.ceph.com 2024-04-16T15:51:19.409 DEBUG:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-16T15:51:19.485 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T15:51:19.485 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T15:51:19.486 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T15:51:19.486 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T15:51:19.486 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T15:51:19.486 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2024-04-16T15:51:19.486 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T15:51:19.486 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T15:51:19.486 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T15:51:19.486 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T15:51:19.967 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2024-04-16T15:51:19.969 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2024-04-16T15:51:19.970 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-16T15:51:20.089 DEBUG:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-16T15:51:20.124 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-16T15:51:20.195 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-16T15:51:20.195 INFO:tasks.ceph:role: osd.3 2024-04-16T15:51:20.195 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi132.front.sepia.ceph.com 2024-04-16T15:51:20.195 DEBUG:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-16T15:51:20.271 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T15:51:20.272 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T15:51:20.272 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T15:51:20.272 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T15:51:20.272 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T15:51:20.272 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2024-04-16T15:51:20.272 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T15:51:20.272 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T15:51:20.272 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T15:51:20.272 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T15:51:20.771 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2024-04-16T15:51:20.774 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2024-04-16T15:51:20.774 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-16T15:51:20.914 DEBUG:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-16T15:51:20.954 DEBUG:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-16T15:51:21.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:21.060+0000 7f56ae60d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-16T15:51:21.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:21.060+0000 7f56ae60d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-16T15:51:21.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:21.060+0000 7f56ae60d640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-16T15:51:21.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:21.060+0000 7f56ae60d640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-16T15:51:21.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:21.060+0000 7f56ae60d640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-16T15:51:21.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:21.061+0000 7f56ae60d640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-16T15:51:23.908 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-16T15:51:23.942 DEBUG:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-16T15:51:24.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:24.035+0000 7fae5132a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-16T15:51:24.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:24.036+0000 7fae5132a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-16T15:51:24.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:24.036+0000 7fae5132a640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-16T15:51:24.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:24.036+0000 7fae5132a640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-16T15:51:24.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:24.036+0000 7fae5132a640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-16T15:51:24.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:24.037+0000 7fae5132a640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-16T15:51:26.883 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-16T15:51:26.916 DEBUG:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-16T15:51:27.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:27.016+0000 7f68540d7640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-16T15:51:27.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:27.016+0000 7f68540d7640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-16T15:51:27.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:27.016+0000 7f68540d7640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-16T15:51:27.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:27.016+0000 7f68540d7640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-16T15:51:27.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:27.016+0000 7f68540d7640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-16T15:51:27.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:27.016+0000 7f68540d7640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-16T15:51:29.867 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-16T15:51:29.900 DEBUG:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-16T15:51:29.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:29.993+0000 7f84b721e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-16T15:51:29.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:29.993+0000 7f84b721e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-16T15:51:29.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:29.994+0000 7f84b721e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-16T15:51:29.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:29.994+0000 7f84b721e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-16T15:51:29.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:29.994+0000 7f84b721e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-16T15:51:29.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:29.994+0000 7f84b721e640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-16T15:51:32.847 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-16T15:51:32.880 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-16T15:51:32.915 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-16T15:51:32.915 INFO:tasks.ceph:role: osd.4 2024-04-16T15:51:32.915 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi179.front.sepia.ceph.com 2024-04-16T15:51:32.915 DEBUG:teuthology.orchestra.run.smithi179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-16T15:51:32.995 INFO:teuthology.orchestra.run.smithi179.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T15:51:32.995 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T15:51:32.995 INFO:teuthology.orchestra.run.smithi179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T15:51:32.995 INFO:teuthology.orchestra.run.smithi179.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T15:51:32.995 INFO:teuthology.orchestra.run.smithi179.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T15:51:32.995 INFO:teuthology.orchestra.run.smithi179.stdout: = sunit=0 swidth=0 blks 2024-04-16T15:51:32.995 INFO:teuthology.orchestra.run.smithi179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T15:51:32.995 INFO:teuthology.orchestra.run.smithi179.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T15:51:32.995 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T15:51:32.995 INFO:teuthology.orchestra.run.smithi179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T15:51:33.492 INFO:teuthology.orchestra.run.smithi179.stdout:Discarding blocks...Done. 2024-04-16T15:51:33.495 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi179.front.sepia.ceph.com -o noatime 2024-04-16T15:51:33.495 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-16T15:51:33.613 DEBUG:teuthology.orchestra.run.smithi179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-16T15:51:33.650 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-16T15:51:33.719 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-16T15:51:33.719 INFO:tasks.ceph:role: osd.5 2024-04-16T15:51:33.720 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi179.front.sepia.ceph.com 2024-04-16T15:51:33.720 DEBUG:teuthology.orchestra.run.smithi179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-16T15:51:33.796 INFO:teuthology.orchestra.run.smithi179.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T15:51:33.796 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T15:51:33.796 INFO:teuthology.orchestra.run.smithi179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T15:51:33.796 INFO:teuthology.orchestra.run.smithi179.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T15:51:33.796 INFO:teuthology.orchestra.run.smithi179.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T15:51:33.796 INFO:teuthology.orchestra.run.smithi179.stdout: = sunit=0 swidth=0 blks 2024-04-16T15:51:33.797 INFO:teuthology.orchestra.run.smithi179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T15:51:33.797 INFO:teuthology.orchestra.run.smithi179.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T15:51:33.797 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T15:51:33.797 INFO:teuthology.orchestra.run.smithi179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T15:51:34.254 INFO:teuthology.orchestra.run.smithi179.stdout:Discarding blocks...Done. 2024-04-16T15:51:34.256 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi179.front.sepia.ceph.com -o noatime 2024-04-16T15:51:34.257 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-16T15:51:34.352 DEBUG:teuthology.orchestra.run.smithi179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-16T15:51:34.384 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-16T15:51:34.452 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-16T15:51:34.452 INFO:tasks.ceph:role: osd.6 2024-04-16T15:51:34.452 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi179.front.sepia.ceph.com 2024-04-16T15:51:34.452 DEBUG:teuthology.orchestra.run.smithi179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-16T15:51:34.527 INFO:teuthology.orchestra.run.smithi179.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T15:51:34.527 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T15:51:34.527 INFO:teuthology.orchestra.run.smithi179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T15:51:34.528 INFO:teuthology.orchestra.run.smithi179.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T15:51:34.528 INFO:teuthology.orchestra.run.smithi179.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T15:51:34.528 INFO:teuthology.orchestra.run.smithi179.stdout: = sunit=0 swidth=0 blks 2024-04-16T15:51:34.528 INFO:teuthology.orchestra.run.smithi179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T15:51:34.528 INFO:teuthology.orchestra.run.smithi179.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T15:51:34.528 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T15:51:34.528 INFO:teuthology.orchestra.run.smithi179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T15:51:35.024 INFO:teuthology.orchestra.run.smithi179.stdout:Discarding blocks...Done. 2024-04-16T15:51:35.026 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi179.front.sepia.ceph.com -o noatime 2024-04-16T15:51:35.027 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-16T15:51:35.186 DEBUG:teuthology.orchestra.run.smithi179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-16T15:51:35.225 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-16T15:51:35.296 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-16T15:51:35.296 INFO:tasks.ceph:role: osd.7 2024-04-16T15:51:35.296 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi179.front.sepia.ceph.com 2024-04-16T15:51:35.296 DEBUG:teuthology.orchestra.run.smithi179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-16T15:51:35.374 INFO:teuthology.orchestra.run.smithi179.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T15:51:35.374 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T15:51:35.374 INFO:teuthology.orchestra.run.smithi179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T15:51:35.375 INFO:teuthology.orchestra.run.smithi179.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T15:51:35.375 INFO:teuthology.orchestra.run.smithi179.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T15:51:35.375 INFO:teuthology.orchestra.run.smithi179.stdout: = sunit=0 swidth=0 blks 2024-04-16T15:51:35.375 INFO:teuthology.orchestra.run.smithi179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T15:51:35.375 INFO:teuthology.orchestra.run.smithi179.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T15:51:35.375 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T15:51:35.376 INFO:teuthology.orchestra.run.smithi179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T15:51:35.878 INFO:teuthology.orchestra.run.smithi179.stdout:Discarding blocks...Done. 2024-04-16T15:51:35.880 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi179.front.sepia.ceph.com -o noatime 2024-04-16T15:51:35.880 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-16T15:51:35.998 DEBUG:teuthology.orchestra.run.smithi179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-16T15:51:36.035 DEBUG:teuthology.orchestra.run.smithi179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-16T15:51:36.139 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:36.140+0000 7fe320e0c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-16T15:51:36.140 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:36.140+0000 7fe320e0c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-16T15:51:36.140 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:36.140+0000 7fe320e0c640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-16T15:51:36.140 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:36.140+0000 7fe320e0c640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-16T15:51:36.140 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:36.140+0000 7fe320e0c640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-16T15:51:36.140 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:36.141+0000 7fe320e0c640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-16T15:51:38.996 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-16T15:51:39.030 DEBUG:teuthology.orchestra.run.smithi179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-16T15:51:39.125 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:39.125+0000 7f02ef41a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-16T15:51:39.125 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:39.125+0000 7f02ef41a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-16T15:51:39.125 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:39.125+0000 7f02ef41a640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-16T15:51:39.125 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:39.125+0000 7f02ef41a640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-16T15:51:39.125 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:39.125+0000 7f02ef41a640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-16T15:51:39.125 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:39.126+0000 7f02ef41a640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-16T15:51:41.975 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-16T15:51:42.009 DEBUG:teuthology.orchestra.run.smithi179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-16T15:51:42.105 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:42.105+0000 7f24efa68640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-16T15:51:42.105 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:42.105+0000 7f24efa68640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-16T15:51:42.105 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:42.105+0000 7f24efa68640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-16T15:51:42.105 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:42.105+0000 7f24efa68640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-16T15:51:42.105 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:42.105+0000 7f24efa68640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-16T15:51:42.105 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:42.106+0000 7f24efa68640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-16T15:51:44.627 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T15:51:44.630 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T15:51:44.970 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-16T15:51:45.001 DEBUG:teuthology.orchestra.run.smithi179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-16T15:51:45.092 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:45.092+0000 7f9652811640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-16T15:51:45.093 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:45.093+0000 7f9652811640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-16T15:51:45.093 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:45.093+0000 7f9652811640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-16T15:51:45.093 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:45.093+0000 7f9652811640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-16T15:51:45.093 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:45.093+0000 7f9652811640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-16T15:51:45.093 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:45.093+0000 7f9652811640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-16T15:51:47.947 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-16T15:51:47.980 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-16T15:51:47.980 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-16T15:51:47.980 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-16T15:51:48.014 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-16T15:51:48.014 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-16T15:51:48.086 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-16T15:51:48.086 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-16T15:51:48.158 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-16T15:51:48.158 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-16T15:51:48.228 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-16T15:51:48.228 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-16T15:51:48.297 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-16T15:51:48.297 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-16T15:51:48.367 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-16T15:51:48.367 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-16T15:51:48.436 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-16T15:51:48.436 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-16T15:51:48.469 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-16T15:51:48.469 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-16T15:51:48.541 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-16T15:51:48.541 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-16T15:51:48.612 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-16T15:51:48.612 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-16T15:51:48.682 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-16T15:51:48.682 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-16T15:51:48.752 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-16T15:51:48.752 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-16T15:51:48.821 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-16T15:51:48.821 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-16T15:51:48.889 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-16T15:51:48.890 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-16T15:51:48.907 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-16T15:51:48.907 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-04-16T15:51:48.963 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-16T15:51:48.963 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-16T15:51:48.979 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-16T15:51:48.979 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-04-16T15:51:49.035 INFO:tasks.ceph:Adding keys to all mons... 2024-04-16T15:51:49.035 DEBUG:teuthology.orchestra.run.smithi132:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-16T15:51:49.037 DEBUG:teuthology.orchestra.run.smithi179:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-16T15:51:49.078 INFO:teuthology.orchestra.run.smithi132.stdout:[mgr.y] 2024-04-16T15:51:49.078 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQB1nh5m5bbkBBAAMJ/gX/XrGsyyODIhrFu+vw== 2024-04-16T15:51:49.079 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.a] 2024-04-16T15:51:49.079 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQB1nh5mi1D3DBAAf/33QJ705Ty+AP6ukFTeYg== 2024-04-16T15:51:49.079 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.c] 2024-04-16T15:51:49.079 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQB1nh5mY8eSFBAA0+GUx4mnmoq7FSYJ0MJYKA== 2024-04-16T15:51:49.079 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.0] 2024-04-16T15:51:49.079 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQB5nh5mkOesAxAAS1yb0DA/4s8+ROxvl9Mxow== 2024-04-16T15:51:49.079 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.1] 2024-04-16T15:51:49.079 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQB8nh5mDyo0AhAARaIf6z33kpQR/jK5qRxpsw== 2024-04-16T15:51:49.079 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.2] 2024-04-16T15:51:49.079 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQB/nh5mQGgFARAAlfLdq8GprK0dFOhY/kUPYA== 2024-04-16T15:51:49.079 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.3] 2024-04-16T15:51:49.079 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQCBnh5mZIxKOxAAjVmKVE6rOp/ER9jTSgZ3cQ== 2024-04-16T15:51:49.079 INFO:teuthology.orchestra.run.smithi132.stdout:[mgr.x] 2024-04-16T15:51:49.080 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQB1nh5m3dZfCRAAoZETk5BYerNva+hZ6FnL3Q== 2024-04-16T15:51:49.080 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.b] 2024-04-16T15:51:49.080 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQB1nh5mDT3WGRAAWGCnSM2yO01pDPAXWL+adg== 2024-04-16T15:51:49.080 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.d] 2024-04-16T15:51:49.080 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQB1nh5mCZp5IRAAVzjp6ha9GVGviXhP1B5onQ== 2024-04-16T15:51:49.080 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.4] 2024-04-16T15:51:49.080 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQCInh5mP0pyCBAAGqZA4ARkCOquLuQnKTF9Hg== 2024-04-16T15:51:49.080 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.5] 2024-04-16T15:51:49.080 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQCLnh5mI/aNBxAAYcGFAsiApb/PUiVX0rw9gA== 2024-04-16T15:51:49.080 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.6] 2024-04-16T15:51:49.080 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQCOnh5mVzhcBhAAbODQ2u1KagQ13QJYHIYvOg== 2024-04-16T15:51:49.080 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.7] 2024-04-16T15:51:49.080 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQCRnh5mkWOZBRAAW0nhoapLwmcPmsJonher7A== 2024-04-16T15:51:49.080 INFO:teuthology.orchestra.run.smithi132.stdout:[client.0] 2024-04-16T15:51:49.081 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQB1nh5msfL1JRAAxfWBGq3EmoGhFqhZir0xkg== 2024-04-16T15:51:49.081 INFO:teuthology.orchestra.run.smithi132.stdout:[client.2] 2024-04-16T15:51:49.081 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQB1nh5mJ+95KRAA+3ImUsvR4WGoKBTGTdJPfg== 2024-04-16T15:51:49.081 INFO:teuthology.orchestra.run.smithi132.stdout:[client.1] 2024-04-16T15:51:49.081 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQB1nh5mIqoZLRAArGq3U7+ErEFogizPylN0Gw== 2024-04-16T15:51:49.081 INFO:teuthology.orchestra.run.smithi132.stdout:[client.3] 2024-04-16T15:51:49.081 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQB1nh5mbcOnMBAAs21wgcHB1TA3s70gs6Svrw== 2024-04-16T15:51:49.102 INFO:teuthology.orchestra.run.smithi179.stdout:[mgr.y] 2024-04-16T15:51:49.102 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQB1nh5m5bbkBBAAMJ/gX/XrGsyyODIhrFu+vw== 2024-04-16T15:51:49.102 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.a] 2024-04-16T15:51:49.102 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQB1nh5mi1D3DBAAf/33QJ705Ty+AP6ukFTeYg== 2024-04-16T15:51:49.102 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.c] 2024-04-16T15:51:49.103 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQB1nh5mY8eSFBAA0+GUx4mnmoq7FSYJ0MJYKA== 2024-04-16T15:51:49.103 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.0] 2024-04-16T15:51:49.103 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQB5nh5mkOesAxAAS1yb0DA/4s8+ROxvl9Mxow== 2024-04-16T15:51:49.103 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.1] 2024-04-16T15:51:49.103 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQB8nh5mDyo0AhAARaIf6z33kpQR/jK5qRxpsw== 2024-04-16T15:51:49.103 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.2] 2024-04-16T15:51:49.103 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQB/nh5mQGgFARAAlfLdq8GprK0dFOhY/kUPYA== 2024-04-16T15:51:49.103 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.3] 2024-04-16T15:51:49.103 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCBnh5mZIxKOxAAjVmKVE6rOp/ER9jTSgZ3cQ== 2024-04-16T15:51:49.103 INFO:teuthology.orchestra.run.smithi179.stdout:[mgr.x] 2024-04-16T15:51:49.103 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQB1nh5m3dZfCRAAoZETk5BYerNva+hZ6FnL3Q== 2024-04-16T15:51:49.103 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.b] 2024-04-16T15:51:49.103 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQB1nh5mDT3WGRAAWGCnSM2yO01pDPAXWL+adg== 2024-04-16T15:51:49.103 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.d] 2024-04-16T15:51:49.103 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQB1nh5mCZp5IRAAVzjp6ha9GVGviXhP1B5onQ== 2024-04-16T15:51:49.104 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.4] 2024-04-16T15:51:49.104 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCInh5mP0pyCBAAGqZA4ARkCOquLuQnKTF9Hg== 2024-04-16T15:51:49.104 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.5] 2024-04-16T15:51:49.104 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCLnh5mI/aNBxAAYcGFAsiApb/PUiVX0rw9gA== 2024-04-16T15:51:49.104 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.6] 2024-04-16T15:51:49.104 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCOnh5mVzhcBhAAbODQ2u1KagQ13QJYHIYvOg== 2024-04-16T15:51:49.105 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.7] 2024-04-16T15:51:49.105 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCRnh5mkWOZBRAAW0nhoapLwmcPmsJonher7A== 2024-04-16T15:51:49.105 INFO:teuthology.orchestra.run.smithi179.stdout:[client.0] 2024-04-16T15:51:49.106 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQB1nh5msfL1JRAAxfWBGq3EmoGhFqhZir0xkg== 2024-04-16T15:51:49.106 INFO:teuthology.orchestra.run.smithi179.stdout:[client.2] 2024-04-16T15:51:49.106 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQB1nh5mJ+95KRAA+3ImUsvR4WGoKBTGTdJPfg== 2024-04-16T15:51:49.106 INFO:teuthology.orchestra.run.smithi179.stdout:[client.1] 2024-04-16T15:51:49.106 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQB1nh5mIqoZLRAArGq3U7+ErEFogizPylN0Gw== 2024-04-16T15:51:49.106 INFO:teuthology.orchestra.run.smithi179.stdout:[client.3] 2024-04-16T15:51:49.106 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQB1nh5mbcOnMBAAs21wgcHB1TA3s70gs6Svrw== 2024-04-16T15:51:49.107 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-16T15:51:49.124 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-16T15:51:49.201 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-16T15:51:49.203 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-16T15:51:49.260 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-16T15:51:49.262 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-16T15:51:49.318 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T15:51:49.320 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T15:51:49.374 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T15:51:49.376 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T15:51:49.429 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T15:51:49.432 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T15:51:49.485 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T15:51:49.488 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T15:51:49.543 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-16T15:51:49.545 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-16T15:51:49.599 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-16T15:51:49.602 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-16T15:51:49.659 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-16T15:51:49.661 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-16T15:51:49.718 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T15:51:49.720 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T15:51:49.800 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T15:51:49.803 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T15:51:49.857 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T15:51:49.860 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T15:51:49.913 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T15:51:49.916 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T15:51:49.969 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-16T15:51:49.972 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-16T15:51:50.028 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-16T15:51:50.031 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-16T15:51:50.087 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-16T15:51:50.089 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-16T15:51:50.146 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-16T15:51:50.149 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-16T15:51:50.205 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-16T15:51:50.205 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-16T15:51:50.233 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-16T15:51:50.335 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-16T15:51:50.362 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-16T15:51:50.391 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-16T15:51:50.489 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-16T15:51:50.518 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-16T15:51:50.587 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-16T15:51:50.685 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-16T15:51:50.713 DEBUG:teuthology.orchestra.run.smithi132:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-16T15:51:50.716 DEBUG:teuthology.orchestra.run.smithi179:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-16T15:51:50.769 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-16T15:51:50.769 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-16T15:51:50.770 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-16T15:51:50.772 INFO:tasks.ceph.mon.a:Started 2024-04-16T15:51:50.772 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-16T15:51:50.772 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-16T15:51:50.811 INFO:tasks.ceph.mon.b:Started 2024-04-16T15:51:50.811 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-16T15:51:50.811 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-16T15:51:50.813 INFO:tasks.ceph.mon.c:Started 2024-04-16T15:51:50.813 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-16T15:51:50.813 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-16T15:51:50.813 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-16T15:51:50.815 INFO:tasks.ceph.mgr.y:Started 2024-04-16T15:51:50.816 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-16T15:51:50.816 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-16T15:51:50.818 INFO:tasks.ceph.mgr.x:Started 2024-04-16T15:51:50.818 INFO:tasks.ceph:Setting crush tunables to default 2024-04-16T15:51:50.818 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd crush tunables default 2024-04-16T15:51:50.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:50.922+0000 7f1f3ee35640 1 Processor -- start 2024-04-16T15:51:50.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:50.922+0000 7f1f3ee35640 1 -- start start 2024-04-16T15:51:50.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:50.922+0000 7f1f3ee35640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1f3809b950 0x7f1f380d1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:50.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:50.922+0000 7f1f3ee35640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1f3809ab80 0x7f1f3809af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:50.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:50.923+0000 7f1f3ee35640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f3809b4d0 con 0x7f1f381600a0 2024-04-16T15:51:50.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:50.923+0000 7f1f3ee35640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f1f380b23c0 con 0x7f1f3809ab80 2024-04-16T15:51:50.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:50.923+0000 7f1f3ee35640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f1f380b26a0 con 0x7f1f3809b950 2024-04-16T15:51:50.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:50.923+0000 7f1f3d3d2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1f3809ab80 0x7f1f3809af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:50.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:50.923+0000 7f1f3d3d2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1f3809ab80 0x7f1f3809af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57876/0 (socket says 172.21.15.132:57876) 2024-04-16T15:51:50.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:50.923+0000 7f1f3d3d2640 1 -- 172.21.15.132:0/2462036142 learned_addr learned my addr 172.21.15.132:0/2462036142 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:51:50.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:50.923+0000 7f1f3d3d2640 1 -- 172.21.15.132:0/2462036142 >> v2:172.21.15.132:3300/0 conn(0x7f1f3809ab80 msgr2=0x7f1f3809af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-16T15:51:50.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:50.923+0000 7f1f3d3d2640 1 -- 172.21.15.132:0/2462036142 >> v2:172.21.15.132:3300/0 conn(0x7f1f3809ab80 msgr2=0x7f1f3809af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-16T15:51:50.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:50.923+0000 7f1f3d3d2640 1 --2- 172.21.15.132:0/2462036142 >> v2:172.21.15.132:3300/0 conn(0x7f1f3809ab80 0x7f1f3809af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-16T15:51:50.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:50.923+0000 7f1f3d3d2640 1 --2- 172.21.15.132:0/2462036142 >> v2:172.21.15.132:3300/0 conn(0x7f1f3809ab80 0x7f1f3809af90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-16T15:51:50.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:50.923+0000 7f1f37fff640 1 --2- 172.21.15.132:0/2462036142 >> v2:172.21.15.179:3300/0 conn(0x7f1f3809b950 0x7f1f380d1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:50.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:50.923+0000 7f1f37fff640 1 -- 172.21.15.132:0/2462036142 >> v2:172.21.15.179:3300/0 conn(0x7f1f3809b950 msgr2=0x7f1f380d1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-16T15:51:50.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:50.923+0000 7f1f37fff640 1 -- 172.21.15.132:0/2462036142 >> v2:172.21.15.179:3300/0 conn(0x7f1f3809b950 msgr2=0x7f1f380d1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-16T15:51:50.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:50.923+0000 7f1f37fff640 1 --2- 172.21.15.132:0/2462036142 >> v2:172.21.15.179:3300/0 conn(0x7f1f3809b950 0x7f1f380d1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-16T15:51:50.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:50.923+0000 7f1f37fff640 1 --2- 172.21.15.132:0/2462036142 >> v2:172.21.15.179:3300/0 conn(0x7f1f3809b950 0x7f1f380d1290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-16T15:51:51.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.089+0000 7f1f377fe640 1 -- 172.21.15.132:0/2462036142 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3387711114 0 0) 0x7f1f2c001110 con 0x7f1f381600a0 2024-04-16T15:51:51.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.089+0000 7f1f377fe640 1 -- 172.21.15.132:0/2462036142 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f28003520 con 0x7f1f381600a0 2024-04-16T15:51:51.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.090+0000 7f1f377fe640 1 -- 172.21.15.132:0/2462036142 <== mon.1 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 856625661 0 0) 0x7f1f28003520 con 0x7f1f381600a0 2024-04-16T15:51:51.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.091+0000 7f1f377fe640 1 -- 172.21.15.132:0/2462036142 >> v2:172.21.15.179:3300/0 conn(0x7f1f3809b950 msgr2=0x7f1f380d1290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-16T15:51:51.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.091+0000 7f1f377fe640 1 --2- 172.21.15.132:0/2462036142 >> v2:172.21.15.179:3300/0 conn(0x7f1f3809b950 0x7f1f380d1290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:51.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.091+0000 7f1f377fe640 1 -- 172.21.15.132:0/2462036142 >> v2:172.21.15.132:3300/0 conn(0x7f1f3809ab80 msgr2=0x7f1f3809af90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-16T15:51:51.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.091+0000 7f1f377fe640 1 --2- 172.21.15.132:0/2462036142 >> v2:172.21.15.132:3300/0 conn(0x7f1f3809ab80 0x7f1f3809af90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:51.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.091+0000 7f1f377fe640 1 -- 172.21.15.132:0/2462036142 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f380b2980 con 0x7f1f381600a0 2024-04-16T15:51:51.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.091+0000 7f1f377fe640 1 -- 172.21.15.132:0/2462036142 <== mon.1 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2803668828 0 0) 0x7f1f2c001840 con 0x7f1f381600a0 2024-04-16T15:51:51.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.091+0000 7f1f377fe640 1 -- 172.21.15.132:0/2462036142 >> v1:172.21.15.179:6789/0 conn(0x7f1f381600a0 legacy=0x7f1f380b3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:51:51.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.091+0000 7f1f377fe640 1 --2- 172.21.15.132:0/2462036142 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f280039b0 0x7f1f28003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:51.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.091+0000 7f1f377fe640 1 --2- 172.21.15.132:0/2462036142 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f28004800 0x7f1f28004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:51.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.091+0000 7f1f377fe640 1 --2- 172.21.15.132:0/2462036142 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f280051c0 0x7f1f2800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:51.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.091+0000 7f1f377fe640 1 -- 172.21.15.132:0/2462036142 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f1f380b23c0 con 0x7f1f28004800 2024-04-16T15:51:51.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.091+0000 7f1f377fe640 1 -- 172.21.15.132:0/2462036142 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1f380b26a0 con 0x7f1f280051c0 2024-04-16T15:51:51.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.091+0000 7f1f377fe640 1 -- 172.21.15.132:0/2462036142 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1f2800c0c0 con 0x7f1f280039b0 2024-04-16T15:51:51.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.091+0000 7f1f37fff640 1 --2- 172.21.15.132:0/2462036142 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f28004800 0x7f1f28004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:51.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.091+0000 7f1f3cbd1640 1 --2- 172.21.15.132:0/2462036142 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f280039b0 0x7f1f28003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:51.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.091+0000 7f1f3d3d2640 1 --2- 172.21.15.132:0/2462036142 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f280051c0 0x7f1f2800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:51.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.091+0000 7f1f37fff640 1 -- 172.21.15.132:0/2462036142 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f280039b0 msgr2=0x7f1f28003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:51:51.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.091+0000 7f1f37fff640 1 --2- 172.21.15.132:0/2462036142 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f280039b0 0x7f1f28003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:51.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.091+0000 7f1f37fff640 1 -- 172.21.15.132:0/2462036142 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f280051c0 msgr2=0x7f1f2800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:51:51.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.091+0000 7f1f37fff640 1 --2- 172.21.15.132:0/2462036142 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f280051c0 0x7f1f2800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:51.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.091+0000 7f1f37fff640 1 -- 172.21.15.132:0/2462036142 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f28003520 con 0x7f1f28004800 2024-04-16T15:51:51.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.091+0000 7f1f3d3d2640 1 -- 172.21.15.132:0/2462036142 reap_dead start 2024-04-16T15:51:51.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.092+0000 7f1f37fff640 1 --2- 172.21.15.132:0/2462036142 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f28004800 0x7f1f28004c80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1f38073790 tx=0x7f1f28005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a27d1327f8f7b56d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:51:51.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.092+0000 7f1f377fe640 1 -- 172.21.15.132:0/2462036142 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f2400b5e0 con 0x7f1f28004800 2024-04-16T15:51:51.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.092+0000 7f1f377fe640 1 -- 172.21.15.132:0/2462036142 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f24038070 con 0x7f1f28004800 2024-04-16T15:51:51.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.092+0000 7f1f377fe640 1 -- 172.21.15.132:0/2462036142 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f2402d040 con 0x7f1f28004800 2024-04-16T15:51:51.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.093+0000 7f1f3ee35640 1 -- 172.21.15.132:0/2462036142 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f28004800 msgr2=0x7f1f28004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:51:51.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.093+0000 7f1f3ee35640 1 --2- 172.21.15.132:0/2462036142 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f28004800 0x7f1f28004c80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1f38073790 tx=0x7f1f28005830 comp rx=0 tx=0).stop 2024-04-16T15:51:51.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.093+0000 7f1f3ee35640 1 -- 172.21.15.132:0/2462036142 shutdown_connections 2024-04-16T15:51:51.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.093+0000 7f1f3ee35640 1 --2- 172.21.15.132:0/2462036142 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f28004800 0x7f1f28004c80 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:51.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.093+0000 7f1f3ee35640 1 -- 172.21.15.132:0/2462036142 >> 172.21.15.132:0/2462036142 conn(0x7f1f380b4400 msgr2=0x7f1f380b4810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:51:51.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.093+0000 7f1f3ee35640 1 -- 172.21.15.132:0/2462036142 shutdown_connections 2024-04-16T15:51:51.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.093+0000 7f1f3ee35640 1 -- 172.21.15.132:0/2462036142 wait complete. 2024-04-16T15:51:51.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.095+0000 7f1f3ee35640 1 Processor -- start 2024-04-16T15:51:51.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.095+0000 7f1f3ee35640 1 -- start start 2024-04-16T15:51:51.097 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.096+0000 7f1f3ee35640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f28004800 0x7f1f38152960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:51.097 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.096+0000 7f1f3ee35640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f380c99e0 0x7f1f380cbef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:51.097 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.096+0000 7f1f3ee35640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f380711d0 0x7f1f38071680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:51.097 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.096+0000 7f1f3ee35640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f1f380b2090 con 0x7f1f380711d0 2024-04-16T15:51:51.097 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.096+0000 7f1f3ee35640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1f380b2f40 con 0x7f1f28004800 2024-04-16T15:51:51.097 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.096+0000 7f1f3ee35640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1f38160480 con 0x7f1f380c99e0 2024-04-16T15:51:51.097 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.096+0000 7f1f3d3d2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f380711d0 0x7f1f38071680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:51.097 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.096+0000 7f1f3d3d2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f380711d0 0x7f1f38071680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57894/0 (socket says 172.21.15.132:57894) 2024-04-16T15:51:51.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.096+0000 7f1f3cbd1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f28004800 0x7f1f38152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:51.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.096+0000 7f1f37fff640 1 --2- 172.21.15.132:0/3264426996 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f380c99e0 0x7f1f380cbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:51.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.096+0000 7f1f3d3d2640 1 -- 172.21.15.132:0/3264426996 learned_addr learned my addr 172.21.15.132:0/3264426996 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:51:51.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.096+0000 7f1f3d3d2640 1 -- 172.21.15.132:0/3264426996 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f380c99e0 msgr2=0x7f1f380cbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:51:51.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.096+0000 7f1f3d3d2640 1 --2- 172.21.15.132:0/3264426996 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f380c99e0 0x7f1f380cbef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:51.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.096+0000 7f1f3d3d2640 1 -- 172.21.15.132:0/3264426996 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f28004800 msgr2=0x7f1f38152960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:51:51.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.096+0000 7f1f3d3d2640 1 --2- 172.21.15.132:0/3264426996 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f28004800 0x7f1f38152960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:51.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.096+0000 7f1f3d3d2640 1 -- 172.21.15.132:0/3264426996 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f380ce240 con 0x7f1f380711d0 2024-04-16T15:51:51.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.096+0000 7f1f3d3d2640 1 --2- 172.21.15.132:0/3264426996 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f380711d0 0x7f1f38071680 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1f380730d0 tx=0x7f1f30007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:51:51.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.096+0000 7f1f357fa640 1 -- 172.21.15.132:0/3264426996 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f3001b070 con 0x7f1f380711d0 2024-04-16T15:51:51.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.096+0000 7f1f357fa640 1 -- 172.21.15.132:0/3264426996 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f3000fcb0 con 0x7f1f380711d0 2024-04-16T15:51:51.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.096+0000 7f1f3ee35640 1 -- 172.21.15.132:0/3264426996 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f380c9f10 con 0x7f1f380711d0 2024-04-16T15:51:51.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.096+0000 7f1f357fa640 1 -- 172.21.15.132:0/3264426996 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f30003bd0 con 0x7f1f380711d0 2024-04-16T15:51:51.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.096+0000 7f1f3ee35640 1 -- 172.21.15.132:0/3264426996 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f380ca4d0 con 0x7f1f380711d0 2024-04-16T15:51:51.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.097+0000 7f1f357fa640 1 -- 172.21.15.132:0/3264426996 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1f3001e070 con 0x7f1f380711d0 2024-04-16T15:51:51.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.097+0000 7f1f357fa640 1 -- 172.21.15.132:0/3264426996 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1f30009d70 con 0x7f1f380711d0 2024-04-16T15:51:51.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.097+0000 7f1f3ee35640 1 -- 172.21.15.132:0/3264426996 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f38075510 con 0x7f1f380711d0 2024-04-16T15:51:51.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.100+0000 7f1f357fa640 1 -- 172.21.15.132:0/3264426996 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f1f380ce240 con 0x7f1f380711d0 2024-04-16T15:51:51.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.164+0000 7f1f3ee35640 1 -- 172.21.15.132:0/3264426996 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f1f381544c0 con 0x7f1f380711d0 2024-04-16T15:51:51.165 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.166+0000 7f1f357fa640 1 -- 172.21.15.132:0/3264426996 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f1f3000a030 con 0x7f1f380711d0 2024-04-16T15:51:51.165 INFO:teuthology.orchestra.run.smithi132.stderr:adjusted tunables profile to default 2024-04-16T15:51:51.166 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.167+0000 7f1f3ee35640 1 -- 172.21.15.132:0/3264426996 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f380711d0 msgr2=0x7f1f38071680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:51:51.166 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.167+0000 7f1f3ee35640 1 --2- 172.21.15.132:0/3264426996 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f380711d0 0x7f1f38071680 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1f380730d0 tx=0x7f1f30007f60 comp rx=0 tx=0).stop 2024-04-16T15:51:51.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.167+0000 7f1f3ee35640 1 -- 172.21.15.132:0/3264426996 shutdown_connections 2024-04-16T15:51:51.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.167+0000 7f1f3ee35640 1 --2- 172.21.15.132:0/3264426996 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f380711d0 0x7f1f38071680 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:51.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.167+0000 7f1f3ee35640 1 --2- 172.21.15.132:0/3264426996 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f380c99e0 0x7f1f380cbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:51.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.167+0000 7f1f3ee35640 1 --2- 172.21.15.132:0/3264426996 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f28004800 0x7f1f38152960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:51.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.167+0000 7f1f3ee35640 1 -- 172.21.15.132:0/3264426996 >> 172.21.15.132:0/3264426996 conn(0x7f1f380b4400 msgr2=0x7f1f380d1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:51:51.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.167+0000 7f1f3ee35640 1 -- 172.21.15.132:0/3264426996 shutdown_connections 2024-04-16T15:51:51.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:51.167+0000 7f1f3ee35640 1 -- 172.21.15.132:0/3264426996 wait complete. 2024-04-16T15:51:51.177 INFO:tasks.ceph:check_enable_crimson: False 2024-04-16T15:51:51.177 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-16T15:51:51.178 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-16T15:51:51.178 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-16T15:51:51.206 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-16T15:51:51.206 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-16T15:51:51.274 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-16T15:51:51.274 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-16T15:51:51.342 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-16T15:51:51.342 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-16T15:51:51.410 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-16T15:51:51.410 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-16T15:51:51.440 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-16T15:51:51.440 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-16T15:51:51.508 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-16T15:51:51.509 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-16T15:51:51.573 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-16T15:51:51.574+0000 7ff84fe32040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-16T15:51:51.574 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-04-16T15:51:51.575+0000 7fd895645040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-16T15:51:51.578 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-16T15:51:51.579 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-16T15:51:51.628 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-04-16T15:51:51.629+0000 7fd895645040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-16T15:51:51.629 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-16T15:51:51.629+0000 7ff84fe32040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-16T15:51:51.648 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 2d45908b-6e22-4619-b190-897af594b712 0 2024-04-16T15:51:51.800 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.793+0000 7ffad2bbd640 1 Processor -- start 2024-04-16T15:51:51.800 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.793+0000 7ffad2bbd640 1 -- start start 2024-04-16T15:51:51.800 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.793+0000 7ffad2bbd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffacc160350 0x7ffacc0b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:51.801 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.793+0000 7ffad2bbd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ffacc0ce3f0 0x7ffacc0b2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:51.801 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.793+0000 7ffad2bbd640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffacc09bc40 con 0x7ffacc09ae60 2024-04-16T15:51:51.801 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.793+0000 7ffad2bbd640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7ffacc09bf20 con 0x7ffacc0ce3f0 2024-04-16T15:51:51.801 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.793+0000 7ffad2bbd640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ffacc0b3ab0 con 0x7ffacc160350 2024-04-16T15:51:51.801 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.794+0000 7ffacbfff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffacc160350 0x7ffacc0b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:51.801 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.794+0000 7ffad0959640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7ffacc09ae60 0x7ffacc15fc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:50432/0 (socket says 172.21.15.179:50432) 2024-04-16T15:51:51.801 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.794+0000 7ffad0959640 1 -- 172.21.15.179:0/1717378466 learned_addr learned my addr 172.21.15.179:0/1717378466 (peer_addr_for_me v1:172.21.15.179:0/0) 2024-04-16T15:51:51.801 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.794+0000 7ffad115a640 1 --2- 172.21.15.179:0/1717378466 >> v2:172.21.15.132:3300/0 conn(0x7ffacc0ce3f0 0x7ffacc0b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:51.801 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.794+0000 7ffacb7fe640 1 -- 172.21.15.179:0/1717378466 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1725768867 0 0) 0x7ffacc09bc40 con 0x7ffacc09ae60 2024-04-16T15:51:51.801 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.794+0000 7ffacb7fe640 1 -- 172.21.15.179:0/1717378466 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffabc003520 con 0x7ffacc09ae60 2024-04-16T15:51:51.802 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.794+0000 7ffacbfff640 1 -- 172.21.15.179:0/1717378466 >> v2:172.21.15.132:3300/0 conn(0x7ffacc0ce3f0 msgr2=0x7ffacc0b2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:51:51.802 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.794+0000 7ffacbfff640 1 --2- 172.21.15.179:0/1717378466 >> v2:172.21.15.132:3300/0 conn(0x7ffacc0ce3f0 0x7ffacc0b2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:51.802 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.794+0000 7ffacbfff640 1 -- 172.21.15.179:0/1717378466 >> v1:172.21.15.179:6789/0 conn(0x7ffacc09ae60 legacy=0x7ffacc15fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:51:51.802 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.794+0000 7ffacbfff640 1 -- 172.21.15.179:0/1717378466 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffacc0b3d90 con 0x7ffacc160350 2024-04-16T15:51:51.802 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.794+0000 7ffad115a640 1 --2- 172.21.15.179:0/1717378466 >> v2:172.21.15.132:3300/0 conn(0x7ffacc0ce3f0 0x7ffacc0b2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:51:51.802 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.795+0000 7ffacbfff640 1 --2- 172.21.15.179:0/1717378466 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffacc160350 0x7ffacc0b1e20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ffab80097a0 tx=0x7ffab802b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d99abe6916500eb server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:51:51.802 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.795+0000 7ffacb7fe640 1 -- 172.21.15.179:0/1717378466 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab8031780 con 0x7ffacc160350 2024-04-16T15:51:51.802 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.795+0000 7ffacb7fe640 1 -- 172.21.15.179:0/1717378466 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffab8037070 con 0x7ffacc160350 2024-04-16T15:51:51.802 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.795+0000 7ffacb7fe640 1 -- 172.21.15.179:0/1717378466 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab8031b40 con 0x7ffacc160350 2024-04-16T15:51:51.803 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.795+0000 7ffad2bbd640 1 -- 172.21.15.179:0/1717378466 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffacc160350 msgr2=0x7ffacc0b1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:51:51.803 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.795+0000 7ffad2bbd640 1 --2- 172.21.15.179:0/1717378466 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffacc160350 0x7ffacc0b1e20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ffab80097a0 tx=0x7ffab802b820 comp rx=0 tx=0).stop 2024-04-16T15:51:51.803 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.796+0000 7ffad2bbd640 1 -- 172.21.15.179:0/1717378466 shutdown_connections 2024-04-16T15:51:51.803 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.796+0000 7ffad2bbd640 1 --2- 172.21.15.179:0/1717378466 >> v2:172.21.15.132:3300/0 conn(0x7ffacc0ce3f0 0x7ffacc0b2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:51.803 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.796+0000 7ffad2bbd640 1 --2- 172.21.15.179:0/1717378466 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffacc160350 0x7ffacc0b1e20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:51.803 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.796+0000 7ffad2bbd640 1 -- 172.21.15.179:0/1717378466 >> 172.21.15.179:0/1717378466 conn(0x7ffacc0b43c0 msgr2=0x7ffacc0b47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:51:51.803 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.796+0000 7ffad2bbd640 1 -- 172.21.15.179:0/1717378466 shutdown_connections 2024-04-16T15:51:51.803 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.796+0000 7ffad2bbd640 1 -- 172.21.15.179:0/1717378466 wait complete. 2024-04-16T15:51:51.803 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.797+0000 7ffad2bbd640 1 Processor -- start 2024-04-16T15:51:51.804 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.797+0000 7ffad2bbd640 1 -- start start 2024-04-16T15:51:51.804 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.798+0000 7ffad2bbd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffacc09ae60 0x7ffacc0af640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:51.804 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.798+0000 7ffad2bbd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffacc0ce3f0 0x7ffacc15cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:51.804 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.798+0000 7ffad2bbd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffacc160350 0x7ffacc15d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:51.804 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.798+0000 7ffad2bbd640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7ffacc0d0620 con 0x7ffacc0ce3f0 2024-04-16T15:51:51.804 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.798+0000 7ffad2bbd640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ffacc0d04a0 con 0x7ffacc160350 2024-04-16T15:51:51.804 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.798+0000 7ffad2bbd640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ffacc0d07a0 con 0x7ffacc09ae60 2024-04-16T15:51:51.804 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.798+0000 7ffad0959640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffacc09ae60 0x7ffacc0af640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:51.804 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.798+0000 7ffad115a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffacc160350 0x7ffacc15d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:51.805 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.798+0000 7ffad0959640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffacc09ae60 0x7ffacc0af640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:55908/0 (socket says 172.21.15.179:55908) 2024-04-16T15:51:51.805 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.798+0000 7ffad0959640 1 -- 172.21.15.179:0/3434062541 learned_addr learned my addr 172.21.15.179:0/3434062541 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-04-16T15:51:51.805 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.798+0000 7ffacbfff640 1 --2- 172.21.15.179:0/3434062541 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffacc0ce3f0 0x7ffacc15cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:51.805 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.798+0000 7ffad115a640 1 -- 172.21.15.179:0/3434062541 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffacc09ae60 msgr2=0x7ffacc0af640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:51:51.805 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.798+0000 7ffad115a640 1 --2- 172.21.15.179:0/3434062541 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffacc09ae60 0x7ffacc0af640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:51.805 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.798+0000 7ffad115a640 1 -- 172.21.15.179:0/3434062541 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffacc0ce3f0 msgr2=0x7ffacc15cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:51:51.805 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.798+0000 7ffad115a640 1 --2- 172.21.15.179:0/3434062541 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffacc0ce3f0 0x7ffacc15cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:51.805 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.798+0000 7ffad115a640 1 -- 172.21.15.179:0/3434062541 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffacc0b7f10 con 0x7ffacc160350 2024-04-16T15:51:51.805 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.798+0000 7ffad0959640 1 --2- 172.21.15.179:0/3434062541 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffacc09ae60 0x7ffacc0af640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:51:51.805 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.798+0000 7ffad115a640 1 --2- 172.21.15.179:0/3434062541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffacc160350 0x7ffacc15d4e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ffac4007db0 tx=0x7ffac400d4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:51:51.805 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.798+0000 7ffac97fa640 1 -- 172.21.15.179:0/3434062541 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac401a070 con 0x7ffacc160350 2024-04-16T15:51:51.805 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.798+0000 7ffac97fa640 1 -- 172.21.15.179:0/3434062541 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffac4003990 con 0x7ffacc160350 2024-04-16T15:51:51.805 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.799+0000 7ffad2bbd640 1 -- 172.21.15.179:0/3434062541 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffacc0b8180 con 0x7ffacc160350 2024-04-16T15:51:51.805 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.799+0000 7ffac97fa640 1 -- 172.21.15.179:0/3434062541 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac4003d80 con 0x7ffacc160350 2024-04-16T15:51:51.805 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.799+0000 7ffad2bbd640 1 -- 172.21.15.179:0/3434062541 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffacc0b59b0 con 0x7ffacc160350 2024-04-16T15:51:51.806 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.799+0000 7ffac97fa640 1 -- 172.21.15.179:0/3434062541 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ffac401d070 con 0x7ffacc160350 2024-04-16T15:51:51.806 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.799+0000 7ffac97fa640 1 -- 172.21.15.179:0/3434062541 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7ffac401faa0 con 0x7ffacc160350 2024-04-16T15:51:51.806 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.800+0000 7ffad2bbd640 1 -- 172.21.15.179:0/3434062541 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffacc075510 con 0x7ffacc160350 2024-04-16T15:51:51.806 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.802+0000 7ffac97fa640 1 -- 172.21.15.179:0/3434062541 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7ffac4024080 con 0x7ffacc160350 2024-04-16T15:51:51.873 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.874+0000 7ffad2bbd640 1 -- 172.21.15.179:0/3434062541 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2d45908b-6e22-4619-b190-897af594b712", "id": 0} v 0) -- 0x7ffacc0b49b0 con 0x7ffacc160350 2024-04-16T15:51:51.876 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.877+0000 7ffac97fa640 1 -- 172.21.15.179:0/3434062541 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2d45908b-6e22-4619-b190-897af594b712", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7ffac4010070 con 0x7ffacc160350 2024-04-16T15:51:51.876 INFO:teuthology.orchestra.run.smithi179.stdout:0 2024-04-16T15:51:51.877 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.878+0000 7ffad2bbd640 1 -- 172.21.15.179:0/3434062541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffacc160350 msgr2=0x7ffacc15d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:51:51.878 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.878+0000 7ffad2bbd640 1 --2- 172.21.15.179:0/3434062541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffacc160350 0x7ffacc15d4e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ffac4007db0 tx=0x7ffac400d4a0 comp rx=0 tx=0).stop 2024-04-16T15:51:51.878 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.878+0000 7ffad2bbd640 1 -- 172.21.15.179:0/3434062541 shutdown_connections 2024-04-16T15:51:51.878 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.878+0000 7ffad2bbd640 1 --2- 172.21.15.179:0/3434062541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffacc160350 0x7ffacc15d4e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:51.878 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.878+0000 7ffad2bbd640 1 --2- 172.21.15.179:0/3434062541 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffacc0ce3f0 0x7ffacc15cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:51.878 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.878+0000 7ffad2bbd640 1 --2- 172.21.15.179:0/3434062541 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffacc09ae60 0x7ffacc0af640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:51.878 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.878+0000 7ffad2bbd640 1 -- 172.21.15.179:0/3434062541 >> 172.21.15.179:0/3434062541 conn(0x7ffacc0b43c0 msgr2=0x7ffacc0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:51:51.878 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.878+0000 7ffad2bbd640 1 -- 172.21.15.179:0/3434062541 shutdown_connections 2024-04-16T15:51:51.878 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.878+0000 7ffad2bbd640 1 -- 172.21.15.179:0/3434062541 wait complete. 2024-04-16T15:51:51.888 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new c88bf082-e51f-4ee6-815a-025f6ce0d67b 1 2024-04-16T15:51:51.993 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.993+0000 7fb9b6796640 1 Processor -- start 2024-04-16T15:51:51.993 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.994+0000 7fb9b6796640 1 -- start start 2024-04-16T15:51:51.995 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.994+0000 7fb9b6796640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb9b0070cd0 0x7fb9b015fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:51.995 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.994+0000 7fb9b6796640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9b00aee70 0x7fb9b006ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:51.995 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.994+0000 7fb9b6796640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9b00b5030 con 0x7fb9b00b4ba0 2024-04-16T15:51:51.995 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.994+0000 7fb9b6796640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fb9b00b5310 con 0x7fb9b0070cd0 2024-04-16T15:51:51.995 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.994+0000 7fb9b6796640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb9b00b55f0 con 0x7fb9b00aee70 2024-04-16T15:51:51.995 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.994+0000 7fb9b4d33640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9b00aee70 0x7fb9b006ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:51.995 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.995+0000 7fb9affff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb9b0070cd0 0x7fb9b015fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:51.995 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.995+0000 7fb9b4d33640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9b00aee70 0x7fb9b006ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:55916/0 (socket says 172.21.15.179:55916) 2024-04-16T15:51:51.996 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.995+0000 7fb9b4d33640 1 -- 172.21.15.179:0/4156334849 learned_addr learned my addr 172.21.15.179:0/4156334849 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-04-16T15:51:51.996 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.995+0000 7fb9b4d33640 1 -- 172.21.15.179:0/4156334849 >> v2:172.21.15.179:3300/0 conn(0x7fb9b0070cd0 msgr2=0x7fb9b015fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:51:51.996 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.995+0000 7fb9b4d33640 1 --2- 172.21.15.179:0/4156334849 >> v2:172.21.15.179:3300/0 conn(0x7fb9b0070cd0 0x7fb9b015fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:51.996 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.995+0000 7fb9b4d33640 1 -- 172.21.15.179:0/4156334849 >> v1:172.21.15.132:6789/0 conn(0x7fb9b00b4ba0 legacy=0x7fb9b00ae760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:51:51.996 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.995+0000 7fb9b4d33640 1 -- 172.21.15.179:0/4156334849 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9b00b58d0 con 0x7fb9b00aee70 2024-04-16T15:51:51.996 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.995+0000 7fb9affff640 1 --2- 172.21.15.179:0/4156334849 >> v2:172.21.15.179:3300/0 conn(0x7fb9b0070cd0 0x7fb9b015fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:51:51.996 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.996+0000 7fb9b4d33640 1 --2- 172.21.15.179:0/4156334849 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9b00aee70 0x7fb9b006ba20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb9a8009e80 tx=0x7fb9a802bf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7c00b914371442c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:51:51.996 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.996+0000 7fb9aeffd640 1 -- 172.21.15.179:0/4156334849 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a802caf0 con 0x7fb9b00aee70 2024-04-16T15:51:51.996 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.996+0000 7fb9aeffd640 1 -- 172.21.15.179:0/4156334849 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9a802cc90 con 0x7fb9b00aee70 2024-04-16T15:51:51.996 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.996+0000 7fb9aeffd640 1 -- 172.21.15.179:0/4156334849 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a8034610 con 0x7fb9b00aee70 2024-04-16T15:51:51.999 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.996+0000 7fb9b6796640 1 -- 172.21.15.179:0/4156334849 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9b00aee70 msgr2=0x7fb9b006ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:51:51.999 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.996+0000 7fb9b6796640 1 --2- 172.21.15.179:0/4156334849 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9b00aee70 0x7fb9b006ba20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb9a8009e80 tx=0x7fb9a802bf50 comp rx=0 tx=0).stop 2024-04-16T15:51:51.999 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.996+0000 7fb9b6796640 1 -- 172.21.15.179:0/4156334849 shutdown_connections 2024-04-16T15:51:51.999 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.996+0000 7fb9b6796640 1 --2- 172.21.15.179:0/4156334849 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9b00aee70 0x7fb9b006ba20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:51.999 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.996+0000 7fb9b6796640 1 --2- 172.21.15.179:0/4156334849 >> v2:172.21.15.179:3300/0 conn(0x7fb9b0070cd0 0x7fb9b015fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:51.999 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.996+0000 7fb9b6796640 1 -- 172.21.15.179:0/4156334849 >> 172.21.15.179:0/4156334849 conn(0x7fb9b00d1180 msgr2=0x7fb9b00d1590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:51:52.000 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.996+0000 7fb9b6796640 1 -- 172.21.15.179:0/4156334849 shutdown_connections 2024-04-16T15:51:52.000 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.996+0000 7fb9b6796640 1 -- 172.21.15.179:0/4156334849 wait complete. 2024-04-16T15:51:52.000 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.997+0000 7fb9b6796640 1 Processor -- start 2024-04-16T15:51:52.000 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.998+0000 7fb9b6796640 1 -- start start 2024-04-16T15:51:52.000 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.998+0000 7fb9b6796640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9b0070cd0 0x7fb9b0159780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:52.000 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.998+0000 7fb9b6796640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9b00aee70 0x7fb9b00ce310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:52.000 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.998+0000 7fb9b6796640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9b0159cc0 0x7fb9b00ce850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:52.000 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.998+0000 7fb9b6796640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b0071230 con 0x7fb9b0070cd0 2024-04-16T15:51:52.000 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.998+0000 7fb9b6796640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b00710b0 con 0x7fb9b0159cc0 2024-04-16T15:51:52.000 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.998+0000 7fb9b6796640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb9b00b60d0 con 0x7fb9b00aee70 2024-04-16T15:51:52.000 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.998+0000 7fb9af7fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9b00aee70 0x7fb9b00ce310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:52.000 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.998+0000 7fb9b4d33640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9b0159cc0 0x7fb9b00ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:52.001 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.999+0000 7fb9b4d33640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9b0159cc0 0x7fb9b00ce850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:52642/0 (socket says 172.21.15.179:52642) 2024-04-16T15:51:52.001 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.999+0000 7fb9b4d33640 1 -- 172.21.15.179:0/3616893322 learned_addr learned my addr 172.21.15.179:0/3616893322 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-04-16T15:51:52.001 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.999+0000 7fb9af7fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9b00aee70 0x7fb9b00ce310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:55924/0 (socket says 172.21.15.179:55924) 2024-04-16T15:51:52.001 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.999+0000 7fb9affff640 1 --2- 172.21.15.179:0/3616893322 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9b0070cd0 0x7fb9b0159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:52.001 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.999+0000 7fb9b4d33640 1 -- 172.21.15.179:0/3616893322 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9b00aee70 msgr2=0x7fb9b00ce310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:51:52.001 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.999+0000 7fb9b4d33640 1 --2- 172.21.15.179:0/3616893322 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9b00aee70 0x7fb9b00ce310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:52.001 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.999+0000 7fb9b4d33640 1 -- 172.21.15.179:0/3616893322 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9b0070cd0 msgr2=0x7fb9b0159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:51:52.001 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.999+0000 7fb9b4d33640 1 --2- 172.21.15.179:0/3616893322 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9b0070cd0 0x7fb9b0159780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:52.001 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.999+0000 7fb9b4d33640 1 -- 172.21.15.179:0/3616893322 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9b0148a50 con 0x7fb9b0159cc0 2024-04-16T15:51:52.001 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.999+0000 7fb9af7fe640 1 --2- 172.21.15.179:0/3616893322 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9b00aee70 0x7fb9b00ce310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:51:52.001 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.999+0000 7fb9b4d33640 1 --2- 172.21.15.179:0/3616893322 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9b0159cc0 0x7fb9b00ce850 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb9a8036040 tx=0x7fb9a8004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:51:52.001 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.999+0000 7fb9acff9640 1 -- 172.21.15.179:0/3616893322 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a8043020 con 0x7fb9b0159cc0 2024-04-16T15:51:52.001 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.999+0000 7fb9acff9640 1 -- 172.21.15.179:0/3616893322 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9a803e450 con 0x7fb9b0159cc0 2024-04-16T15:51:52.001 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.999+0000 7fb9acff9640 1 -- 172.21.15.179:0/3616893322 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a8009510 con 0x7fb9b0159cc0 2024-04-16T15:51:52.001 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.999+0000 7fb9b6796640 1 -- 172.21.15.179:0/3616893322 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9b0148d30 con 0x7fb9b0159cc0 2024-04-16T15:51:52.002 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.999+0000 7fb9b6796640 1 -- 172.21.15.179:0/3616893322 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9b01492f0 con 0x7fb9b0159cc0 2024-04-16T15:51:52.002 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.999+0000 7fb9acff9640 1 -- 172.21.15.179:0/3616893322 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb9a8046020 con 0x7fb9b0159cc0 2024-04-16T15:51:52.002 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:51.999+0000 7fb9acff9640 1 -- 172.21.15.179:0/3616893322 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fb9a80487b0 con 0x7fb9b0159cc0 2024-04-16T15:51:52.002 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.000+0000 7fb9b6796640 1 -- 172.21.15.179:0/3616893322 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9b0075510 con 0x7fb9b0159cc0 2024-04-16T15:51:52.002 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.002+0000 7fb9acff9640 1 -- 172.21.15.179:0/3616893322 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fb9a804d030 con 0x7fb9b0159cc0 2024-04-16T15:51:52.074 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.075+0000 7fb9b6796640 1 -- 172.21.15.179:0/3616893322 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c88bf082-e51f-4ee6-815a-025f6ce0d67b", "id": 1} v 0) -- 0x7fb9b00b4590 con 0x7fb9b0159cc0 2024-04-16T15:51:52.078 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.079+0000 7fb9acff9640 1 -- 172.21.15.179:0/3616893322 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c88bf082-e51f-4ee6-815a-025f6ce0d67b", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fb9a802cb00 con 0x7fb9b0159cc0 2024-04-16T15:51:52.078 INFO:teuthology.orchestra.run.smithi179.stdout:1 2024-04-16T15:51:52.079 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.079+0000 7fb9b6796640 1 -- 172.21.15.179:0/3616893322 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9b0159cc0 msgr2=0x7fb9b00ce850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:51:52.079 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.079+0000 7fb9b6796640 1 --2- 172.21.15.179:0/3616893322 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9b0159cc0 0x7fb9b00ce850 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb9a8036040 tx=0x7fb9a8004a40 comp rx=0 tx=0).stop 2024-04-16T15:51:52.079 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.079+0000 7fb9b6796640 1 -- 172.21.15.179:0/3616893322 shutdown_connections 2024-04-16T15:51:52.079 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.079+0000 7fb9b6796640 1 --2- 172.21.15.179:0/3616893322 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9b0159cc0 0x7fb9b00ce850 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:52.079 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.079+0000 7fb9b6796640 1 --2- 172.21.15.179:0/3616893322 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9b00aee70 0x7fb9b00ce310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:52.079 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.079+0000 7fb9b6796640 1 --2- 172.21.15.179:0/3616893322 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9b0070cd0 0x7fb9b0159780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:52.079 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.079+0000 7fb9b6796640 1 -- 172.21.15.179:0/3616893322 >> 172.21.15.179:0/3616893322 conn(0x7fb9b00d1180 msgr2=0x7fb9b0158060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:51:52.079 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.080+0000 7fb9b6796640 1 -- 172.21.15.179:0/3616893322 shutdown_connections 2024-04-16T15:51:52.080 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.080+0000 7fb9b6796640 1 -- 172.21.15.179:0/3616893322 wait complete. 2024-04-16T15:51:52.091 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new e5dbd6b4-4e7b-47e4-ad4e-35b4b81696c7 2 2024-04-16T15:51:52.165 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-04-16T15:51:52.166+0000 7fd895645040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-16T15:51:52.194 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.195+0000 7f8726de6640 1 Processor -- start 2024-04-16T15:51:52.194 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.195+0000 7f8726de6640 1 -- start start 2024-04-16T15:51:52.195 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.195+0000 7f8726de6640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f872009ae60 0x7f872015fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:52.195 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.195+0000 7f8726de6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87200d04a0 0x7f8720160180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:52.195 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.195+0000 7f8726de6640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f872009b240 0x7f87200cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:52.195 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.195+0000 7f8726de6640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f872009bc40 con 0x7f872009ae60 2024-04-16T15:51:52.196 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.195+0000 7f8726de6640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f872009bf20 con 0x7f872009b240 2024-04-16T15:51:52.196 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.195+0000 7f8726de6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f87200b3ab0 con 0x7f87200d04a0 2024-04-16T15:51:52.196 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.196+0000 7f8725383640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f872009b240 0x7f87200cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:52.196 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.196+0000 7f871ffff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87200d04a0 0x7f8720160180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:52.196 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.196+0000 7f8725383640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f872009b240 0x7f87200cd3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:52652/0 (socket says 172.21.15.179:52652) 2024-04-16T15:51:52.196 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.196+0000 7f8725383640 1 -- 172.21.15.179:0/416632060 learned_addr learned my addr 172.21.15.179:0/416632060 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-04-16T15:51:52.196 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.196+0000 7f8724b82640 1 --2- 172.21.15.179:0/416632060 >> v2:172.21.15.132:3300/0 conn(0x7f872009ae60 0x7f872015fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:52.196 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.196+0000 7f871ffff640 1 -- 172.21.15.179:0/416632060 >> v2:172.21.15.179:3300/0 conn(0x7f872009b240 msgr2=0x7f87200cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:51:52.196 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.196+0000 7f871ffff640 1 --2- 172.21.15.179:0/416632060 >> v2:172.21.15.179:3300/0 conn(0x7f872009b240 0x7f87200cd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:52.196 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.196+0000 7f871ffff640 1 -- 172.21.15.179:0/416632060 >> v2:172.21.15.132:3300/0 conn(0x7f872009ae60 msgr2=0x7f872015fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:51:52.196 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.196+0000 7f871ffff640 1 --2- 172.21.15.179:0/416632060 >> v2:172.21.15.132:3300/0 conn(0x7f872009ae60 0x7f872015fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:52.196 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.196+0000 7f871ffff640 1 -- 172.21.15.179:0/416632060 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87200b3d90 con 0x7f87200d04a0 2024-04-16T15:51:52.196 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.196+0000 7f8725383640 1 --2- 172.21.15.179:0/416632060 >> v2:172.21.15.179:3300/0 conn(0x7f872009b240 0x7f87200cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:51:52.196 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.196+0000 7f8724b82640 1 --2- 172.21.15.179:0/416632060 >> v2:172.21.15.132:3300/0 conn(0x7f872009ae60 0x7f872015fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:51:52.198 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.197+0000 7f871ffff640 1 --2- 172.21.15.179:0/416632060 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87200d04a0 0x7f8720160180 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f87200b8950 tx=0x7f870c02b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e030e919d5907c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:51:52.198 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.197+0000 7f871f7fe640 1 -- 172.21.15.179:0/416632060 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f870c038070 con 0x7f87200d04a0 2024-04-16T15:51:52.198 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.197+0000 7f871f7fe640 1 -- 172.21.15.179:0/416632060 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f870c031700 con 0x7f87200d04a0 2024-04-16T15:51:52.198 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.197+0000 7f871f7fe640 1 -- 172.21.15.179:0/416632060 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f870c031ad0 con 0x7f87200d04a0 2024-04-16T15:51:52.198 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.197+0000 7f8726de6640 1 -- 172.21.15.179:0/416632060 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87200d04a0 msgr2=0x7f8720160180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:51:52.198 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.197+0000 7f8726de6640 1 --2- 172.21.15.179:0/416632060 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87200d04a0 0x7f8720160180 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f87200b8950 tx=0x7f870c02b7a0 comp rx=0 tx=0).stop 2024-04-16T15:51:52.198 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.197+0000 7f8726de6640 1 -- 172.21.15.179:0/416632060 shutdown_connections 2024-04-16T15:51:52.198 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.197+0000 7f8726de6640 1 --2- 172.21.15.179:0/416632060 >> v2:172.21.15.179:3300/0 conn(0x7f872009b240 0x7f87200cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:52.198 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.197+0000 7f8726de6640 1 --2- 172.21.15.179:0/416632060 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87200d04a0 0x7f8720160180 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:52.198 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.197+0000 7f8726de6640 1 --2- 172.21.15.179:0/416632060 >> v2:172.21.15.132:3300/0 conn(0x7f872009ae60 0x7f872015fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:52.199 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.197+0000 7f8726de6640 1 -- 172.21.15.179:0/416632060 >> 172.21.15.179:0/416632060 conn(0x7f87200b43c0 msgr2=0x7f87200b47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:51:52.199 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.198+0000 7f8726de6640 1 -- 172.21.15.179:0/416632060 shutdown_connections 2024-04-16T15:51:52.199 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.198+0000 7f8726de6640 1 -- 172.21.15.179:0/416632060 wait complete. 2024-04-16T15:51:52.199 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.199+0000 7f8726de6640 1 Processor -- start 2024-04-16T15:51:52.199 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.199+0000 7f8726de6640 1 -- start start 2024-04-16T15:51:52.201 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.199+0000 7f8726de6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f872009ae60 0x7f87201e58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:52.201 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.199+0000 7f8726de6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f872009b240 0x7f87201f2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:52.201 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.200+0000 7f8726de6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87200d04a0 0x7f87200b7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:52.201 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.200+0000 7f8726de6640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f87200cdaa0 con 0x7f872009b240 2024-04-16T15:51:52.201 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.200+0000 7f8726de6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f87200cd920 con 0x7f87200d04a0 2024-04-16T15:51:52.201 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.200+0000 7f8726de6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f87200cdc20 con 0x7f872009ae60 2024-04-16T15:51:52.201 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.200+0000 7f8724b82640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f872009ae60 0x7f87201e58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:52.201 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.200+0000 7f8724b82640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f872009ae60 0x7f87201e58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:55930/0 (socket says 172.21.15.179:55930) 2024-04-16T15:51:52.201 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.200+0000 7f8724b82640 1 -- 172.21.15.179:0/761510387 learned_addr learned my addr 172.21.15.179:0/761510387 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-04-16T15:51:52.202 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.200+0000 7f8725383640 1 --2- 172.21.15.179:0/761510387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87200d04a0 0x7f87200b7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:52.202 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.200+0000 7f871ffff640 1 --2- 172.21.15.179:0/761510387 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f872009b240 0x7f87201f2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:52.202 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.200+0000 7f8724b82640 1 -- 172.21.15.179:0/761510387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87200d04a0 msgr2=0x7f87200b7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:51:52.202 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.200+0000 7f8724b82640 1 --2- 172.21.15.179:0/761510387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87200d04a0 0x7f87200b7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:52.202 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.200+0000 7f8724b82640 1 -- 172.21.15.179:0/761510387 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f872009b240 msgr2=0x7f87201f2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:51:52.202 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.200+0000 7f8724b82640 1 --2- 172.21.15.179:0/761510387 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f872009b240 0x7f87201f2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:52.202 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.200+0000 7f8724b82640 1 -- 172.21.15.179:0/761510387 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87201e5f30 con 0x7f872009ae60 2024-04-16T15:51:52.202 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.200+0000 7f8725383640 1 --2- 172.21.15.179:0/761510387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87200d04a0 0x7f87200b7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:51:52.202 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.200+0000 7f8724b82640 1 --2- 172.21.15.179:0/761510387 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f872009ae60 0x7f87201e58a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f871400e760 tx=0x7f871400ec20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:51:52.202 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.200+0000 7f871d7fa640 1 -- 172.21.15.179:0/761510387 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f871400f040 con 0x7f872009ae60 2024-04-16T15:51:52.202 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.200+0000 7f871d7fa640 1 -- 172.21.15.179:0/761510387 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8714004030 con 0x7f872009ae60 2024-04-16T15:51:52.202 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.200+0000 7f8726de6640 1 -- 172.21.15.179:0/761510387 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87201e6210 con 0x7f872009ae60 2024-04-16T15:51:52.202 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.200+0000 7f871d7fa640 1 -- 172.21.15.179:0/761510387 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8714004420 con 0x7f872009ae60 2024-04-16T15:51:52.203 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.200+0000 7f8726de6640 1 -- 172.21.15.179:0/761510387 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f87201e67d0 con 0x7f872009ae60 2024-04-16T15:51:52.203 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.200+0000 7f871d7fa640 1 -- 172.21.15.179:0/761510387 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f871400ca60 con 0x7f872009ae60 2024-04-16T15:51:52.203 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.201+0000 7f871d7fa640 1 -- 172.21.15.179:0/761510387 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f87140138d0 con 0x7f872009ae60 2024-04-16T15:51:52.203 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.201+0000 7f8726de6640 1 -- 172.21.15.179:0/761510387 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8720075510 con 0x7f872009ae60 2024-04-16T15:51:52.204 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.205+0000 7f871d7fa640 1 -- 172.21.15.179:0/761510387 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f8714017020 con 0x7f872009ae60 2024-04-16T15:51:52.210 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-16T15:51:52.211+0000 7ff84fe32040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-16T15:51:52.219 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-04-16T15:51:52.220+0000 7fd895645040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-16T15:51:52.263 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-04-16T15:51:52.264+0000 7fd895645040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-16T15:51:52.266 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-16T15:51:52.267+0000 7ff84fe32040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-16T15:51:52.277 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.278+0000 7f8726de6640 1 -- 172.21.15.179:0/761510387 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e5dbd6b4-4e7b-47e4-ad4e-35b4b81696c7", "id": 2} v 0) -- 0x7f87200b84a0 con 0x7f872009ae60 2024-04-16T15:51:52.281 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.282+0000 7f871d7fa640 1 -- 172.21.15.179:0/761510387 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e5dbd6b4-4e7b-47e4-ad4e-35b4b81696c7", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f87140134b0 con 0x7f872009ae60 2024-04-16T15:51:52.281 INFO:teuthology.orchestra.run.smithi179.stdout:2 2024-04-16T15:51:52.282 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.282+0000 7f8726de6640 1 -- 172.21.15.179:0/761510387 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f872009ae60 msgr2=0x7f87201e58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:51:52.282 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.282+0000 7f8726de6640 1 --2- 172.21.15.179:0/761510387 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f872009ae60 0x7f87201e58a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f871400e760 tx=0x7f871400ec20 comp rx=0 tx=0).stop 2024-04-16T15:51:52.282 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.283+0000 7f8726de6640 1 -- 172.21.15.179:0/761510387 shutdown_connections 2024-04-16T15:51:52.282 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.283+0000 7f8726de6640 1 --2- 172.21.15.179:0/761510387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87200d04a0 0x7f87200b7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:52.282 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.283+0000 7f8726de6640 1 --2- 172.21.15.179:0/761510387 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f872009b240 0x7f87201f2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:52.282 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.283+0000 7f8726de6640 1 --2- 172.21.15.179:0/761510387 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f872009ae60 0x7f87201e58a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:52.283 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.283+0000 7f8726de6640 1 -- 172.21.15.179:0/761510387 >> 172.21.15.179:0/761510387 conn(0x7f87200b43c0 msgr2=0x7f87200cfb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:51:52.283 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.283+0000 7f8726de6640 1 -- 172.21.15.179:0/761510387 shutdown_connections 2024-04-16T15:51:52.283 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.283+0000 7f8726de6640 1 -- 172.21.15.179:0/761510387 wait complete. 2024-04-16T15:51:52.293 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 9d75cd67-3b8a-4424-8884-5f3660e1f5f6 3 2024-04-16T15:51:52.315 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-16T15:51:52.316+0000 7ff84fe32040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-16T15:51:52.317 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-04-16T15:51:52.319+0000 7fd895645040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-16T15:51:52.360 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-04-16T15:51:52.361+0000 7fd895645040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-16T15:51:52.372 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-16T15:51:52.373+0000 7ff84fe32040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-16T15:51:52.396 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.397+0000 7f9d3c500640 1 Processor -- start 2024-04-16T15:51:52.396 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.397+0000 7f9d3c500640 1 -- start start 2024-04-16T15:51:52.398 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.398+0000 7f9d3c500640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9d3409ae60 0x7f9d3415fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:52.398 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.398+0000 7f9d3c500640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d3409bc40 con 0x7f9d340b2e30 2024-04-16T15:51:52.398 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.398+0000 7f9d3c500640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d3409bf20 con 0x7f9d340d04a0 2024-04-16T15:51:52.398 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.398+0000 7f9d3c500640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f9d340b3ab0 con 0x7f9d3409ae60 2024-04-16T15:51:52.398 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.398+0000 7f9d3a29c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9d3409ae60 0x7f9d3415fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:52.398 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.398+0000 7f9d39a9b640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f9d340d04a0 0x7f9d340cd3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:50446/0 (socket says 172.21.15.179:50446) 2024-04-16T15:51:52.398 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.398+0000 7f9d39a9b640 1 -- 172.21.15.179:0/1638735177 learned_addr learned my addr 172.21.15.179:0/1638735177 (peer_addr_for_me v1:172.21.15.179:0/0) 2024-04-16T15:51:52.398 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.398+0000 7f9d3a29c640 1 -- 172.21.15.179:0/1638735177 >> v1:172.21.15.179:6789/0 conn(0x7f9d340d04a0 legacy=0x7f9d340cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:51:52.398 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.398+0000 7f9d3a29c640 1 -- 172.21.15.179:0/1638735177 >> v1:172.21.15.132:6789/0 conn(0x7f9d340b2e30 legacy=0x7f9d340cdaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:51:52.398 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.398+0000 7f9d3a29c640 1 -- 172.21.15.179:0/1638735177 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d340b3d90 con 0x7f9d3409ae60 2024-04-16T15:51:52.400 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.399+0000 7f9d3a29c640 1 --2- 172.21.15.179:0/1638735177 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d3409ae60 0x7f9d3415fc40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9d240097a0 tx=0x7f9d2402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e44e844a2c7eaa7 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:51:52.400 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.399+0000 7f9d3929a640 1 -- 172.21.15.179:0/1638735177 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d24035020 con 0x7f9d3409ae60 2024-04-16T15:51:52.400 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.399+0000 7f9d3929a640 1 -- 172.21.15.179:0/1638735177 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d24031830 con 0x7f9d3409ae60 2024-04-16T15:51:52.400 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.399+0000 7f9d3929a640 1 -- 172.21.15.179:0/1638735177 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d24031c00 con 0x7f9d3409ae60 2024-04-16T15:51:52.400 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.400+0000 7f9d3c500640 1 -- 172.21.15.179:0/1638735177 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d3409ae60 msgr2=0x7f9d3415fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:51:52.400 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.400+0000 7f9d3c500640 1 --2- 172.21.15.179:0/1638735177 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d3409ae60 0x7f9d3415fc40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9d240097a0 tx=0x7f9d2402b8d0 comp rx=0 tx=0).stop 2024-04-16T15:51:52.401 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.400+0000 7f9d3c500640 1 -- 172.21.15.179:0/1638735177 shutdown_connections 2024-04-16T15:51:52.401 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.400+0000 7f9d3c500640 1 --2- 172.21.15.179:0/1638735177 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d3409ae60 0x7f9d3415fc40 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:52.401 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.400+0000 7f9d3c500640 1 -- 172.21.15.179:0/1638735177 >> 172.21.15.179:0/1638735177 conn(0x7f9d340b43c0 msgr2=0x7f9d340b47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:51:52.401 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.400+0000 7f9d3c500640 1 -- 172.21.15.179:0/1638735177 shutdown_connections 2024-04-16T15:51:52.401 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.400+0000 7f9d3c500640 1 -- 172.21.15.179:0/1638735177 wait complete. 2024-04-16T15:51:52.401 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.401+0000 7f9d3c500640 1 Processor -- start 2024-04-16T15:51:52.401 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.401+0000 7f9d3c500640 1 -- start start 2024-04-16T15:51:52.404 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.402+0000 7f9d3c500640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d3409ae60 0x7f9d340cc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:52.404 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.402+0000 7f9d3c500640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d340b2e30 0x7f9d34153490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:52.404 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.402+0000 7f9d3c500640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d340d04a0 0x7f9d340b6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:52.404 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.402+0000 7f9d3c500640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3409b3c0 con 0x7f9d340b2e30 2024-04-16T15:51:52.404 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.402+0000 7f9d3c500640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3409b240 con 0x7f9d340d04a0 2024-04-16T15:51:52.404 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.402+0000 7f9d3c500640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9d3409b540 con 0x7f9d3409ae60 2024-04-16T15:51:52.404 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.402+0000 7f9d3a29c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d3409ae60 0x7f9d340cc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:52.405 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.402+0000 7f9d3a29c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d3409ae60 0x7f9d340cc3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:55940/0 (socket says 172.21.15.179:55940) 2024-04-16T15:51:52.405 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.402+0000 7f9d3aa9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d340d04a0 0x7f9d340b6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:52.405 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.402+0000 7f9d3a29c640 1 -- 172.21.15.179:0/4088441058 learned_addr learned my addr 172.21.15.179:0/4088441058 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-04-16T15:51:52.405 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.402+0000 7f9d39a9b640 1 --2- 172.21.15.179:0/4088441058 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d340b2e30 0x7f9d34153490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:52.405 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.402+0000 7f9d3a29c640 1 -- 172.21.15.179:0/4088441058 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d340d04a0 msgr2=0x7f9d340b6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:51:52.405 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.402+0000 7f9d3a29c640 1 --2- 172.21.15.179:0/4088441058 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d340d04a0 0x7f9d340b6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:52.405 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.402+0000 7f9d3a29c640 1 -- 172.21.15.179:0/4088441058 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d340b2e30 msgr2=0x7f9d34153490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:51:52.405 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.402+0000 7f9d3a29c640 1 --2- 172.21.15.179:0/4088441058 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d340b2e30 0x7f9d34153490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:52.405 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.402+0000 7f9d3a29c640 1 -- 172.21.15.179:0/4088441058 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d341539d0 con 0x7f9d3409ae60 2024-04-16T15:51:52.405 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.403+0000 7f9d3a29c640 1 --2- 172.21.15.179:0/4088441058 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d3409ae60 0x7f9d340cc3a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9d24034040 tx=0x7f9d240046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:51:52.405 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.403+0000 7f9d2affd640 1 -- 172.21.15.179:0/4088441058 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d24040070 con 0x7f9d3409ae60 2024-04-16T15:51:52.405 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.403+0000 7f9d2affd640 1 -- 172.21.15.179:0/4088441058 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d24039a20 con 0x7f9d3409ae60 2024-04-16T15:51:52.405 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.403+0000 7f9d3c500640 1 -- 172.21.15.179:0/4088441058 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d341593c0 con 0x7f9d3409ae60 2024-04-16T15:51:52.406 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.403+0000 7f9d2affd640 1 -- 172.21.15.179:0/4088441058 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d24035040 con 0x7f9d3409ae60 2024-04-16T15:51:52.406 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.403+0000 7f9d3c500640 1 -- 172.21.15.179:0/4088441058 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d341576d0 con 0x7f9d3409ae60 2024-04-16T15:51:52.406 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.403+0000 7f9d2affd640 1 -- 172.21.15.179:0/4088441058 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9d24038020 con 0x7f9d3409ae60 2024-04-16T15:51:52.406 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.403+0000 7f9d2affd640 1 -- 172.21.15.179:0/4088441058 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f9d2403a8b0 con 0x7f9d3409ae60 2024-04-16T15:51:52.406 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.404+0000 7f9d3c500640 1 -- 172.21.15.179:0/4088441058 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d34075510 con 0x7f9d3409ae60 2024-04-16T15:51:52.406 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.406+0000 7f9d2affd640 1 -- 172.21.15.179:0/4088441058 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f9d24052020 con 0x7f9d3409ae60 2024-04-16T15:51:52.418 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-16T15:51:52.419+0000 7ff84fe32040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-16T15:51:52.478 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.479+0000 7f9d3c500640 1 -- 172.21.15.179:0/4088441058 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9d75cd67-3b8a-4424-8884-5f3660e1f5f6", "id": 3} v 0) -- 0x7f9d3406f420 con 0x7f9d3409ae60 2024-04-16T15:51:52.478 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-04-16T15:51:52.480+0000 7fd895645040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-16T15:51:52.481 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.482+0000 7f9d2affd640 1 -- 172.21.15.179:0/4088441058 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9d75cd67-3b8a-4424-8884-5f3660e1f5f6", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f9d2403a420 con 0x7f9d3409ae60 2024-04-16T15:51:52.481 INFO:teuthology.orchestra.run.smithi179.stdout:3 2024-04-16T15:51:52.483 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.483+0000 7f9d3c500640 1 -- 172.21.15.179:0/4088441058 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d3409ae60 msgr2=0x7f9d340cc3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:51:52.483 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.483+0000 7f9d3c500640 1 --2- 172.21.15.179:0/4088441058 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d3409ae60 0x7f9d340cc3a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9d24034040 tx=0x7f9d240046c0 comp rx=0 tx=0).stop 2024-04-16T15:51:52.483 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.483+0000 7f9d3c500640 1 -- 172.21.15.179:0/4088441058 shutdown_connections 2024-04-16T15:51:52.483 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.483+0000 7f9d3c500640 1 --2- 172.21.15.179:0/4088441058 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d340d04a0 0x7f9d340b6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:52.483 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.483+0000 7f9d3c500640 1 --2- 172.21.15.179:0/4088441058 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d340b2e30 0x7f9d34153490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:52.483 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.483+0000 7f9d3c500640 1 --2- 172.21.15.179:0/4088441058 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d3409ae60 0x7f9d340cc3a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:52.483 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.483+0000 7f9d3c500640 1 -- 172.21.15.179:0/4088441058 >> 172.21.15.179:0/4088441058 conn(0x7f9d340b43c0 msgr2=0x7f9d34155c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:51:52.483 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.483+0000 7f9d3c500640 1 -- 172.21.15.179:0/4088441058 shutdown_connections 2024-04-16T15:51:52.483 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.483+0000 7f9d3c500640 1 -- 172.21.15.179:0/4088441058 wait complete. 2024-04-16T15:51:52.493 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 83aea46a-8642-4777-912b-c130e5890da7 4 2024-04-16T15:51:52.540 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-16T15:51:52.541+0000 7ff84fe32040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-16T15:51:52.548 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-04-16T15:51:52.549+0000 7fd895645040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-16T15:51:52.594 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-04-16T15:51:52.595+0000 7fd895645040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-16T15:51:52.614 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-16T15:51:52.615+0000 7ff84fe32040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-16T15:51:52.636 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.637+0000 7f345070e640 1 Processor -- start 2024-04-16T15:51:52.636 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.637+0000 7f345070e640 1 -- start start 2024-04-16T15:51:52.638 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.638+0000 7f345070e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f34480b71f0 0x7f34480d0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:52.638 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.638+0000 7f345070e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34480d1c80 0x7f34480b5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:52.638 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.638+0000 7f345070e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34480b75d0 con 0x7f344815ff90 2024-04-16T15:51:52.638 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.638+0000 7f345070e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f344815f260 con 0x7f34480b71f0 2024-04-16T15:51:52.638 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.638+0000 7f345070e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f344815fb00 con 0x7f34480d1c80 2024-04-16T15:51:52.638 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.638+0000 7f344ecab640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34480d1c80 0x7f34480b5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:52.638 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.638+0000 7f344ecab640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34480d1c80 0x7f34480b5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:55954/0 (socket says 172.21.15.179:55954) 2024-04-16T15:51:52.638 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.638+0000 7f344ecab640 1 -- 172.21.15.179:0/1610837159 learned_addr learned my addr 172.21.15.179:0/1610837159 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-04-16T15:51:52.638 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.638+0000 7f344e4aa640 1 --2- 172.21.15.179:0/1610837159 >> v2:172.21.15.132:3300/0 conn(0x7f34480b71f0 0x7f34480d0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:52.638 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.639+0000 7f344ecab640 1 -- 172.21.15.179:0/1610837159 >> v2:172.21.15.132:3300/0 conn(0x7f34480b71f0 msgr2=0x7f34480d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:51:52.639 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.639+0000 7f344ecab640 1 --2- 172.21.15.179:0/1610837159 >> v2:172.21.15.132:3300/0 conn(0x7f34480b71f0 0x7f34480d0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:52.639 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.639+0000 7f344ecab640 1 -- 172.21.15.179:0/1610837159 >> v1:172.21.15.132:6789/0 conn(0x7f344815ff90 legacy=0x7f34480d1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:51:52.639 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.639+0000 7f344ecab640 1 -- 172.21.15.179:0/1610837159 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34480d0fd0 con 0x7f34480d1c80 2024-04-16T15:51:52.640 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.639+0000 7f344ecab640 1 --2- 172.21.15.179:0/1610837159 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34480d1c80 0x7f34480b5830 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3440009e50 tx=0x7f344002bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4dc4d5a8b43c5293 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:51:52.640 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.640+0000 7f344d4a8640 1 -- 172.21.15.179:0/1610837159 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344002cb00 con 0x7f34480d1c80 2024-04-16T15:51:52.640 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.640+0000 7f344d4a8640 1 -- 172.21.15.179:0/1610837159 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f344002cca0 con 0x7f34480d1c80 2024-04-16T15:51:52.640 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.640+0000 7f344d4a8640 1 -- 172.21.15.179:0/1610837159 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3440034610 con 0x7f34480d1c80 2024-04-16T15:51:52.640 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.640+0000 7f345070e640 1 -- 172.21.15.179:0/1610837159 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34480d1c80 msgr2=0x7f34480b5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:51:52.640 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.640+0000 7f345070e640 1 --2- 172.21.15.179:0/1610837159 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34480d1c80 0x7f34480b5830 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3440009e50 tx=0x7f344002bf60 comp rx=0 tx=0).stop 2024-04-16T15:51:52.640 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.640+0000 7f345070e640 1 -- 172.21.15.179:0/1610837159 shutdown_connections 2024-04-16T15:51:52.640 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.640+0000 7f345070e640 1 --2- 172.21.15.179:0/1610837159 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34480d1c80 0x7f34480b5830 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:52.640 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.640+0000 7f345070e640 1 --2- 172.21.15.179:0/1610837159 >> v2:172.21.15.132:3300/0 conn(0x7f34480b71f0 0x7f34480d0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:52.641 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.640+0000 7f345070e640 1 -- 172.21.15.179:0/1610837159 >> 172.21.15.179:0/1610837159 conn(0x7f34480ce0b0 msgr2=0x7f34480ce4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:51:52.641 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.640+0000 7f345070e640 1 -- 172.21.15.179:0/1610837159 shutdown_connections 2024-04-16T15:51:52.641 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.640+0000 7f345070e640 1 -- 172.21.15.179:0/1610837159 wait complete. 2024-04-16T15:51:52.643 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.641+0000 7f345070e640 1 Processor -- start 2024-04-16T15:51:52.643 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.642+0000 7f345070e640 1 -- start start 2024-04-16T15:51:52.643 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.642+0000 7f345070e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34480b71f0 0x7f3448153fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:52.643 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.642+0000 7f345070e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34480d1c80 0x7f3448144140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:52.643 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.642+0000 7f345070e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f344815ff90 0x7f3448150f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:52.643 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.642+0000 7f345070e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f34480b4090 con 0x7f34480b71f0 2024-04-16T15:51:52.643 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.642+0000 7f345070e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f344815f790 con 0x7f34480d1c80 2024-04-16T15:51:52.643 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.642+0000 7f345070e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f34480d0a50 con 0x7f344815ff90 2024-04-16T15:51:52.644 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.642+0000 7f344ecab640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f344815ff90 0x7f3448150f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:52.644 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.642+0000 7f344dca9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34480d1c80 0x7f3448144140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:52.644 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.642+0000 7f344ecab640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f344815ff90 0x7f3448150f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:55964/0 (socket says 172.21.15.179:55964) 2024-04-16T15:51:52.644 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.642+0000 7f344ecab640 1 -- 172.21.15.179:0/1086168501 learned_addr learned my addr 172.21.15.179:0/1086168501 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-04-16T15:51:52.644 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.642+0000 7f344dca9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34480d1c80 0x7f3448144140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:52690/0 (socket says 172.21.15.179:52690) 2024-04-16T15:51:52.644 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.642+0000 7f344e4aa640 1 --2- 172.21.15.179:0/1086168501 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34480b71f0 0x7f3448153fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:52.644 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.643+0000 7f344ecab640 1 -- 172.21.15.179:0/1086168501 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34480d1c80 msgr2=0x7f3448144140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:51:52.644 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.643+0000 7f344ecab640 1 --2- 172.21.15.179:0/1086168501 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34480d1c80 0x7f3448144140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:52.644 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.643+0000 7f344ecab640 1 -- 172.21.15.179:0/1086168501 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34480b71f0 msgr2=0x7f3448153fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:51:52.644 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.643+0000 7f344ecab640 1 --2- 172.21.15.179:0/1086168501 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34480b71f0 0x7f3448153fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:52.644 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.643+0000 7f344ecab640 1 -- 172.21.15.179:0/1086168501 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3448151470 con 0x7f344815ff90 2024-04-16T15:51:52.644 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.643+0000 7f344dca9640 1 --2- 172.21.15.179:0/1086168501 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34480d1c80 0x7f3448144140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:51:52.644 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.643+0000 7f344ecab640 1 --2- 172.21.15.179:0/1086168501 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f344815ff90 0x7f3448150f30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3440009e50 tx=0x7f3440004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:51:52.644 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.643+0000 7f343affd640 1 -- 172.21.15.179:0/1086168501 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3440043020 con 0x7f344815ff90 2024-04-16T15:51:52.644 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.643+0000 7f343affd640 1 -- 172.21.15.179:0/1086168501 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f344002ce50 con 0x7f344815ff90 2024-04-16T15:51:52.645 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.643+0000 7f345070e640 1 -- 172.21.15.179:0/1086168501 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3448151710 con 0x7f344815ff90 2024-04-16T15:51:52.645 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.643+0000 7f343affd640 1 -- 172.21.15.179:0/1086168501 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3440009510 con 0x7f344815ff90 2024-04-16T15:51:52.645 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.643+0000 7f345070e640 1 -- 172.21.15.179:0/1086168501 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3448151cd0 con 0x7f344815ff90 2024-04-16T15:51:52.645 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.643+0000 7f343affd640 1 -- 172.21.15.179:0/1086168501 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3440046020 con 0x7f344815ff90 2024-04-16T15:51:52.645 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.643+0000 7f343affd640 1 -- 172.21.15.179:0/1086168501 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f344003ed70 con 0x7f344815ff90 2024-04-16T15:51:52.645 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.644+0000 7f345070e640 1 -- 172.21.15.179:0/1086168501 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3448075510 con 0x7f344815ff90 2024-04-16T15:51:52.645 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.646+0000 7f343affd640 1 -- 172.21.15.179:0/1086168501 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f344004d030 con 0x7f344815ff90 2024-04-16T15:51:52.647 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-04-16T15:51:52.648+0000 7fd895645040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-16T15:51:52.664 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-16T15:51:52.665+0000 7ff84fe32040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-16T15:51:52.695 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-04-16T15:51:52.696+0000 7fd895645040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-16T15:51:52.718 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.719+0000 7f345070e640 1 -- 172.21.15.179:0/1086168501 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd new", "uuid": "83aea46a-8642-4777-912b-c130e5890da7", "id": 4} v 0) -- 0x7f34480d23c0 con 0x7f344815ff90 2024-04-16T15:51:52.719 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-16T15:51:52.720+0000 7ff84fe32040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-16T15:51:52.723 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.724+0000 7f343affd640 1 -- 172.21.15.179:0/1086168501 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "83aea46a-8642-4777-912b-c130e5890da7", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f344002cb10 con 0x7f344815ff90 2024-04-16T15:51:52.724 INFO:teuthology.orchestra.run.smithi179.stdout:4 2024-04-16T15:51:52.725 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.725+0000 7f345070e640 1 -- 172.21.15.179:0/1086168501 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f344815ff90 msgr2=0x7f3448150f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:51:52.725 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.725+0000 7f345070e640 1 --2- 172.21.15.179:0/1086168501 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f344815ff90 0x7f3448150f30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3440009e50 tx=0x7f3440004a40 comp rx=0 tx=0).stop 2024-04-16T15:51:52.725 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.725+0000 7f345070e640 1 -- 172.21.15.179:0/1086168501 shutdown_connections 2024-04-16T15:51:52.725 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.725+0000 7f345070e640 1 --2- 172.21.15.179:0/1086168501 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f344815ff90 0x7f3448150f30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:52.725 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.725+0000 7f345070e640 1 --2- 172.21.15.179:0/1086168501 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34480d1c80 0x7f3448144140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:52.725 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.725+0000 7f345070e640 1 --2- 172.21.15.179:0/1086168501 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34480b71f0 0x7f3448153fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:52.725 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.725+0000 7f345070e640 1 -- 172.21.15.179:0/1086168501 >> 172.21.15.179:0/1086168501 conn(0x7f34480ce0b0 msgr2=0x7f34480d11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:51:52.725 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.725+0000 7f345070e640 1 -- 172.21.15.179:0/1086168501 shutdown_connections 2024-04-16T15:51:52.726 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.725+0000 7f345070e640 1 -- 172.21.15.179:0/1086168501 wait complete. 2024-04-16T15:51:52.735 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 534117c8-3317-48d6-b436-afd5709f71e9 5 2024-04-16T15:51:52.769 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-16T15:51:52.769+0000 7ff84fe32040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-16T15:51:52.872 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.872+0000 7ffbc833d640 1 Processor -- start 2024-04-16T15:51:52.872 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.872+0000 7ffbc833d640 1 -- start start 2024-04-16T15:51:52.873 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.873+0000 7ffbc833d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ffbc015b7b0 0x7ffbc00b4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:52.873 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.873+0000 7ffbc833d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbc00d07e0 0x7ffbc0073090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:52.873 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.873+0000 7ffbc833d640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbc015bb90 con 0x7ffbc0073dd0 2024-04-16T15:51:52.873 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.873+0000 7ffbc833d640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7ffbc0071600 con 0x7ffbc015b7b0 2024-04-16T15:51:52.874 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.873+0000 7ffbc833d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ffbc00718e0 con 0x7ffbc00d07e0 2024-04-16T15:51:52.874 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.874+0000 7ffbc68da640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbc00d07e0 0x7ffbc0073090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:52.874 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.874+0000 7ffbc58d8640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7ffbc0073dd0 0x7ffbc00d00d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:50450/0 (socket says 172.21.15.179:50450) 2024-04-16T15:51:52.874 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.874+0000 7ffbc68da640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbc00d07e0 0x7ffbc0073090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:55976/0 (socket says 172.21.15.179:55976) 2024-04-16T15:51:52.874 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.874+0000 7ffbc58d8640 1 -- 172.21.15.179:0/1051170301 learned_addr learned my addr 172.21.15.179:0/1051170301 (peer_addr_for_me v1:172.21.15.179:0/0) 2024-04-16T15:51:52.874 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.874+0000 7ffbc60d9640 1 --2- 172.21.15.179:0/1051170301 >> v2:172.21.15.132:3300/0 conn(0x7ffbc015b7b0 0x7ffbc00b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:52.874 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.874+0000 7ffbc68da640 1 -- 172.21.15.179:0/1051170301 >> v2:172.21.15.132:3300/0 conn(0x7ffbc015b7b0 msgr2=0x7ffbc00b4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:51:52.874 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.874+0000 7ffbc68da640 1 --2- 172.21.15.179:0/1051170301 >> v2:172.21.15.132:3300/0 conn(0x7ffbc015b7b0 0x7ffbc00b4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:52.874 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.874+0000 7ffbc68da640 1 -- 172.21.15.179:0/1051170301 >> v1:172.21.15.179:6789/0 conn(0x7ffbc0073dd0 legacy=0x7ffbc00d00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:51:52.874 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.874+0000 7ffbc50d7640 1 -- 172.21.15.179:0/1051170301 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2597235766 0 0) 0x7ffbc015bb90 con 0x7ffbc0073dd0 2024-04-16T15:51:52.874 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.874+0000 7ffbc68da640 1 -- 172.21.15.179:0/1051170301 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbc00cf8d0 con 0x7ffbc00d07e0 2024-04-16T15:51:52.876 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.875+0000 7ffbc68da640 1 --2- 172.21.15.179:0/1051170301 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbc00d07e0 0x7ffbc0073090 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8009d90 tx=0x7ffbb802bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd31dda774da3c4c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:51:52.876 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.875+0000 7ffbc50d7640 1 -- 172.21.15.179:0/1051170301 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb8039070 con 0x7ffbc00d07e0 2024-04-16T15:51:52.876 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.875+0000 7ffbc50d7640 1 -- 172.21.15.179:0/1051170301 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbb802cc50 con 0x7ffbc00d07e0 2024-04-16T15:51:52.876 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.875+0000 7ffbc50d7640 1 -- 172.21.15.179:0/1051170301 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb8034440 con 0x7ffbc00d07e0 2024-04-16T15:51:52.876 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.875+0000 7ffbc833d640 1 -- 172.21.15.179:0/1051170301 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbc00d07e0 msgr2=0x7ffbc0073090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:51:52.876 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.875+0000 7ffbc833d640 1 --2- 172.21.15.179:0/1051170301 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbc00d07e0 0x7ffbc0073090 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8009d90 tx=0x7ffbb802bea0 comp rx=0 tx=0).stop 2024-04-16T15:51:52.876 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.876+0000 7ffbc833d640 1 -- 172.21.15.179:0/1051170301 shutdown_connections 2024-04-16T15:51:52.876 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.876+0000 7ffbc833d640 1 --2- 172.21.15.179:0/1051170301 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbc00d07e0 0x7ffbc0073090 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:52.876 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.876+0000 7ffbc833d640 1 --2- 172.21.15.179:0/1051170301 >> v2:172.21.15.132:3300/0 conn(0x7ffbc015b7b0 0x7ffbc00b4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:52.876 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.876+0000 7ffbc833d640 1 -- 172.21.15.179:0/1051170301 >> 172.21.15.179:0/1051170301 conn(0x7ffbc006f120 msgr2=0x7ffbc006f530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:51:52.876 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.876+0000 7ffbc833d640 1 -- 172.21.15.179:0/1051170301 shutdown_connections 2024-04-16T15:51:52.876 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.876+0000 7ffbc833d640 1 -- 172.21.15.179:0/1051170301 wait complete. 2024-04-16T15:51:52.877 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.877+0000 7ffbc833d640 1 Processor -- start 2024-04-16T15:51:52.877 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.877+0000 7ffbc833d640 1 -- start start 2024-04-16T15:51:52.879 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.877+0000 7ffbc833d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffbc0073dd0 0x7ffbc0149f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:52.879 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.877+0000 7ffbc833d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbc00d07e0 0x7ffbc0146c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:52.879 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.877+0000 7ffbc833d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbc015b7b0 0x7ffbc006ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:52.879 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.877+0000 7ffbc833d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc0071290 con 0x7ffbc0073dd0 2024-04-16T15:51:52.879 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.877+0000 7ffbc833d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc00cf580 con 0x7ffbc015b7b0 2024-04-16T15:51:52.879 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.877+0000 7ffbc833d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ffbc00b4ba0 con 0x7ffbc00d07e0 2024-04-16T15:51:52.879 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.878+0000 7ffbc68da640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbc015b7b0 0x7ffbc006ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:52.879 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.878+0000 7ffbc58d8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbc00d07e0 0x7ffbc0146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:52.879 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.878+0000 7ffbc68da640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbc015b7b0 0x7ffbc006ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:52694/0 (socket says 172.21.15.179:52694) 2024-04-16T15:51:52.880 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.878+0000 7ffbc68da640 1 -- 172.21.15.179:0/3130482297 learned_addr learned my addr 172.21.15.179:0/3130482297 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-04-16T15:51:52.880 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.878+0000 7ffbc60d9640 1 --2- 172.21.15.179:0/3130482297 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffbc0073dd0 0x7ffbc0149f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:52.880 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.878+0000 7ffbc68da640 1 -- 172.21.15.179:0/3130482297 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbc00d07e0 msgr2=0x7ffbc0146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:51:52.880 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.878+0000 7ffbc68da640 1 --2- 172.21.15.179:0/3130482297 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbc00d07e0 0x7ffbc0146c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:52.880 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.878+0000 7ffbc68da640 1 -- 172.21.15.179:0/3130482297 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffbc0073dd0 msgr2=0x7ffbc0149f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:51:52.880 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.878+0000 7ffbc68da640 1 --2- 172.21.15.179:0/3130482297 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffbc0073dd0 0x7ffbc0149f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:52.880 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.878+0000 7ffbc68da640 1 -- 172.21.15.179:0/3130482297 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbc014a4d0 con 0x7ffbc015b7b0 2024-04-16T15:51:52.880 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.878+0000 7ffbc58d8640 1 --2- 172.21.15.179:0/3130482297 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbc00d07e0 0x7ffbc0146c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:51:52.880 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.878+0000 7ffbc68da640 1 --2- 172.21.15.179:0/3130482297 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbc015b7b0 0x7ffbc006ba20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8009d90 tx=0x7ffbb8004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:51:52.880 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.878+0000 7ffbb6ffd640 1 -- 172.21.15.179:0/3130482297 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb8039050 con 0x7ffbc015b7b0 2024-04-16T15:51:52.880 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.878+0000 7ffbb6ffd640 1 -- 172.21.15.179:0/3130482297 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbb8045070 con 0x7ffbc015b7b0 2024-04-16T15:51:52.880 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.878+0000 7ffbc833d640 1 -- 172.21.15.179:0/3130482297 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbc00af0e0 con 0x7ffbc015b7b0 2024-04-16T15:51:52.880 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.878+0000 7ffbb6ffd640 1 -- 172.21.15.179:0/3130482297 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb8009450 con 0x7ffbc015b7b0 2024-04-16T15:51:52.880 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.878+0000 7ffbc833d640 1 -- 172.21.15.179:0/3130482297 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbc00af6a0 con 0x7ffbc015b7b0 2024-04-16T15:51:52.880 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.878+0000 7ffbb6ffd640 1 -- 172.21.15.179:0/3130482297 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ffbb803e610 con 0x7ffbc015b7b0 2024-04-16T15:51:52.881 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.879+0000 7ffbb6ffd640 1 -- 172.21.15.179:0/3130482297 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7ffbb804ada0 con 0x7ffbc015b7b0 2024-04-16T15:51:52.881 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.879+0000 7ffbc833d640 1 -- 172.21.15.179:0/3130482297 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbc0075510 con 0x7ffbc015b7b0 2024-04-16T15:51:52.881 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.881+0000 7ffbb6ffd640 1 -- 172.21.15.179:0/3130482297 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7ffbb804a820 con 0x7ffbc015b7b0 2024-04-16T15:51:52.953 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.954+0000 7ffbc833d640 1 -- 172.21.15.179:0/3130482297 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd new", "uuid": "534117c8-3317-48d6-b436-afd5709f71e9", "id": 5} v 0) -- 0x7ffbc006f880 con 0x7ffbc015b7b0 2024-04-16T15:51:52.958 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.959+0000 7ffbb6ffd640 1 -- 172.21.15.179:0/3130482297 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "534117c8-3317-48d6-b436-afd5709f71e9", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7ffbb804aa00 con 0x7ffbc015b7b0 2024-04-16T15:51:52.958 INFO:teuthology.orchestra.run.smithi179.stdout:5 2024-04-16T15:51:52.960 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.960+0000 7ffbc833d640 1 -- 172.21.15.179:0/3130482297 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbc015b7b0 msgr2=0x7ffbc006ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:51:52.960 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.960+0000 7ffbc833d640 1 --2- 172.21.15.179:0/3130482297 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbc015b7b0 0x7ffbc006ba20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8009d90 tx=0x7ffbb8004a40 comp rx=0 tx=0).stop 2024-04-16T15:51:52.960 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.960+0000 7ffbc833d640 1 -- 172.21.15.179:0/3130482297 shutdown_connections 2024-04-16T15:51:52.960 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.960+0000 7ffbc833d640 1 --2- 172.21.15.179:0/3130482297 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbc015b7b0 0x7ffbc006ba20 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:52.960 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.960+0000 7ffbc833d640 1 --2- 172.21.15.179:0/3130482297 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbc00d07e0 0x7ffbc0146c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:52.960 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.960+0000 7ffbc833d640 1 --2- 172.21.15.179:0/3130482297 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffbc0073dd0 0x7ffbc0149f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:52.960 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.960+0000 7ffbc833d640 1 -- 172.21.15.179:0/3130482297 >> 172.21.15.179:0/3130482297 conn(0x7ffbc006f120 msgr2=0x7ffbc00d0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:51:52.960 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.960+0000 7ffbc833d640 1 -- 172.21.15.179:0/3130482297 shutdown_connections 2024-04-16T15:51:52.960 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:52.960+0000 7ffbc833d640 1 -- 172.21.15.179:0/3130482297 wait complete. 2024-04-16T15:51:52.970 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 0ba363e7-fa9d-42b1-ae09-a6a0f57d41f7 6 2024-04-16T15:51:53.074 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-04-16T15:51:53.075+0000 7fd895645040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-16T15:51:53.076 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.075+0000 7f8987140640 1 Processor -- start 2024-04-16T15:51:53.076 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.075+0000 7f8987140640 1 -- start start 2024-04-16T15:51:53.076 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.075+0000 7f8987140640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8980073dd0 0x7f89800d00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:53.076 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.075+0000 7f8987140640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89800b0790 0x7f89800d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:53.076 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.075+0000 7f8987140640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f898015bb90 con 0x7f898015b7b0 2024-04-16T15:51:53.076 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.075+0000 7f8987140640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f8980071600 con 0x7f8980073dd0 2024-04-16T15:51:53.076 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.075+0000 7f8987140640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f89800718e0 con 0x7f89800b0790 2024-04-16T15:51:53.076 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.076+0000 7f89856dd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89800b0790 0x7f89800d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:53.077 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.076+0000 7f897ffff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8980073dd0 0x7f89800d00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:53.077 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.076+0000 7f89856dd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89800b0790 0x7f89800d0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:56000/0 (socket says 172.21.15.179:56000) 2024-04-16T15:51:53.077 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.076+0000 7f89856dd640 1 -- 172.21.15.179:0/555374685 learned_addr learned my addr 172.21.15.179:0/555374685 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-04-16T15:51:53.077 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.076+0000 7f89856dd640 1 -- 172.21.15.179:0/555374685 >> v2:172.21.15.179:3300/0 conn(0x7f8980073dd0 msgr2=0x7f89800d00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:51:53.077 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.076+0000 7f89856dd640 1 --2- 172.21.15.179:0/555374685 >> v2:172.21.15.179:3300/0 conn(0x7f8980073dd0 0x7f89800d00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:53.077 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.076+0000 7f89856dd640 1 -- 172.21.15.179:0/555374685 >> v1:172.21.15.132:6789/0 conn(0x7f898015b7b0 legacy=0x7f89800b4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:51:53.077 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.076+0000 7f89856dd640 1 -- 172.21.15.179:0/555374685 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89800cf8d0 con 0x7f89800b0790 2024-04-16T15:51:53.077 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.077+0000 7f89856dd640 1 --2- 172.21.15.179:0/555374685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89800b0790 0x7f89800d0610 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f897800d150 tx=0x7f897802e0e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62ebbb6eb90f6727 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:51:53.077 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.077+0000 7f897f7fe640 1 -- 172.21.15.179:0/555374685 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f897802ea80 con 0x7f89800b0790 2024-04-16T15:51:53.077 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.077+0000 7f897f7fe640 1 -- 172.21.15.179:0/555374685 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f897802ec20 con 0x7f89800b0790 2024-04-16T15:51:53.077 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.077+0000 7f897f7fe640 1 -- 172.21.15.179:0/555374685 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8978009600 con 0x7f89800b0790 2024-04-16T15:51:53.078 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.078+0000 7f8987140640 1 -- 172.21.15.179:0/555374685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89800b0790 msgr2=0x7f89800d0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:51:53.078 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.078+0000 7f8987140640 1 --2- 172.21.15.179:0/555374685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89800b0790 0x7f89800d0610 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f897800d150 tx=0x7f897802e0e0 comp rx=0 tx=0).stop 2024-04-16T15:51:53.078 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.078+0000 7f8987140640 1 -- 172.21.15.179:0/555374685 shutdown_connections 2024-04-16T15:51:53.078 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.078+0000 7f8987140640 1 --2- 172.21.15.179:0/555374685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89800b0790 0x7f89800d0610 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:53.078 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.078+0000 7f8987140640 1 --2- 172.21.15.179:0/555374685 >> v2:172.21.15.179:3300/0 conn(0x7f8980073dd0 0x7f89800d00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:53.079 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.078+0000 7f8987140640 1 -- 172.21.15.179:0/555374685 >> 172.21.15.179:0/555374685 conn(0x7f898006f120 msgr2=0x7f898006f530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:51:53.079 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.078+0000 7f8987140640 1 -- 172.21.15.179:0/555374685 shutdown_connections 2024-04-16T15:51:53.079 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.078+0000 7f8987140640 1 -- 172.21.15.179:0/555374685 wait complete. 2024-04-16T15:51:53.079 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.079+0000 7f8987140640 1 Processor -- start 2024-04-16T15:51:53.079 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.080+0000 7f8987140640 1 -- start start 2024-04-16T15:51:53.083 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.081+0000 7f8987140640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8980073dd0 0x7f8980158650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:53.083 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.081+0000 7f8987140640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89800b0790 0x7f89801e0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:53.083 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.081+0000 7f8987140640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f898015b7b0 0x7f89801efeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:53.083 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.081+0000 7f8987140640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f8980071290 con 0x7f8980073dd0 2024-04-16T15:51:53.083 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.081+0000 7f8987140640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f89800cf580 con 0x7f898015b7b0 2024-04-16T15:51:53.083 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.081+0000 7f8987140640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f89800b4d70 con 0x7f89800b0790 2024-04-16T15:51:53.083 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.081+0000 7f897ffff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89800b0790 0x7f89801e0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:53.083 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.081+0000 7f897ffff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89800b0790 0x7f89801e0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:56008/0 (socket says 172.21.15.179:56008) 2024-04-16T15:51:53.083 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.081+0000 7f897ffff640 1 -- 172.21.15.179:0/4290548186 learned_addr learned my addr 172.21.15.179:0/4290548186 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-04-16T15:51:53.084 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.081+0000 7f89856dd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f898015b7b0 0x7f89801efeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:53.084 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.081+0000 7f8984edc640 1 --2- 172.21.15.179:0/4290548186 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8980073dd0 0x7f8980158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:53.084 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.081+0000 7f897ffff640 1 -- 172.21.15.179:0/4290548186 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f898015b7b0 msgr2=0x7f89801efeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:51:53.084 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.081+0000 7f897ffff640 1 --2- 172.21.15.179:0/4290548186 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f898015b7b0 0x7f89801efeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:53.084 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.081+0000 7f897ffff640 1 -- 172.21.15.179:0/4290548186 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8980073dd0 msgr2=0x7f8980158650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:51:53.084 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.081+0000 7f897ffff640 1 --2- 172.21.15.179:0/4290548186 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8980073dd0 0x7f8980158650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:53.084 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.081+0000 7f897ffff640 1 -- 172.21.15.179:0/4290548186 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89801e0fb0 con 0x7f89800b0790 2024-04-16T15:51:53.084 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.081+0000 7f89856dd640 1 --2- 172.21.15.179:0/4290548186 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f898015b7b0 0x7f89801efeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:51:53.084 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.082+0000 7f897ffff640 1 --2- 172.21.15.179:0/4290548186 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89800b0790 0x7f89801e0a70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f896c00e9b0 tx=0x7f896c00ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:51:53.084 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.082+0000 7f897d7fa640 1 -- 172.21.15.179:0/4290548186 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f896c017070 con 0x7f89800b0790 2024-04-16T15:51:53.084 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.082+0000 7f897d7fa640 1 -- 172.21.15.179:0/4290548186 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f896c00c9a0 con 0x7f89800b0790 2024-04-16T15:51:53.084 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.082+0000 7f8987140640 1 -- 172.21.15.179:0/4290548186 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8980140af0 con 0x7f89800b0790 2024-04-16T15:51:53.084 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.082+0000 7f897d7fa640 1 -- 172.21.15.179:0/4290548186 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f896c00cd90 con 0x7f89800b0790 2024-04-16T15:51:53.085 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.082+0000 7f8987140640 1 -- 172.21.15.179:0/4290548186 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f89801410b0 con 0x7f89800b0790 2024-04-16T15:51:53.085 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.082+0000 7f897d7fa640 1 -- 172.21.15.179:0/4290548186 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f896c01a070 con 0x7f89800b0790 2024-04-16T15:51:53.085 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.082+0000 7f897d7fa640 1 -- 172.21.15.179:0/4290548186 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f896c006660 con 0x7f89800b0790 2024-04-16T15:51:53.085 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.083+0000 7f8987140640 1 -- 172.21.15.179:0/4290548186 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8980075510 con 0x7f89800b0790 2024-04-16T15:51:53.085 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.085+0000 7f897d7fa640 1 -- 172.21.15.179:0/4290548186 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f896c005990 con 0x7f89800b0790 2024-04-16T15:51:53.171 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.172+0000 7f8987140640 1 -- 172.21.15.179:0/4290548186 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0ba363e7-fa9d-42b1-ae09-a6a0f57d41f7", "id": 6} v 0) -- 0x7f89800cde00 con 0x7f89800b0790 2024-04-16T15:51:53.177 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.178+0000 7f897d7fa640 1 -- 172.21.15.179:0/4290548186 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0ba363e7-fa9d-42b1-ae09-a6a0f57d41f7", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f896c005b70 con 0x7f89800b0790 2024-04-16T15:51:53.177 INFO:teuthology.orchestra.run.smithi179.stdout:6 2024-04-16T15:51:53.179 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.179+0000 7f8987140640 1 -- 172.21.15.179:0/4290548186 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89800b0790 msgr2=0x7f89801e0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:51:53.179 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.179+0000 7f8987140640 1 --2- 172.21.15.179:0/4290548186 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89800b0790 0x7f89801e0a70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f896c00e9b0 tx=0x7f896c00ee70 comp rx=0 tx=0).stop 2024-04-16T15:51:53.179 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.179+0000 7f8987140640 1 -- 172.21.15.179:0/4290548186 shutdown_connections 2024-04-16T15:51:53.179 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.179+0000 7f8987140640 1 --2- 172.21.15.179:0/4290548186 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f898015b7b0 0x7f89801efeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:53.179 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.179+0000 7f8987140640 1 --2- 172.21.15.179:0/4290548186 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89800b0790 0x7f89801e0a70 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:53.179 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.179+0000 7f8987140640 1 --2- 172.21.15.179:0/4290548186 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8980073dd0 0x7f8980158650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:53.179 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.179+0000 7f8987140640 1 -- 172.21.15.179:0/4290548186 >> 172.21.15.179:0/4290548186 conn(0x7f898006f120 msgr2=0x7f89800b0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:51:53.179 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.179+0000 7f8987140640 1 -- 172.21.15.179:0/4290548186 shutdown_connections 2024-04-16T15:51:53.179 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.179+0000 7f8987140640 1 -- 172.21.15.179:0/4290548186 wait complete. 2024-04-16T15:51:53.186 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-16T15:51:53.187+0000 7ff84fe32040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-16T15:51:53.188 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new e6830c77-2f2d-4067-9866-ee7625afc1a2 7 2024-04-16T15:51:53.210 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-04-16T15:51:53.211+0000 7fd895645040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-16T15:51:53.293 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.292+0000 7f6fc8a77640 1 Processor -- start 2024-04-16T15:51:53.293 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.292+0000 7f6fc8a77640 1 -- start start 2024-04-16T15:51:53.293 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.293+0000 7f6fc8a77640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6fc415b7b0 0x7f6fc40b4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:53.293 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.293+0000 7f6fc8a77640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6fc40d07e0 0x7f6fc4073090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:53.293 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.293+0000 7f6fc8a77640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fc415bb90 con 0x7f6fc4073dd0 2024-04-16T15:51:53.293 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.293+0000 7f6fc8a77640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f6fc4071600 con 0x7f6fc415b7b0 2024-04-16T15:51:53.293 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.293+0000 7f6fc8a77640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6fc40718e0 con 0x7f6fc40d07e0 2024-04-16T15:51:53.293 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.293+0000 7f6fc259c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6fc415b7b0 0x7f6fc40b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:53.293 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.293+0000 7f6fc2d9d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6fc40d07e0 0x7f6fc4073090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:53.293 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.293+0000 7f6fbbfff640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f6fc4073dd0 0x7f6fc40d00d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:50458/0 (socket says 172.21.15.179:50458) 2024-04-16T15:51:53.293 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.293+0000 7f6fbbfff640 1 -- 172.21.15.179:0/3789736996 learned_addr learned my addr 172.21.15.179:0/3789736996 (peer_addr_for_me v1:172.21.15.179:0/0) 2024-04-16T15:51:53.294 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.293+0000 7f6fc259c640 1 -- 172.21.15.179:0/3789736996 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6fc40d07e0 msgr2=0x7f6fc4073090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:51:53.294 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.293+0000 7f6fc259c640 1 --2- 172.21.15.179:0/3789736996 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6fc40d07e0 0x7f6fc4073090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:53.294 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.293+0000 7f6fc259c640 1 -- 172.21.15.179:0/3789736996 >> v1:172.21.15.179:6789/0 conn(0x7f6fc4073dd0 legacy=0x7f6fc40d00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:51:53.294 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.293+0000 7f6fc259c640 1 -- 172.21.15.179:0/3789736996 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fc40cf8d0 con 0x7f6fc415b7b0 2024-04-16T15:51:53.294 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.293+0000 7f6fc1d9b640 1 -- 172.21.15.179:0/3789736996 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2152496105 0 0) 0x7f6fc415bb90 con 0x7f6fc4073dd0 2024-04-16T15:51:53.294 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.293+0000 7f6fc2d9d640 1 --2- 172.21.15.179:0/3789736996 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6fc40d07e0 0x7f6fc4073090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:51:53.295 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.294+0000 7f6fc259c640 1 --2- 172.21.15.179:0/3789736996 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6fc415b7b0 0x7f6fc40b4660 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6fb40097a0 tx=0x7f6fb402b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=966a784676553db6 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:51:53.295 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.294+0000 7f6fc1d9b640 1 -- 172.21.15.179:0/3789736996 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb4035020 con 0x7f6fc415b7b0 2024-04-16T15:51:53.295 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.294+0000 7f6fc1d9b640 1 -- 172.21.15.179:0/3789736996 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fb4031810 con 0x7f6fc415b7b0 2024-04-16T15:51:53.296 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.294+0000 7f6fc1d9b640 1 -- 172.21.15.179:0/3789736996 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb4031be0 con 0x7f6fc415b7b0 2024-04-16T15:51:53.296 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.295+0000 7f6fc8a77640 1 -- 172.21.15.179:0/3789736996 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6fc415b7b0 msgr2=0x7f6fc40b4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:51:53.296 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.295+0000 7f6fc8a77640 1 --2- 172.21.15.179:0/3789736996 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6fc415b7b0 0x7f6fc40b4660 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6fb40097a0 tx=0x7f6fb402b8b0 comp rx=0 tx=0).stop 2024-04-16T15:51:53.296 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.295+0000 7f6fc8a77640 1 -- 172.21.15.179:0/3789736996 shutdown_connections 2024-04-16T15:51:53.296 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.295+0000 7f6fc8a77640 1 --2- 172.21.15.179:0/3789736996 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6fc40d07e0 0x7f6fc4073090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:53.296 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.295+0000 7f6fc8a77640 1 --2- 172.21.15.179:0/3789736996 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6fc415b7b0 0x7f6fc40b4660 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:53.296 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.295+0000 7f6fc8a77640 1 -- 172.21.15.179:0/3789736996 >> 172.21.15.179:0/3789736996 conn(0x7f6fc406f120 msgr2=0x7f6fc406f530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:51:53.296 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.295+0000 7f6fc8a77640 1 -- 172.21.15.179:0/3789736996 shutdown_connections 2024-04-16T15:51:53.296 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.295+0000 7f6fc8a77640 1 -- 172.21.15.179:0/3789736996 wait complete. 2024-04-16T15:51:53.296 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.296+0000 7f6fc8a77640 1 Processor -- start 2024-04-16T15:51:53.296 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.296+0000 7f6fc8a77640 1 -- start start 2024-04-16T15:51:53.299 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.297+0000 7f6fc8a77640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6fc4073dd0 0x7f6fc40cd270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:53.299 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.297+0000 7f6fc8a77640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6fc40d07e0 0x7f6fc40b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:53.299 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.297+0000 7f6fc8a77640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6fc415b7b0 0x7f6fc41f43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:53.299 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.297+0000 7f6fc8a77640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f6fc4071290 con 0x7f6fc415b7b0 2024-04-16T15:51:53.299 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.297+0000 7f6fc8a77640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6fc40cf580 con 0x7f6fc4073dd0 2024-04-16T15:51:53.299 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.297+0000 7f6fc8a77640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6fc40b4ba0 con 0x7f6fc40d07e0 2024-04-16T15:51:53.299 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.297+0000 7f6fbbfff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6fc40d07e0 0x7f6fc40b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:53.299 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.297+0000 7f6fc259c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6fc4073dd0 0x7f6fc40cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:53.299 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.297+0000 7f6fc259c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6fc4073dd0 0x7f6fc40cd270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:52728/0 (socket says 172.21.15.179:52728) 2024-04-16T15:51:53.299 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.297+0000 7f6fbbfff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6fc40d07e0 0x7f6fc40b1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:56040/0 (socket says 172.21.15.179:56040) 2024-04-16T15:51:53.300 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.297+0000 7f6fc259c640 1 -- 172.21.15.179:0/3881216338 learned_addr learned my addr 172.21.15.179:0/3881216338 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-04-16T15:51:53.300 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.297+0000 7f6fc2d9d640 1 --2- 172.21.15.179:0/3881216338 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6fc415b7b0 0x7f6fc41f43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:53.300 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.297+0000 7f6fc259c640 1 -- 172.21.15.179:0/3881216338 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6fc40d07e0 msgr2=0x7f6fc40b1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:51:53.300 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.297+0000 7f6fc259c640 1 --2- 172.21.15.179:0/3881216338 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6fc40d07e0 0x7f6fc40b1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:53.300 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.297+0000 7f6fc259c640 1 -- 172.21.15.179:0/3881216338 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6fc415b7b0 msgr2=0x7f6fc41f43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:51:53.300 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.297+0000 7f6fc259c640 1 --2- 172.21.15.179:0/3881216338 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6fc415b7b0 0x7f6fc41f43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:53.300 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.297+0000 7f6fc259c640 1 -- 172.21.15.179:0/3881216338 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fc40af670 con 0x7f6fc4073dd0 2024-04-16T15:51:53.300 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.297+0000 7f6fc2d9d640 1 --2- 172.21.15.179:0/3881216338 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6fc415b7b0 0x7f6fc41f43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:51:53.300 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.297+0000 7f6fbbfff640 1 --2- 172.21.15.179:0/3881216338 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6fc40d07e0 0x7f6fc40b1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:51:53.300 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.298+0000 7f6fc259c640 1 --2- 172.21.15.179:0/3881216338 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6fc4073dd0 0x7f6fc40cd270 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6fb40097a0 tx=0x7f6fb40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:51:53.300 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.298+0000 7f6fbaffd640 1 -- 172.21.15.179:0/3881216338 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb4041070 con 0x7f6fc4073dd0 2024-04-16T15:51:53.300 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.298+0000 7f6fbaffd640 1 -- 172.21.15.179:0/3881216338 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fb403ac80 con 0x7f6fc4073dd0 2024-04-16T15:51:53.300 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.298+0000 7f6fc8a77640 1 -- 172.21.15.179:0/3881216338 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fc40af950 con 0x7f6fc4073dd0 2024-04-16T15:51:53.300 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.298+0000 7f6fbaffd640 1 -- 172.21.15.179:0/3881216338 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb4035040 con 0x7f6fc4073dd0 2024-04-16T15:51:53.300 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.298+0000 7f6fc8a77640 1 -- 172.21.15.179:0/3881216338 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fc40aff10 con 0x7f6fc4073dd0 2024-04-16T15:51:53.300 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.298+0000 7f6fbaffd640 1 -- 172.21.15.179:0/3881216338 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6fb4038020 con 0x7f6fc4073dd0 2024-04-16T15:51:53.301 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.298+0000 7f6fbaffd640 1 -- 172.21.15.179:0/3881216338 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f6fb404e440 con 0x7f6fc4073dd0 2024-04-16T15:51:53.301 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.299+0000 7f6fc8a77640 1 -- 172.21.15.179:0/3881216338 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fc4075510 con 0x7f6fc4073dd0 2024-04-16T15:51:53.301 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.301+0000 7f6fbaffd640 1 -- 172.21.15.179:0/3881216338 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f6fb4064e50 con 0x7f6fc4073dd0 2024-04-16T15:51:53.329 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-16T15:51:53.330+0000 7ff84fe32040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-16T15:51:53.331 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-04-16T15:51:53.332+0000 7fd895645040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-16T15:51:53.373 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.374+0000 7f6fc8a77640 1 -- 172.21.15.179:0/3881216338 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e6830c77-2f2d-4067-9866-ee7625afc1a2", "id": 7} v 0) -- 0x7f6fc40b0250 con 0x7f6fc4073dd0 2024-04-16T15:51:53.376 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-04-16T15:51:53.377+0000 7fd895645040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-16T15:51:53.381 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.382+0000 7f6fbaffd640 1 -- 172.21.15.179:0/3881216338 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e6830c77-2f2d-4067-9866-ee7625afc1a2", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f6fb4053070 con 0x7f6fc4073dd0 2024-04-16T15:51:53.381 INFO:teuthology.orchestra.run.smithi179.stdout:7 2024-04-16T15:51:53.382 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.383+0000 7f6fc8a77640 1 -- 172.21.15.179:0/3881216338 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6fc4073dd0 msgr2=0x7f6fc40cd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:51:53.382 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.383+0000 7f6fc8a77640 1 --2- 172.21.15.179:0/3881216338 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6fc4073dd0 0x7f6fc40cd270 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6fb40097a0 tx=0x7f6fb40046c0 comp rx=0 tx=0).stop 2024-04-16T15:51:53.382 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.383+0000 7f6fc8a77640 1 -- 172.21.15.179:0/3881216338 shutdown_connections 2024-04-16T15:51:53.382 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.383+0000 7f6fc8a77640 1 --2- 172.21.15.179:0/3881216338 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6fc415b7b0 0x7f6fc41f43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:53.382 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.383+0000 7f6fc8a77640 1 --2- 172.21.15.179:0/3881216338 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6fc40d07e0 0x7f6fc40b1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:53.382 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.383+0000 7f6fc8a77640 1 --2- 172.21.15.179:0/3881216338 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6fc4073dd0 0x7f6fc40cd270 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:53.382 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.383+0000 7f6fc8a77640 1 -- 172.21.15.179:0/3881216338 >> 172.21.15.179:0/3881216338 conn(0x7f6fc406f120 msgr2=0x7f6fc4070880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:51:53.383 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.383+0000 7f6fc8a77640 1 -- 172.21.15.179:0/3881216338 shutdown_connections 2024-04-16T15:51:53.383 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:51:53.383+0000 7f6fc8a77640 1 -- 172.21.15.179:0/3881216338 wait complete. 2024-04-16T15:51:53.392 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-16T15:51:53.393 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-16T15:51:53.395 INFO:tasks.ceph.osd.0:Started 2024-04-16T15:51:53.395 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-16T15:51:53.395 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-16T15:51:53.399 INFO:tasks.ceph.osd.1:Started 2024-04-16T15:51:53.399 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-16T15:51:53.399 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-16T15:51:53.401 INFO:tasks.ceph.osd.2:Started 2024-04-16T15:51:53.402 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-16T15:51:53.402 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-16T15:51:53.404 INFO:tasks.ceph.osd.3:Started 2024-04-16T15:51:53.404 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-16T15:51:53.404 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-16T15:51:53.406 INFO:tasks.ceph.osd.4:Started 2024-04-16T15:51:53.406 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-16T15:51:53.407 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-16T15:51:53.411 INFO:tasks.ceph.osd.5:Started 2024-04-16T15:51:53.411 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-16T15:51:53.411 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-16T15:51:53.413 INFO:tasks.ceph.osd.6:Started 2024-04-16T15:51:53.413 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-16T15:51:53.413 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-16T15:51:53.415 INFO:tasks.ceph.osd.7:Started 2024-04-16T15:51:53.416 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:51:53.470 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-16T15:51:53.471+0000 7ff84fe32040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-16T15:51:53.528 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-16T15:51:53.529+0000 7ff84fe32040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-16T15:51:53.530 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-04-16T15:51:53.531+0000 7fd895645040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-16T15:51:53.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.537+0000 7f52edfa8640 1 Processor -- start 2024-04-16T15:51:53.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.537+0000 7f52edfa8640 1 -- start start 2024-04-16T15:51:53.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.537+0000 7f52edfa8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52e80cec60 0x7f52e8161180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:53.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.537+0000 7f52edfa8640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f52e80b20d0 0x7f52e809aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:53.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.537+0000 7f52edfa8640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52e80b28b0 con 0x7f52e809afe0 2024-04-16T15:51:53.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.537+0000 7f52edfa8640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f52e80cf040 con 0x7f52e80b20d0 2024-04-16T15:51:53.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.537+0000 7f52edfa8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f52e80b34c0 con 0x7f52e80cec60 2024-04-16T15:51:53.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.538+0000 7f52e77fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52e80cec60 0x7f52e8161180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:53.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.538+0000 7f52e77fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52e80cec60 0x7f52e8161180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.132:54320/0 (socket says 172.21.15.132:54320) 2024-04-16T15:51:53.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.538+0000 7f52e6ffd640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f52e80b20d0 0x7f52e809aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:53.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.538+0000 7f52e77fe640 1 -- 172.21.15.132:0/3174550416 learned_addr learned my addr 172.21.15.132:0/3174550416 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:51:53.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.538+0000 7f52e7fff640 1 --1- 172.21.15.132:0/3174550416 >> v1:172.21.15.179:6789/0 conn(0x7f52e809afe0 0x7f52e80d06b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.132:55418/0 (socket says 172.21.15.132:55418) 2024-04-16T15:51:53.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.538+0000 7f52e77fe640 1 -- 172.21.15.132:0/3174550416 >> v2:172.21.15.179:3300/0 conn(0x7f52e80b20d0 msgr2=0x7f52e809aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:51:53.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.538+0000 7f52e67fc640 1 -- 172.21.15.132:0/3174550416 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4117574910 0 0) 0x7f52e80b28b0 con 0x7f52e809afe0 2024-04-16T15:51:53.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.538+0000 7f52e77fe640 1 --2- 172.21.15.132:0/3174550416 >> v2:172.21.15.179:3300/0 conn(0x7f52e80b20d0 0x7f52e809aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:53.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.538+0000 7f52e77fe640 1 -- 172.21.15.132:0/3174550416 >> v1:172.21.15.179:6789/0 conn(0x7f52e809afe0 legacy=0x7f52e80d06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:51:53.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.538+0000 7f52e77fe640 1 -- 172.21.15.132:0/3174550416 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52e80b2b90 con 0x7f52e80cec60 2024-04-16T15:51:53.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.539+0000 7f52e77fe640 1 --2- 172.21.15.132:0/3174550416 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52e80cec60 0x7f52e8161180 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f52d8009870 tx=0x7f52d802b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f35c6a78a3363c18 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:51:53.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.539+0000 7f52e67fc640 1 -- 172.21.15.132:0/3174550416 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d8035020 con 0x7f52e80cec60 2024-04-16T15:51:53.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.539+0000 7f52e67fc640 1 -- 172.21.15.132:0/3174550416 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52d8031640 con 0x7f52e80cec60 2024-04-16T15:51:53.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.539+0000 7f52e67fc640 1 -- 172.21.15.132:0/3174550416 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d802d040 con 0x7f52e80cec60 2024-04-16T15:51:53.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.540+0000 7f52edfa8640 1 -- 172.21.15.132:0/3174550416 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52e80cec60 msgr2=0x7f52e8161180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:51:53.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.540+0000 7f52edfa8640 1 --2- 172.21.15.132:0/3174550416 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52e80cec60 0x7f52e8161180 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f52d8009870 tx=0x7f52d802b8f0 comp rx=0 tx=0).stop 2024-04-16T15:51:53.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.540+0000 7f52edfa8640 1 -- 172.21.15.132:0/3174550416 shutdown_connections 2024-04-16T15:51:53.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.540+0000 7f52edfa8640 1 --2- 172.21.15.132:0/3174550416 >> v2:172.21.15.179:3300/0 conn(0x7f52e80b20d0 0x7f52e809aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:53.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.540+0000 7f52edfa8640 1 --2- 172.21.15.132:0/3174550416 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52e80cec60 0x7f52e8161180 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:53.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.540+0000 7f52edfa8640 1 -- 172.21.15.132:0/3174550416 >> 172.21.15.132:0/3174550416 conn(0x7f52e80d2740 msgr2=0x7f52e80d2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:51:53.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.540+0000 7f52edfa8640 1 -- 172.21.15.132:0/3174550416 shutdown_connections 2024-04-16T15:51:53.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.540+0000 7f52edfa8640 1 -- 172.21.15.132:0/3174550416 wait complete. 2024-04-16T15:51:53.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.541+0000 7f52edfa8640 1 Processor -- start 2024-04-16T15:51:53.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.541+0000 7f52edfa8640 1 -- start start 2024-04-16T15:51:53.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.542+0000 7f52edfa8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52e809afe0 0x7f52e80c9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:53.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.542+0000 7f52edfa8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52e80b20d0 0x7f52e815c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:53.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.542+0000 7f52edfa8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f52e80cec60 0x7f52e8158cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:53.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.542+0000 7f52edfa8640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f52e80b3950 con 0x7f52e80cec60 2024-04-16T15:51:53.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.542+0000 7f52edfa8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f52e80b3150 con 0x7f52e80b20d0 2024-04-16T15:51:53.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.542+0000 7f52edfa8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f52e80b2530 con 0x7f52e809afe0 2024-04-16T15:51:53.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.542+0000 7f52e77fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52e809afe0 0x7f52e80c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:53.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.542+0000 7f52e6ffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52e80b20d0 0x7f52e815c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:53.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.542+0000 7f52e7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f52e80cec60 0x7f52e8158cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:53.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.542+0000 7f52e77fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52e809afe0 0x7f52e80c9810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.132:54328/0 (socket says 172.21.15.132:54328) 2024-04-16T15:51:53.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.542+0000 7f52e77fe640 1 -- 172.21.15.132:0/1783056082 learned_addr learned my addr 172.21.15.132:0/1783056082 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:51:53.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.542+0000 7f52e77fe640 1 -- 172.21.15.132:0/1783056082 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52e80b20d0 msgr2=0x7f52e815c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:51:53.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.542+0000 7f52e77fe640 1 --2- 172.21.15.132:0/1783056082 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52e80b20d0 0x7f52e815c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:53.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.542+0000 7f52e77fe640 1 -- 172.21.15.132:0/1783056082 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f52e80cec60 msgr2=0x7f52e8158cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:51:53.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.542+0000 7f52e77fe640 1 --2- 172.21.15.132:0/1783056082 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f52e80cec60 0x7f52e8158cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:53.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.542+0000 7f52e77fe640 1 -- 172.21.15.132:0/1783056082 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52e80b1390 con 0x7f52e809afe0 2024-04-16T15:51:53.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.543+0000 7f52e77fe640 1 --2- 172.21.15.132:0/1783056082 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52e809afe0 0x7f52e80c9810 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f52d80090b0 tx=0x7f52d80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:51:53.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.543+0000 7f52cffff640 1 -- 172.21.15.132:0/1783056082 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d8040070 con 0x7f52e809afe0 2024-04-16T15:51:53.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.543+0000 7f52cffff640 1 -- 172.21.15.132:0/1783056082 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52d80399f0 con 0x7f52e809afe0 2024-04-16T15:51:53.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.543+0000 7f52edfa8640 1 -- 172.21.15.132:0/1783056082 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52e815ad00 con 0x7f52e809afe0 2024-04-16T15:51:53.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.543+0000 7f52cffff640 1 -- 172.21.15.132:0/1783056082 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d8035040 con 0x7f52e809afe0 2024-04-16T15:51:53.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.543+0000 7f52edfa8640 1 -- 172.21.15.132:0/1783056082 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f52e815b2c0 con 0x7f52e809afe0 2024-04-16T15:51:53.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.543+0000 7f52cffff640 1 -- 172.21.15.132:0/1783056082 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f52d8038020 con 0x7f52e809afe0 2024-04-16T15:51:53.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.543+0000 7f52cffff640 1 -- 172.21.15.132:0/1783056082 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f52d8003610 con 0x7f52e809afe0 2024-04-16T15:51:53.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.544+0000 7f52edfa8640 1 -- 172.21.15.132:0/1783056082 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52e8069590 con 0x7f52e809afe0 2024-04-16T15:51:53.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.546+0000 7f52cffff640 1 -- 172.21.15.132:0/1783056082 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f52e8069590 con 0x7f52e809afe0 2024-04-16T15:51:53.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.607+0000 7f52edfa8640 1 -- 172.21.15.132:0/1783056082 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f52e806bf10 con 0x7f52e809afe0 2024-04-16T15:51:53.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.608+0000 7f52cffff640 1 -- 172.21.15.132:0/1783056082 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f52e806bf10 con 0x7f52e809afe0 2024-04-16T15:51:53.607 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:51:53.607 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":10,"fsid":"6bdec5d9-f406-43ad-8584-0503b32f6f0d","created":"2024-04-16T15:51:51.073040+0000","modified":"2024-04-16T15:51:53.376468+0000","last_up_change":"0.000000","last_in_change":"2024-04-16T15:51:53.376468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2d45908b-6e22-4619-b190-897af594b712","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c88bf082-e51f-4ee6-815a-025f6ce0d67b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e5dbd6b4-4e7b-47e4-ad4e-35b4b81696c7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9d75cd67-3b8a-4424-8884-5f3660e1f5f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"83aea46a-8642-4777-912b-c130e5890da7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"534117c8-3317-48d6-b436-afd5709f71e9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0ba363e7-fa9d-42b1-ae09-a6a0f57d41f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e6830c77-2f2d-4067-9866-ee7625afc1a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:51:53.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.609+0000 7f52edfa8640 1 -- 172.21.15.132:0/1783056082 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52e809afe0 msgr2=0x7f52e80c9810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:51:53.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.609+0000 7f52edfa8640 1 --2- 172.21.15.132:0/1783056082 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52e809afe0 0x7f52e80c9810 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f52d80090b0 tx=0x7f52d80046c0 comp rx=0 tx=0).stop 2024-04-16T15:51:53.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.609+0000 7f52edfa8640 1 -- 172.21.15.132:0/1783056082 shutdown_connections 2024-04-16T15:51:53.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.609+0000 7f52edfa8640 1 --2- 172.21.15.132:0/1783056082 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f52e80cec60 0x7f52e8158cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:53.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.609+0000 7f52edfa8640 1 --2- 172.21.15.132:0/1783056082 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52e80b20d0 0x7f52e815c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:53.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.609+0000 7f52edfa8640 1 --2- 172.21.15.132:0/1783056082 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52e809afe0 0x7f52e80c9810 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:53.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.609+0000 7f52edfa8640 1 -- 172.21.15.132:0/1783056082 >> 172.21.15.132:0/1783056082 conn(0x7f52e80d2740 msgr2=0x7f52e806cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:51:53.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.609+0000 7f52edfa8640 1 -- 172.21.15.132:0/1783056082 shutdown_connections 2024-04-16T15:51:53.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:51:53.609+0000 7f52edfa8640 1 -- 172.21.15.132:0/1783056082 wait complete. 2024-04-16T15:51:53.618 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-16T15:51:53.619 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-16T15:51:53.631 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-04-16T15:51:53.632+0000 7fd895645040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-16T15:51:53.641 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-16T15:51:53.642+0000 7ff84fe32040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-16T15:51:53.737 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-16T15:51:53.738+0000 7ff84fe32040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-16T15:51:53.790 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-04-16T15:51:53.791+0000 7fd895645040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-16T15:51:53.833 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-04-16T15:51:53.834+0000 7fd895645040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-16T15:51:53.893 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-16T15:51:53.894+0000 7ff84fe32040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-16T15:51:53.935 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-16T15:51:53.936+0000 7ff84fe32040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-16T15:51:53.987 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-04-16T15:51:53.988+0000 7fd895645040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-16T15:51:54.019 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-04-16T15:51:54.021+0000 7f6b8abf6640 -1 Falling back to public interface 2024-04-16T15:51:54.023 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-04-16T15:51:54.024+0000 7fe6f8e13640 -1 Falling back to public interface 2024-04-16T15:51:54.024 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-04-16T15:51:54.024+0000 7f4376824640 -1 Falling back to public interface 2024-04-16T15:51:54.030 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-04-16T15:51:54.031+0000 7fb15c219640 -1 Falling back to public interface 2024-04-16T15:51:54.037 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-16T15:51:54.038+0000 7fde67ca4640 -1 Falling back to public interface 2024-04-16T15:51:54.038 INFO:tasks.ceph.osd.3.smithi132.stderr:2024-04-16T15:51:54.039+0000 7f3384a13640 -1 Falling back to public interface 2024-04-16T15:51:54.038 INFO:tasks.ceph.osd.1.smithi132.stderr:2024-04-16T15:51:54.039+0000 7ffaa3415640 -1 Falling back to public interface 2024-04-16T15:51:54.040 INFO:tasks.ceph.osd.1.smithi132.stderr:2024-04-16T15:51:54.041+0000 7ffaa1e96640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6821/0: (98) Address already in use 2024-04-16T15:51:54.043 INFO:tasks.ceph.osd.2.smithi132.stderr:2024-04-16T15:51:54.044+0000 7fcf91037640 -1 Falling back to public interface 2024-04-16T15:51:54.095 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-16T15:51:54.096+0000 7ff84fe32040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-16T15:51:54.426 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-16T15:51:54.518 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.519+0000 7f22f8a74640 1 Processor -- start 2024-04-16T15:51:54.518 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.519+0000 7f22f8a74640 1 -- start start 2024-04-16T15:51:54.520 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.519+0000 7f22f8a74640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22f415b9c0 0x7f22f40b2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:54.520 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.519+0000 7f22f8a74640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22f40c7520 con 0x7f22f40ccb70 2024-04-16T15:51:54.520 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.519+0000 7f22f8a74640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22f40d0470 con 0x7f22f40cdd90 2024-04-16T15:51:54.520 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.519+0000 7f22f8a74640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f22f415bda0 con 0x7f22f415b9c0 2024-04-16T15:51:54.520 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.520+0000 7f22f2d9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f22f40ccb70 0x7f22f40c6e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45020/0 (socket says 172.21.15.132:45020) 2024-04-16T15:51:54.520 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.520+0000 7f22f2d9d640 1 -- 172.21.15.132:0/1226084151 learned_addr learned my addr 172.21.15.132:0/1226084151 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:51:54.520 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.520+0000 7f22f259c640 1 --2- 172.21.15.132:0/1226084151 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22f415b9c0 0x7f22f40b2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:54.520 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.520+0000 7f22f1d9b640 1 -- 172.21.15.132:0/1226084151 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 407013394 0 0) 0x7f22f40c7520 con 0x7f22f40ccb70 2024-04-16T15:51:54.520 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.520+0000 7f22f1d9b640 1 -- 172.21.15.132:0/1226084151 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22e0003520 con 0x7f22f40ccb70 2024-04-16T15:51:54.520 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.520+0000 7f22f1d9b640 1 -- 172.21.15.132:0/1226084151 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4065393415 0 0) 0x7f22f40d0470 con 0x7f22f40cdd90 2024-04-16T15:51:54.521 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.520+0000 7f22f1d9b640 1 -- 172.21.15.132:0/1226084151 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22f40c7520 con 0x7f22f40cdd90 2024-04-16T15:51:54.521 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.520+0000 7f22f259c640 1 -- 172.21.15.132:0/1226084151 >> v1:172.21.15.179:6789/0 conn(0x7f22f40cdd90 legacy=0x7f22f40c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:51:54.521 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.520+0000 7f22f259c640 1 -- 172.21.15.132:0/1226084151 >> v1:172.21.15.132:6789/0 conn(0x7f22f40ccb70 legacy=0x7f22f40c6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:51:54.521 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.520+0000 7f22f259c640 1 -- 172.21.15.132:0/1226084151 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22f40d0750 con 0x7f22f415b9c0 2024-04-16T15:51:54.521 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.521+0000 7f22f259c640 1 --2- 172.21.15.132:0/1226084151 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22f415b9c0 0x7f22f40b2ad0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f22e40097d0 tx=0x7f22e402b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c2217ed541b3aba server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:51:54.521 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.521+0000 7f22f1d9b640 1 -- 172.21.15.132:0/1226084151 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e4035020 con 0x7f22f415b9c0 2024-04-16T15:51:54.521 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.521+0000 7f22f1d9b640 1 -- 172.21.15.132:0/1226084151 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22e4031890 con 0x7f22f415b9c0 2024-04-16T15:51:54.521 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.521+0000 7f22f1d9b640 1 -- 172.21.15.132:0/1226084151 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e4031c60 con 0x7f22f415b9c0 2024-04-16T15:51:54.522 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.521+0000 7f22f8a74640 1 -- 172.21.15.132:0/1226084151 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22f415b9c0 msgr2=0x7f22f40b2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:51:54.522 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.521+0000 7f22f8a74640 1 --2- 172.21.15.132:0/1226084151 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22f415b9c0 0x7f22f40b2ad0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f22e40097d0 tx=0x7f22e402b930 comp rx=0 tx=0).stop 2024-04-16T15:51:54.522 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.521+0000 7f22f8a74640 1 -- 172.21.15.132:0/1226084151 shutdown_connections 2024-04-16T15:51:54.522 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.521+0000 7f22f8a74640 1 --2- 172.21.15.132:0/1226084151 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22f415b9c0 0x7f22f40b2ad0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:54.522 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.522+0000 7f22f8a74640 1 -- 172.21.15.132:0/1226084151 >> 172.21.15.132:0/1226084151 conn(0x7f22f409aa70 msgr2=0x7f22f40b3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:51:54.522 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.522+0000 7f22f8a74640 1 -- 172.21.15.132:0/1226084151 shutdown_connections 2024-04-16T15:51:54.523 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.522+0000 7f22f8a74640 1 -- 172.21.15.132:0/1226084151 wait complete. 2024-04-16T15:51:54.523 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.523+0000 7f22f8a74640 1 Processor -- start 2024-04-16T15:51:54.523 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.523+0000 7f22f8a74640 1 -- start start 2024-04-16T15:51:54.525 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.524+0000 7f22f8a74640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22f40ccb70 0x7f22f4145680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:54.525 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.524+0000 7f22f8a74640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22f40cdd90 0x7f22f415c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:54.525 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.524+0000 7f22f8a74640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22f415b9c0 0x7f22f415cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:51:54.525 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.524+0000 7f22f8a74640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f22f40d0ff0 con 0x7f22f415b9c0 2024-04-16T15:51:54.525 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.524+0000 7f22f8a74640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f22f40d0d10 con 0x7f22f40ccb70 2024-04-16T15:51:54.525 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.524+0000 7f22f8a74640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f22f40b2760 con 0x7f22f40cdd90 2024-04-16T15:51:54.525 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.524+0000 7f22f2d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22f415b9c0 0x7f22f415cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:54.525 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.524+0000 7f22f2d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22f415b9c0 0x7f22f415cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48746/0 (socket says 172.21.15.132:48746) 2024-04-16T15:51:54.525 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.524+0000 7f22f2d9d640 1 -- 172.21.15.132:0/330993538 learned_addr learned my addr 172.21.15.132:0/330993538 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:51:54.526 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.524+0000 7f22f259c640 1 --2- 172.21.15.132:0/330993538 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22f40ccb70 0x7f22f4145680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:54.526 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.524+0000 7f22ebfff640 1 --2- 172.21.15.132:0/330993538 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22f40cdd90 0x7f22f415c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:51:54.526 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.524+0000 7f22f2d9d640 1 -- 172.21.15.132:0/330993538 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22f40cdd90 msgr2=0x7f22f415c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:51:54.526 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.524+0000 7f22f2d9d640 1 --2- 172.21.15.132:0/330993538 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22f40cdd90 0x7f22f415c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:54.526 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.524+0000 7f22f2d9d640 1 -- 172.21.15.132:0/330993538 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22f40ccb70 msgr2=0x7f22f4145680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:51:54.526 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.524+0000 7f22f2d9d640 1 --2- 172.21.15.132:0/330993538 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22f40ccb70 0x7f22f4145680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:54.526 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.524+0000 7f22f2d9d640 1 -- 172.21.15.132:0/330993538 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22f40c9ca0 con 0x7f22f415b9c0 2024-04-16T15:51:54.526 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.524+0000 7f22f2d9d640 1 --2- 172.21.15.132:0/330993538 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22f415b9c0 0x7f22f415cb40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f22ec00ee10 tx=0x7f22ec00c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:51:54.526 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.524+0000 7f22eaffd640 1 -- 172.21.15.132:0/330993538 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ec015070 con 0x7f22f415b9c0 2024-04-16T15:51:54.526 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.524+0000 7f22eaffd640 1 -- 172.21.15.132:0/330993538 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22ec011670 con 0x7f22f415b9c0 2024-04-16T15:51:54.526 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.524+0000 7f22f8a74640 1 -- 172.21.15.132:0/330993538 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22f40b7230 con 0x7f22f415b9c0 2024-04-16T15:51:54.526 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.524+0000 7f22eaffd640 1 -- 172.21.15.132:0/330993538 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ec011a40 con 0x7f22f415b9c0 2024-04-16T15:51:54.526 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.524+0000 7f22f8a74640 1 -- 172.21.15.132:0/330993538 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22f40ca200 con 0x7f22f415b9c0 2024-04-16T15:51:54.526 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.525+0000 7f22eaffd640 1 -- 172.21.15.132:0/330993538 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f22ec018070 con 0x7f22f415b9c0 2024-04-16T15:51:54.527 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.525+0000 7f22eaffd640 1 -- 172.21.15.132:0/330993538 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f22ec01ad60 con 0x7f22f415b9c0 2024-04-16T15:51:54.527 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.525+0000 7f22f8a74640 1 -- 172.21.15.132:0/330993538 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22f40c7fd0 con 0x7f22f415b9c0 2024-04-16T15:51:54.527 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.527+0000 7f22eaffd640 1 -- 172.21.15.132:0/330993538 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f22f40c7fd0 con 0x7f22f415b9c0 2024-04-16T15:51:54.588 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.589+0000 7f22f8a74640 1 -- 172.21.15.132:0/330993538 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f22f40d21a0 con 0x7f22f415b9c0 2024-04-16T15:51:54.589 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.590+0000 7f22eaffd640 1 -- 172.21.15.132:0/330993538 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f22f40c9ca0 con 0x7f22f415b9c0 2024-04-16T15:51:54.589 INFO:teuthology.misc.health.smithi132.stdout: 2024-04-16T15:51:54.589 INFO:teuthology.misc.health.smithi132.stdout:{"epoch":10,"fsid":"6bdec5d9-f406-43ad-8584-0503b32f6f0d","created":"2024-04-16T15:51:51.073040+0000","modified":"2024-04-16T15:51:53.376468+0000","last_up_change":"0.000000","last_in_change":"2024-04-16T15:51:53.376468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2d45908b-6e22-4619-b190-897af594b712","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c88bf082-e51f-4ee6-815a-025f6ce0d67b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e5dbd6b4-4e7b-47e4-ad4e-35b4b81696c7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9d75cd67-3b8a-4424-8884-5f3660e1f5f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"83aea46a-8642-4777-912b-c130e5890da7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"534117c8-3317-48d6-b436-afd5709f71e9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0ba363e7-fa9d-42b1-ae09-a6a0f57d41f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e6830c77-2f2d-4067-9866-ee7625afc1a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:51:54.590 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.591+0000 7f22f8a74640 1 -- 172.21.15.132:0/330993538 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22f415b9c0 msgr2=0x7f22f415cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:51:54.590 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.591+0000 7f22f8a74640 1 --2- 172.21.15.132:0/330993538 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22f415b9c0 0x7f22f415cb40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f22ec00ee10 tx=0x7f22ec00c640 comp rx=0 tx=0).stop 2024-04-16T15:51:54.590 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.591+0000 7f22f8a74640 1 -- 172.21.15.132:0/330993538 shutdown_connections 2024-04-16T15:51:54.590 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.591+0000 7f22f8a74640 1 --2- 172.21.15.132:0/330993538 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22f415b9c0 0x7f22f415cb40 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:54.591 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.591+0000 7f22f8a74640 1 --2- 172.21.15.132:0/330993538 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22f40cdd90 0x7f22f415c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:54.591 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.591+0000 7f22f8a74640 1 --2- 172.21.15.132:0/330993538 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22f40ccb70 0x7f22f4145680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:51:54.591 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.591+0000 7f22f8a74640 1 -- 172.21.15.132:0/330993538 >> 172.21.15.132:0/330993538 conn(0x7f22f409aa70 msgr2=0x7f22f40d13d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:51:54.591 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.591+0000 7f22f8a74640 1 -- 172.21.15.132:0/330993538 shutdown_connections 2024-04-16T15:51:54.591 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:51:54.591+0000 7f22f8a74640 1 -- 172.21.15.132:0/330993538 wait complete. 2024-04-16T15:51:54.600 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-16T15:51:54.813 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-04-16T15:51:54.814+0000 7fd895645040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-16T15:51:54.917 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-16T15:51:54.919+0000 7ff84fe32040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-16T15:51:55.090 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-04-16T15:51:55.091+0000 7fd895645040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-16T15:51:55.142 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-04-16T15:51:55.143+0000 7fd895645040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-16T15:51:55.194 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-16T15:51:55.196+0000 7ff84fe32040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-16T15:51:55.245 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-16T15:51:55.247+0000 7ff84fe32040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-16T15:51:55.259 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-04-16T15:51:55.260+0000 7fd895645040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-16T15:51:55.365 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-16T15:51:55.367+0000 7ff84fe32040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-16T15:51:56.272 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-04-16T15:51:56.273+0000 7fd8362d1640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-16T15:51:56.272 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-04-16T15:51:56.273+0000 7fd8362d1640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-16T15:51:57.507 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-04-16T15:51:57.509+0000 7f6b8abf6640 -1 osd.5 0 log_to_monitors true 2024-04-16T15:51:57.541 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-16T15:51:57.542+0000 7fde67ca4640 -1 osd.0 0 log_to_monitors true 2024-04-16T15:51:57.547 INFO:tasks.ceph.osd.3.smithi132.stderr:2024-04-16T15:51:57.548+0000 7f3384a13640 -1 osd.3 0 log_to_monitors true 2024-04-16T15:51:57.554 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-04-16T15:51:57.556+0000 7fe6f8e13640 -1 osd.6 0 log_to_monitors true 2024-04-16T15:51:57.554 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-04-16T15:51:57.557+0000 7f4376824640 -1 osd.7 0 log_to_monitors true 2024-04-16T15:51:57.556 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-04-16T15:51:57.558+0000 7fb15c219640 -1 osd.4 0 log_to_monitors true 2024-04-16T15:51:57.557 INFO:tasks.ceph.osd.2.smithi132.stderr:2024-04-16T15:51:57.559+0000 7fcf91037640 -1 osd.2 0 log_to_monitors true 2024-04-16T15:51:57.562 INFO:tasks.ceph.osd.1.smithi132.stderr:2024-04-16T15:51:57.563+0000 7ffaa3415640 -1 osd.1 0 log_to_monitors true 2024-04-16T15:52:01.274 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-04-16T15:52:01.276+0000 7fe6f4ef9640 -1 osd.6 0 waiting for initial osdmap 2024-04-16T15:52:01.289 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-04-16T15:52:01.291+0000 7fe6ec505640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T15:52:01.306 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-04-16T15:52:01.308+0000 7f43727ba640 -1 osd.7 0 waiting for initial osdmap 2024-04-16T15:52:01.317 INFO:tasks.ceph.osd.3.smithi132.stderr:2024-04-16T15:52:01.318+0000 7f33809a9640 -1 osd.3 0 waiting for initial osdmap 2024-04-16T15:52:01.319 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-04-16T15:52:01.321+0000 7f436a5da640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T15:52:01.332 INFO:tasks.ceph.osd.3.smithi132.stderr:2024-04-16T15:52:01.333+0000 7f33787c9640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T15:52:01.333 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-04-16T15:52:01.335+0000 7fb157c0c640 -1 osd.4 0 waiting for initial osdmap 2024-04-16T15:52:01.347 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-04-16T15:52:01.349+0000 7fb14fa2c640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T15:52:01.378 INFO:tasks.ceph.osd.2.smithi132.stderr:2024-04-16T15:52:01.379+0000 7fcf8cfcd640 -1 osd.2 0 waiting for initial osdmap 2024-04-16T15:52:01.388 INFO:tasks.ceph.osd.2.smithi132.stderr:2024-04-16T15:52:01.389+0000 7fcf84ded640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T15:52:01.391 INFO:tasks.ceph.osd.1.smithi132.stderr:2024-04-16T15:52:01.393+0000 7ffa9f691640 -1 osd.1 0 waiting for initial osdmap 2024-04-16T15:52:01.401 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-16T15:52:01.403+0000 7fde63c3a640 -1 osd.0 0 waiting for initial osdmap 2024-04-16T15:52:01.406 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-16T15:52:01.407 INFO:tasks.ceph.osd.1.smithi132.stderr:2024-04-16T15:52:01.408+0000 7ffa96c9d640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T15:52:01.415 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-16T15:52:01.416+0000 7fde5ba5a640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T15:52:01.497 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.498+0000 7f273af59640 1 Processor -- start 2024-04-16T15:52:01.497 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.498+0000 7f273af59640 1 -- start start 2024-04-16T15:52:01.500 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.499+0000 7f273af59640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f273415fe20 0x7f27340ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:01.500 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.499+0000 7f273af59640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27340d03e0 0x7f273409b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:01.500 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.499+0000 7f273af59640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f273409bf50 con 0x7f27340d0be0 2024-04-16T15:52:01.501 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.499+0000 7f273af59640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f27340cd1a0 con 0x7f273415fe20 2024-04-16T15:52:01.501 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.499+0000 7f273af59640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f273409bd20 con 0x7f27340d03e0 2024-04-16T15:52:01.501 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.499+0000 7f2738cf5640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f273415fe20 0x7f27340ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:01.501 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.499+0000 7f2738cf5640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f273415fe20 0x7f27340ce190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33452/0 (socket says 172.21.15.132:33452) 2024-04-16T15:52:01.501 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.499+0000 7f2738cf5640 1 -- 172.21.15.132:0/3460688945 learned_addr learned my addr 172.21.15.132:0/3460688945 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:01.501 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.499+0000 7f272bfff640 1 --2- 172.21.15.132:0/3460688945 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27340d03e0 0x7f273409b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:01.501 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.499+0000 7f2738cf5640 1 -- 172.21.15.132:0/3460688945 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27340d03e0 msgr2=0x7f273409b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:01.501 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.499+0000 7f2738cf5640 1 --2- 172.21.15.132:0/3460688945 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27340d03e0 0x7f273409b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:01.501 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.499+0000 7f2738cf5640 1 -- 172.21.15.132:0/3460688945 >> v1:172.21.15.179:6789/0 conn(0x7f27340d0be0 legacy=0x7f27340c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:01.502 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.499+0000 7f2738cf5640 1 -- 172.21.15.132:0/3460688945 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27340cd3d0 con 0x7f273415fe20 2024-04-16T15:52:01.502 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.500+0000 7f2738cf5640 1 --2- 172.21.15.132:0/3460688945 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f273415fe20 0x7f27340ce190 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2730009870 tx=0x7f273002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e72d9e5f2b3e23ba server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:01.502 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.500+0000 7f272b7fe640 1 -- 172.21.15.132:0/3460688945 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2730034070 con 0x7f273415fe20 2024-04-16T15:52:01.502 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.500+0000 7f272b7fe640 1 -- 172.21.15.132:0/3460688945 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2730030840 con 0x7f273415fe20 2024-04-16T15:52:01.502 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.500+0000 7f272b7fe640 1 -- 172.21.15.132:0/3460688945 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2730030c10 con 0x7f273415fe20 2024-04-16T15:52:01.502 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.501+0000 7f273af59640 1 -- 172.21.15.132:0/3460688945 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f273415fe20 msgr2=0x7f27340ce190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:01.502 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.501+0000 7f273af59640 1 --2- 172.21.15.132:0/3460688945 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f273415fe20 0x7f27340ce190 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2730009870 tx=0x7f273002b980 comp rx=0 tx=0).stop 2024-04-16T15:52:01.502 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.501+0000 7f273af59640 1 -- 172.21.15.132:0/3460688945 shutdown_connections 2024-04-16T15:52:01.503 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.501+0000 7f273af59640 1 --2- 172.21.15.132:0/3460688945 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27340d03e0 0x7f273409b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:01.503 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.501+0000 7f273af59640 1 --2- 172.21.15.132:0/3460688945 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f273415fe20 0x7f27340ce190 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:01.503 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.501+0000 7f273af59640 1 -- 172.21.15.132:0/3460688945 >> 172.21.15.132:0/3460688945 conn(0x7f27340b40f0 msgr2=0x7f27340b4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:01.503 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.501+0000 7f273af59640 1 -- 172.21.15.132:0/3460688945 shutdown_connections 2024-04-16T15:52:01.503 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.501+0000 7f273af59640 1 -- 172.21.15.132:0/3460688945 wait complete. 2024-04-16T15:52:01.508 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.502+0000 7f273af59640 1 Processor -- start 2024-04-16T15:52:01.508 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.502+0000 7f273af59640 1 -- start start 2024-04-16T15:52:01.508 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.503+0000 7f273af59640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27340d03e0 0x7f2734159d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:01.508 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.503+0000 7f273af59640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27340d0be0 0x7f27340b0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:01.508 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.503+0000 7f273af59640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f273415fe20 0x7f27340caca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:01.508 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.503+0000 7f273af59640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f27340cdc70 con 0x7f27340d03e0 2024-04-16T15:52:01.508 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.503+0000 7f273af59640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f27340cd990 con 0x7f27340d0be0 2024-04-16T15:52:01.508 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.503+0000 7f273af59640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f2734160200 con 0x7f273415fe20 2024-04-16T15:52:01.508 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.503+0000 7f2738cf5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27340d03e0 0x7f2734159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:01.509 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.503+0000 7f2738cf5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27340d03e0 0x7f2734159d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33466/0 (socket says 172.21.15.132:33466) 2024-04-16T15:52:01.509 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.503+0000 7f2738cf5640 1 -- 172.21.15.132:0/555494002 learned_addr learned my addr 172.21.15.132:0/555494002 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:01.509 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.503+0000 7f27394f6640 1 --2- 172.21.15.132:0/555494002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f273415fe20 0x7f27340caca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:01.509 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.503+0000 7f272bfff640 1 --2- 172.21.15.132:0/555494002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27340d0be0 0x7f27340b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:01.509 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.503+0000 7f2738cf5640 1 -- 172.21.15.132:0/555494002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f273415fe20 msgr2=0x7f27340caca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:01.509 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.503+0000 7f2738cf5640 1 --2- 172.21.15.132:0/555494002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f273415fe20 0x7f27340caca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:01.509 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.503+0000 7f2738cf5640 1 -- 172.21.15.132:0/555494002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27340d0be0 msgr2=0x7f27340b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:01.509 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.503+0000 7f2738cf5640 1 --2- 172.21.15.132:0/555494002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27340d0be0 0x7f27340b0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:01.509 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.503+0000 7f2738cf5640 1 -- 172.21.15.132:0/555494002 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f273415bd80 con 0x7f27340d03e0 2024-04-16T15:52:01.509 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.503+0000 7f2738cf5640 1 --2- 172.21.15.132:0/555494002 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27340d03e0 0x7f2734159d10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2730000c00 tx=0x7f2730004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:01.510 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.503+0000 7f27297fa640 1 -- 172.21.15.132:0/555494002 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2730048070 con 0x7f27340d03e0 2024-04-16T15:52:01.510 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.503+0000 7f27297fa640 1 -- 172.21.15.132:0/555494002 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2730030640 con 0x7f27340d03e0 2024-04-16T15:52:01.510 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.503+0000 7f273af59640 1 -- 172.21.15.132:0/555494002 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f273415c060 con 0x7f27340d03e0 2024-04-16T15:52:01.510 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.503+0000 7f27297fa640 1 -- 172.21.15.132:0/555494002 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2730034040 con 0x7f27340d03e0 2024-04-16T15:52:01.510 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.504+0000 7f273af59640 1 -- 172.21.15.132:0/555494002 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f273415c620 con 0x7f27340d03e0 2024-04-16T15:52:01.510 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.504+0000 7f273af59640 1 -- 172.21.15.132:0/555494002 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2734075e90 con 0x7f27340d03e0 2024-04-16T15:52:01.510 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.505+0000 7f27297fa640 1 -- 172.21.15.132:0/555494002 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7f273004b070 con 0x7f27340d03e0 2024-04-16T15:52:01.510 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.505+0000 7f27297fa640 1 --2- 172.21.15.132:0/555494002 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f272006c860 0x7f272006ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:01.510 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.505+0000 7f27297fa640 1 -- 172.21.15.132:0/555494002 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7f27300acb00 con 0x7f27340d03e0 2024-04-16T15:52:01.510 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.505+0000 7f272bfff640 1 --2- 172.21.15.132:0/555494002 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f272006c860 0x7f272006ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:01.510 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.506+0000 7f272bfff640 1 --2- 172.21.15.132:0/555494002 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f272006c860 0x7f272006ed20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f27340b7dd0 tx=0x7f2724009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:01.511 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.510+0000 7f27297fa640 1 -- 172.21.15.132:0/555494002 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2730030810 con 0x7f27340d03e0 2024-04-16T15:52:01.686 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.687+0000 7f273af59640 1 -- 172.21.15.132:0/555494002 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f27340b4e50 con 0x7f27340d03e0 2024-04-16T15:52:01.687 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.687+0000 7f27297fa640 1 -- 172.21.15.132:0/555494002 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7f273007b750 con 0x7f27340d03e0 2024-04-16T15:52:01.687 INFO:teuthology.misc.health.smithi132.stdout: 2024-04-16T15:52:01.687 INFO:teuthology.misc.health.smithi132.stdout:{"epoch":12,"fsid":"6bdec5d9-f406-43ad-8584-0503b32f6f0d","created":"2024-04-16T15:51:51.073040+0000","modified":"2024-04-16T15:51:59.274746+0000","last_up_change":"0.000000","last_in_change":"2024-04-16T15:51:53.376468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2d45908b-6e22-4619-b190-897af594b712","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c88bf082-e51f-4ee6-815a-025f6ce0d67b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e5dbd6b4-4e7b-47e4-ad4e-35b4b81696c7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9d75cd67-3b8a-4424-8884-5f3660e1f5f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"83aea46a-8642-4777-912b-c130e5890da7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"534117c8-3317-48d6-b436-afd5709f71e9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0ba363e7-fa9d-42b1-ae09-a6a0f57d41f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e6830c77-2f2d-4067-9866-ee7625afc1a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:52:01.689 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.689+0000 7f273af59640 1 -- 172.21.15.132:0/555494002 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f272006c860 msgr2=0x7f272006ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:01.689 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.689+0000 7f273af59640 1 --2- 172.21.15.132:0/555494002 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f272006c860 0x7f272006ed20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f27340b7dd0 tx=0x7f2724009190 comp rx=0 tx=0).stop 2024-04-16T15:52:01.689 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.689+0000 7f273af59640 1 -- 172.21.15.132:0/555494002 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27340d03e0 msgr2=0x7f2734159d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:01.689 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.689+0000 7f273af59640 1 --2- 172.21.15.132:0/555494002 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27340d03e0 0x7f2734159d10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2730000c00 tx=0x7f2730004730 comp rx=0 tx=0).stop 2024-04-16T15:52:01.689 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.689+0000 7f273af59640 1 -- 172.21.15.132:0/555494002 shutdown_connections 2024-04-16T15:52:01.690 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.689+0000 7f273af59640 1 --2- 172.21.15.132:0/555494002 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f272006c860 0x7f272006ed20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:01.690 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.689+0000 7f273af59640 1 --2- 172.21.15.132:0/555494002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f273415fe20 0x7f27340caca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:01.690 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.689+0000 7f273af59640 1 --2- 172.21.15.132:0/555494002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27340d0be0 0x7f27340b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:01.690 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.689+0000 7f273af59640 1 --2- 172.21.15.132:0/555494002 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27340d03e0 0x7f2734159d10 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:01.690 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.689+0000 7f273af59640 1 -- 172.21.15.132:0/555494002 >> 172.21.15.132:0/555494002 conn(0x7f27340b40f0 msgr2=0x7f2734071300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:01.690 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.689+0000 7f273af59640 1 -- 172.21.15.132:0/555494002 shutdown_connections 2024-04-16T15:52:01.690 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:01.689+0000 7f273af59640 1 -- 172.21.15.132:0/555494002 wait complete. 2024-04-16T15:52:01.698 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-16T15:52:01.752 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-04-16T15:52:01.753+0000 7f6b86b8c640 -1 osd.5 0 waiting for initial osdmap 2024-04-16T15:52:01.766 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-04-16T15:52:01.767+0000 7f6b7e9ac640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T15:52:08.506 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-16T15:52:08.608 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.608+0000 7f066c84e640 1 Processor -- start 2024-04-16T15:52:08.608 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.609+0000 7f066c84e640 1 -- start start 2024-04-16T15:52:08.609 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.609+0000 7f066c84e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06680ba500 0x7f0668169490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:08.609 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.609+0000 7f066c84e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06680b9300 con 0x7f06680d3df0 2024-04-16T15:52:08.609 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.609+0000 7f066c84e640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06680b95e0 con 0x7f066815e9e0 2024-04-16T15:52:08.609 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.609+0000 7f066c84e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f066815edc0 con 0x7f06680ba500 2024-04-16T15:52:08.609 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.610+0000 7f0665d9b640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f06680d3df0 0x7f06680b78f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:58394/0 (socket says 172.21.15.132:58394) 2024-04-16T15:52:08.610 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.610+0000 7f0665d9b640 1 -- 172.21.15.132:0/2705675589 learned_addr learned my addr 172.21.15.132:0/2705675589 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:08.610 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.610+0000 7f0666d9d640 1 --2- 172.21.15.132:0/2705675589 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06680ba500 0x7f0668169490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:08.610 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.610+0000 7f066559a640 1 -- 172.21.15.132:0/2705675589 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 347837079 0 0) 0x7f06680b9300 con 0x7f06680d3df0 2024-04-16T15:52:08.610 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.610+0000 7f066559a640 1 -- 172.21.15.132:0/2705675589 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0650003520 con 0x7f06680d3df0 2024-04-16T15:52:08.610 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.610+0000 7f066559a640 1 -- 172.21.15.132:0/2705675589 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1936746619 0 0) 0x7f06680b95e0 con 0x7f066815e9e0 2024-04-16T15:52:08.610 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.610+0000 7f066559a640 1 -- 172.21.15.132:0/2705675589 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06680b9300 con 0x7f066815e9e0 2024-04-16T15:52:08.610 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.610+0000 7f0666d9d640 1 -- 172.21.15.132:0/2705675589 >> v1:172.21.15.179:6789/0 conn(0x7f066815e9e0 legacy=0x7f06680cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:08.610 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.610+0000 7f0666d9d640 1 -- 172.21.15.132:0/2705675589 >> v1:172.21.15.132:6789/0 conn(0x7f06680d3df0 legacy=0x7f06680b78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:08.610 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.610+0000 7f066559a640 1 -- 172.21.15.132:0/2705675589 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2163843454 0 0) 0x7f0650003520 con 0x7f06680d3df0 2024-04-16T15:52:08.610 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.610+0000 7f0666d9d640 1 -- 172.21.15.132:0/2705675589 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06680b98c0 con 0x7f06680ba500 2024-04-16T15:52:08.612 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.611+0000 7f0666d9d640 1 --2- 172.21.15.132:0/2705675589 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06680ba500 0x7f0668169490 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0660009dc0 tx=0x7f066002be70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8bedcd43a2c93b16 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:08.612 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.611+0000 7f066559a640 1 -- 172.21.15.132:0/2705675589 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0660039070 con 0x7f06680ba500 2024-04-16T15:52:08.612 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.611+0000 7f066559a640 1 -- 172.21.15.132:0/2705675589 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f066002c9a0 con 0x7f06680ba500 2024-04-16T15:52:08.612 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.611+0000 7f066559a640 1 -- 172.21.15.132:0/2705675589 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f065c001670 con 0x7f06680ba500 2024-04-16T15:52:08.612 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.612+0000 7f066c84e640 1 -- 172.21.15.132:0/2705675589 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06680ba500 msgr2=0x7f0668169490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:08.612 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.612+0000 7f066c84e640 1 --2- 172.21.15.132:0/2705675589 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06680ba500 0x7f0668169490 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0660009dc0 tx=0x7f066002be70 comp rx=0 tx=0).stop 2024-04-16T15:52:08.612 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.612+0000 7f066c84e640 1 -- 172.21.15.132:0/2705675589 shutdown_connections 2024-04-16T15:52:08.612 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.612+0000 7f066c84e640 1 --2- 172.21.15.132:0/2705675589 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06680ba500 0x7f0668169490 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:08.612 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.612+0000 7f066c84e640 1 -- 172.21.15.132:0/2705675589 >> 172.21.15.132:0/2705675589 conn(0x7f0668073500 msgr2=0x7f0668073910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:08.612 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.612+0000 7f066c84e640 1 -- 172.21.15.132:0/2705675589 shutdown_connections 2024-04-16T15:52:08.612 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.612+0000 7f066c84e640 1 -- 172.21.15.132:0/2705675589 wait complete. 2024-04-16T15:52:08.615 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.613+0000 7f066c84e640 1 Processor -- start 2024-04-16T15:52:08.615 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.613+0000 7f066c84e640 1 -- start start 2024-04-16T15:52:08.615 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.614+0000 7f066c84e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06680ba500 0x7f06680caeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:08.615 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.614+0000 7f066c84e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06680d3df0 0x7f06681f7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:08.615 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.614+0000 7f066c84e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f066815e9e0 0x7f06680c83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:08.615 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.614+0000 7f066c84e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f06680b9010 con 0x7f066815e9e0 2024-04-16T15:52:08.615 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.614+0000 7f066c84e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f06680d2900 con 0x7f06680ba500 2024-04-16T15:52:08.615 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.614+0000 7f066c84e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f06680cfc60 con 0x7f06680d3df0 2024-04-16T15:52:08.615 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.614+0000 7f0666d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f066815e9e0 0x7f06680c83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:08.615 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.614+0000 7f0666d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f066815e9e0 0x7f06680c83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33516/0 (socket says 172.21.15.132:33516) 2024-04-16T15:52:08.616 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.614+0000 7f0666d9d640 1 -- 172.21.15.132:0/4015628543 learned_addr learned my addr 172.21.15.132:0/4015628543 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:08.616 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.614+0000 7f0665d9b640 1 --2- 172.21.15.132:0/4015628543 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06680d3df0 0x7f06681f7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:08.616 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.614+0000 7f066659c640 1 --2- 172.21.15.132:0/4015628543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06680ba500 0x7f06680caeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:08.616 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.615+0000 7f0666d9d640 1 -- 172.21.15.132:0/4015628543 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06680d3df0 msgr2=0x7f06681f7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:08.616 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.615+0000 7f0666d9d640 1 --2- 172.21.15.132:0/4015628543 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06680d3df0 0x7f06681f7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:08.616 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.615+0000 7f0666d9d640 1 -- 172.21.15.132:0/4015628543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06680ba500 msgr2=0x7f06680caeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:08.616 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.615+0000 7f0666d9d640 1 --2- 172.21.15.132:0/4015628543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06680ba500 0x7f06680caeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:08.616 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.615+0000 7f0666d9d640 1 -- 172.21.15.132:0/4015628543 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f066815c880 con 0x7f066815e9e0 2024-04-16T15:52:08.616 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.615+0000 7f0666d9d640 1 --2- 172.21.15.132:0/4015628543 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f066815e9e0 0x7f06680c83b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0660037040 tx=0x7f0660004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:08.616 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.615+0000 7f0656ffd640 1 -- 172.21.15.132:0/4015628543 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0660039050 con 0x7f066815e9e0 2024-04-16T15:52:08.616 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.615+0000 7f0656ffd640 1 -- 172.21.15.132:0/4015628543 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0660045070 con 0x7f066815e9e0 2024-04-16T15:52:08.616 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.615+0000 7f0656ffd640 1 -- 172.21.15.132:0/4015628543 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0660009450 con 0x7f066815e9e0 2024-04-16T15:52:08.616 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.615+0000 7f066c84e640 1 -- 172.21.15.132:0/4015628543 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06681f7850 con 0x7f066815e9e0 2024-04-16T15:52:08.616 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.615+0000 7f066c84e640 1 -- 172.21.15.132:0/4015628543 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06681586a0 con 0x7f066815e9e0 2024-04-16T15:52:08.617 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.616+0000 7f066c84e640 1 -- 172.21.15.132:0/4015628543 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0668075e90 con 0x7f066815e9e0 2024-04-16T15:52:08.617 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.616+0000 7f0656ffd640 1 -- 172.21.15.132:0/4015628543 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0660040690 con 0x7f066815e9e0 2024-04-16T15:52:08.618 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.617+0000 7f0656ffd640 1 --2- 172.21.15.132:0/4015628543 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f064806c8f0 0x7f064806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:08.618 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.617+0000 7f066659c640 1 --2- 172.21.15.132:0/4015628543 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f064806c8f0 0x7f064806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:08.618 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.617+0000 7f0656ffd640 1 -- 172.21.15.132:0/4015628543 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f06600adf20 con 0x7f066815e9e0 2024-04-16T15:52:08.618 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.617+0000 7f066659c640 1 --2- 172.21.15.132:0/4015628543 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f064806c8f0 0x7f064806edb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f06580011e0 tx=0x7f0658009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:08.621 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.622+0000 7f0656ffd640 1 -- 172.21.15.132:0/4015628543 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f066007c0e0 con 0x7f066815e9e0 2024-04-16T15:52:08.798 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.799+0000 7f066c84e640 1 -- 172.21.15.132:0/4015628543 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0668068f20 con 0x7f066815e9e0 2024-04-16T15:52:08.799 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.800+0000 7f0656ffd640 1 -- 172.21.15.132:0/4015628543 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12884 (secure 0 0 0) 0x7f06600803e0 con 0x7f066815e9e0 2024-04-16T15:52:08.799 INFO:teuthology.misc.health.smithi132.stdout: 2024-04-16T15:52:08.799 INFO:teuthology.misc.health.smithi132.stdout:{"epoch":16,"fsid":"6bdec5d9-f406-43ad-8584-0503b32f6f0d","created":"2024-04-16T15:51:51.073040+0000","modified":"2024-04-16T15:52:05.288321+0000","last_up_change":"2024-04-16T15:52:02.280496+0000","last_in_change":"2024-04-16T15:51:53.376468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:52:03.284927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d45908b-6e22-4619-b190-897af594b712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6801","nonce":1170594668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6803","nonce":1170594668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6807","nonce":1170594668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6805","nonce":1170594668}]},"public_addr":"172.21.15.132:6801/1170594668","cluster_addr":"172.21.15.132:6803/1170594668","heartbeat_back_addr":"172.21.15.132:6807/1170594668","heartbeat_front_addr":"172.21.15.132:6805/1170594668","state":["exists","up"]},{"osd":1,"uuid":"c88bf082-e51f-4ee6-815a-025f6ce0d67b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6809","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6811","nonce":2494780358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6815","nonce":2494780358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6823","nonce":2494780358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6819","nonce":2494780358}]},"public_addr":"172.21.15.132:6811/2494780358","cluster_addr":"172.21.15.132:6815/2494780358","heartbeat_back_addr":"172.21.15.132:6823/2494780358","heartbeat_front_addr":"172.21.15.132:6819/2494780358","state":["exists","up"]},{"osd":2,"uuid":"e5dbd6b4-4e7b-47e4-ad4e-35b4b81696c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6825","nonce":27655483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6827","nonce":27655483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6831","nonce":27655483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6829","nonce":27655483}]},"public_addr":"172.21.15.132:6825/27655483","cluster_addr":"172.21.15.132:6827/27655483","heartbeat_back_addr":"172.21.15.132:6831/27655483","heartbeat_front_addr":"172.21.15.132:6829/27655483","state":["exists","up"]},{"osd":3,"uuid":"9d75cd67-3b8a-4424-8884-5f3660e1f5f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6810","nonce":3100919191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6814","nonce":3100919191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6821","nonce":3100919191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6818","nonce":3100919191}]},"public_addr":"172.21.15.132:6810/3100919191","cluster_addr":"172.21.15.132:6814/3100919191","heartbeat_back_addr":"172.21.15.132:6821/3100919191","heartbeat_front_addr":"172.21.15.132:6818/3100919191","state":["exists","up"]},{"osd":4,"uuid":"83aea46a-8642-4777-912b-c130e5890da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6825","nonce":123637799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6827","nonce":123637799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6831","nonce":123637799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6829","nonce":123637799}]},"public_addr":"172.21.15.179:6825/123637799","cluster_addr":"172.21.15.179:6827/123637799","heartbeat_back_addr":"172.21.15.179:6831/123637799","heartbeat_front_addr":"172.21.15.179:6829/123637799","state":["exists","up"]},{"osd":5,"uuid":"534117c8-3317-48d6-b436-afd5709f71e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6801","nonce":2224750370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6803","nonce":2224750370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6807","nonce":2224750370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6805","nonce":2224750370}]},"public_addr":"172.21.15.179:6801/2224750370","cluster_addr":"172.21.15.179:6803/2224750370","heartbeat_back_addr":"172.21.15.179:6807/2224750370","heartbeat_front_addr":"172.21.15.179:6805/2224750370","state":["exists","up"]},{"osd":6,"uuid":"0ba363e7-fa9d-42b1-ae09-a6a0f57d41f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6809","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6811","nonce":101498164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6813","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6815","nonce":101498164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6823","nonce":101498164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6819","nonce":101498164}]},"public_addr":"172.21.15.179:6811/101498164","cluster_addr":"172.21.15.179:6815/101498164","heartbeat_back_addr":"172.21.15.179:6823/101498164","heartbeat_front_addr":"172.21.15.179:6819/101498164","state":["exists","up"]},{"osd":7,"uuid":"e6830c77-2f2d-4067-9866-ee7625afc1a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6810","nonce":872148365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6814","nonce":872148365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6822","nonce":872148365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6818","nonce":872148365}]},"public_addr":"172.21.15.179:6810/872148365","cluster_addr":"172.21.15.179:6814/872148365","heartbeat_back_addr":"172.21.15.179:6822/872148365","heartbeat_front_addr":"172.21.15.179:6818/872148365","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.535221+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.563769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.520765+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.526264+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.517058+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.500842+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.534332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.512486+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:52:08.801 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.802+0000 7f066c84e640 1 -- 172.21.15.132:0/4015628543 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f064806c8f0 msgr2=0x7f064806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:08.801 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.802+0000 7f066c84e640 1 --2- 172.21.15.132:0/4015628543 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f064806c8f0 0x7f064806edb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f06580011e0 tx=0x7f0658009040 comp rx=0 tx=0).stop 2024-04-16T15:52:08.801 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.802+0000 7f066c84e640 1 -- 172.21.15.132:0/4015628543 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f066815e9e0 msgr2=0x7f06680c83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:08.801 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.802+0000 7f066c84e640 1 --2- 172.21.15.132:0/4015628543 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f066815e9e0 0x7f06680c83b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0660037040 tx=0x7f0660004a40 comp rx=0 tx=0).stop 2024-04-16T15:52:08.802 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.802+0000 7f066c84e640 1 -- 172.21.15.132:0/4015628543 shutdown_connections 2024-04-16T15:52:08.802 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.802+0000 7f066c84e640 1 --2- 172.21.15.132:0/4015628543 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f064806c8f0 0x7f064806edb0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:08.802 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.802+0000 7f066c84e640 1 --2- 172.21.15.132:0/4015628543 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f066815e9e0 0x7f06680c83b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:08.802 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.802+0000 7f066c84e640 1 --2- 172.21.15.132:0/4015628543 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06680d3df0 0x7f06681f7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:08.802 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.802+0000 7f066c84e640 1 --2- 172.21.15.132:0/4015628543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06680ba500 0x7f06680caeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:08.802 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.802+0000 7f066c84e640 1 -- 172.21.15.132:0/4015628543 >> 172.21.15.132:0/4015628543 conn(0x7f0668073500 msgr2=0x7f06680d4840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:08.802 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.802+0000 7f066c84e640 1 -- 172.21.15.132:0/4015628543 shutdown_connections 2024-04-16T15:52:08.802 INFO:teuthology.misc.health.smithi132.stderr:2024-04-16T15:52:08.802+0000 7f066c84e640 1 -- 172.21.15.132:0/4015628543 wait complete. 2024-04-16T15:52:08.811 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-16T15:52:08.811 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-16T15:52:08.811 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-16T15:52:08.811 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-16T15:52:08.814 INFO:tasks.ceph.mds.a:Started 2024-04-16T15:52:08.814 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-16T15:52:08.814 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-16T15:52:08.816 INFO:tasks.ceph.mds.c:Started 2024-04-16T15:52:08.816 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-16T15:52:08.816 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-16T15:52:08.819 INFO:tasks.ceph.mds.b:Started 2024-04-16T15:52:08.819 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-16T15:52:08.819 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-16T15:52:08.821 INFO:tasks.ceph.mds.d:Started 2024-04-16T15:52:08.822 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-16T15:52:08.822 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:52:08.893 INFO:tasks.ceph.mds.a.smithi132.stdout:starting mds.a at 2024-04-16T15:52:08.895 INFO:tasks.ceph.mds.c.smithi132.stdout:starting mds.c at 2024-04-16T15:52:08.908 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2024-04-16T15:52:08.908 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2024-04-16T15:52:08.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.934+0000 7f7400606640 1 Processor -- start 2024-04-16T15:52:08.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.934+0000 7f7400606640 1 -- start start 2024-04-16T15:52:08.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.935+0000 7f7400606640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f73f815eaf0 0x7f73f80ba300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:08.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.935+0000 7f7400606640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73f8162cc0 con 0x7f73f815eed0 2024-04-16T15:52:08.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.935+0000 7f7400606640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73f8162fa0 con 0x7f73f80b6b00 2024-04-16T15:52:08.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.935+0000 7f7400606640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f73f80d2af0 con 0x7f73f815eaf0 2024-04-16T15:52:08.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.935+0000 7f73fe3a2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f73f815eaf0 0x7f73f80ba300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:08.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.935+0000 7f73fdba1640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f73f815eed0 0x7f73f80b63f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:58420/0 (socket says 172.21.15.132:58420) 2024-04-16T15:52:08.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.935+0000 7f73fdba1640 1 -- 172.21.15.132:0/654743728 learned_addr learned my addr 172.21.15.132:0/654743728 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:08.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.936+0000 7f73fe3a2640 1 -- 172.21.15.132:0/654743728 >> v1:172.21.15.179:6789/0 conn(0x7f73f80b6b00 legacy=0x7f73f80d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:08.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.936+0000 7f73fd3a0640 1 -- 172.21.15.132:0/654743728 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3307819653 0 0) 0x7f73f8162cc0 con 0x7f73f815eed0 2024-04-16T15:52:08.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.936+0000 7f73fe3a2640 1 -- 172.21.15.132:0/654743728 >> v1:172.21.15.132:6789/0 conn(0x7f73f815eed0 legacy=0x7f73f80b63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:08.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.936+0000 7f73fe3a2640 1 -- 172.21.15.132:0/654743728 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73f8163280 con 0x7f73f815eaf0 2024-04-16T15:52:08.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.936+0000 7f73fe3a2640 1 --2- 172.21.15.132:0/654743728 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73f815eaf0 0x7f73f80ba300 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f73f80d2c70 tx=0x7f73f402b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eed103a9fd6fe8f server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:08.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.936+0000 7f73fd3a0640 1 -- 172.21.15.132:0/654743728 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f4037070 con 0x7f73f815eaf0 2024-04-16T15:52:08.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.937+0000 7f73fd3a0640 1 -- 172.21.15.132:0/654743728 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73f4030710 con 0x7f73f815eaf0 2024-04-16T15:52:08.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.937+0000 7f73fd3a0640 1 -- 172.21.15.132:0/654743728 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f4030ae0 con 0x7f73f815eaf0 2024-04-16T15:52:08.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.937+0000 7f7400606640 1 -- 172.21.15.132:0/654743728 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73f815eaf0 msgr2=0x7f73f80ba300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:08.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.937+0000 7f7400606640 1 --2- 172.21.15.132:0/654743728 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73f815eaf0 0x7f73f80ba300 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f73f80d2c70 tx=0x7f73f402b730 comp rx=0 tx=0).stop 2024-04-16T15:52:08.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.937+0000 7f7400606640 1 -- 172.21.15.132:0/654743728 shutdown_connections 2024-04-16T15:52:08.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.937+0000 7f7400606640 1 --2- 172.21.15.132:0/654743728 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73f815eaf0 0x7f73f80ba300 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:08.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.937+0000 7f7400606640 1 -- 172.21.15.132:0/654743728 >> 172.21.15.132:0/654743728 conn(0x7f73f80d13f0 msgr2=0x7f73f80d1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:08.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.937+0000 7f7400606640 1 -- 172.21.15.132:0/654743728 shutdown_connections 2024-04-16T15:52:08.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.937+0000 7f7400606640 1 -- 172.21.15.132:0/654743728 wait complete. 2024-04-16T15:52:08.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.938+0000 7f7400606640 1 Processor -- start 2024-04-16T15:52:08.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.938+0000 7f7400606640 1 -- start start 2024-04-16T15:52:08.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.939+0000 7f7400606640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73f80b6b00 0x7f73f8156040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:08.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.939+0000 7f7400606640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73f815eaf0 0x7f73f80b90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:08.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.939+0000 7f7400606640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73f815eed0 0x7f73f80b9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:08.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.939+0000 7f7400606640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f73f81627e0 con 0x7f73f815eaf0 2024-04-16T15:52:08.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.939+0000 7f7400606640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f73f80ba840 con 0x7f73f815eed0 2024-04-16T15:52:08.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.939+0000 7f7400606640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f73f8162960 con 0x7f73f80b6b00 2024-04-16T15:52:08.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.939+0000 7f73fdba1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73f815eaf0 0x7f73f80b90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:08.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.939+0000 7f73fdba1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73f815eaf0 0x7f73f80b90c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33554/0 (socket says 172.21.15.132:33554) 2024-04-16T15:52:08.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.939+0000 7f73fdba1640 1 -- 172.21.15.132:0/1659125654 learned_addr learned my addr 172.21.15.132:0/1659125654 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:08.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.939+0000 7f73fe3a2640 1 --2- 172.21.15.132:0/1659125654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73f80b6b00 0x7f73f8156040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:08.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.939+0000 7f73feba3640 1 --2- 172.21.15.132:0/1659125654 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73f815eed0 0x7f73f80b9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:08.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.939+0000 7f73fdba1640 1 -- 172.21.15.132:0/1659125654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73f80b6b00 msgr2=0x7f73f8156040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:08.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.939+0000 7f73fdba1640 1 --2- 172.21.15.132:0/1659125654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73f80b6b00 0x7f73f8156040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:08.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.939+0000 7f73fdba1640 1 -- 172.21.15.132:0/1659125654 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73f815eed0 msgr2=0x7f73f80b9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:08.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.939+0000 7f73fdba1640 1 --2- 172.21.15.132:0/1659125654 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73f815eed0 0x7f73f80b9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:08.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.939+0000 7f73fdba1640 1 -- 172.21.15.132:0/1659125654 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73f80ccc10 con 0x7f73f815eaf0 2024-04-16T15:52:08.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.940+0000 7f73fe3a2640 1 --2- 172.21.15.132:0/1659125654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73f80b6b00 0x7f73f8156040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:08.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.940+0000 7f73feba3640 1 --2- 172.21.15.132:0/1659125654 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73f815eed0 0x7f73f80b9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:08.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.940+0000 7f73fdba1640 1 --2- 172.21.15.132:0/1659125654 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73f815eaf0 0x7f73f80b90c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f73e800c3f0 tx=0x7f73e800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:08.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.940+0000 7f73eeffd640 1 -- 172.21.15.132:0/1659125654 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73e80074e0 con 0x7f73f815eaf0 2024-04-16T15:52:08.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.940+0000 7f73eeffd640 1 -- 172.21.15.132:0/1659125654 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73e80047e0 con 0x7f73f815eaf0 2024-04-16T15:52:08.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.940+0000 7f7400606640 1 -- 172.21.15.132:0/1659125654 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73f80cbb70 con 0x7f73f815eaf0 2024-04-16T15:52:08.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.940+0000 7f73eeffd640 1 -- 172.21.15.132:0/1659125654 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73e8004bd0 con 0x7f73f815eaf0 2024-04-16T15:52:08.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.940+0000 7f7400606640 1 -- 172.21.15.132:0/1659125654 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73f80cc130 con 0x7f73f815eaf0 2024-04-16T15:52:08.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.941+0000 7f7400606640 1 -- 172.21.15.132:0/1659125654 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73f8075510 con 0x7f73f815eaf0 2024-04-16T15:52:08.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.941+0000 7f73eeffd640 1 -- 172.21.15.132:0/1659125654 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f73e8011070 con 0x7f73f815eaf0 2024-04-16T15:52:08.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.942+0000 7f73eeffd640 1 --2- 172.21.15.132:0/1659125654 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f73dc06c8f0 0x7f73dc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:08.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.942+0000 7f73eeffd640 1 -- 172.21.15.132:0/1659125654 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f73e808b360 con 0x7f73f815eaf0 2024-04-16T15:52:08.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.942+0000 7f73fe3a2640 1 --2- 172.21.15.132:0/1659125654 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f73dc06c8f0 0x7f73dc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:08.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.942+0000 7f73fe3a2640 1 --2- 172.21.15.132:0/1659125654 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f73dc06c8f0 0x7f73dc06edb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f73f4034000 tx=0x7f73f4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:08.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:08.946+0000 7f73eeffd640 1 -- 172.21.15.132:0/1659125654 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f73e801a2b0 con 0x7f73f815eaf0 2024-04-16T15:52:09.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.124+0000 7f7400606640 1 -- 172.21.15.132:0/1659125654 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f73f80b5670 con 0x7f73f815eaf0 2024-04-16T15:52:09.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.124+0000 7f73eeffd640 1 -- 172.21.15.132:0/1659125654 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12884 (secure 0 0 0) 0x7f73e8059b70 con 0x7f73f815eaf0 2024-04-16T15:52:09.124 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:52:09.124 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":16,"fsid":"6bdec5d9-f406-43ad-8584-0503b32f6f0d","created":"2024-04-16T15:51:51.073040+0000","modified":"2024-04-16T15:52:05.288321+0000","last_up_change":"2024-04-16T15:52:02.280496+0000","last_in_change":"2024-04-16T15:51:53.376468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:52:03.284927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d45908b-6e22-4619-b190-897af594b712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6801","nonce":1170594668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6803","nonce":1170594668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6807","nonce":1170594668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6805","nonce":1170594668}]},"public_addr":"172.21.15.132:6801/1170594668","cluster_addr":"172.21.15.132:6803/1170594668","heartbeat_back_addr":"172.21.15.132:6807/1170594668","heartbeat_front_addr":"172.21.15.132:6805/1170594668","state":["exists","up"]},{"osd":1,"uuid":"c88bf082-e51f-4ee6-815a-025f6ce0d67b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6809","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6811","nonce":2494780358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6815","nonce":2494780358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6823","nonce":2494780358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6819","nonce":2494780358}]},"public_addr":"172.21.15.132:6811/2494780358","cluster_addr":"172.21.15.132:6815/2494780358","heartbeat_back_addr":"172.21.15.132:6823/2494780358","heartbeat_front_addr":"172.21.15.132:6819/2494780358","state":["exists","up"]},{"osd":2,"uuid":"e5dbd6b4-4e7b-47e4-ad4e-35b4b81696c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6825","nonce":27655483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6827","nonce":27655483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6831","nonce":27655483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6829","nonce":27655483}]},"public_addr":"172.21.15.132:6825/27655483","cluster_addr":"172.21.15.132:6827/27655483","heartbeat_back_addr":"172.21.15.132:6831/27655483","heartbeat_front_addr":"172.21.15.132:6829/27655483","state":["exists","up"]},{"osd":3,"uuid":"9d75cd67-3b8a-4424-8884-5f3660e1f5f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6810","nonce":3100919191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6814","nonce":3100919191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6821","nonce":3100919191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6818","nonce":3100919191}]},"public_addr":"172.21.15.132:6810/3100919191","cluster_addr":"172.21.15.132:6814/3100919191","heartbeat_back_addr":"172.21.15.132:6821/3100919191","heartbeat_front_addr":"172.21.15.132:6818/3100919191","state":["exists","up"]},{"osd":4,"uuid":"83aea46a-8642-4777-912b-c130e5890da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6825","nonce":123637799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6827","nonce":123637799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6831","nonce":123637799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6829","nonce":123637799}]},"public_addr":"172.21.15.179:6825/123637799","cluster_addr":"172.21.15.179:6827/123637799","heartbeat_back_addr":"172.21.15.179:6831/123637799","heartbeat_front_addr":"172.21.15.179:6829/123637799","state":["exists","up"]},{"osd":5,"uuid":"534117c8-3317-48d6-b436-afd5709f71e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6801","nonce":2224750370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6803","nonce":2224750370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6807","nonce":2224750370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6805","nonce":2224750370}]},"public_addr":"172.21.15.179:6801/2224750370","cluster_addr":"172.21.15.179:6803/2224750370","heartbeat_back_addr":"172.21.15.179:6807/2224750370","heartbeat_front_addr":"172.21.15.179:6805/2224750370","state":["exists","up"]},{"osd":6,"uuid":"0ba363e7-fa9d-42b1-ae09-a6a0f57d41f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6809","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6811","nonce":101498164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6813","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6815","nonce":101498164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6823","nonce":101498164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6819","nonce":101498164}]},"public_addr":"172.21.15.179:6811/101498164","cluster_addr":"172.21.15.179:6815/101498164","heartbeat_back_addr":"172.21.15.179:6823/101498164","heartbeat_front_addr":"172.21.15.179:6819/101498164","state":["exists","up"]},{"osd":7,"uuid":"e6830c77-2f2d-4067-9866-ee7625afc1a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6810","nonce":872148365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6814","nonce":872148365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6822","nonce":872148365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6818","nonce":872148365}]},"public_addr":"172.21.15.179:6810/872148365","cluster_addr":"172.21.15.179:6814/872148365","heartbeat_back_addr":"172.21.15.179:6822/872148365","heartbeat_front_addr":"172.21.15.179:6818/872148365","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.535221+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.563769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.520765+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.526264+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.517058+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.500842+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.534332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.512486+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:52:09.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.127+0000 7f7400606640 1 -- 172.21.15.132:0/1659125654 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f73dc06c8f0 msgr2=0x7f73dc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:09.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.127+0000 7f7400606640 1 --2- 172.21.15.132:0/1659125654 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f73dc06c8f0 0x7f73dc06edb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f73f4034000 tx=0x7f73f4008030 comp rx=0 tx=0).stop 2024-04-16T15:52:09.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.127+0000 7f7400606640 1 -- 172.21.15.132:0/1659125654 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73f815eaf0 msgr2=0x7f73f80b90c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:09.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.127+0000 7f7400606640 1 --2- 172.21.15.132:0/1659125654 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73f815eaf0 0x7f73f80b90c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f73e800c3f0 tx=0x7f73e800c8b0 comp rx=0 tx=0).stop 2024-04-16T15:52:09.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.127+0000 7f7400606640 1 -- 172.21.15.132:0/1659125654 shutdown_connections 2024-04-16T15:52:09.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.127+0000 7f7400606640 1 --2- 172.21.15.132:0/1659125654 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f73dc06c8f0 0x7f73dc06edb0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:09.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.127+0000 7f7400606640 1 --2- 172.21.15.132:0/1659125654 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73f815eed0 0x7f73f80b9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:09.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.127+0000 7f7400606640 1 --2- 172.21.15.132:0/1659125654 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73f815eaf0 0x7f73f80b90c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:09.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.127+0000 7f7400606640 1 --2- 172.21.15.132:0/1659125654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73f80b6b00 0x7f73f8156040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:09.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.127+0000 7f7400606640 1 -- 172.21.15.132:0/1659125654 >> 172.21.15.132:0/1659125654 conn(0x7f73f80d13f0 msgr2=0x7f73f80d2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:09.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.127+0000 7f7400606640 1 -- 172.21.15.132:0/1659125654 shutdown_connections 2024-04-16T15:52:09.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.127+0000 7f7400606640 1 -- 172.21.15.132:0/1659125654 wait complete. 2024-04-16T15:52:09.137 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T15:52:03.284927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T15:52:09.137 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T15:52:09.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.245+0000 7fc582ae4640 1 Processor -- start 2024-04-16T15:52:09.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.245+0000 7fc582ae4640 1 -- start start 2024-04-16T15:52:09.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.245+0000 7fc582ae4640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc57c15ec20 0x7fc57c0d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:09.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.245+0000 7fc582ae4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc57c0d2030 0x7fc57c0b7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:09.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.245+0000 7fc582ae4640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc57c0d3850 con 0x7fc57c0d3340 2024-04-16T15:52:09.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.245+0000 7fc582ae4640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fc57c0d3b30 con 0x7fc57c15ec20 2024-04-16T15:52:09.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.245+0000 7fc582ae4640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc57c0d3e10 con 0x7fc57c0d2030 2024-04-16T15:52:09.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.246+0000 7fc581081640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc57c0d2030 0x7fc57c0b7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:09.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.246+0000 7fc580880640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc57c15ec20 0x7fc57c0d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:09.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.246+0000 7fc57bfff640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fc57c0d3340 0x7fc57c0d1920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.132:35180/0 (socket says 172.21.15.132:35180) 2024-04-16T15:52:09.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.246+0000 7fc581081640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc57c0d2030 0x7fc57c0b7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.132:36002/0 (socket says 172.21.15.132:36002) 2024-04-16T15:52:09.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.246+0000 7fc580880640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc57c15ec20 0x7fc57c0d2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.132:48166/0 (socket says 172.21.15.132:48166) 2024-04-16T15:52:09.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.246+0000 7fc581081640 1 -- 172.21.15.132:0/1149772212 learned_addr learned my addr 172.21.15.132:0/1149772212 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:09.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.246+0000 7fc581081640 1 -- 172.21.15.132:0/1149772212 >> v2:172.21.15.179:3300/0 conn(0x7fc57c15ec20 msgr2=0x7fc57c0d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:09.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.246+0000 7fc581081640 1 --2- 172.21.15.132:0/1149772212 >> v2:172.21.15.179:3300/0 conn(0x7fc57c15ec20 0x7fc57c0d2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:09.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.246+0000 7fc581081640 1 -- 172.21.15.132:0/1149772212 >> v1:172.21.15.179:6789/0 conn(0x7fc57c0d3340 legacy=0x7fc57c0d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:09.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.246+0000 7fc581081640 1 -- 172.21.15.132:0/1149772212 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc57c0d40f0 con 0x7fc57c0d2030 2024-04-16T15:52:09.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.247+0000 7fc581081640 1 --2- 172.21.15.132:0/1149772212 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc57c0d2030 0x7fc57c0b7bb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc574009e50 tx=0x7fc57402bff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a403e12d655bd36f server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:09.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.247+0000 7fc57b7fe640 1 -- 172.21.15.132:0/1149772212 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc57402cb90 con 0x7fc57c0d2030 2024-04-16T15:52:09.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.247+0000 7fc57b7fe640 1 -- 172.21.15.132:0/1149772212 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc57402cd30 con 0x7fc57c0d2030 2024-04-16T15:52:09.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.247+0000 7fc57b7fe640 1 -- 172.21.15.132:0/1149772212 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc574034610 con 0x7fc57c0d2030 2024-04-16T15:52:09.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.247+0000 7fc582ae4640 1 -- 172.21.15.132:0/1149772212 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc57c0d2030 msgr2=0x7fc57c0b7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:09.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.247+0000 7fc582ae4640 1 --2- 172.21.15.132:0/1149772212 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc57c0d2030 0x7fc57c0b7bb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc574009e50 tx=0x7fc57402bff0 comp rx=0 tx=0).stop 2024-04-16T15:52:09.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.247+0000 7fc582ae4640 1 -- 172.21.15.132:0/1149772212 shutdown_connections 2024-04-16T15:52:09.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.247+0000 7fc582ae4640 1 --2- 172.21.15.132:0/1149772212 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc57c0d2030 0x7fc57c0b7bb0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:09.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.247+0000 7fc582ae4640 1 --2- 172.21.15.132:0/1149772212 >> v2:172.21.15.179:3300/0 conn(0x7fc57c15ec20 0x7fc57c0d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:09.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.247+0000 7fc582ae4640 1 -- 172.21.15.132:0/1149772212 >> 172.21.15.132:0/1149772212 conn(0x7fc57c06d2d0 msgr2=0x7fc57c06d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:09.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.248+0000 7fc582ae4640 1 -- 172.21.15.132:0/1149772212 shutdown_connections 2024-04-16T15:52:09.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.248+0000 7fc582ae4640 1 -- 172.21.15.132:0/1149772212 wait complete. 2024-04-16T15:52:09.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.249+0000 7fc582ae4640 1 Processor -- start 2024-04-16T15:52:09.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.249+0000 7fc582ae4640 1 -- start start 2024-04-16T15:52:09.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.249+0000 7fc582ae4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc57c0d2030 0x7fc57c15d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:09.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.249+0000 7fc582ae4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc57c0d3340 0x7fc57c0ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:09.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.250+0000 7fc582ae4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc57c15ec20 0x7fc57c0ca630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:09.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.250+0000 7fc582ae4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fc57c0cf3a0 con 0x7fc57c0d2030 2024-04-16T15:52:09.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.250+0000 7fc582ae4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc57c15f000 con 0x7fc57c15ec20 2024-04-16T15:52:09.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.250+0000 7fc582ae4640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc57c0cf520 con 0x7fc57c0d3340 2024-04-16T15:52:09.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.250+0000 7fc580880640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc57c0d2030 0x7fc57c15d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:09.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.250+0000 7fc580880640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc57c0d2030 0x7fc57c15d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33566/0 (socket says 172.21.15.132:33566) 2024-04-16T15:52:09.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.250+0000 7fc580880640 1 -- 172.21.15.132:0/2551093333 learned_addr learned my addr 172.21.15.132:0/2551093333 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:09.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.250+0000 7fc581081640 1 --2- 172.21.15.132:0/2551093333 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc57c15ec20 0x7fc57c0ca630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:09.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.250+0000 7fc57bfff640 1 --2- 172.21.15.132:0/2551093333 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc57c0d3340 0x7fc57c0ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:09.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.250+0000 7fc580880640 1 -- 172.21.15.132:0/2551093333 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc57c0d3340 msgr2=0x7fc57c0ca0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:09.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.250+0000 7fc580880640 1 --2- 172.21.15.132:0/2551093333 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc57c0d3340 0x7fc57c0ca0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:09.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.250+0000 7fc580880640 1 -- 172.21.15.132:0/2551093333 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc57c15ec20 msgr2=0x7fc57c0ca630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:09.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.250+0000 7fc580880640 1 --2- 172.21.15.132:0/2551093333 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc57c15ec20 0x7fc57c0ca630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:09.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.250+0000 7fc580880640 1 -- 172.21.15.132:0/2551093333 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc57c14a7d0 con 0x7fc57c0d2030 2024-04-16T15:52:09.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.250+0000 7fc580880640 1 --2- 172.21.15.132:0/2551093333 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc57c0d2030 0x7fc57c15d140 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc57000e8a0 tx=0x7fc57000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:09.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.250+0000 7fc5797fa640 1 -- 172.21.15.132:0/2551093333 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc570017070 con 0x7fc57c0d2030 2024-04-16T15:52:09.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.250+0000 7fc5797fa640 1 -- 172.21.15.132:0/2551093333 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc57000c940 con 0x7fc57c0d2030 2024-04-16T15:52:09.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.250+0000 7fc582ae4640 1 -- 172.21.15.132:0/2551093333 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc57c1f82f0 con 0x7fc57c0d2030 2024-04-16T15:52:09.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.250+0000 7fc5797fa640 1 -- 172.21.15.132:0/2551093333 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc57000cd30 con 0x7fc57c0d2030 2024-04-16T15:52:09.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.250+0000 7fc582ae4640 1 -- 172.21.15.132:0/2551093333 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc57c1f88b0 con 0x7fc57c0d2030 2024-04-16T15:52:09.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.251+0000 7fc582ae4640 1 -- 172.21.15.132:0/2551093333 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc57c075510 con 0x7fc57c0d2030 2024-04-16T15:52:09.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.252+0000 7fc5797fa640 1 -- 172.21.15.132:0/2551093333 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc57001a070 con 0x7fc57c0d2030 2024-04-16T15:52:09.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.252+0000 7fc5797fa640 1 --2- 172.21.15.132:0/2551093333 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fc56006c8f0 0x7fc56006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:09.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.252+0000 7fc5797fa640 1 -- 172.21.15.132:0/2551093333 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fc57008b5e0 con 0x7fc57c0d2030 2024-04-16T15:52:09.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.252+0000 7fc57bfff640 1 --2- 172.21.15.132:0/2551093333 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fc56006c8f0 0x7fc56006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:09.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.252+0000 7fc57bfff640 1 --2- 172.21.15.132:0/2551093333 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fc56006c8f0 0x7fc56006edb0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc57c1f7c90 tx=0x7fc568007e00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:09.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.256+0000 7fc5797fa640 1 -- 172.21.15.132:0/2551093333 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc570059710 con 0x7fc57c0d2030 2024-04-16T15:52:09.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.431+0000 7fc582ae4640 1 -- 172.21.15.132:0/2551093333 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc57c0d2fe0 con 0x7fc57c0d2030 2024-04-16T15:52:09.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.431+0000 7fc5797fa640 1 -- 172.21.15.132:0/2551093333 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7fc57005da10 con 0x7fc57c0d2030 2024-04-16T15:52:09.431 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2024-04-16T15:52:09.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.433+0000 7fc582ae4640 1 -- 172.21.15.132:0/2551093333 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fc56006c8f0 msgr2=0x7fc56006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:09.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.433+0000 7fc582ae4640 1 --2- 172.21.15.132:0/2551093333 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fc56006c8f0 0x7fc56006edb0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc57c1f7c90 tx=0x7fc568007e00 comp rx=0 tx=0).stop 2024-04-16T15:52:09.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.433+0000 7fc582ae4640 1 -- 172.21.15.132:0/2551093333 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc57c0d2030 msgr2=0x7fc57c15d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:09.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.433+0000 7fc582ae4640 1 --2- 172.21.15.132:0/2551093333 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc57c0d2030 0x7fc57c15d140 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc57000e8a0 tx=0x7fc57000ed60 comp rx=0 tx=0).stop 2024-04-16T15:52:09.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.433+0000 7fc582ae4640 1 -- 172.21.15.132:0/2551093333 shutdown_connections 2024-04-16T15:52:09.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.433+0000 7fc582ae4640 1 --2- 172.21.15.132:0/2551093333 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fc56006c8f0 0x7fc56006edb0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:09.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.433+0000 7fc582ae4640 1 --2- 172.21.15.132:0/2551093333 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc57c15ec20 0x7fc57c0ca630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:09.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.433+0000 7fc582ae4640 1 --2- 172.21.15.132:0/2551093333 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc57c0d3340 0x7fc57c0ca0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:09.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.433+0000 7fc582ae4640 1 --2- 172.21.15.132:0/2551093333 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc57c0d2030 0x7fc57c15d140 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:09.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.433+0000 7fc582ae4640 1 -- 172.21.15.132:0/2551093333 >> 172.21.15.132:0/2551093333 conn(0x7fc57c06d2d0 msgr2=0x7fc57c160350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:09.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.433+0000 7fc582ae4640 1 -- 172.21.15.132:0/2551093333 shutdown_connections 2024-04-16T15:52:09.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.434+0000 7fc582ae4640 1 -- 172.21.15.132:0/2551093333 wait complete. 2024-04-16T15:52:09.444 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T15:52:09.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.549+0000 7f49c1fb5640 1 Processor -- start 2024-04-16T15:52:09.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.549+0000 7f49c1fb5640 1 -- start start 2024-04-16T15:52:09.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.549+0000 7f49c1fb5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49bc09ab80 0x7f49bc0d1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:09.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.549+0000 7f49c1fb5640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49bc0d1730 con 0x7f49bc0b3060 2024-04-16T15:52:09.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.549+0000 7f49c1fb5640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49bc0b22a0 con 0x7f49bc09af60 2024-04-16T15:52:09.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.549+0000 7f49c1fb5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f49bc0b2bd0 con 0x7f49bc09ab80 2024-04-16T15:52:09.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.549+0000 7f49bbfff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f49bc0b3060 0x7f49bc0b34e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:58426/0 (socket says 172.21.15.132:58426) 2024-04-16T15:52:09.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.549+0000 7f49bbfff640 1 -- 172.21.15.132:0/3923984583 learned_addr learned my addr 172.21.15.132:0/3923984583 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:09.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.550+0000 7f49bb7fe640 1 --2- 172.21.15.132:0/3923984583 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49bc09ab80 0x7f49bc0d1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:09.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.550+0000 7f49ba7fc640 1 -- 172.21.15.132:0/3923984583 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1399042674 0 0) 0x7f49bc0d1730 con 0x7f49bc0b3060 2024-04-16T15:52:09.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.550+0000 7f49ba7fc640 1 -- 172.21.15.132:0/3923984583 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f49a4003520 con 0x7f49bc0b3060 2024-04-16T15:52:09.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.550+0000 7f49ba7fc640 1 -- 172.21.15.132:0/3923984583 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2216540672 0 0) 0x7f49a4003520 con 0x7f49bc0b3060 2024-04-16T15:52:09.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.550+0000 7f49ba7fc640 1 -- 172.21.15.132:0/3923984583 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49bc09ab80 msgr2=0x7f49bc0d1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:09.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.550+0000 7f49ba7fc640 1 --2- 172.21.15.132:0/3923984583 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49bc09ab80 0x7f49bc0d1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:09.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.550+0000 7f49ba7fc640 1 -- 172.21.15.132:0/3923984583 >> v1:172.21.15.179:6789/0 conn(0x7f49bc09af60 legacy=0x7f49bc0cd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:09.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.550+0000 7f49ba7fc640 1 -- 172.21.15.132:0/3923984583 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49bc0b2580 con 0x7f49bc0b3060 2024-04-16T15:52:09.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.550+0000 7f49ba7fc640 1 -- 172.21.15.132:0/3923984583 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2803668828 0 0) 0x7f49b4001670 con 0x7f49bc0b3060 2024-04-16T15:52:09.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.550+0000 7f49bb7fe640 1 --2- 172.21.15.132:0/3923984583 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49bc09ab80 0x7f49bc0d1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:52:09.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.550+0000 7f49ba7fc640 1 -- 172.21.15.132:0/3923984583 >> v1:172.21.15.132:6789/0 conn(0x7f49bc0b3060 legacy=0x7f49bc0b34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:09.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.550+0000 7f49ba7fc640 1 --2- 172.21.15.132:0/3923984583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49a40039e0 0x7f49a4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:09.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.550+0000 7f49ba7fc640 1 --2- 172.21.15.132:0/3923984583 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49a4004390 0x7f49a4004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:09.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.550+0000 7f49ba7fc640 1 --2- 172.21.15.132:0/3923984583 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49bc09ab80 0x7f49a4005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:09.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.550+0000 7f49ba7fc640 1 -- 172.21.15.132:0/3923984583 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f49bc0b2bd0 con 0x7f49a4004390 2024-04-16T15:52:09.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.550+0000 7f49ba7fc640 1 -- 172.21.15.132:0/3923984583 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f49a400b9c0 con 0x7f49a40039e0 2024-04-16T15:52:09.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.550+0000 7f49ba7fc640 1 -- 172.21.15.132:0/3923984583 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f49a400bb70 con 0x7f49bc09ab80 2024-04-16T15:52:09.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.550+0000 7f49baffd640 1 --2- 172.21.15.132:0/3923984583 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49a4004390 0x7f49a4004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:09.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.550+0000 7f49bb7fe640 1 --2- 172.21.15.132:0/3923984583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49a40039e0 0x7f49a4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:09.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.550+0000 7f49bbfff640 1 --2- 172.21.15.132:0/3923984583 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49bc09ab80 0x7f49a4005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:09.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.550+0000 7f49baffd640 1 -- 172.21.15.132:0/3923984583 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49bc09ab80 msgr2=0x7f49a4005080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:09.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.550+0000 7f49baffd640 1 --2- 172.21.15.132:0/3923984583 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49bc09ab80 0x7f49a4005080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:09.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.550+0000 7f49baffd640 1 -- 172.21.15.132:0/3923984583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49a40039e0 msgr2=0x7f49a4003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:09.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.550+0000 7f49baffd640 1 --2- 172.21.15.132:0/3923984583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49a40039e0 0x7f49a4003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:09.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.550+0000 7f49baffd640 1 -- 172.21.15.132:0/3923984583 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49a4003520 con 0x7f49a4004390 2024-04-16T15:52:09.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.551+0000 7f49baffd640 1 --2- 172.21.15.132:0/3923984583 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49a4004390 0x7f49a4004860 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f49b0001f30 tx=0x7f49a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f16ee8a90b2185a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:09.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.551+0000 7f49ba7fc640 1 -- 172.21.15.132:0/3923984583 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b0001b30 con 0x7f49a4004390 2024-04-16T15:52:09.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.551+0000 7f49ba7fc640 1 -- 172.21.15.132:0/3923984583 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49b002d6e0 con 0x7f49a4004390 2024-04-16T15:52:09.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.551+0000 7f49ba7fc640 1 -- 172.21.15.132:0/3923984583 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b002dad0 con 0x7f49a4004390 2024-04-16T15:52:09.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.552+0000 7f49c1fb5640 1 -- 172.21.15.132:0/3923984583 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49a4004390 msgr2=0x7f49a4004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:09.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.552+0000 7f49c1fb5640 1 --2- 172.21.15.132:0/3923984583 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49a4004390 0x7f49a4004860 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f49b0001f30 tx=0x7f49a4005830 comp rx=0 tx=0).stop 2024-04-16T15:52:09.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.552+0000 7f49bbfff640 1 -- 172.21.15.132:0/3923984583 reap_dead start 2024-04-16T15:52:09.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.552+0000 7f49c1fb5640 1 -- 172.21.15.132:0/3923984583 shutdown_connections 2024-04-16T15:52:09.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.552+0000 7f49c1fb5640 1 -- 172.21.15.132:0/3923984583 >> 172.21.15.132:0/3923984583 conn(0x7f49bc0b4450 msgr2=0x7f49bc0b4860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:09.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.552+0000 7f49c1fb5640 1 -- 172.21.15.132:0/3923984583 shutdown_connections 2024-04-16T15:52:09.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.552+0000 7f49c1fb5640 1 -- 172.21.15.132:0/3923984583 wait complete. 2024-04-16T15:52:09.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.553+0000 7f49c1fb5640 1 Processor -- start 2024-04-16T15:52:09.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.553+0000 7f49c1fb5640 1 -- start start 2024-04-16T15:52:09.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.554+0000 7f49c1fb5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49a4004390 0x7f49bc0c9a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:09.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.554+0000 7f49c1fb5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49bc06e510 0x7f49bc159110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:09.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.554+0000 7f49c1fb5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49bc0d0510 0x7f49bc0d0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:09.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.554+0000 7f49c1fb5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f49bc0b1a80 con 0x7f49bc0d0510 2024-04-16T15:52:09.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.554+0000 7f49c1fb5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f49bc0cd9a0 con 0x7f49a4004390 2024-04-16T15:52:09.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.554+0000 7f49c1fb5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f49bc09b3e0 con 0x7f49bc06e510 2024-04-16T15:52:09.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.554+0000 7f49bbfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49bc0d0510 0x7f49bc0d0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:09.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.554+0000 7f49bbfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49bc0d0510 0x7f49bc0d0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33586/0 (socket says 172.21.15.132:33586) 2024-04-16T15:52:09.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.554+0000 7f49bbfff640 1 -- 172.21.15.132:0/3992692091 learned_addr learned my addr 172.21.15.132:0/3992692091 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:09.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.554+0000 7f49bb7fe640 1 --2- 172.21.15.132:0/3992692091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49a4004390 0x7f49bc0c9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:09.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.554+0000 7f49baffd640 1 --2- 172.21.15.132:0/3992692091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49bc06e510 0x7f49bc159110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:09.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.554+0000 7f49bbfff640 1 -- 172.21.15.132:0/3992692091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49bc06e510 msgr2=0x7f49bc159110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:09.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.554+0000 7f49bbfff640 1 --2- 172.21.15.132:0/3992692091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49bc06e510 0x7f49bc159110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:09.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.554+0000 7f49bbfff640 1 -- 172.21.15.132:0/3992692091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49a4004390 msgr2=0x7f49bc0c9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:09.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.554+0000 7f49bbfff640 1 --2- 172.21.15.132:0/3992692091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49a4004390 0x7f49bc0c9a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:09.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.554+0000 7f49bbfff640 1 -- 172.21.15.132:0/3992692091 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49bc0c92b0 con 0x7f49bc0d0510 2024-04-16T15:52:09.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.554+0000 7f49bbfff640 1 --2- 172.21.15.132:0/3992692091 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49bc0d0510 0x7f49bc0d0990 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f49bc0a09b0 tx=0x7f49b4007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:09.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.555+0000 7f49a3fff640 1 -- 172.21.15.132:0/3992692091 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b401a070 con 0x7f49bc0d0510 2024-04-16T15:52:09.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.555+0000 7f49a3fff640 1 -- 172.21.15.132:0/3992692091 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49b400f8b0 con 0x7f49bc0d0510 2024-04-16T15:52:09.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.555+0000 7f49c1fb5640 1 -- 172.21.15.132:0/3992692091 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49bc0b5e80 con 0x7f49bc0d0510 2024-04-16T15:52:09.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.555+0000 7f49a3fff640 1 -- 172.21.15.132:0/3992692091 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b400fca0 con 0x7f49bc0d0510 2024-04-16T15:52:09.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.555+0000 7f49c1fb5640 1 -- 172.21.15.132:0/3992692091 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49bc0b6440 con 0x7f49bc0d0510 2024-04-16T15:52:09.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.556+0000 7f49c1fb5640 1 -- 172.21.15.132:0/3992692091 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49bc0d0ed0 con 0x7f49bc0d0510 2024-04-16T15:52:09.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.556+0000 7f49a3fff640 1 -- 172.21.15.132:0/3992692091 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f49b401d070 con 0x7f49bc0d0510 2024-04-16T15:52:09.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.556+0000 7f49a3fff640 1 --2- 172.21.15.132:0/3992692091 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f49a806c8f0 0x7f49a806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:09.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.557+0000 7f49a3fff640 1 -- 172.21.15.132:0/3992692091 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f49b408ade0 con 0x7f49bc0d0510 2024-04-16T15:52:09.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.557+0000 7f49bb7fe640 1 --2- 172.21.15.132:0/3992692091 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f49a806c8f0 0x7f49a806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:09.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.557+0000 7f49bb7fe640 1 --2- 172.21.15.132:0/3992692091 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f49a806c8f0 0x7f49a806edb0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f49ac009560 tx=0x7f49ac008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:09.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.561+0000 7f49a3fff640 1 -- 172.21.15.132:0/3992692091 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f49b40595f0 con 0x7f49bc0d0510 2024-04-16T15:52:09.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.775+0000 7f49c1fb5640 1 -- 172.21.15.132:0/3992692091 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f49bc075510 con 0x7f49bc0d0510 2024-04-16T15:52:09.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.775+0000 7f49a3fff640 1 -- 172.21.15.132:0/3992692091 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7f49b4058ef0 con 0x7f49bc0d0510 2024-04-16T15:52:09.775 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:52:09.775 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/659108212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":659108212},{"type":"v1","addr":"172.21.15.132:6835","nonce":659108212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-16T15:52:09.775 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 2 2024-04-16T15:52:09.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.777+0000 7f49c1fb5640 1 -- 172.21.15.132:0/3992692091 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f49a806c8f0 msgr2=0x7f49a806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:09.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.777+0000 7f49c1fb5640 1 --2- 172.21.15.132:0/3992692091 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f49a806c8f0 0x7f49a806edb0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f49ac009560 tx=0x7f49ac008040 comp rx=0 tx=0).stop 2024-04-16T15:52:09.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.777+0000 7f49c1fb5640 1 -- 172.21.15.132:0/3992692091 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49bc0d0510 msgr2=0x7f49bc0d0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:09.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.777+0000 7f49c1fb5640 1 --2- 172.21.15.132:0/3992692091 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49bc0d0510 0x7f49bc0d0990 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f49bc0a09b0 tx=0x7f49b4007720 comp rx=0 tx=0).stop 2024-04-16T15:52:09.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.777+0000 7f49c1fb5640 1 -- 172.21.15.132:0/3992692091 shutdown_connections 2024-04-16T15:52:09.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.777+0000 7f49c1fb5640 1 --2- 172.21.15.132:0/3992692091 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f49a806c8f0 0x7f49a806edb0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:09.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.777+0000 7f49c1fb5640 1 --2- 172.21.15.132:0/3992692091 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49bc0d0510 0x7f49bc0d0990 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:09.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.777+0000 7f49c1fb5640 1 --2- 172.21.15.132:0/3992692091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49bc06e510 0x7f49bc159110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:09.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.777+0000 7f49c1fb5640 1 --2- 172.21.15.132:0/3992692091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49a4004390 0x7f49bc0c9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:09.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.777+0000 7f49c1fb5640 1 -- 172.21.15.132:0/3992692091 >> 172.21.15.132:0/3992692091 conn(0x7f49bc0b4450 msgr2=0x7f49bc071cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:09.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.777+0000 7f49c1fb5640 1 -- 172.21.15.132:0/3992692091 shutdown_connections 2024-04-16T15:52:09.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:09.777+0000 7f49c1fb5640 1 -- 172.21.15.132:0/3992692091 wait complete. 2024-04-16T15:52:11.788 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T15:52:11.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:11.904+0000 7fce79877640 1 Processor -- start 2024-04-16T15:52:11.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:11.904+0000 7fce79877640 1 -- start start 2024-04-16T15:52:11.904 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:11.905+0000 7fce79877640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fce740b6b00 0x7fce74169b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:11.904 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:11.905+0000 7fce79877640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce74162cc0 con 0x7fce7415eed0 2024-04-16T15:52:11.904 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:11.905+0000 7fce79877640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce74162fa0 con 0x7fce7415eaf0 2024-04-16T15:52:11.904 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:11.905+0000 7fce79877640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fce740d2af0 con 0x7fce740b6b00 2024-04-16T15:52:11.904 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:11.905+0000 7fce737fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fce740b6b00 0x7fce74169b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:11.904 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:11.905+0000 7fce727fc640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fce7415eed0 0x7fce740b63f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56442/0 (socket says 172.21.15.132:56442) 2024-04-16T15:52:11.904 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:11.905+0000 7fce727fc640 1 -- 172.21.15.132:0/3211225999 learned_addr learned my addr 172.21.15.132:0/3211225999 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:11.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:11.905+0000 7fce737fe640 1 -- 172.21.15.132:0/3211225999 >> v1:172.21.15.179:6789/0 conn(0x7fce7415eaf0 legacy=0x7fce740ba300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:11.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:11.905+0000 7fce737fe640 1 -- 172.21.15.132:0/3211225999 >> v1:172.21.15.132:6789/0 conn(0x7fce7415eed0 legacy=0x7fce740b63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:11.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:11.905+0000 7fce71ffb640 1 -- 172.21.15.132:0/3211225999 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 547776235 0 0) 0x7fce74162cc0 con 0x7fce7415eed0 2024-04-16T15:52:11.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:11.905+0000 7fce737fe640 1 -- 172.21.15.132:0/3211225999 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce74163280 con 0x7fce740b6b00 2024-04-16T15:52:11.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:11.906+0000 7fce737fe640 1 --2- 172.21.15.132:0/3211225999 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fce740b6b00 0x7fce74169b10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fce740d2c70 tx=0x7fce6c02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff840c446e767188 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:11.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:11.906+0000 7fce71ffb640 1 -- 172.21.15.132:0/3211225999 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce6c039070 con 0x7fce740b6b00 2024-04-16T15:52:11.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:11.906+0000 7fce71ffb640 1 -- 172.21.15.132:0/3211225999 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce6c02cc50 con 0x7fce740b6b00 2024-04-16T15:52:11.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:11.906+0000 7fce71ffb640 1 -- 172.21.15.132:0/3211225999 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce6c034440 con 0x7fce740b6b00 2024-04-16T15:52:11.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:11.907+0000 7fce79877640 1 -- 172.21.15.132:0/3211225999 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fce740b6b00 msgr2=0x7fce74169b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:11.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:11.907+0000 7fce79877640 1 --2- 172.21.15.132:0/3211225999 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fce740b6b00 0x7fce74169b10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fce740d2c70 tx=0x7fce6c02bea0 comp rx=0 tx=0).stop 2024-04-16T15:52:11.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:11.907+0000 7fce79877640 1 -- 172.21.15.132:0/3211225999 shutdown_connections 2024-04-16T15:52:11.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:11.907+0000 7fce79877640 1 --2- 172.21.15.132:0/3211225999 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fce740b6b00 0x7fce74169b10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:11.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:11.907+0000 7fce79877640 1 -- 172.21.15.132:0/3211225999 >> 172.21.15.132:0/3211225999 conn(0x7fce740d13f0 msgr2=0x7fce740d1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:11.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:11.907+0000 7fce79877640 1 -- 172.21.15.132:0/3211225999 shutdown_connections 2024-04-16T15:52:11.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:11.907+0000 7fce79877640 1 -- 172.21.15.132:0/3211225999 wait complete. 2024-04-16T15:52:11.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:11.908+0000 7fce79877640 1 Processor -- start 2024-04-16T15:52:11.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:11.908+0000 7fce79877640 1 -- start start 2024-04-16T15:52:11.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:11.909+0000 7fce79877640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fce740b6b00 0x7fce740c74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:11.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:11.909+0000 7fce79877640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce7415eaf0 0x7fce740d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:11.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:11.909+0000 7fce79877640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce7415eed0 0x7fce74157700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:11.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:11.909+0000 7fce79877640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fce74162960 con 0x7fce740b6b00 2024-04-16T15:52:11.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:11.909+0000 7fce79877640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fce741627e0 con 0x7fce7415eed0 2024-04-16T15:52:11.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:11.909+0000 7fce79877640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fce740d3f90 con 0x7fce7415eaf0 2024-04-16T15:52:11.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:11.909+0000 7fce72ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fce740b6b00 0x7fce740c74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:11.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:11.909+0000 7fce72ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fce740b6b00 0x7fce740c74b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37186/0 (socket says 172.21.15.132:37186) 2024-04-16T15:52:11.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:11.909+0000 7fce72ffd640 1 -- 172.21.15.132:0/652413925 learned_addr learned my addr 172.21.15.132:0/652413925 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:11.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:11.909+0000 7fce737fe640 1 --2- 172.21.15.132:0/652413925 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce7415eed0 0x7fce74157700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:11.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:11.909+0000 7fce727fc640 1 --2- 172.21.15.132:0/652413925 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce7415eaf0 0x7fce740d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:11.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:11.909+0000 7fce72ffd640 1 -- 172.21.15.132:0/652413925 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce7415eaf0 msgr2=0x7fce740d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:11.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:11.909+0000 7fce72ffd640 1 --2- 172.21.15.132:0/652413925 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce7415eaf0 0x7fce740d2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:11.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:11.909+0000 7fce72ffd640 1 -- 172.21.15.132:0/652413925 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce7415eed0 msgr2=0x7fce74157700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:11.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:11.909+0000 7fce72ffd640 1 --2- 172.21.15.132:0/652413925 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce7415eed0 0x7fce74157700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:11.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:11.909+0000 7fce72ffd640 1 -- 172.21.15.132:0/652413925 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce740c79f0 con 0x7fce740b6b00 2024-04-16T15:52:11.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:11.909+0000 7fce727fc640 1 --2- 172.21.15.132:0/652413925 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce7415eaf0 0x7fce740d2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:52:11.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:11.909+0000 7fce72ffd640 1 --2- 172.21.15.132:0/652413925 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fce740b6b00 0x7fce740c74b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fce5c00c430 tx=0x7fce5c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:11.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:11.909+0000 7fce6bfff640 1 -- 172.21.15.132:0/652413925 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce5c011790 con 0x7fce740b6b00 2024-04-16T15:52:11.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:11.909+0000 7fce6bfff640 1 -- 172.21.15.132:0/652413925 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce5c017070 con 0x7fce740b6b00 2024-04-16T15:52:11.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:11.909+0000 7fce79877640 1 -- 172.21.15.132:0/652413925 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce740d3a40 con 0x7fce740b6b00 2024-04-16T15:52:11.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:11.909+0000 7fce6bfff640 1 -- 172.21.15.132:0/652413925 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce5c011bb0 con 0x7fce740b6b00 2024-04-16T15:52:11.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:11.910+0000 7fce79877640 1 -- 172.21.15.132:0/652413925 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce740c8760 con 0x7fce740b6b00 2024-04-16T15:52:11.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:11.911+0000 7fce79877640 1 -- 172.21.15.132:0/652413925 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce74075510 con 0x7fce740b6b00 2024-04-16T15:52:11.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:11.911+0000 7fce6bfff640 1 -- 172.21.15.132:0/652413925 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fce5c01c460 con 0x7fce740b6b00 2024-04-16T15:52:11.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:11.911+0000 7fce6bfff640 1 --2- 172.21.15.132:0/652413925 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fce5406c8f0 0x7fce5406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:11.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:11.912+0000 7fce727fc640 1 --2- 172.21.15.132:0/652413925 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fce5406c8f0 0x7fce5406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:11.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:11.912+0000 7fce6bfff640 1 -- 172.21.15.132:0/652413925 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fce5c08b6a0 con 0x7fce740b6b00 2024-04-16T15:52:11.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:11.912+0000 7fce727fc640 1 --2- 172.21.15.132:0/652413925 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fce5406c8f0 0x7fce5406edb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fce740c9bd0 tx=0x7fce64009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:11.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:11.916+0000 7fce6bfff640 1 -- 172.21.15.132:0/652413925 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fce740c79f0 con 0x7fce740b6b00 2024-04-16T15:52:12.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.129+0000 7fce79877640 1 -- 172.21.15.132:0/652413925 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fce740d2610 con 0x7fce740b6b00 2024-04-16T15:52:12.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.129+0000 7fce6bfff640 1 -- 172.21.15.132:0/652413925 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3864 (secure 0 0 0) 0x7fce5c059e20 con 0x7fce740b6b00 2024-04-16T15:52:12.128 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:52:12.129 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/659108212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":659108212},{"type":"v1","addr":"172.21.15.132:6835","nonce":659108212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/811468074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":811468074},{"type":"v1","addr":"172.21.15.132:6837","nonce":811468074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/493922944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":493922944},{"type":"v1","addr":"172.21.15.179:6834","nonce":493922944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/202618568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":202618568},{"type":"v1","addr":"172.21.15.179:6835","nonce":202618568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-16T15:52:12.129 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 3 2024-04-16T15:52:12.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.131+0000 7fce79877640 1 -- 172.21.15.132:0/652413925 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fce5406c8f0 msgr2=0x7fce5406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:12.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.131+0000 7fce79877640 1 --2- 172.21.15.132:0/652413925 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fce5406c8f0 0x7fce5406edb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fce740c9bd0 tx=0x7fce64009040 comp rx=0 tx=0).stop 2024-04-16T15:52:12.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.131+0000 7fce79877640 1 -- 172.21.15.132:0/652413925 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fce740b6b00 msgr2=0x7fce740c74b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:12.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.131+0000 7fce79877640 1 --2- 172.21.15.132:0/652413925 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fce740b6b00 0x7fce740c74b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fce5c00c430 tx=0x7fce5c00c8f0 comp rx=0 tx=0).stop 2024-04-16T15:52:12.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.131+0000 7fce79877640 1 -- 172.21.15.132:0/652413925 shutdown_connections 2024-04-16T15:52:12.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.131+0000 7fce79877640 1 --2- 172.21.15.132:0/652413925 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fce5406c8f0 0x7fce5406edb0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:12.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.131+0000 7fce79877640 1 --2- 172.21.15.132:0/652413925 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce7415eed0 0x7fce74157700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:12.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.131+0000 7fce79877640 1 --2- 172.21.15.132:0/652413925 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce7415eaf0 0x7fce740d2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:12.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.131+0000 7fce79877640 1 --2- 172.21.15.132:0/652413925 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fce740b6b00 0x7fce740c74b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:12.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.131+0000 7fce79877640 1 -- 172.21.15.132:0/652413925 >> 172.21.15.132:0/652413925 conn(0x7fce740d13f0 msgr2=0x7fce740d17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:12.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.131+0000 7fce79877640 1 -- 172.21.15.132:0/652413925 shutdown_connections 2024-04-16T15:52:12.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.131+0000 7fce79877640 1 -- 172.21.15.132:0/652413925 wait complete. 2024-04-16T15:52:12.142 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:52:12.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.245+0000 7fd8ffaf2640 1 Processor -- start 2024-04-16T15:52:12.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.245+0000 7fd8ffaf2640 1 -- start start 2024-04-16T15:52:12.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.246+0000 7fd8ffaf2640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd8f80b6060 0x7fd8f80ce570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:12.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.246+0000 7fd8ffaf2640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8f8142070 con 0x7fd8f813f7f0 2024-04-16T15:52:12.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.246+0000 7fd8ffaf2640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8f8142350 con 0x7fd8f80ceab0 2024-04-16T15:52:12.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.246+0000 7fd8ffaf2640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fd8f8142630 con 0x7fd8f80b6060 2024-04-16T15:52:12.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.246+0000 7fd8fd88e640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fd8f813f7f0 0x7fd8f80b5950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56452/0 (socket says 172.21.15.132:56452) 2024-04-16T15:52:12.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.246+0000 7fd8fd88e640 1 -- 172.21.15.132:0/2025029957 learned_addr learned my addr 172.21.15.132:0/2025029957 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:12.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.246+0000 7fd8fc88c640 1 -- 172.21.15.132:0/2025029957 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1659213231 0 0) 0x7fd8f8142070 con 0x7fd8f813f7f0 2024-04-16T15:52:12.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.246+0000 7fd8fc88c640 1 -- 172.21.15.132:0/2025029957 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd8e4003520 con 0x7fd8f813f7f0 2024-04-16T15:52:12.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.246+0000 7fd8fd08d640 1 --2- 172.21.15.132:0/2025029957 >> v2:172.21.15.179:3300/0 conn(0x7fd8f80b6060 0x7fd8f80ce570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:12.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.247+0000 7fd8fc88c640 1 -- 172.21.15.132:0/2025029957 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 883594351 0 0) 0x7fd8e4003520 con 0x7fd8f813f7f0 2024-04-16T15:52:12.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.247+0000 7fd8fc88c640 1 -- 172.21.15.132:0/2025029957 >> v2:172.21.15.179:3300/0 conn(0x7fd8f80b6060 msgr2=0x7fd8f80ce570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:12.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.247+0000 7fd8fc88c640 1 --2- 172.21.15.132:0/2025029957 >> v2:172.21.15.179:3300/0 conn(0x7fd8f80b6060 0x7fd8f80ce570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:12.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.247+0000 7fd8fc88c640 1 -- 172.21.15.132:0/2025029957 >> v1:172.21.15.179:6789/0 conn(0x7fd8f80ceab0 legacy=0x7fd8f81602b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:12.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.247+0000 7fd8fc88c640 1 -- 172.21.15.132:0/2025029957 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8f80cef40 con 0x7fd8f813f7f0 2024-04-16T15:52:12.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.247+0000 7fd8fc88c640 1 -- 172.21.15.132:0/2025029957 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2803668828 0 0) 0x7fd8f4001a10 con 0x7fd8f813f7f0 2024-04-16T15:52:12.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.247+0000 7fd8fc88c640 1 -- 172.21.15.132:0/2025029957 >> v1:172.21.15.132:6789/0 conn(0x7fd8f813f7f0 legacy=0x7fd8f80b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:12.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.247+0000 7fd8fc88c640 1 --2- 172.21.15.132:0/2025029957 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8e40039b0 0x7fd8e4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:12.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.247+0000 7fd8fc88c640 1 --2- 172.21.15.132:0/2025029957 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8e4004800 0x7fd8e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:12.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.247+0000 7fd8fc88c640 1 --2- 172.21.15.132:0/2025029957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8e40051c0 0x7fd8e400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:12.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.247+0000 7fd8fc88c640 1 -- 172.21.15.132:0/2025029957 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f8142630 con 0x7fd8e40051c0 2024-04-16T15:52:12.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.247+0000 7fd8fc88c640 1 -- 172.21.15.132:0/2025029957 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd8e400c060 con 0x7fd8e4004800 2024-04-16T15:52:12.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.247+0000 7fd8fc88c640 1 -- 172.21.15.132:0/2025029957 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fd8e400c260 con 0x7fd8e40039b0 2024-04-16T15:52:12.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.247+0000 7fd8fe08f640 1 --2- 172.21.15.132:0/2025029957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8e40051c0 0x7fd8e400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:12.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.247+0000 7fd8fd08d640 1 --2- 172.21.15.132:0/2025029957 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8e4004800 0x7fd8e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:12.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.247+0000 7fd8fd88e640 1 --2- 172.21.15.132:0/2025029957 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8e40039b0 0x7fd8e4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:12.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.247+0000 7fd8fe08f640 1 -- 172.21.15.132:0/2025029957 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8e40039b0 msgr2=0x7fd8e4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:12.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.247+0000 7fd8fe08f640 1 --2- 172.21.15.132:0/2025029957 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8e40039b0 0x7fd8e4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:12.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.247+0000 7fd8fe08f640 1 -- 172.21.15.132:0/2025029957 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8e4004800 msgr2=0x7fd8e4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:12.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.247+0000 7fd8fe08f640 1 --2- 172.21.15.132:0/2025029957 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8e4004800 0x7fd8e4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:12.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.247+0000 7fd8fe08f640 1 -- 172.21.15.132:0/2025029957 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8e4003520 con 0x7fd8e40051c0 2024-04-16T15:52:12.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.248+0000 7fd8fe08f640 1 -- 172.21.15.132:0/2025029957 reap_dead start 2024-04-16T15:52:12.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.248+0000 7fd8fe08f640 1 --2- 172.21.15.132:0/2025029957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8e40051c0 0x7fd8e400b9c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0001750 tx=0x7fd8e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=915d99ab6ab38eba server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:12.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.248+0000 7fd8fc88c640 1 -- 172.21.15.132:0/2025029957 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f0001370 con 0x7fd8e40051c0 2024-04-16T15:52:12.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.248+0000 7fd8fc88c640 1 -- 172.21.15.132:0/2025029957 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8f0005310 con 0x7fd8e40051c0 2024-04-16T15:52:12.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.248+0000 7fd8fc88c640 1 -- 172.21.15.132:0/2025029957 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f0003830 con 0x7fd8e40051c0 2024-04-16T15:52:12.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.248+0000 7fd8ffaf2640 1 -- 172.21.15.132:0/2025029957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8e40051c0 msgr2=0x7fd8e400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:12.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.248+0000 7fd8ffaf2640 1 --2- 172.21.15.132:0/2025029957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8e40051c0 0x7fd8e400b9c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0001750 tx=0x7fd8e4005830 comp rx=0 tx=0).stop 2024-04-16T15:52:12.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.248+0000 7fd8ffaf2640 1 -- 172.21.15.132:0/2025029957 shutdown_connections 2024-04-16T15:52:12.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.248+0000 7fd8ffaf2640 1 --2- 172.21.15.132:0/2025029957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8e40051c0 0x7fd8e400b9c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:12.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.248+0000 7fd8ffaf2640 1 -- 172.21.15.132:0/2025029957 >> 172.21.15.132:0/2025029957 conn(0x7fd8f80b2d50 msgr2=0x7fd8f806ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:12.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.249+0000 7fd8ffaf2640 1 -- 172.21.15.132:0/2025029957 shutdown_connections 2024-04-16T15:52:12.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.249+0000 7fd8ffaf2640 1 -- 172.21.15.132:0/2025029957 wait complete. 2024-04-16T15:52:12.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.250+0000 7fd8ffaf2640 1 Processor -- start 2024-04-16T15:52:12.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.250+0000 7fd8ffaf2640 1 -- start start 2024-04-16T15:52:12.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.250+0000 7fd8ffaf2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8e40051c0 0x7fd8f8153dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:12.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.250+0000 7fd8ffaf2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8f8154750 0x7fd8f8157380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:12.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.250+0000 7fd8ffaf2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8f815f120 0x7fd8f8152710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:12.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.250+0000 7fd8ffaf2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f80ce6f0 con 0x7fd8e40051c0 2024-04-16T15:52:12.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.250+0000 7fd8ffaf2640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f80ce570 con 0x7fd8f815f120 2024-04-16T15:52:12.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.250+0000 7fd8ffaf2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fd8f80ce870 con 0x7fd8f8154750 2024-04-16T15:52:12.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.250+0000 7fd8fd88e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8e40051c0 0x7fd8f8153dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:12.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.250+0000 7fd8fd88e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8e40051c0 0x7fd8f8153dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37216/0 (socket says 172.21.15.132:37216) 2024-04-16T15:52:12.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.250+0000 7fd8fd88e640 1 -- 172.21.15.132:0/1673962329 learned_addr learned my addr 172.21.15.132:0/1673962329 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:12.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.251+0000 7fd8fe08f640 1 --2- 172.21.15.132:0/1673962329 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8f815f120 0x7fd8f8152710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:12.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.251+0000 7fd8fd08d640 1 --2- 172.21.15.132:0/1673962329 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8f8154750 0x7fd8f8157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:12.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.251+0000 7fd8fd88e640 1 -- 172.21.15.132:0/1673962329 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8f8154750 msgr2=0x7fd8f8157380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:12.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.251+0000 7fd8fd88e640 1 --2- 172.21.15.132:0/1673962329 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8f8154750 0x7fd8f8157380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:12.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.251+0000 7fd8fd88e640 1 -- 172.21.15.132:0/1673962329 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8f815f120 msgr2=0x7fd8f8152710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:12.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.251+0000 7fd8fd88e640 1 --2- 172.21.15.132:0/1673962329 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8f815f120 0x7fd8f8152710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:12.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.251+0000 7fd8fd88e640 1 -- 172.21.15.132:0/1673962329 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8f8154bd0 con 0x7fd8e40051c0 2024-04-16T15:52:12.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.251+0000 7fd8fe08f640 1 --2- 172.21.15.132:0/1673962329 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8f815f120 0x7fd8f8152710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:52:12.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.251+0000 7fd8fd88e640 1 --2- 172.21.15.132:0/1673962329 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8e40051c0 0x7fd8f8153dc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd8f40077f0 tx=0x7fd8f400a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:12.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.251+0000 7fd8ee7fc640 1 -- 172.21.15.132:0/1673962329 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f4017020 con 0x7fd8e40051c0 2024-04-16T15:52:12.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.251+0000 7fd8ee7fc640 1 -- 172.21.15.132:0/1673962329 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8f40133f0 con 0x7fd8e40051c0 2024-04-16T15:52:12.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.251+0000 7fd8ffaf2640 1 -- 172.21.15.132:0/1673962329 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8f8132760 con 0x7fd8e40051c0 2024-04-16T15:52:12.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.251+0000 7fd8ee7fc640 1 -- 172.21.15.132:0/1673962329 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f40137e0 con 0x7fd8e40051c0 2024-04-16T15:52:12.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.251+0000 7fd8ffaf2640 1 -- 172.21.15.132:0/1673962329 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8f8132d20 con 0x7fd8e40051c0 2024-04-16T15:52:12.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.252+0000 7fd8ffaf2640 1 -- 172.21.15.132:0/1673962329 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8f8075510 con 0x7fd8e40051c0 2024-04-16T15:52:12.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.252+0000 7fd8ee7fc640 1 -- 172.21.15.132:0/1673962329 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd8f401a020 con 0x7fd8e40051c0 2024-04-16T15:52:12.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.253+0000 7fd8ee7fc640 1 --2- 172.21.15.132:0/1673962329 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fd8dc06c8f0 0x7fd8dc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:12.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.253+0000 7fd8ee7fc640 1 -- 172.21.15.132:0/1673962329 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fd8f408c210 con 0x7fd8e40051c0 2024-04-16T15:52:12.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.253+0000 7fd8fd08d640 1 --2- 172.21.15.132:0/1673962329 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fd8dc06c8f0 0x7fd8dc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:12.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.253+0000 7fd8fd08d640 1 --2- 172.21.15.132:0/1673962329 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fd8dc06c8f0 0x7fd8dc06edb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd8f80ce310 tx=0x7fd8e8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:12.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.257+0000 7fd8ee7fc640 1 -- 172.21.15.132:0/1673962329 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd8f4021020 con 0x7fd8e40051c0 2024-04-16T15:52:12.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.436+0000 7fd8ffaf2640 1 -- 172.21.15.132:0/1673962329 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd8f80ce060 con 0x7fd8e40051c0 2024-04-16T15:52:12.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.437+0000 7fd8ee7fc640 1 -- 172.21.15.132:0/1673962329 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12884 (secure 0 0 0) 0x7fd8f405aa20 con 0x7fd8e40051c0 2024-04-16T15:52:12.436 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:52:12.436 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":16,"fsid":"6bdec5d9-f406-43ad-8584-0503b32f6f0d","created":"2024-04-16T15:51:51.073040+0000","modified":"2024-04-16T15:52:05.288321+0000","last_up_change":"2024-04-16T15:52:02.280496+0000","last_in_change":"2024-04-16T15:51:53.376468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:52:03.284927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d45908b-6e22-4619-b190-897af594b712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6801","nonce":1170594668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6803","nonce":1170594668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6807","nonce":1170594668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6805","nonce":1170594668}]},"public_addr":"172.21.15.132:6801/1170594668","cluster_addr":"172.21.15.132:6803/1170594668","heartbeat_back_addr":"172.21.15.132:6807/1170594668","heartbeat_front_addr":"172.21.15.132:6805/1170594668","state":["exists","up"]},{"osd":1,"uuid":"c88bf082-e51f-4ee6-815a-025f6ce0d67b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6809","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6811","nonce":2494780358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6815","nonce":2494780358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6823","nonce":2494780358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6819","nonce":2494780358}]},"public_addr":"172.21.15.132:6811/2494780358","cluster_addr":"172.21.15.132:6815/2494780358","heartbeat_back_addr":"172.21.15.132:6823/2494780358","heartbeat_front_addr":"172.21.15.132:6819/2494780358","state":["exists","up"]},{"osd":2,"uuid":"e5dbd6b4-4e7b-47e4-ad4e-35b4b81696c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6825","nonce":27655483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6827","nonce":27655483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6831","nonce":27655483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6829","nonce":27655483}]},"public_addr":"172.21.15.132:6825/27655483","cluster_addr":"172.21.15.132:6827/27655483","heartbeat_back_addr":"172.21.15.132:6831/27655483","heartbeat_front_addr":"172.21.15.132:6829/27655483","state":["exists","up"]},{"osd":3,"uuid":"9d75cd67-3b8a-4424-8884-5f3660e1f5f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6810","nonce":3100919191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6814","nonce":3100919191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6821","nonce":3100919191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6818","nonce":3100919191}]},"public_addr":"172.21.15.132:6810/3100919191","cluster_addr":"172.21.15.132:6814/3100919191","heartbeat_back_addr":"172.21.15.132:6821/3100919191","heartbeat_front_addr":"172.21.15.132:6818/3100919191","state":["exists","up"]},{"osd":4,"uuid":"83aea46a-8642-4777-912b-c130e5890da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6825","nonce":123637799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6827","nonce":123637799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6831","nonce":123637799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6829","nonce":123637799}]},"public_addr":"172.21.15.179:6825/123637799","cluster_addr":"172.21.15.179:6827/123637799","heartbeat_back_addr":"172.21.15.179:6831/123637799","heartbeat_front_addr":"172.21.15.179:6829/123637799","state":["exists","up"]},{"osd":5,"uuid":"534117c8-3317-48d6-b436-afd5709f71e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6801","nonce":2224750370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6803","nonce":2224750370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6807","nonce":2224750370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6805","nonce":2224750370}]},"public_addr":"172.21.15.179:6801/2224750370","cluster_addr":"172.21.15.179:6803/2224750370","heartbeat_back_addr":"172.21.15.179:6807/2224750370","heartbeat_front_addr":"172.21.15.179:6805/2224750370","state":["exists","up"]},{"osd":6,"uuid":"0ba363e7-fa9d-42b1-ae09-a6a0f57d41f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6809","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6811","nonce":101498164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6813","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6815","nonce":101498164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6823","nonce":101498164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6819","nonce":101498164}]},"public_addr":"172.21.15.179:6811/101498164","cluster_addr":"172.21.15.179:6815/101498164","heartbeat_back_addr":"172.21.15.179:6823/101498164","heartbeat_front_addr":"172.21.15.179:6819/101498164","state":["exists","up"]},{"osd":7,"uuid":"e6830c77-2f2d-4067-9866-ee7625afc1a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6810","nonce":872148365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6814","nonce":872148365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6822","nonce":872148365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6818","nonce":872148365}]},"public_addr":"172.21.15.179:6810/872148365","cluster_addr":"172.21.15.179:6814/872148365","heartbeat_back_addr":"172.21.15.179:6822/872148365","heartbeat_front_addr":"172.21.15.179:6818/872148365","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.535221+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.563769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.520765+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.526264+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.517058+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.500842+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.534332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.512486+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:52:12.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.439+0000 7fd8ffaf2640 1 -- 172.21.15.132:0/1673962329 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fd8dc06c8f0 msgr2=0x7fd8dc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:12.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.439+0000 7fd8ffaf2640 1 --2- 172.21.15.132:0/1673962329 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fd8dc06c8f0 0x7fd8dc06edb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd8f80ce310 tx=0x7fd8e8008040 comp rx=0 tx=0).stop 2024-04-16T15:52:12.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.439+0000 7fd8ffaf2640 1 -- 172.21.15.132:0/1673962329 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8e40051c0 msgr2=0x7fd8f8153dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:12.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.439+0000 7fd8ffaf2640 1 --2- 172.21.15.132:0/1673962329 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8e40051c0 0x7fd8f8153dc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd8f40077f0 tx=0x7fd8f400a750 comp rx=0 tx=0).stop 2024-04-16T15:52:12.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.439+0000 7fd8ffaf2640 1 -- 172.21.15.132:0/1673962329 shutdown_connections 2024-04-16T15:52:12.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.439+0000 7fd8ffaf2640 1 --2- 172.21.15.132:0/1673962329 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fd8dc06c8f0 0x7fd8dc06edb0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:12.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.439+0000 7fd8ffaf2640 1 --2- 172.21.15.132:0/1673962329 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8f815f120 0x7fd8f8152710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:12.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.439+0000 7fd8ffaf2640 1 --2- 172.21.15.132:0/1673962329 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8f8154750 0x7fd8f8157380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:12.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.439+0000 7fd8ffaf2640 1 --2- 172.21.15.132:0/1673962329 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8e40051c0 0x7fd8f8153dc0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:12.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.439+0000 7fd8ffaf2640 1 -- 172.21.15.132:0/1673962329 >> 172.21.15.132:0/1673962329 conn(0x7fd8f80b2d50 msgr2=0x7fd8f806ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:12.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.439+0000 7fd8ffaf2640 1 -- 172.21.15.132:0/1673962329 shutdown_connections 2024-04-16T15:52:12.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.439+0000 7fd8ffaf2640 1 -- 172.21.15.132:0/1673962329 wait complete. 2024-04-16T15:52:12.449 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T15:52:03.284927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T15:52:12.449 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T15:52:12.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.556+0000 7ffa1bc50640 1 Processor -- start 2024-04-16T15:52:12.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.556+0000 7ffa1bc50640 1 -- start start 2024-04-16T15:52:12.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.557+0000 7ffa1bc50640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ffa140d1920 0x7ffa140d1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:12.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.557+0000 7ffa1bc50640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa140d3850 con 0x7ffa1415ec20 2024-04-16T15:52:12.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.557+0000 7ffa1bc50640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa140d3b30 con 0x7ffa140b7bb0 2024-04-16T15:52:12.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.557+0000 7ffa1bc50640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7ffa140d22c0 con 0x7ffa140d1920 2024-04-16T15:52:12.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.557+0000 7ffa191eb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ffa140d1920 0x7ffa140d1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:12.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.557+0000 7ffa199ec640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7ffa1415ec20 0x7ffa140d2e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56458/0 (socket says 172.21.15.132:56458) 2024-04-16T15:52:12.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.557+0000 7ffa199ec640 1 -- 172.21.15.132:0/1821652634 learned_addr learned my addr 172.21.15.132:0/1821652634 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:12.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.557+0000 7ffa191eb640 1 -- 172.21.15.132:0/1821652634 >> v1:172.21.15.179:6789/0 conn(0x7ffa140b7bb0 legacy=0x7ffa140b8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:12.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.557+0000 7ffa191eb640 1 -- 172.21.15.132:0/1821652634 >> v1:172.21.15.132:6789/0 conn(0x7ffa1415ec20 legacy=0x7ffa140d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:12.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.557+0000 7ffa191eb640 1 -- 172.21.15.132:0/1821652634 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa140d3e10 con 0x7ffa140d1920 2024-04-16T15:52:12.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.557+0000 7ffa189ea640 1 -- 172.21.15.132:0/1821652634 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2089476805 0 0) 0x7ffa140d3850 con 0x7ffa1415ec20 2024-04-16T15:52:12.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.558+0000 7ffa191eb640 1 --2- 172.21.15.132:0/1821652634 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffa140d1920 0x7ffa140d1d80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ffa040097a0 tx=0x7ffa0402b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c98f87e0b60887a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:12.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.558+0000 7ffa189ea640 1 -- 172.21.15.132:0/1821652634 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0402f810 con 0x7ffa140d1920 2024-04-16T15:52:12.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.558+0000 7ffa189ea640 1 -- 172.21.15.132:0/1821652634 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa0402f9b0 con 0x7ffa140d1920 2024-04-16T15:52:12.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.558+0000 7ffa189ea640 1 -- 172.21.15.132:0/1821652634 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0402fd80 con 0x7ffa140d1920 2024-04-16T15:52:12.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.559+0000 7ffa1bc50640 1 -- 172.21.15.132:0/1821652634 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffa140d1920 msgr2=0x7ffa140d1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:12.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.559+0000 7ffa1bc50640 1 --2- 172.21.15.132:0/1821652634 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffa140d1920 0x7ffa140d1d80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ffa040097a0 tx=0x7ffa0402b9f0 comp rx=0 tx=0).stop 2024-04-16T15:52:12.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.559+0000 7ffa1bc50640 1 -- 172.21.15.132:0/1821652634 shutdown_connections 2024-04-16T15:52:12.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.559+0000 7ffa1bc50640 1 --2- 172.21.15.132:0/1821652634 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffa140d1920 0x7ffa140d1d80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:12.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.559+0000 7ffa1bc50640 1 -- 172.21.15.132:0/1821652634 >> 172.21.15.132:0/1821652634 conn(0x7ffa1406d2d0 msgr2=0x7ffa1406d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:12.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.559+0000 7ffa1bc50640 1 -- 172.21.15.132:0/1821652634 shutdown_connections 2024-04-16T15:52:12.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.559+0000 7ffa1bc50640 1 -- 172.21.15.132:0/1821652634 wait complete. 2024-04-16T15:52:12.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.560+0000 7ffa1bc50640 1 Processor -- start 2024-04-16T15:52:12.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.560+0000 7ffa1bc50640 1 -- start start 2024-04-16T15:52:12.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.561+0000 7ffa1bc50640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa140b7bb0 0x7ffa1415b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:12.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.561+0000 7ffa1bc50640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa140d1920 0x7ffa141f4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:12.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.561+0000 7ffa1bc50640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffa1415ec20 0x7ffa1414ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:12.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.561+0000 7ffa1bc50640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7ffa140d3510 con 0x7ffa1415ec20 2024-04-16T15:52:12.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.561+0000 7ffa1bc50640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ffa140d43d0 con 0x7ffa140b7bb0 2024-04-16T15:52:12.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.561+0000 7ffa1bc50640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ffa1415f000 con 0x7ffa140d1920 2024-04-16T15:52:12.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.561+0000 7ffa1a1ed640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffa1415ec20 0x7ffa1414ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:12.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.561+0000 7ffa1a1ed640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffa1415ec20 0x7ffa1414ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37246/0 (socket says 172.21.15.132:37246) 2024-04-16T15:52:12.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.561+0000 7ffa1a1ed640 1 -- 172.21.15.132:0/229611330 learned_addr learned my addr 172.21.15.132:0/229611330 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:12.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.561+0000 7ffa191eb640 1 --2- 172.21.15.132:0/229611330 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa140d1920 0x7ffa141f4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:12.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.561+0000 7ffa199ec640 1 --2- 172.21.15.132:0/229611330 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa140b7bb0 0x7ffa1415b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:12.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.561+0000 7ffa1a1ed640 1 -- 172.21.15.132:0/229611330 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa140d1920 msgr2=0x7ffa141f4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:12.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.561+0000 7ffa1a1ed640 1 --2- 172.21.15.132:0/229611330 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa140d1920 0x7ffa141f4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:12.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.561+0000 7ffa1a1ed640 1 -- 172.21.15.132:0/229611330 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa140b7bb0 msgr2=0x7ffa1415b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:12.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.561+0000 7ffa1a1ed640 1 --2- 172.21.15.132:0/229611330 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa140b7bb0 0x7ffa1415b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:12.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.561+0000 7ffa1a1ed640 1 -- 172.21.15.132:0/229611330 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa141f4ae0 con 0x7ffa1415ec20 2024-04-16T15:52:12.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.561+0000 7ffa1a1ed640 1 --2- 172.21.15.132:0/229611330 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffa1415ec20 0x7ffa1414ec70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c00c3c0 tx=0x7ffa0c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:12.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.562+0000 7ffa0a7fc640 1 -- 172.21.15.132:0/229611330 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c017070 con 0x7ffa1415ec20 2024-04-16T15:52:12.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.562+0000 7ffa0a7fc640 1 -- 172.21.15.132:0/229611330 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa0c0052d0 con 0x7ffa1415ec20 2024-04-16T15:52:12.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.562+0000 7ffa1bc50640 1 -- 172.21.15.132:0/229611330 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa141f4dc0 con 0x7ffa1415ec20 2024-04-16T15:52:12.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.562+0000 7ffa0a7fc640 1 -- 172.21.15.132:0/229611330 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c003810 con 0x7ffa1415ec20 2024-04-16T15:52:12.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.562+0000 7ffa1bc50640 1 -- 172.21.15.132:0/229611330 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa140b5af0 con 0x7ffa1415ec20 2024-04-16T15:52:12.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.563+0000 7ffa1bc50640 1 -- 172.21.15.132:0/229611330 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa14075510 con 0x7ffa1415ec20 2024-04-16T15:52:12.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.563+0000 7ffa0a7fc640 1 -- 172.21.15.132:0/229611330 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ffa0c01a070 con 0x7ffa1415ec20 2024-04-16T15:52:12.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.563+0000 7ffa0a7fc640 1 --2- 172.21.15.132:0/229611330 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7ff9f806c8f0 0x7ff9f806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:12.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.564+0000 7ffa199ec640 1 --2- 172.21.15.132:0/229611330 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7ff9f806c8f0 0x7ff9f806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:12.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.564+0000 7ffa0a7fc640 1 -- 172.21.15.132:0/229611330 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7ffa0c08aa10 con 0x7ffa1415ec20 2024-04-16T15:52:12.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.564+0000 7ffa199ec640 1 --2- 172.21.15.132:0/229611330 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7ff9f806c8f0 0x7ff9f806edb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ffa10001920 tx=0x7ffa100018b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:12.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.568+0000 7ffa0a7fc640 1 -- 172.21.15.132:0/229611330 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ffa0c058b40 con 0x7ffa1415ec20 2024-04-16T15:52:12.740 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.741+0000 7ffa1bc50640 1 -- 172.21.15.132:0/229611330 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ffa1415e1e0 con 0x7ffa1415ec20 2024-04-16T15:52:12.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.742+0000 7ffa0a7fc640 1 -- 172.21.15.132:0/229611330 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7ffa0c05ce40 con 0x7ffa1415ec20 2024-04-16T15:52:12.741 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2024-04-16T15:52:12.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.744+0000 7ffa1bc50640 1 -- 172.21.15.132:0/229611330 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7ff9f806c8f0 msgr2=0x7ff9f806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:12.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.744+0000 7ffa1bc50640 1 --2- 172.21.15.132:0/229611330 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7ff9f806c8f0 0x7ff9f806edb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ffa10001920 tx=0x7ffa100018b0 comp rx=0 tx=0).stop 2024-04-16T15:52:12.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.744+0000 7ffa1bc50640 1 -- 172.21.15.132:0/229611330 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffa1415ec20 msgr2=0x7ffa1414ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:12.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.744+0000 7ffa1bc50640 1 --2- 172.21.15.132:0/229611330 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffa1415ec20 0x7ffa1414ec70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c00c3c0 tx=0x7ffa0c00c880 comp rx=0 tx=0).stop 2024-04-16T15:52:12.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.744+0000 7ffa1bc50640 1 -- 172.21.15.132:0/229611330 shutdown_connections 2024-04-16T15:52:12.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.744+0000 7ffa1bc50640 1 --2- 172.21.15.132:0/229611330 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7ff9f806c8f0 0x7ff9f806edb0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:12.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.744+0000 7ffa1bc50640 1 --2- 172.21.15.132:0/229611330 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffa1415ec20 0x7ffa1414ec70 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:12.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.744+0000 7ffa1bc50640 1 --2- 172.21.15.132:0/229611330 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa140d1920 0x7ffa141f4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:12.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.744+0000 7ffa1bc50640 1 --2- 172.21.15.132:0/229611330 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa140b7bb0 0x7ffa1415b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:12.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.744+0000 7ffa1bc50640 1 -- 172.21.15.132:0/229611330 >> 172.21.15.132:0/229611330 conn(0x7ffa1406d2d0 msgr2=0x7ffa140b8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:12.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.744+0000 7ffa1bc50640 1 -- 172.21.15.132:0/229611330 shutdown_connections 2024-04-16T15:52:12.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.744+0000 7ffa1bc50640 1 -- 172.21.15.132:0/229611330 wait complete. 2024-04-16T15:52:12.754 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-16T15:52:12.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.857+0000 7f5ae6ec5640 1 Processor -- start 2024-04-16T15:52:12.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.857+0000 7f5ae6ec5640 1 -- start start 2024-04-16T15:52:12.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.858+0000 7f5ae6ec5640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5ae015ede0 0x7f5ae006cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:12.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.858+0000 7f5ae6ec5640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5ae006df50 0x7f5ae00d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:12.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.858+0000 7f5ae6ec5640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ae00d1fe0 con 0x7f5ae009aa30 2024-04-16T15:52:12.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.858+0000 7f5ae6ec5640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f5ae00b1c00 con 0x7f5ae006df50 2024-04-16T15:52:12.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.858+0000 7f5ae6ec5640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f5ae00cd530 con 0x7f5ae015ede0 2024-04-16T15:52:12.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.858+0000 7f5ae5462640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5ae006df50 0x7f5ae00d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:12.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.858+0000 7f5ae4c61640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f5ae009aa30 0x7f5ae009ae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56474/0 (socket says 172.21.15.132:56474) 2024-04-16T15:52:12.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.858+0000 7f5ae4c61640 1 -- 172.21.15.132:0/3335609564 learned_addr learned my addr 172.21.15.132:0/3335609564 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:12.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.858+0000 7f5adffff640 1 --2- 172.21.15.132:0/3335609564 >> v2:172.21.15.179:3300/0 conn(0x7f5ae015ede0 0x7f5ae006cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:12.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.858+0000 7f5ae5462640 1 -- 172.21.15.132:0/3335609564 >> v2:172.21.15.179:3300/0 conn(0x7f5ae015ede0 msgr2=0x7f5ae006cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:12.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.858+0000 7f5ae5462640 1 --2- 172.21.15.132:0/3335609564 >> v2:172.21.15.179:3300/0 conn(0x7f5ae015ede0 0x7f5ae006cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:12.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.858+0000 7f5ae5462640 1 -- 172.21.15.132:0/3335609564 >> v1:172.21.15.132:6789/0 conn(0x7f5ae009aa30 legacy=0x7f5ae009ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:12.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.858+0000 7f5ae5462640 1 -- 172.21.15.132:0/3335609564 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ae00ccee0 con 0x7f5ae006df50 2024-04-16T15:52:12.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.858+0000 7f5adf7fe640 1 -- 172.21.15.132:0/3335609564 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2216022853 0 0) 0x7f5ae00d1fe0 con 0x7f5ae009aa30 2024-04-16T15:52:12.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.858+0000 7f5adffff640 1 --2- 172.21.15.132:0/3335609564 >> v2:172.21.15.179:3300/0 conn(0x7f5ae015ede0 0x7f5ae006cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:52:12.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.859+0000 7f5ae5462640 1 --2- 172.21.15.132:0/3335609564 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ae006df50 0x7f5ae00d0af0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5ae006d490 tx=0x7f5ad802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae658a91df458448 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:12.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.859+0000 7f5adf7fe640 1 -- 172.21.15.132:0/3335609564 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad8039070 con 0x7f5ae006df50 2024-04-16T15:52:12.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.859+0000 7f5adf7fe640 1 -- 172.21.15.132:0/3335609564 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ad802cc80 con 0x7f5ae006df50 2024-04-16T15:52:12.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.859+0000 7f5adf7fe640 1 -- 172.21.15.132:0/3335609564 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad8034660 con 0x7f5ae006df50 2024-04-16T15:52:12.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.860+0000 7f5ae6ec5640 1 -- 172.21.15.132:0/3335609564 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ae006df50 msgr2=0x7f5ae00d0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:12.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.860+0000 7f5ae6ec5640 1 --2- 172.21.15.132:0/3335609564 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ae006df50 0x7f5ae00d0af0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5ae006d490 tx=0x7f5ad802bed0 comp rx=0 tx=0).stop 2024-04-16T15:52:12.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.860+0000 7f5ae6ec5640 1 -- 172.21.15.132:0/3335609564 shutdown_connections 2024-04-16T15:52:12.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.860+0000 7f5ae6ec5640 1 --2- 172.21.15.132:0/3335609564 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ae006df50 0x7f5ae00d0af0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:12.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.860+0000 7f5ae6ec5640 1 --2- 172.21.15.132:0/3335609564 >> v2:172.21.15.179:3300/0 conn(0x7f5ae015ede0 0x7f5ae006cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:12.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.860+0000 7f5ae6ec5640 1 -- 172.21.15.132:0/3335609564 >> 172.21.15.132:0/3335609564 conn(0x7f5ae00b41e0 msgr2=0x7f5ae00b45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:12.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.860+0000 7f5ae6ec5640 1 -- 172.21.15.132:0/3335609564 shutdown_connections 2024-04-16T15:52:12.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.860+0000 7f5ae6ec5640 1 -- 172.21.15.132:0/3335609564 wait complete. 2024-04-16T15:52:12.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.861+0000 7f5ae6ec5640 1 Processor -- start 2024-04-16T15:52:12.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.861+0000 7f5ae6ec5640 1 -- start start 2024-04-16T15:52:12.866 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.862+0000 7f5ae6ec5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ae006df50 0x7f5ae00b0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:12.866 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.862+0000 7f5ae6ec5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ae009aa30 0x7f5ae014ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:12.866 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.862+0000 7f5ae6ec5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ae00af820 0x7f5ae01f5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:12.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.862+0000 7f5ae6ec5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f5ae00ceb50 con 0x7f5ae00af820 2024-04-16T15:52:12.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.862+0000 7f5ae6ec5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5ae00ce9d0 con 0x7f5ae006df50 2024-04-16T15:52:12.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.862+0000 7f5ae6ec5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f5ae00d1030 con 0x7f5ae009aa30 2024-04-16T15:52:12.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.862+0000 7f5ae5462640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ae00af820 0x7f5ae01f5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:12.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.862+0000 7f5ae5462640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ae00af820 0x7f5ae01f5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37264/0 (socket says 172.21.15.132:37264) 2024-04-16T15:52:12.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.862+0000 7f5ae5462640 1 -- 172.21.15.132:0/462168561 learned_addr learned my addr 172.21.15.132:0/462168561 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:12.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.862+0000 7f5ae4c61640 1 --2- 172.21.15.132:0/462168561 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ae006df50 0x7f5ae00b0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:12.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.862+0000 7f5adffff640 1 --2- 172.21.15.132:0/462168561 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ae009aa30 0x7f5ae014ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:12.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.862+0000 7f5ae5462640 1 -- 172.21.15.132:0/462168561 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ae009aa30 msgr2=0x7f5ae014ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:12.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.862+0000 7f5ae5462640 1 --2- 172.21.15.132:0/462168561 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ae009aa30 0x7f5ae014ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:12.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.862+0000 7f5ae5462640 1 -- 172.21.15.132:0/462168561 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ae006df50 msgr2=0x7f5ae00b0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:12.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.862+0000 7f5ae5462640 1 --2- 172.21.15.132:0/462168561 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ae006df50 0x7f5ae00b0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:12.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.862+0000 7f5ae5462640 1 -- 172.21.15.132:0/462168561 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ae01f5540 con 0x7f5ae00af820 2024-04-16T15:52:12.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.862+0000 7f5ae5462640 1 --2- 172.21.15.132:0/462168561 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ae00af820 0x7f5ae01f5000 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5ad802c4e0 tx=0x7f5ad8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:12.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.862+0000 7f5add7fa640 1 -- 172.21.15.132:0/462168561 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad8039050 con 0x7f5ae00af820 2024-04-16T15:52:12.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.863+0000 7f5add7fa640 1 -- 172.21.15.132:0/462168561 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ad8045070 con 0x7f5ae00af820 2024-04-16T15:52:12.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.863+0000 7f5ae6ec5640 1 -- 172.21.15.132:0/462168561 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ae00afd90 con 0x7f5ae00af820 2024-04-16T15:52:12.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.863+0000 7f5add7fa640 1 -- 172.21.15.132:0/462168561 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad803e830 con 0x7f5ae00af820 2024-04-16T15:52:12.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.863+0000 7f5ae6ec5640 1 -- 172.21.15.132:0/462168561 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ae00b0350 con 0x7f5ae00af820 2024-04-16T15:52:12.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.864+0000 7f5ae6ec5640 1 -- 172.21.15.132:0/462168561 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ae0075510 con 0x7f5ae00af820 2024-04-16T15:52:12.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.864+0000 7f5add7fa640 1 -- 172.21.15.132:0/462168561 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5ad803e9d0 con 0x7f5ae00af820 2024-04-16T15:52:12.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.864+0000 7f5add7fa640 1 --2- 172.21.15.132:0/462168561 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f5acc06c920 0x7f5acc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:12.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.864+0000 7f5add7fa640 1 -- 172.21.15.132:0/462168561 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f5ad80ae5c0 con 0x7f5ae00af820 2024-04-16T15:52:12.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.864+0000 7f5ae4c61640 1 --2- 172.21.15.132:0/462168561 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f5acc06c920 0x7f5acc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:12.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.865+0000 7f5ae4c61640 1 --2- 172.21.15.132:0/462168561 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f5acc06c920 0x7f5acc06ede0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5ad0000f60 tx=0x7f5ad0007b50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:12.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:12.869+0000 7f5add7fa640 1 -- 172.21.15.132:0/462168561 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5ad807ce60 con 0x7f5ae00af820 2024-04-16T15:52:13.047 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.047+0000 7f5ae6ec5640 1 -- 172.21.15.132:0/462168561 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f5ae015e490 con 0x7f5ae00af820 2024-04-16T15:52:13.047 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.048+0000 7f5add7fa640 1 -- 172.21.15.132:0/462168561 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7f5ad807c760 con 0x7f5ae00af820 2024-04-16T15:52:13.048 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:52:13.048 INFO:teuthology.orchestra.run.smithi132.stdout:[ 2024-04-16T15:52:13.048 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-16T15:52:13.049 INFO:teuthology.orchestra.run.smithi132.stdout: "poolnum": 1, 2024-04-16T15:52:13.049 INFO:teuthology.orchestra.run.smithi132.stdout: "poolname": ".mgr" 2024-04-16T15:52:13.049 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-16T15:52:13.049 INFO:teuthology.orchestra.run.smithi132.stdout:] 2024-04-16T15:52:13.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.050+0000 7f5ae6ec5640 1 -- 172.21.15.132:0/462168561 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f5acc06c920 msgr2=0x7f5acc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:13.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.050+0000 7f5ae6ec5640 1 --2- 172.21.15.132:0/462168561 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f5acc06c920 0x7f5acc06ede0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5ad0000f60 tx=0x7f5ad0007b50 comp rx=0 tx=0).stop 2024-04-16T15:52:13.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.050+0000 7f5ae6ec5640 1 -- 172.21.15.132:0/462168561 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ae00af820 msgr2=0x7f5ae01f5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:13.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.050+0000 7f5ae6ec5640 1 --2- 172.21.15.132:0/462168561 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ae00af820 0x7f5ae01f5000 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5ad802c4e0 tx=0x7f5ad8004a40 comp rx=0 tx=0).stop 2024-04-16T15:52:13.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.050+0000 7f5ae6ec5640 1 -- 172.21.15.132:0/462168561 shutdown_connections 2024-04-16T15:52:13.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.050+0000 7f5ae6ec5640 1 --2- 172.21.15.132:0/462168561 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f5acc06c920 0x7f5acc06ede0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:13.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.050+0000 7f5ae6ec5640 1 --2- 172.21.15.132:0/462168561 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ae00af820 0x7f5ae01f5000 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:13.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.050+0000 7f5ae6ec5640 1 --2- 172.21.15.132:0/462168561 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ae009aa30 0x7f5ae014ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:13.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.050+0000 7f5ae6ec5640 1 --2- 172.21.15.132:0/462168561 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ae006df50 0x7f5ae00b0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:13.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.050+0000 7f5ae6ec5640 1 -- 172.21.15.132:0/462168561 >> 172.21.15.132:0/462168561 conn(0x7f5ae00b41e0 msgr2=0x7f5ae006caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:13.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.050+0000 7f5ae6ec5640 1 -- 172.21.15.132:0/462168561 shutdown_connections 2024-04-16T15:52:13.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.050+0000 7f5ae6ec5640 1 -- 172.21.15.132:0/462168561 wait complete. 2024-04-16T15:52:13.060 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-16T15:52:13.060 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-16T15:52:13.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.168+0000 7f9c75488640 1 Processor -- start 2024-04-16T15:52:13.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.168+0000 7f9c75488640 1 -- start start 2024-04-16T15:52:13.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.169+0000 7f9c75488640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9c700b66d0 0x7f9c701626c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:13.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.169+0000 7f9c75488640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c700ba860 con 0x7f9c7015edb0 2024-04-16T15:52:13.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.169+0000 7f9c75488640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c70162dc0 con 0x7f9c700ba3b0 2024-04-16T15:52:13.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.169+0000 7f9c75488640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f9c701630a0 con 0x7f9c700b66d0 2024-04-16T15:52:13.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.169+0000 7f9c6effd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9c700b66d0 0x7f9c701626c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:13.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.169+0000 7f9c6e7fc640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f9c7015edb0 0x7f9c700b6ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56486/0 (socket says 172.21.15.132:56486) 2024-04-16T15:52:13.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.169+0000 7f9c6e7fc640 1 -- 172.21.15.132:0/4288937889 learned_addr learned my addr 172.21.15.132:0/4288937889 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:13.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.169+0000 7f9c6effd640 1 -- 172.21.15.132:0/4288937889 >> v1:172.21.15.179:6789/0 conn(0x7f9c700ba3b0 legacy=0x7f9c700d3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:13.174 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.169+0000 7f9c6effd640 1 -- 172.21.15.132:0/4288937889 >> v1:172.21.15.132:6789/0 conn(0x7f9c7015edb0 legacy=0x7f9c700b6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:13.174 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.169+0000 7f9c6effd640 1 -- 172.21.15.132:0/4288937889 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c70163380 con 0x7f9c700b66d0 2024-04-16T15:52:13.174 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.170+0000 7f9c6effd640 1 --2- 172.21.15.132:0/4288937889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c700b66d0 0x7f9c701626c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9c60009d90 tx=0x7f9c6002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61d4f88dc2c1edff server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:13.174 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.170+0000 7f9c6dffb640 1 -- 172.21.15.132:0/4288937889 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c60039070 con 0x7f9c700b66d0 2024-04-16T15:52:13.174 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.170+0000 7f9c6dffb640 1 -- 172.21.15.132:0/4288937889 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c6002cc60 con 0x7f9c700b66d0 2024-04-16T15:52:13.174 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.170+0000 7f9c6dffb640 1 -- 172.21.15.132:0/4288937889 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c60034660 con 0x7f9c700b66d0 2024-04-16T15:52:13.174 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.171+0000 7f9c75488640 1 -- 172.21.15.132:0/4288937889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c700b66d0 msgr2=0x7f9c701626c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:13.174 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.171+0000 7f9c75488640 1 --2- 172.21.15.132:0/4288937889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c700b66d0 0x7f9c701626c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9c60009d90 tx=0x7f9c6002beb0 comp rx=0 tx=0).stop 2024-04-16T15:52:13.174 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.171+0000 7f9c75488640 1 -- 172.21.15.132:0/4288937889 shutdown_connections 2024-04-16T15:52:13.175 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.171+0000 7f9c75488640 1 --2- 172.21.15.132:0/4288937889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c700b66d0 0x7f9c701626c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:13.175 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.171+0000 7f9c75488640 1 -- 172.21.15.132:0/4288937889 >> 172.21.15.132:0/4288937889 conn(0x7f9c700d1780 msgr2=0x7f9c700d1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:13.175 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.171+0000 7f9c75488640 1 -- 172.21.15.132:0/4288937889 shutdown_connections 2024-04-16T15:52:13.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.171+0000 7f9c75488640 1 -- 172.21.15.132:0/4288937889 wait complete. 2024-04-16T15:52:13.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.172+0000 7f9c75488640 1 Processor -- start 2024-04-16T15:52:13.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.172+0000 7f9c75488640 1 -- start start 2024-04-16T15:52:13.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.173+0000 7f9c75488640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c700b66d0 0x7f9c70159ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:13.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.173+0000 7f9c75488640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c700ba3b0 0x7f9c700ca980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:13.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.173+0000 7f9c75488640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c7015edb0 0x7f9c700cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:13.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.173+0000 7f9c75488640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f9c700d3da0 con 0x7f9c7015edb0 2024-04-16T15:52:13.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.173+0000 7f9c75488640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9c700d3c20 con 0x7f9c700ba3b0 2024-04-16T15:52:13.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.173+0000 7f9c75488640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9c700d3f20 con 0x7f9c700b66d0 2024-04-16T15:52:13.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.173+0000 7f9c6f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c7015edb0 0x7f9c700cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:13.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.173+0000 7f9c6f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c7015edb0 0x7f9c700cc7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37278/0 (socket says 172.21.15.132:37278) 2024-04-16T15:52:13.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.173+0000 7f9c6f7fe640 1 -- 172.21.15.132:0/1009122687 learned_addr learned my addr 172.21.15.132:0/1009122687 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:13.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.173+0000 7f9c6e7fc640 1 --2- 172.21.15.132:0/1009122687 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c700ba3b0 0x7f9c700ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:13.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.173+0000 7f9c6effd640 1 --2- 172.21.15.132:0/1009122687 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c700b66d0 0x7f9c70159ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:13.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.173+0000 7f9c6f7fe640 1 -- 172.21.15.132:0/1009122687 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c700b66d0 msgr2=0x7f9c70159ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:13.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.173+0000 7f9c6f7fe640 1 --2- 172.21.15.132:0/1009122687 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c700b66d0 0x7f9c70159ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:13.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.173+0000 7f9c6f7fe640 1 -- 172.21.15.132:0/1009122687 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c700ba3b0 msgr2=0x7f9c700ca980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:13.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.173+0000 7f9c6f7fe640 1 --2- 172.21.15.132:0/1009122687 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c700ba3b0 0x7f9c700ca980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:13.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.173+0000 7f9c6f7fe640 1 -- 172.21.15.132:0/1009122687 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c700ce120 con 0x7f9c7015edb0 2024-04-16T15:52:13.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.173+0000 7f9c6f7fe640 1 --2- 172.21.15.132:0/1009122687 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c7015edb0 0x7f9c700cc7a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9c6800c440 tx=0x7f9c6800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:13.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.173+0000 7f9c577fe640 1 -- 172.21.15.132:0/1009122687 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c68011790 con 0x7f9c7015edb0 2024-04-16T15:52:13.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.174+0000 7f9c577fe640 1 -- 172.21.15.132:0/1009122687 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c68017070 con 0x7f9c7015edb0 2024-04-16T15:52:13.184 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.174+0000 7f9c75488640 1 -- 172.21.15.132:0/1009122687 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c700cd080 con 0x7f9c7015edb0 2024-04-16T15:52:13.184 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.174+0000 7f9c577fe640 1 -- 172.21.15.132:0/1009122687 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c68011b70 con 0x7f9c7015edb0 2024-04-16T15:52:13.184 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.174+0000 7f9c75488640 1 -- 172.21.15.132:0/1009122687 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c700cd640 con 0x7f9c7015edb0 2024-04-16T15:52:13.184 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.175+0000 7f9c75488640 1 -- 172.21.15.132:0/1009122687 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c70068b80 con 0x7f9c7015edb0 2024-04-16T15:52:13.184 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.175+0000 7f9c577fe640 1 -- 172.21.15.132:0/1009122687 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9c68011d10 con 0x7f9c7015edb0 2024-04-16T15:52:13.184 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.175+0000 7f9c577fe640 1 --2- 172.21.15.132:0/1009122687 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f9c5c06c920 0x7f9c5c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:13.184 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.175+0000 7f9c577fe640 1 -- 172.21.15.132:0/1009122687 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f9c6808b4e0 con 0x7f9c7015edb0 2024-04-16T15:52:13.184 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.175+0000 7f9c6effd640 1 --2- 172.21.15.132:0/1009122687 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f9c5c06c920 0x7f9c5c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:13.184 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.176+0000 7f9c6effd640 1 --2- 172.21.15.132:0/1009122687 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f9c5c06c920 0x7f9c5c06ede0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9c60036000 tx=0x7f9c60030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:13.184 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.180+0000 7f9c577fe640 1 -- 172.21.15.132:0/1009122687 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9c68059cf0 con 0x7f9c7015edb0 2024-04-16T15:52:13.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.359+0000 7f9c75488640 1 -- 172.21.15.132:0/1009122687 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f9c700d2850 con 0x7f9c7015edb0 2024-04-16T15:52:13.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.924+0000 7f9c577fe640 1 -- 172.21.15.132:0/1009122687 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7f9c680595f0 con 0x7f9c7015edb0 2024-04-16T15:52:13.923 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_metadata' created 2024-04-16T15:52:13.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.926+0000 7f9c75488640 1 -- 172.21.15.132:0/1009122687 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f9c5c06c920 msgr2=0x7f9c5c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:13.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.926+0000 7f9c75488640 1 --2- 172.21.15.132:0/1009122687 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f9c5c06c920 0x7f9c5c06ede0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9c60036000 tx=0x7f9c60030000 comp rx=0 tx=0).stop 2024-04-16T15:52:13.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.926+0000 7f9c75488640 1 -- 172.21.15.132:0/1009122687 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c7015edb0 msgr2=0x7f9c700cc7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:13.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.926+0000 7f9c75488640 1 --2- 172.21.15.132:0/1009122687 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c7015edb0 0x7f9c700cc7a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9c6800c440 tx=0x7f9c6800c900 comp rx=0 tx=0).stop 2024-04-16T15:52:13.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.926+0000 7f9c75488640 1 -- 172.21.15.132:0/1009122687 shutdown_connections 2024-04-16T15:52:13.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.926+0000 7f9c75488640 1 --2- 172.21.15.132:0/1009122687 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f9c5c06c920 0x7f9c5c06ede0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:13.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.926+0000 7f9c75488640 1 --2- 172.21.15.132:0/1009122687 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c7015edb0 0x7f9c700cc7a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:13.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.926+0000 7f9c75488640 1 --2- 172.21.15.132:0/1009122687 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c700ba3b0 0x7f9c700ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:13.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.926+0000 7f9c75488640 1 --2- 172.21.15.132:0/1009122687 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c700b66d0 0x7f9c70159ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:13.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.926+0000 7f9c75488640 1 -- 172.21.15.132:0/1009122687 >> 172.21.15.132:0/1009122687 conn(0x7f9c700d1780 msgr2=0x7f9c7006ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:13.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.926+0000 7f9c75488640 1 -- 172.21.15.132:0/1009122687 shutdown_connections 2024-04-16T15:52:13.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:13.926+0000 7f9c75488640 1 -- 172.21.15.132:0/1009122687 wait complete. 2024-04-16T15:52:13.940 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-16T15:52:14.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.052+0000 7f7485e2c640 1 Processor -- start 2024-04-16T15:52:14.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.052+0000 7f7485e2c640 1 -- start start 2024-04-16T15:52:14.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.053+0000 7f7485e2c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f74800affd0 0x7f748006fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:14.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.053+0000 7f7485e2c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74800ce540 con 0x7f7480072ad0 2024-04-16T15:52:14.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.053+0000 7f7485e2c640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7480073450 con 0x7f748015ca90 2024-04-16T15:52:14.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.053+0000 7f7485e2c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f74800cdef0 con 0x7f74800affd0 2024-04-16T15:52:14.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.053+0000 7f747ffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f74800affd0 0x7f748006fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:14.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.053+0000 7f747effd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f7480072ad0 0x7f748006e420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56502/0 (socket says 172.21.15.132:56502) 2024-04-16T15:52:14.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.053+0000 7f747effd640 1 -- 172.21.15.132:0/67744704 learned_addr learned my addr 172.21.15.132:0/67744704 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:14.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.053+0000 7f747ffff640 1 -- 172.21.15.132:0/67744704 >> v1:172.21.15.179:6789/0 conn(0x7f748015ca90 legacy=0x7f74800723c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:14.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.053+0000 7f747ffff640 1 -- 172.21.15.132:0/67744704 >> v1:172.21.15.132:6789/0 conn(0x7f7480072ad0 legacy=0x7f748006e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:14.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.053+0000 7f747ffff640 1 -- 172.21.15.132:0/67744704 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74800ce1d0 con 0x7f74800affd0 2024-04-16T15:52:14.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.053+0000 7f747e7fc640 1 -- 172.21.15.132:0/67744704 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 663532919 0 0) 0x7f74800ce540 con 0x7f7480072ad0 2024-04-16T15:52:14.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.054+0000 7f747ffff640 1 --2- 172.21.15.132:0/67744704 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74800affd0 0x7f748006fe80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f74780097a0 tx=0x7f747802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3afbfb0e7e4fbd7e server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:14.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.054+0000 7f747e7fc640 1 -- 172.21.15.132:0/67744704 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74780315a0 con 0x7f74800affd0 2024-04-16T15:52:14.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.054+0000 7f747e7fc640 1 -- 172.21.15.132:0/67744704 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7478037070 con 0x7f74800affd0 2024-04-16T15:52:14.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.054+0000 7f747e7fc640 1 -- 172.21.15.132:0/67744704 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7478031960 con 0x7f74800affd0 2024-04-16T15:52:14.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.055+0000 7f7485e2c640 1 -- 172.21.15.132:0/67744704 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74800affd0 msgr2=0x7f748006fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:14.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.055+0000 7f7485e2c640 1 --2- 172.21.15.132:0/67744704 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74800affd0 0x7f748006fe80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f74780097a0 tx=0x7f747802b840 comp rx=0 tx=0).stop 2024-04-16T15:52:14.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.055+0000 7f7485e2c640 1 -- 172.21.15.132:0/67744704 shutdown_connections 2024-04-16T15:52:14.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.055+0000 7f7485e2c640 1 --2- 172.21.15.132:0/67744704 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74800affd0 0x7f748006fe80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:14.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.055+0000 7f7485e2c640 1 -- 172.21.15.132:0/67744704 >> 172.21.15.132:0/67744704 conn(0x7f74800b2710 msgr2=0x7f74800b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:14.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.055+0000 7f7485e2c640 1 -- 172.21.15.132:0/67744704 shutdown_connections 2024-04-16T15:52:14.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.055+0000 7f7485e2c640 1 -- 172.21.15.132:0/67744704 wait complete. 2024-04-16T15:52:14.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.056+0000 7f7485e2c640 1 Processor -- start 2024-04-16T15:52:14.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.056+0000 7f7485e2c640 1 -- start start 2024-04-16T15:52:14.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.057+0000 7f7485e2c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7480072ad0 0x7f7480159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:14.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.057+0000 7f7485e2c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74800affd0 0x7f748013f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:14.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.057+0000 7f7485e2c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f748015ca90 0x7f74801f6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:14.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.057+0000 7f7485e2c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f74800cd570 con 0x7f7480072ad0 2024-04-16T15:52:14.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.057+0000 7f7485e2c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f74800cd3f0 con 0x7f74800affd0 2024-04-16T15:52:14.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.057+0000 7f7485e2c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f74800cd6f0 con 0x7f748015ca90 2024-04-16T15:52:14.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.057+0000 7f747f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7480072ad0 0x7f7480159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:14.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.057+0000 7f747f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7480072ad0 0x7f7480159fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37288/0 (socket says 172.21.15.132:37288) 2024-04-16T15:52:14.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.057+0000 7f747f7fe640 1 -- 172.21.15.132:0/2919064266 learned_addr learned my addr 172.21.15.132:0/2919064266 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:14.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.057+0000 7f747ffff640 1 --2- 172.21.15.132:0/2919064266 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f748015ca90 0x7f74801f6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:14.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.057+0000 7f747effd640 1 --2- 172.21.15.132:0/2919064266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74800affd0 0x7f748013f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:14.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.057+0000 7f747f7fe640 1 -- 172.21.15.132:0/2919064266 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f748015ca90 msgr2=0x7f74801f6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:14.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.057+0000 7f747f7fe640 1 --2- 172.21.15.132:0/2919064266 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f748015ca90 0x7f74801f6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:14.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.057+0000 7f747f7fe640 1 -- 172.21.15.132:0/2919064266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74800affd0 msgr2=0x7f748013f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:14.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.057+0000 7f747f7fe640 1 --2- 172.21.15.132:0/2919064266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74800affd0 0x7f748013f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:14.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.057+0000 7f747f7fe640 1 -- 172.21.15.132:0/2919064266 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f748013fb40 con 0x7f7480072ad0 2024-04-16T15:52:14.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.057+0000 7f747f7fe640 1 --2- 172.21.15.132:0/2919064266 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7480072ad0 0x7f7480159fe0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f747000ba80 tx=0x7f747000bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:14.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.058+0000 7f7467fff640 1 -- 172.21.15.132:0/2919064266 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f747000cc00 con 0x7f7480072ad0 2024-04-16T15:52:14.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.058+0000 7f7467fff640 1 -- 172.21.15.132:0/2919064266 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f747000cda0 con 0x7f7480072ad0 2024-04-16T15:52:14.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.058+0000 7f7467fff640 1 -- 172.21.15.132:0/2919064266 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7470003bb0 con 0x7f7480072ad0 2024-04-16T15:52:14.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.058+0000 7f7485e2c640 1 -- 172.21.15.132:0/2919064266 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f748013fef0 con 0x7f7480072ad0 2024-04-16T15:52:14.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.058+0000 7f7485e2c640 1 -- 172.21.15.132:0/2919064266 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74801404b0 con 0x7f7480072ad0 2024-04-16T15:52:14.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.059+0000 7f7485e2c640 1 -- 172.21.15.132:0/2919064266 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7480075510 con 0x7f7480072ad0 2024-04-16T15:52:14.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.059+0000 7f7467fff640 1 -- 172.21.15.132:0/2919064266 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7470014440 con 0x7f7480072ad0 2024-04-16T15:52:14.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.060+0000 7f7467fff640 1 --2- 172.21.15.132:0/2919064266 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f746c06c8f0 0x7f746c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:14.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.060+0000 7f747effd640 1 --2- 172.21.15.132:0/2919064266 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f746c06c8f0 0x7f746c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:14.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.060+0000 7f7467fff640 1 -- 172.21.15.132:0/2919064266 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7f747008b870 con 0x7f7480072ad0 2024-04-16T15:52:14.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.060+0000 7f747effd640 1 --2- 172.21.15.132:0/2919064266 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f746c06c8f0 0x7f746c06edb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f74801f6250 tx=0x7f7474007b90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:14.063 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.064+0000 7f7467fff640 1 -- 172.21.15.132:0/2919064266 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7470059e80 con 0x7f7480072ad0 2024-04-16T15:52:14.241 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.242+0000 7f7485e2c640 1 -- 172.21.15.132:0/2919064266 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f748006f980 con 0x7f7480072ad0 2024-04-16T15:52:14.721 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T15:52:14.724 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T15:52:14.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.926+0000 7f7467fff640 1 -- 172.21.15.132:0/2919064266 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) ==== 170+0+0 (secure 0 0 0) 0x7f7470059780 con 0x7f7480072ad0 2024-04-16T15:52:14.926 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_data' created 2024-04-16T15:52:14.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.928+0000 7f7485e2c640 1 -- 172.21.15.132:0/2919064266 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f746c06c8f0 msgr2=0x7f746c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:14.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.928+0000 7f7485e2c640 1 --2- 172.21.15.132:0/2919064266 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f746c06c8f0 0x7f746c06edb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f74801f6250 tx=0x7f7474007b90 comp rx=0 tx=0).stop 2024-04-16T15:52:14.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.928+0000 7f7485e2c640 1 -- 172.21.15.132:0/2919064266 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7480072ad0 msgr2=0x7f7480159fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:14.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.928+0000 7f7485e2c640 1 --2- 172.21.15.132:0/2919064266 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7480072ad0 0x7f7480159fe0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f747000ba80 tx=0x7f747000bf40 comp rx=0 tx=0).stop 2024-04-16T15:52:14.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.928+0000 7f7485e2c640 1 -- 172.21.15.132:0/2919064266 shutdown_connections 2024-04-16T15:52:14.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.928+0000 7f7485e2c640 1 --2- 172.21.15.132:0/2919064266 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f746c06c8f0 0x7f746c06edb0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:14.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.928+0000 7f7485e2c640 1 --2- 172.21.15.132:0/2919064266 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f748015ca90 0x7f74801f6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:14.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.928+0000 7f7485e2c640 1 --2- 172.21.15.132:0/2919064266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74800affd0 0x7f748013f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:14.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.928+0000 7f7485e2c640 1 --2- 172.21.15.132:0/2919064266 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7480072ad0 0x7f7480159fe0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:14.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.928+0000 7f7485e2c640 1 -- 172.21.15.132:0/2919064266 >> 172.21.15.132:0/2919064266 conn(0x7f74800b2710 msgr2=0x7f748006e420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:14.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.928+0000 7f7485e2c640 1 -- 172.21.15.132:0/2919064266 shutdown_connections 2024-04-16T15:52:14.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:14.928+0000 7f7485e2c640 1 -- 172.21.15.132:0/2919064266 wait complete. 2024-04-16T15:52:14.951 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-16T15:52:15.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.058+0000 7fe20d90e640 1 Processor -- start 2024-04-16T15:52:15.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.058+0000 7fe20d90e640 1 -- start start 2024-04-16T15:52:15.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.059+0000 7fe20d90e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe20815ec20 0x7fe2080d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:15.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.059+0000 7fe20d90e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe2080d3340 0x7fe2080d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:15.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.059+0000 7fe20d90e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2080d3850 con 0x7fe2080d1e60 2024-04-16T15:52:15.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.059+0000 7fe20d90e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fe2080d3b30 con 0x7fe2080d3340 2024-04-16T15:52:15.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.059+0000 7fe20d90e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe2080d3e10 con 0x7fe20815ec20 2024-04-16T15:52:15.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.059+0000 7fe2067fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe2080d3340 0x7fe2080d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:15.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.059+0000 7fe2077fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fe2080d1e60 0x7fe2080b6400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56514/0 (socket says 172.21.15.132:56514) 2024-04-16T15:52:15.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.059+0000 7fe2077fe640 1 -- 172.21.15.132:0/2802113242 learned_addr learned my addr 172.21.15.132:0/2802113242 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:15.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.059+0000 7fe2067fc640 1 -- 172.21.15.132:0/2802113242 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe20815ec20 msgr2=0x7fe2080d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:15.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.059+0000 7fe206ffd640 1 --2- 172.21.15.132:0/2802113242 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe20815ec20 0x7fe2080d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:15.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.059+0000 7fe205ffb640 1 -- 172.21.15.132:0/2802113242 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1471939190 0 0) 0x7fe2080d3850 con 0x7fe2080d1e60 2024-04-16T15:52:15.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.059+0000 7fe2067fc640 1 --2- 172.21.15.132:0/2802113242 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe20815ec20 0x7fe2080d2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:15.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.059+0000 7fe2067fc640 1 -- 172.21.15.132:0/2802113242 >> v1:172.21.15.132:6789/0 conn(0x7fe2080d1e60 legacy=0x7fe2080b6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:15.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.059+0000 7fe2067fc640 1 -- 172.21.15.132:0/2802113242 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2080d40f0 con 0x7fe2080d3340 2024-04-16T15:52:15.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.060+0000 7fe2067fc640 1 --2- 172.21.15.132:0/2802113242 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2080d3340 0x7fe2080d1920 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc0097a0 tx=0x7fe1fc02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eb2b61152d4fd4b server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:15.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.060+0000 7fe205ffb640 1 -- 172.21.15.132:0/2802113242 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1fc034070 con 0x7fe2080d3340 2024-04-16T15:52:15.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.060+0000 7fe205ffb640 1 -- 172.21.15.132:0/2802113242 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1fc030610 con 0x7fe2080d3340 2024-04-16T15:52:15.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.060+0000 7fe205ffb640 1 -- 172.21.15.132:0/2802113242 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1fc0309e0 con 0x7fe2080d3340 2024-04-16T15:52:15.063 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.061+0000 7fe20d90e640 1 -- 172.21.15.132:0/2802113242 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2080d3340 msgr2=0x7fe2080d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:15.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.061+0000 7fe20d90e640 1 --2- 172.21.15.132:0/2802113242 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2080d3340 0x7fe2080d1920 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc0097a0 tx=0x7fe1fc02b960 comp rx=0 tx=0).stop 2024-04-16T15:52:15.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.061+0000 7fe20d90e640 1 -- 172.21.15.132:0/2802113242 shutdown_connections 2024-04-16T15:52:15.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.061+0000 7fe20d90e640 1 --2- 172.21.15.132:0/2802113242 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2080d3340 0x7fe2080d1920 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:15.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.061+0000 7fe20d90e640 1 --2- 172.21.15.132:0/2802113242 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe20815ec20 0x7fe2080d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:15.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.061+0000 7fe20d90e640 1 -- 172.21.15.132:0/2802113242 >> 172.21.15.132:0/2802113242 conn(0x7fe20806d2d0 msgr2=0x7fe20806d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:15.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.061+0000 7fe20d90e640 1 -- 172.21.15.132:0/2802113242 shutdown_connections 2024-04-16T15:52:15.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.061+0000 7fe20d90e640 1 -- 172.21.15.132:0/2802113242 wait complete. 2024-04-16T15:52:15.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.062+0000 7fe20d90e640 1 Processor -- start 2024-04-16T15:52:15.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.062+0000 7fe20d90e640 1 -- start start 2024-04-16T15:52:15.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.063+0000 7fe20d90e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2080d1e60 0x7fe2081598a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:15.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.063+0000 7fe20d90e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2080d3340 0x7fe20814ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:15.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.063+0000 7fe20d90e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe20815ec20 0x7fe2080cd480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:15.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.063+0000 7fe20d90e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe2080cf3a0 con 0x7fe2080d1e60 2024-04-16T15:52:15.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.063+0000 7fe20d90e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe20815f000 con 0x7fe2080d3340 2024-04-16T15:52:15.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.063+0000 7fe20d90e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe2080cf520 con 0x7fe20815ec20 2024-04-16T15:52:15.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.063+0000 7fe206ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2080d1e60 0x7fe2081598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:15.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.063+0000 7fe206ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2080d1e60 0x7fe2081598a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37304/0 (socket says 172.21.15.132:37304) 2024-04-16T15:52:15.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.063+0000 7fe206ffd640 1 -- 172.21.15.132:0/2155078309 learned_addr learned my addr 172.21.15.132:0/2155078309 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:15.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.063+0000 7fe2077fe640 1 --2- 172.21.15.132:0/2155078309 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe20815ec20 0x7fe2080cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:15.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.063+0000 7fe206ffd640 1 -- 172.21.15.132:0/2155078309 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe20815ec20 msgr2=0x7fe2080cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:15.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.063+0000 7fe2067fc640 1 --2- 172.21.15.132:0/2155078309 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2080d3340 0x7fe20814ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:15.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.063+0000 7fe206ffd640 1 --2- 172.21.15.132:0/2155078309 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe20815ec20 0x7fe2080cd480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:15.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.063+0000 7fe206ffd640 1 -- 172.21.15.132:0/2155078309 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2080d3340 msgr2=0x7fe20814ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:15.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.063+0000 7fe206ffd640 1 --2- 172.21.15.132:0/2155078309 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2080d3340 0x7fe20814ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:15.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.063+0000 7fe206ffd640 1 -- 172.21.15.132:0/2155078309 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe20814e2f0 con 0x7fe2080d1e60 2024-04-16T15:52:15.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.063+0000 7fe206ffd640 1 --2- 172.21.15.132:0/2155078309 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2080d1e60 0x7fe2081598a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe1f800c7f0 tx=0x7fe1f800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:15.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.064+0000 7fe1effff640 1 -- 172.21.15.132:0/2155078309 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f8015070 con 0x7fe2080d1e60 2024-04-16T15:52:15.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.064+0000 7fe1effff640 1 -- 172.21.15.132:0/2155078309 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1f8004220 con 0x7fe2080d1e60 2024-04-16T15:52:15.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.064+0000 7fe20d90e640 1 -- 172.21.15.132:0/2155078309 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe208159e80 con 0x7fe2080d1e60 2024-04-16T15:52:15.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.064+0000 7fe1effff640 1 -- 172.21.15.132:0/2155078309 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f8007620 con 0x7fe2080d1e60 2024-04-16T15:52:15.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.064+0000 7fe20d90e640 1 -- 172.21.15.132:0/2155078309 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe20815a720 con 0x7fe2080d1e60 2024-04-16T15:52:15.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.065+0000 7fe20d90e640 1 -- 172.21.15.132:0/2155078309 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe208075510 con 0x7fe2080d1e60 2024-04-16T15:52:15.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.065+0000 7fe1effff640 1 -- 172.21.15.132:0/2155078309 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe1f80079d0 con 0x7fe2080d1e60 2024-04-16T15:52:15.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.065+0000 7fe1effff640 1 --2- 172.21.15.132:0/2155078309 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fe1f406c8f0 0x7fe1f406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:15.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.066+0000 7fe2067fc640 1 --2- 172.21.15.132:0/2155078309 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fe1f406c8f0 0x7fe1f406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:15.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.066+0000 7fe1effff640 1 -- 172.21.15.132:0/2155078309 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7fe1f808bd80 con 0x7fe2080d1e60 2024-04-16T15:52:15.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.066+0000 7fe2067fc640 1 --2- 172.21.15.132:0/2155078309 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fe1f406c8f0 0x7fe1f406edb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc036000 tx=0x7fe1fc03b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:15.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.070+0000 7fe1effff640 1 -- 172.21.15.132:0/2155078309 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe20814e2f0 con 0x7fe2080d1e60 2024-04-16T15:52:15.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.284+0000 7fe20d90e640 1 -- 172.21.15.132:0/2155078309 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fe2080cf180 con 0x7fe2080d1e60 2024-04-16T15:52:15.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.949+0000 7fe1effff640 1 -- 172.21.15.132:0/2155078309 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fe1f805a2a0 con 0x7fe2080d1e60 2024-04-16T15:52:15.950 INFO:teuthology.orchestra.run.smithi132.stderr:new fs with metadata pool 2 and data pool 3 2024-04-16T15:52:15.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.959+0000 7fe20d90e640 1 -- 172.21.15.132:0/2155078309 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fe1f406c8f0 msgr2=0x7fe1f406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:15.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.959+0000 7fe20d90e640 1 --2- 172.21.15.132:0/2155078309 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fe1f406c8f0 0x7fe1f406edb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc036000 tx=0x7fe1fc03b040 comp rx=0 tx=0).stop 2024-04-16T15:52:15.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.959+0000 7fe20d90e640 1 -- 172.21.15.132:0/2155078309 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2080d1e60 msgr2=0x7fe2081598a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:15.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.959+0000 7fe20d90e640 1 --2- 172.21.15.132:0/2155078309 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2080d1e60 0x7fe2081598a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe1f800c7f0 tx=0x7fe1f800ccb0 comp rx=0 tx=0).stop 2024-04-16T15:52:15.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.960+0000 7fe20d90e640 1 -- 172.21.15.132:0/2155078309 shutdown_connections 2024-04-16T15:52:15.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.960+0000 7fe20d90e640 1 --2- 172.21.15.132:0/2155078309 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fe1f406c8f0 0x7fe1f406edb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:15.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.960+0000 7fe20d90e640 1 --2- 172.21.15.132:0/2155078309 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe20815ec20 0x7fe2080cd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:15.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.960+0000 7fe20d90e640 1 --2- 172.21.15.132:0/2155078309 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2080d3340 0x7fe20814ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:15.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.960+0000 7fe20d90e640 1 --2- 172.21.15.132:0/2155078309 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2080d1e60 0x7fe2081598a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:15.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.960+0000 7fe20d90e640 1 -- 172.21.15.132:0/2155078309 >> 172.21.15.132:0/2155078309 conn(0x7fe20806d2d0 msgr2=0x7fe2080b4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:15.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.960+0000 7fe20d90e640 1 -- 172.21.15.132:0/2155078309 shutdown_connections 2024-04-16T15:52:15.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:15.960+0000 7fe20d90e640 1 -- 172.21.15.132:0/2155078309 wait complete. 2024-04-16T15:52:15.979 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:52:16.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.087+0000 7f7abbed9640 1 Processor -- start 2024-04-16T15:52:16.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.087+0000 7f7abbed9640 1 -- start start 2024-04-16T15:52:16.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.088+0000 7f7abbed9640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7ab415ecc0 0x7f7ab406d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:16.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.088+0000 7f7abbed9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ab406cd40 0x7f7ab409aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:16.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.088+0000 7f7abbed9640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ab406da80 con 0x7f7ab409af70 2024-04-16T15:52:16.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.088+0000 7f7abbed9640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f7ab409b3c0 con 0x7f7ab415ecc0 2024-04-16T15:52:16.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.088+0000 7f7abbed9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f7ab40ccee0 con 0x7f7ab406cd40 2024-04-16T15:52:16.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.088+0000 7f7ab9c75640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7ab415ecc0 0x7f7ab406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:16.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.088+0000 7f7ab9474640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ab406cd40 0x7f7ab409aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:16.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.088+0000 7f7aba476640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f7ab409af70 0x7f7ab40d0930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.132:39716/0 (socket says 172.21.15.132:39716) 2024-04-16T15:52:16.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.088+0000 7f7ab9c75640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7ab415ecc0 0x7f7ab406d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.132:33908/0 (socket says 172.21.15.132:33908) 2024-04-16T15:52:16.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.088+0000 7f7ab9474640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ab406cd40 0x7f7ab409aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.132:57780/0 (socket says 172.21.15.132:57780) 2024-04-16T15:52:16.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.088+0000 7f7aba476640 1 -- 172.21.15.132:0/3023902698 learned_addr learned my addr 172.21.15.132:0/3023902698 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:16.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.088+0000 7f7ab9474640 1 -- 172.21.15.132:0/3023902698 >> v2:172.21.15.179:3300/0 conn(0x7f7ab415ecc0 msgr2=0x7f7ab406d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:16.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.088+0000 7f7ab9474640 1 --2- 172.21.15.132:0/3023902698 >> v2:172.21.15.179:3300/0 conn(0x7f7ab415ecc0 0x7f7ab406d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:16.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.088+0000 7f7ab9474640 1 -- 172.21.15.132:0/3023902698 >> v1:172.21.15.179:6789/0 conn(0x7f7ab409af70 legacy=0x7f7ab40d0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:16.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.088+0000 7f7ab9474640 1 -- 172.21.15.132:0/3023902698 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ab406dfe0 con 0x7f7ab406cd40 2024-04-16T15:52:16.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.088+0000 7f7ab9c75640 1 --2- 172.21.15.132:0/3023902698 >> v2:172.21.15.179:3300/0 conn(0x7f7ab415ecc0 0x7f7ab406d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:52:16.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.089+0000 7f7ab9474640 1 --2- 172.21.15.132:0/3023902698 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ab406cd40 0x7f7ab409aa30 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7aa40097a0 tx=0x7f7aa402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d501bd73f6768a83 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:16.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.089+0000 7f7ab8c73640 1 -- 172.21.15.132:0/3023902698 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa4035020 con 0x7f7ab406cd40 2024-04-16T15:52:16.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.089+0000 7f7ab8c73640 1 -- 172.21.15.132:0/3023902698 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7aa4031830 con 0x7f7ab406cd40 2024-04-16T15:52:16.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.089+0000 7f7ab8c73640 1 -- 172.21.15.132:0/3023902698 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa4031c00 con 0x7f7ab406cd40 2024-04-16T15:52:16.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.090+0000 7f7abbed9640 1 -- 172.21.15.132:0/3023902698 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ab406cd40 msgr2=0x7f7ab409aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:16.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.090+0000 7f7abbed9640 1 --2- 172.21.15.132:0/3023902698 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ab406cd40 0x7f7ab409aa30 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7aa40097a0 tx=0x7f7aa402b8d0 comp rx=0 tx=0).stop 2024-04-16T15:52:16.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.090+0000 7f7abbed9640 1 -- 172.21.15.132:0/3023902698 shutdown_connections 2024-04-16T15:52:16.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.090+0000 7f7abbed9640 1 --2- 172.21.15.132:0/3023902698 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ab406cd40 0x7f7ab409aa30 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:16.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.090+0000 7f7abbed9640 1 --2- 172.21.15.132:0/3023902698 >> v2:172.21.15.179:3300/0 conn(0x7f7ab415ecc0 0x7f7ab406d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:16.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.090+0000 7f7abbed9640 1 -- 172.21.15.132:0/3023902698 >> 172.21.15.132:0/3023902698 conn(0x7f7ab40b41e0 msgr2=0x7f7ab40b45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:16.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.090+0000 7f7abbed9640 1 -- 172.21.15.132:0/3023902698 shutdown_connections 2024-04-16T15:52:16.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.090+0000 7f7abbed9640 1 -- 172.21.15.132:0/3023902698 wait complete. 2024-04-16T15:52:16.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.091+0000 7f7abbed9640 1 Processor -- start 2024-04-16T15:52:16.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.091+0000 7f7abbed9640 1 -- start start 2024-04-16T15:52:16.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.092+0000 7f7abbed9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ab406cd40 0x7f7ab41f4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:16.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.092+0000 7f7abbed9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ab409af70 0x7f7ab40caf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:16.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.092+0000 7f7abbed9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ab415ecc0 0x7f7ab40c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:16.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.092+0000 7f7abbed9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f7ab40cd460 con 0x7f7ab406cd40 2024-04-16T15:52:16.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.092+0000 7f7abbed9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7ab40cd180 con 0x7f7ab409af70 2024-04-16T15:52:16.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.092+0000 7f7abbed9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f7ab40ce990 con 0x7f7ab415ecc0 2024-04-16T15:52:16.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.092+0000 7f7ab9c75640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ab406cd40 0x7f7ab41f4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:16.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.092+0000 7f7ab9c75640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ab406cd40 0x7f7ab41f4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37314/0 (socket says 172.21.15.132:37314) 2024-04-16T15:52:16.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.092+0000 7f7ab9c75640 1 -- 172.21.15.132:0/4026721526 learned_addr learned my addr 172.21.15.132:0/4026721526 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:16.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.092+0000 7f7ab9474640 1 --2- 172.21.15.132:0/4026721526 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ab409af70 0x7f7ab40caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:16.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.092+0000 7f7aba476640 1 --2- 172.21.15.132:0/4026721526 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ab415ecc0 0x7f7ab40c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:16.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.092+0000 7f7ab9c75640 1 -- 172.21.15.132:0/4026721526 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ab415ecc0 msgr2=0x7f7ab40c89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:16.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.092+0000 7f7ab9c75640 1 --2- 172.21.15.132:0/4026721526 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ab415ecc0 0x7f7ab40c89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:16.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.092+0000 7f7ab9c75640 1 -- 172.21.15.132:0/4026721526 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ab409af70 msgr2=0x7f7ab40caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:16.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.092+0000 7f7ab9c75640 1 --2- 172.21.15.132:0/4026721526 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ab409af70 0x7f7ab40caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:16.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.092+0000 7f7ab9c75640 1 -- 172.21.15.132:0/4026721526 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ab4161c50 con 0x7f7ab406cd40 2024-04-16T15:52:16.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.092+0000 7f7ab9474640 1 --2- 172.21.15.132:0/4026721526 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ab409af70 0x7f7ab40caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:16.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.092+0000 7f7ab9c75640 1 --2- 172.21.15.132:0/4026721526 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ab406cd40 0x7f7ab41f4820 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7ab000ec10 tx=0x7f7ab000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:16.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.092+0000 7f7aaa7fc640 1 -- 172.21.15.132:0/4026721526 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab0017070 con 0x7f7ab406cd40 2024-04-16T15:52:16.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.092+0000 7f7aaa7fc640 1 -- 172.21.15.132:0/4026721526 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ab000cc30 con 0x7f7ab406cd40 2024-04-16T15:52:16.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.092+0000 7f7abbed9640 1 -- 172.21.15.132:0/4026721526 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ab4161f30 con 0x7f7ab406cd40 2024-04-16T15:52:16.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.092+0000 7f7aaa7fc640 1 -- 172.21.15.132:0/4026721526 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab0013470 con 0x7f7ab406cd40 2024-04-16T15:52:16.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.092+0000 7f7abbed9640 1 -- 172.21.15.132:0/4026721526 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ab40ca710 con 0x7f7ab406cd40 2024-04-16T15:52:16.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.093+0000 7f7abbed9640 1 -- 172.21.15.132:0/4026721526 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ab40694f0 con 0x7f7ab406cd40 2024-04-16T15:52:16.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.094+0000 7f7aaa7fc640 1 -- 172.21.15.132:0/4026721526 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7ab001a070 con 0x7f7ab406cd40 2024-04-16T15:52:16.097 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.094+0000 7f7aaa7fc640 1 --2- 172.21.15.132:0/4026721526 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f7a9806c8f0 0x7f7a9806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:16.097 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.094+0000 7f7aaa7fc640 1 -- 172.21.15.132:0/4026721526 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f7ab008bdc0 con 0x7f7ab406cd40 2024-04-16T15:52:16.097 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.094+0000 7f7ab9474640 1 --2- 172.21.15.132:0/4026721526 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f7a9806c8f0 0x7f7a9806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:16.097 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.095+0000 7f7ab9474640 1 --2- 172.21.15.132:0/4026721526 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f7a9806c8f0 0x7f7a9806edb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4036000 tx=0x7f7aa403c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:16.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.099+0000 7f7aaa7fc640 1 -- 172.21.15.132:0/4026721526 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7ab0059ba0 con 0x7f7ab406cd40 2024-04-16T15:52:16.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.277+0000 7f7abbed9640 1 -- 172.21.15.132:0/4026721526 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7ab406d1b0 con 0x7f7ab406cd40 2024-04-16T15:52:16.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.278+0000 7f7aaa7fc640 1 -- 172.21.15.132:0/4026721526 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16618 (secure 0 0 0) 0x7f7ab406d1b0 con 0x7f7ab406cd40 2024-04-16T15:52:16.278 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:52:16.278 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":19,"fsid":"6bdec5d9-f406-43ad-8584-0503b32f6f0d","created":"2024-04-16T15:51:51.073040+0000","modified":"2024-04-16T15:52:15.286193+0000","last_up_change":"2024-04-16T15:52:02.280496+0000","last_in_change":"2024-04-16T15:51:53.376468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:52:03.284927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:52:13.363758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T15:52:14.246647+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d45908b-6e22-4619-b190-897af594b712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6801","nonce":1170594668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6803","nonce":1170594668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6807","nonce":1170594668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6805","nonce":1170594668}]},"public_addr":"172.21.15.132:6801/1170594668","cluster_addr":"172.21.15.132:6803/1170594668","heartbeat_back_addr":"172.21.15.132:6807/1170594668","heartbeat_front_addr":"172.21.15.132:6805/1170594668","state":["exists","up"]},{"osd":1,"uuid":"c88bf082-e51f-4ee6-815a-025f6ce0d67b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6809","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6811","nonce":2494780358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6815","nonce":2494780358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6823","nonce":2494780358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6819","nonce":2494780358}]},"public_addr":"172.21.15.132:6811/2494780358","cluster_addr":"172.21.15.132:6815/2494780358","heartbeat_back_addr":"172.21.15.132:6823/2494780358","heartbeat_front_addr":"172.21.15.132:6819/2494780358","state":["exists","up"]},{"osd":2,"uuid":"e5dbd6b4-4e7b-47e4-ad4e-35b4b81696c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6825","nonce":27655483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6827","nonce":27655483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6831","nonce":27655483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6829","nonce":27655483}]},"public_addr":"172.21.15.132:6825/27655483","cluster_addr":"172.21.15.132:6827/27655483","heartbeat_back_addr":"172.21.15.132:6831/27655483","heartbeat_front_addr":"172.21.15.132:6829/27655483","state":["exists","up"]},{"osd":3,"uuid":"9d75cd67-3b8a-4424-8884-5f3660e1f5f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6810","nonce":3100919191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6814","nonce":3100919191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6821","nonce":3100919191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6818","nonce":3100919191}]},"public_addr":"172.21.15.132:6810/3100919191","cluster_addr":"172.21.15.132:6814/3100919191","heartbeat_back_addr":"172.21.15.132:6821/3100919191","heartbeat_front_addr":"172.21.15.132:6818/3100919191","state":["exists","up"]},{"osd":4,"uuid":"83aea46a-8642-4777-912b-c130e5890da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6825","nonce":123637799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6827","nonce":123637799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6831","nonce":123637799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6829","nonce":123637799}]},"public_addr":"172.21.15.179:6825/123637799","cluster_addr":"172.21.15.179:6827/123637799","heartbeat_back_addr":"172.21.15.179:6831/123637799","heartbeat_front_addr":"172.21.15.179:6829/123637799","state":["exists","up"]},{"osd":5,"uuid":"534117c8-3317-48d6-b436-afd5709f71e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6801","nonce":2224750370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6803","nonce":2224750370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6807","nonce":2224750370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6805","nonce":2224750370}]},"public_addr":"172.21.15.179:6801/2224750370","cluster_addr":"172.21.15.179:6803/2224750370","heartbeat_back_addr":"172.21.15.179:6807/2224750370","heartbeat_front_addr":"172.21.15.179:6805/2224750370","state":["exists","up"]},{"osd":6,"uuid":"0ba363e7-fa9d-42b1-ae09-a6a0f57d41f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6809","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6811","nonce":101498164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6813","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6815","nonce":101498164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6823","nonce":101498164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6819","nonce":101498164}]},"public_addr":"172.21.15.179:6811/101498164","cluster_addr":"172.21.15.179:6815/101498164","heartbeat_back_addr":"172.21.15.179:6823/101498164","heartbeat_front_addr":"172.21.15.179:6819/101498164","state":["exists","up"]},{"osd":7,"uuid":"e6830c77-2f2d-4067-9866-ee7625afc1a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6810","nonce":872148365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6814","nonce":872148365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6822","nonce":872148365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6818","nonce":872148365}]},"public_addr":"172.21.15.179:6810/872148365","cluster_addr":"172.21.15.179:6814/872148365","heartbeat_back_addr":"172.21.15.179:6822/872148365","heartbeat_front_addr":"172.21.15.179:6818/872148365","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.535221+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.563769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.520765+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.526264+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.517058+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.500842+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.534332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.512486+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:52:16.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.280+0000 7f7abbed9640 1 -- 172.21.15.132:0/4026721526 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f7a9806c8f0 msgr2=0x7f7a9806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:16.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.280+0000 7f7abbed9640 1 --2- 172.21.15.132:0/4026721526 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f7a9806c8f0 0x7f7a9806edb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4036000 tx=0x7f7aa403c040 comp rx=0 tx=0).stop 2024-04-16T15:52:16.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.280+0000 7f7abbed9640 1 -- 172.21.15.132:0/4026721526 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ab406cd40 msgr2=0x7f7ab41f4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:16.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.280+0000 7f7abbed9640 1 --2- 172.21.15.132:0/4026721526 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ab406cd40 0x7f7ab41f4820 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7ab000ec10 tx=0x7f7ab000c520 comp rx=0 tx=0).stop 2024-04-16T15:52:16.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.280+0000 7f7abbed9640 1 -- 172.21.15.132:0/4026721526 shutdown_connections 2024-04-16T15:52:16.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.280+0000 7f7abbed9640 1 --2- 172.21.15.132:0/4026721526 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f7a9806c8f0 0x7f7a9806edb0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:16.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.280+0000 7f7abbed9640 1 --2- 172.21.15.132:0/4026721526 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ab415ecc0 0x7f7ab40c89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:16.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.280+0000 7f7abbed9640 1 --2- 172.21.15.132:0/4026721526 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ab409af70 0x7f7ab40caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:16.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.280+0000 7f7abbed9640 1 --2- 172.21.15.132:0/4026721526 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ab406cd40 0x7f7ab41f4820 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:16.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.280+0000 7f7abbed9640 1 -- 172.21.15.132:0/4026721526 >> 172.21.15.132:0/4026721526 conn(0x7f7ab40b41e0 msgr2=0x7f7ab40af750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:16.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.280+0000 7f7abbed9640 1 -- 172.21.15.132:0/4026721526 shutdown_connections 2024-04-16T15:52:16.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.280+0000 7f7abbed9640 1 -- 172.21.15.132:0/4026721526 wait complete. 2024-04-16T15:52:16.291 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:52:16.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.394+0000 7fbe97f0e640 1 Processor -- start 2024-04-16T15:52:16.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.395+0000 7fbe97f0e640 1 -- start start 2024-04-16T15:52:16.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.395+0000 7fbe97f0e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbe9009aa30 0x7fbe9006cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:16.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.396+0000 7fbe97f0e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe900d1fe0 con 0x7fbe9006df50 2024-04-16T15:52:16.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.396+0000 7fbe97f0e640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe900ccee0 con 0x7fbe9015ede0 2024-04-16T15:52:16.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.396+0000 7fbe97f0e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fbe900b1c00 con 0x7fbe9009aa30 2024-04-16T15:52:16.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.396+0000 7fbe95caa640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbe9009aa30 0x7fbe9006cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:16.398 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.396+0000 7fbe964ab640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fbe9006df50 0x7fbe900d0af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56520/0 (socket says 172.21.15.132:56520) 2024-04-16T15:52:16.398 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.396+0000 7fbe964ab640 1 -- 172.21.15.132:0/3292361231 learned_addr learned my addr 172.21.15.132:0/3292361231 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:16.398 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.396+0000 7fbe95caa640 1 -- 172.21.15.132:0/3292361231 >> v1:172.21.15.179:6789/0 conn(0x7fbe9015ede0 legacy=0x7fbe9009ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:16.398 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.396+0000 7fbe95caa640 1 -- 172.21.15.132:0/3292361231 >> v1:172.21.15.132:6789/0 conn(0x7fbe9006df50 legacy=0x7fbe900d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:16.398 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.396+0000 7fbe95caa640 1 -- 172.21.15.132:0/3292361231 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe900cd1c0 con 0x7fbe9009aa30 2024-04-16T15:52:16.398 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.396+0000 7fbe94ca8640 1 -- 172.21.15.132:0/3292361231 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2216521505 0 0) 0x7fbe900d1fe0 con 0x7fbe9006df50 2024-04-16T15:52:16.398 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.397+0000 7fbe95caa640 1 --2- 172.21.15.132:0/3292361231 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbe9009aa30 0x7fbe9006cd40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbe880097a0 tx=0x7fbe8802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ad36e08926dddc7 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:16.398 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.397+0000 7fbe94ca8640 1 -- 172.21.15.132:0/3292361231 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe88034070 con 0x7fbe9009aa30 2024-04-16T15:52:16.398 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.397+0000 7fbe94ca8640 1 -- 172.21.15.132:0/3292361231 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe88030610 con 0x7fbe9009aa30 2024-04-16T15:52:16.398 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.397+0000 7fbe94ca8640 1 -- 172.21.15.132:0/3292361231 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe880309e0 con 0x7fbe9009aa30 2024-04-16T15:52:16.398 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.397+0000 7fbe97f0e640 1 -- 172.21.15.132:0/3292361231 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbe9009aa30 msgr2=0x7fbe9006cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:16.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.397+0000 7fbe97f0e640 1 --2- 172.21.15.132:0/3292361231 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbe9009aa30 0x7fbe9006cd40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbe880097a0 tx=0x7fbe8802b960 comp rx=0 tx=0).stop 2024-04-16T15:52:16.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.397+0000 7fbe97f0e640 1 -- 172.21.15.132:0/3292361231 shutdown_connections 2024-04-16T15:52:16.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.397+0000 7fbe97f0e640 1 --2- 172.21.15.132:0/3292361231 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbe9009aa30 0x7fbe9006cd40 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:16.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.397+0000 7fbe97f0e640 1 -- 172.21.15.132:0/3292361231 >> 172.21.15.132:0/3292361231 conn(0x7fbe900b41e0 msgr2=0x7fbe900b45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:16.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.397+0000 7fbe97f0e640 1 -- 172.21.15.132:0/3292361231 shutdown_connections 2024-04-16T15:52:16.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.397+0000 7fbe97f0e640 1 -- 172.21.15.132:0/3292361231 wait complete. 2024-04-16T15:52:16.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.399+0000 7fbe97f0e640 1 Processor -- start 2024-04-16T15:52:16.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.399+0000 7fbe97f0e640 1 -- start start 2024-04-16T15:52:16.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.399+0000 7fbe97f0e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbe9006df50 0x7fbe90153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:16.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.399+0000 7fbe97f0e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe9009aa30 0x7fbe90153c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:16.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.399+0000 7fbe97f0e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe900cb760 0x7fbe900cbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:16.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.399+0000 7fbe97f0e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fbe900d1200 con 0x7fbe9006df50 2024-04-16T15:52:16.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.399+0000 7fbe97f0e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fbe900cd530 con 0x7fbe900cb760 2024-04-16T15:52:16.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.399+0000 7fbe97f0e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fbe900d1380 con 0x7fbe9009aa30 2024-04-16T15:52:16.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.399+0000 7fbe95caa640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbe9006df50 0x7fbe90153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:16.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.399+0000 7fbe95caa640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbe9006df50 0x7fbe90153520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37326/0 (socket says 172.21.15.132:37326) 2024-04-16T15:52:16.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.399+0000 7fbe95caa640 1 -- 172.21.15.132:0/854937695 learned_addr learned my addr 172.21.15.132:0/854937695 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:16.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.400+0000 7fbe964ab640 1 --2- 172.21.15.132:0/854937695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe900cb760 0x7fbe900cbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:16.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.400+0000 7fbe954a9640 1 --2- 172.21.15.132:0/854937695 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe9009aa30 0x7fbe90153c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:16.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.400+0000 7fbe95caa640 1 -- 172.21.15.132:0/854937695 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe9009aa30 msgr2=0x7fbe90153c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:16.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.400+0000 7fbe95caa640 1 --2- 172.21.15.132:0/854937695 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe9009aa30 0x7fbe90153c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:16.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.400+0000 7fbe95caa640 1 -- 172.21.15.132:0/854937695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe900cb760 msgr2=0x7fbe900cbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:16.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.400+0000 7fbe95caa640 1 --2- 172.21.15.132:0/854937695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe900cb760 0x7fbe900cbbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:16.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.400+0000 7fbe95caa640 1 -- 172.21.15.132:0/854937695 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe900c9a10 con 0x7fbe9006df50 2024-04-16T15:52:16.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.400+0000 7fbe954a9640 1 --2- 172.21.15.132:0/854937695 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe9009aa30 0x7fbe90153c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:52:16.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.400+0000 7fbe95caa640 1 --2- 172.21.15.132:0/854937695 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbe9006df50 0x7fbe90153520 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbe880098c0 tx=0x7fbe880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:16.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.400+0000 7fbe8e7fc640 1 -- 172.21.15.132:0/854937695 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe88034040 con 0x7fbe9006df50 2024-04-16T15:52:16.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.400+0000 7fbe8e7fc640 1 -- 172.21.15.132:0/854937695 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe88039a10 con 0x7fbe9006df50 2024-04-16T15:52:16.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.400+0000 7fbe97f0e640 1 -- 172.21.15.132:0/854937695 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe900c9cf0 con 0x7fbe9006df50 2024-04-16T15:52:16.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.400+0000 7fbe8e7fc640 1 -- 172.21.15.132:0/854937695 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe88039de0 con 0x7fbe9006df50 2024-04-16T15:52:16.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.400+0000 7fbe97f0e640 1 -- 172.21.15.132:0/854937695 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe90154160 con 0x7fbe9006df50 2024-04-16T15:52:16.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.401+0000 7fbe97f0e640 1 -- 172.21.15.132:0/854937695 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe900c97a0 con 0x7fbe9006df50 2024-04-16T15:52:16.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.402+0000 7fbe8e7fc640 1 -- 172.21.15.132:0/854937695 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbe88037070 con 0x7fbe9006df50 2024-04-16T15:52:16.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.402+0000 7fbe8e7fc640 1 --2- 172.21.15.132:0/854937695 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fbe7c06c8f0 0x7fbe7c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:16.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.402+0000 7fbe8e7fc640 1 -- 172.21.15.132:0/854937695 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7fbe880adc30 con 0x7fbe9006df50 2024-04-16T15:52:16.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.402+0000 7fbe954a9640 1 --2- 172.21.15.132:0/854937695 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fbe7c06c8f0 0x7fbe7c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:16.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.402+0000 7fbe954a9640 1 --2- 172.21.15.132:0/854937695 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fbe7c06c8f0 0x7fbe7c06edb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbe900cc610 tx=0x7fbe84009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:16.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.406+0000 7fbe8e7fc640 1 -- 172.21.15.132:0/854937695 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbe8807c0f0 con 0x7fbe9006df50 2024-04-16T15:52:16.584 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.585+0000 7fbe97f0e640 1 -- 172.21.15.132:0/854937695 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbe90075510 con 0x7fbe9006df50 2024-04-16T15:52:16.584 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.586+0000 7fbe8e7fc640 1 -- 172.21.15.132:0/854937695 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16618 (secure 0 0 0) 0x7fbe8807b9f0 con 0x7fbe9006df50 2024-04-16T15:52:16.585 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:52:16.585 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":19,"fsid":"6bdec5d9-f406-43ad-8584-0503b32f6f0d","created":"2024-04-16T15:51:51.073040+0000","modified":"2024-04-16T15:52:15.286193+0000","last_up_change":"2024-04-16T15:52:02.280496+0000","last_in_change":"2024-04-16T15:51:53.376468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:52:03.284927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:52:13.363758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T15:52:14.246647+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d45908b-6e22-4619-b190-897af594b712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6801","nonce":1170594668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6803","nonce":1170594668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6807","nonce":1170594668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6805","nonce":1170594668}]},"public_addr":"172.21.15.132:6801/1170594668","cluster_addr":"172.21.15.132:6803/1170594668","heartbeat_back_addr":"172.21.15.132:6807/1170594668","heartbeat_front_addr":"172.21.15.132:6805/1170594668","state":["exists","up"]},{"osd":1,"uuid":"c88bf082-e51f-4ee6-815a-025f6ce0d67b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6809","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6811","nonce":2494780358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6815","nonce":2494780358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6823","nonce":2494780358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6819","nonce":2494780358}]},"public_addr":"172.21.15.132:6811/2494780358","cluster_addr":"172.21.15.132:6815/2494780358","heartbeat_back_addr":"172.21.15.132:6823/2494780358","heartbeat_front_addr":"172.21.15.132:6819/2494780358","state":["exists","up"]},{"osd":2,"uuid":"e5dbd6b4-4e7b-47e4-ad4e-35b4b81696c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6825","nonce":27655483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6827","nonce":27655483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6831","nonce":27655483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6829","nonce":27655483}]},"public_addr":"172.21.15.132:6825/27655483","cluster_addr":"172.21.15.132:6827/27655483","heartbeat_back_addr":"172.21.15.132:6831/27655483","heartbeat_front_addr":"172.21.15.132:6829/27655483","state":["exists","up"]},{"osd":3,"uuid":"9d75cd67-3b8a-4424-8884-5f3660e1f5f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6810","nonce":3100919191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6814","nonce":3100919191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6821","nonce":3100919191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6818","nonce":3100919191}]},"public_addr":"172.21.15.132:6810/3100919191","cluster_addr":"172.21.15.132:6814/3100919191","heartbeat_back_addr":"172.21.15.132:6821/3100919191","heartbeat_front_addr":"172.21.15.132:6818/3100919191","state":["exists","up"]},{"osd":4,"uuid":"83aea46a-8642-4777-912b-c130e5890da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6825","nonce":123637799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6827","nonce":123637799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6831","nonce":123637799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6829","nonce":123637799}]},"public_addr":"172.21.15.179:6825/123637799","cluster_addr":"172.21.15.179:6827/123637799","heartbeat_back_addr":"172.21.15.179:6831/123637799","heartbeat_front_addr":"172.21.15.179:6829/123637799","state":["exists","up"]},{"osd":5,"uuid":"534117c8-3317-48d6-b436-afd5709f71e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6801","nonce":2224750370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6803","nonce":2224750370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6807","nonce":2224750370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6805","nonce":2224750370}]},"public_addr":"172.21.15.179:6801/2224750370","cluster_addr":"172.21.15.179:6803/2224750370","heartbeat_back_addr":"172.21.15.179:6807/2224750370","heartbeat_front_addr":"172.21.15.179:6805/2224750370","state":["exists","up"]},{"osd":6,"uuid":"0ba363e7-fa9d-42b1-ae09-a6a0f57d41f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6809","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6811","nonce":101498164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6813","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6815","nonce":101498164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6823","nonce":101498164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6819","nonce":101498164}]},"public_addr":"172.21.15.179:6811/101498164","cluster_addr":"172.21.15.179:6815/101498164","heartbeat_back_addr":"172.21.15.179:6823/101498164","heartbeat_front_addr":"172.21.15.179:6819/101498164","state":["exists","up"]},{"osd":7,"uuid":"e6830c77-2f2d-4067-9866-ee7625afc1a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6810","nonce":872148365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6814","nonce":872148365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6822","nonce":872148365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6818","nonce":872148365}]},"public_addr":"172.21.15.179:6810/872148365","cluster_addr":"172.21.15.179:6814/872148365","heartbeat_back_addr":"172.21.15.179:6822/872148365","heartbeat_front_addr":"172.21.15.179:6818/872148365","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.535221+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.563769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.520765+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.526264+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.517058+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.500842+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.534332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.512486+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:52:16.587 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.588+0000 7fbe97f0e640 1 -- 172.21.15.132:0/854937695 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fbe7c06c8f0 msgr2=0x7fbe7c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:16.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.588+0000 7fbe97f0e640 1 --2- 172.21.15.132:0/854937695 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fbe7c06c8f0 0x7fbe7c06edb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbe900cc610 tx=0x7fbe84009040 comp rx=0 tx=0).stop 2024-04-16T15:52:16.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.588+0000 7fbe97f0e640 1 -- 172.21.15.132:0/854937695 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbe9006df50 msgr2=0x7fbe90153520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:16.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.588+0000 7fbe97f0e640 1 --2- 172.21.15.132:0/854937695 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbe9006df50 0x7fbe90153520 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbe880098c0 tx=0x7fbe880046c0 comp rx=0 tx=0).stop 2024-04-16T15:52:16.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.588+0000 7fbe97f0e640 1 -- 172.21.15.132:0/854937695 shutdown_connections 2024-04-16T15:52:16.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.588+0000 7fbe97f0e640 1 --2- 172.21.15.132:0/854937695 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fbe7c06c8f0 0x7fbe7c06edb0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:16.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.588+0000 7fbe97f0e640 1 --2- 172.21.15.132:0/854937695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe900cb760 0x7fbe900cbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:16.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.588+0000 7fbe97f0e640 1 --2- 172.21.15.132:0/854937695 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe9009aa30 0x7fbe90153c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:16.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.588+0000 7fbe97f0e640 1 --2- 172.21.15.132:0/854937695 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbe9006df50 0x7fbe90153520 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:16.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.588+0000 7fbe97f0e640 1 -- 172.21.15.132:0/854937695 >> 172.21.15.132:0/854937695 conn(0x7fbe900b41e0 msgr2=0x7fbe90071410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:16.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.588+0000 7fbe97f0e640 1 -- 172.21.15.132:0/854937695 shutdown_connections 2024-04-16T15:52:16.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.588+0000 7fbe97f0e640 1 -- 172.21.15.132:0/854937695 wait complete. 2024-04-16T15:52:16.599 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-16T15:52:16.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.706+0000 7f654be63640 1 Processor -- start 2024-04-16T15:52:16.706 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.706+0000 7f654be63640 1 -- start start 2024-04-16T15:52:16.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.707+0000 7f654be63640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f654415ea80 0x7f65440b3540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:16.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.707+0000 7f654be63640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f65440727e0 0x7f6544072c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:16.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.707+0000 7f654be63640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65440b3e40 con 0x7f654415ad10 2024-04-16T15:52:16.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.707+0000 7f654be63640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f65440b4120 con 0x7f65440727e0 2024-04-16T15:52:16.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.707+0000 7f654be63640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f65440b4400 con 0x7f654415ea80 2024-04-16T15:52:16.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.707+0000 7f6549bff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f654415ad10 0x7f65440b4ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56526/0 (socket says 172.21.15.132:56526) 2024-04-16T15:52:16.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.707+0000 7f6549bff640 1 -- 172.21.15.132:0/1429653235 learned_addr learned my addr 172.21.15.132:0/1429653235 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:16.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.708+0000 7f6548bfd640 1 -- 172.21.15.132:0/1429653235 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3990229506 0 0) 0x7f65440b3e40 con 0x7f654415ad10 2024-04-16T15:52:16.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.708+0000 7f65493fe640 1 --2- 172.21.15.132:0/1429653235 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f654415ea80 0x7f65440b3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:16.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.708+0000 7f654a400640 1 --2- 172.21.15.132:0/1429653235 >> v2:172.21.15.179:3300/0 conn(0x7f65440727e0 0x7f6544072c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:16.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.708+0000 7f6548bfd640 1 -- 172.21.15.132:0/1429653235 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6530003520 con 0x7f654415ad10 2024-04-16T15:52:16.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.708+0000 7f6548bfd640 1 -- 172.21.15.132:0/1429653235 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4184544707 0 0) 0x7f6530003520 con 0x7f654415ad10 2024-04-16T15:52:16.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.708+0000 7f6548bfd640 1 -- 172.21.15.132:0/1429653235 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f654415ea80 msgr2=0x7f65440b3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:16.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.708+0000 7f6548bfd640 1 --2- 172.21.15.132:0/1429653235 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f654415ea80 0x7f65440b3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:16.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.708+0000 7f6548bfd640 1 -- 172.21.15.132:0/1429653235 >> v2:172.21.15.179:3300/0 conn(0x7f65440727e0 msgr2=0x7f6544072c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:16.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.708+0000 7f6548bfd640 1 --2- 172.21.15.132:0/1429653235 >> v2:172.21.15.179:3300/0 conn(0x7f65440727e0 0x7f6544072c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:16.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.708+0000 7f6548bfd640 1 -- 172.21.15.132:0/1429653235 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65440b46e0 con 0x7f654415ad10 2024-04-16T15:52:16.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.708+0000 7f6548bfd640 1 -- 172.21.15.132:0/1429653235 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2803668828 0 0) 0x7f6540001670 con 0x7f654415ad10 2024-04-16T15:52:16.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.708+0000 7f6548bfd640 1 -- 172.21.15.132:0/1429653235 >> v1:172.21.15.132:6789/0 conn(0x7f654415ad10 legacy=0x7f65440b4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:16.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.708+0000 7f6548bfd640 1 --2- 172.21.15.132:0/1429653235 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f654415ea80 0x7f65300039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:16.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.708+0000 7f6548bfd640 1 --2- 172.21.15.132:0/1429653235 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6530003f30 0x7f6530004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:16.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.708+0000 7f6548bfd640 1 --2- 172.21.15.132:0/1429653235 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6530004d40 0x7f65300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:16.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.708+0000 7f6548bfd640 1 -- 172.21.15.132:0/1429653235 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f65440b4120 con 0x7f6530004d40 2024-04-16T15:52:16.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.708+0000 7f6548bfd640 1 -- 172.21.15.132:0/1429653235 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f65440b4400 con 0x7f6530003f30 2024-04-16T15:52:16.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.708+0000 7f6548bfd640 1 -- 172.21.15.132:0/1429653235 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f653000b9c0 con 0x7f654415ea80 2024-04-16T15:52:16.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.708+0000 7f654a400640 1 --2- 172.21.15.132:0/1429653235 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6530004d40 0x7f65300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:16.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.708+0000 7f6549bff640 1 --2- 172.21.15.132:0/1429653235 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f654415ea80 0x7f65300039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:16.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.708+0000 7f65493fe640 1 --2- 172.21.15.132:0/1429653235 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6530003f30 0x7f6530004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:16.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.708+0000 7f654a400640 1 -- 172.21.15.132:0/1429653235 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f654415ea80 msgr2=0x7f65300039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:16.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.708+0000 7f654a400640 1 --2- 172.21.15.132:0/1429653235 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f654415ea80 0x7f65300039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:16.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.708+0000 7f654a400640 1 -- 172.21.15.132:0/1429653235 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6530003f30 msgr2=0x7f6530004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:16.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.708+0000 7f654a400640 1 --2- 172.21.15.132:0/1429653235 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6530003f30 0x7f6530004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:16.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.708+0000 7f654a400640 1 -- 172.21.15.132:0/1429653235 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6530003520 con 0x7f6530004d40 2024-04-16T15:52:16.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.709+0000 7f654a400640 1 --2- 172.21.15.132:0/1429653235 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6530004d40 0x7f65300051c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f653c010290 tx=0x7f6530005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6edfa3167d1b61fa server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:16.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.709+0000 7f6548bfd640 1 -- 172.21.15.132:0/1429653235 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f653c03a070 con 0x7f6530004d40 2024-04-16T15:52:16.718 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.709+0000 7f6548bfd640 1 -- 172.21.15.132:0/1429653235 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f653c02de10 con 0x7f6530004d40 2024-04-16T15:52:16.718 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.709+0000 7f6548bfd640 1 -- 172.21.15.132:0/1429653235 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f653c009d60 con 0x7f6530004d40 2024-04-16T15:52:16.718 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.710+0000 7f654be63640 1 -- 172.21.15.132:0/1429653235 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6530004d40 msgr2=0x7f65300051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:16.718 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.710+0000 7f654be63640 1 --2- 172.21.15.132:0/1429653235 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6530004d40 0x7f65300051c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f653c010290 tx=0x7f6530005830 comp rx=0 tx=0).stop 2024-04-16T15:52:16.718 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.710+0000 7f654a400640 1 -- 172.21.15.132:0/1429653235 reap_dead start 2024-04-16T15:52:16.718 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.710+0000 7f654be63640 1 -- 172.21.15.132:0/1429653235 shutdown_connections 2024-04-16T15:52:16.718 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.710+0000 7f654be63640 1 -- 172.21.15.132:0/1429653235 >> 172.21.15.132:0/1429653235 conn(0x7f65440d0490 msgr2=0x7f65440d08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:16.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.710+0000 7f654be63640 1 -- 172.21.15.132:0/1429653235 shutdown_connections 2024-04-16T15:52:16.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.710+0000 7f654be63640 1 -- 172.21.15.132:0/1429653235 wait complete. 2024-04-16T15:52:16.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.711+0000 7f654be63640 1 Processor -- start 2024-04-16T15:52:16.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.711+0000 7f654be63640 1 -- start start 2024-04-16T15:52:16.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.712+0000 7f654be63640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6530004d40 0x7f654414fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:16.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.712+0000 7f654be63640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65440ab300 0x7f65440c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:16.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.712+0000 7f654be63640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65440c6c00 0x7f654415c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:16.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.712+0000 7f654be63640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f654415b270 con 0x7f6530004d40 2024-04-16T15:52:16.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.712+0000 7f654be63640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f654415b0f0 con 0x7f65440c6c00 2024-04-16T15:52:16.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.712+0000 7f654be63640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f65440b3540 con 0x7f65440ab300 2024-04-16T15:52:16.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.712+0000 7f6549bff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6530004d40 0x7f654414fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:16.720 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.712+0000 7f6549bff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6530004d40 0x7f654414fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37340/0 (socket says 172.21.15.132:37340) 2024-04-16T15:52:16.720 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.712+0000 7f6549bff640 1 -- 172.21.15.132:0/1606609639 learned_addr learned my addr 172.21.15.132:0/1606609639 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:16.720 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.712+0000 7f6549bff640 1 -- 172.21.15.132:0/1606609639 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65440ab300 msgr2=0x7f65440c66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:16.720 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.712+0000 7f6549bff640 1 --2- 172.21.15.132:0/1606609639 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65440ab300 0x7f65440c66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:16.720 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.712+0000 7f6549bff640 1 -- 172.21.15.132:0/1606609639 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65440c6c00 msgr2=0x7f654415c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:16.720 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.712+0000 7f6549bff640 1 --2- 172.21.15.132:0/1606609639 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65440c6c00 0x7f654415c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:16.720 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.712+0000 7f6549bff640 1 -- 172.21.15.132:0/1606609639 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65440aa260 con 0x7f6530004d40 2024-04-16T15:52:16.720 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.712+0000 7f6549bff640 1 --2- 172.21.15.132:0/1606609639 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6530004d40 0x7f654414fe60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6540007340 tx=0x7f6540007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:16.720 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.712+0000 7f653a7fc640 1 -- 172.21.15.132:0/1606609639 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f654000f980 con 0x7f6530004d40 2024-04-16T15:52:16.720 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.712+0000 7f653a7fc640 1 -- 172.21.15.132:0/1606609639 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6540018070 con 0x7f6530004d40 2024-04-16T15:52:16.720 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.713+0000 7f654be63640 1 -- 172.21.15.132:0/1606609639 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65440aa540 con 0x7f6530004d40 2024-04-16T15:52:16.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.713+0000 7f653a7fc640 1 -- 172.21.15.132:0/1606609639 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f654000fd60 con 0x7f6530004d40 2024-04-16T15:52:16.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.713+0000 7f654be63640 1 -- 172.21.15.132:0/1606609639 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65440aade0 con 0x7f6530004d40 2024-04-16T15:52:16.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.714+0000 7f654be63640 1 -- 172.21.15.132:0/1606609639 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65440aafe0 con 0x7f6530004d40 2024-04-16T15:52:16.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.714+0000 7f653a7fc640 1 -- 172.21.15.132:0/1606609639 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f654001d460 con 0x7f6530004d40 2024-04-16T15:52:16.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.714+0000 7f653a7fc640 1 --2- 172.21.15.132:0/1606609639 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f652806c8f0 0x7f652806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:16.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.715+0000 7f653a7fc640 1 -- 172.21.15.132:0/1606609639 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f654008bce0 con 0x7f6530004d40 2024-04-16T15:52:16.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.715+0000 7f65493fe640 1 --2- 172.21.15.132:0/1606609639 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f652806c8f0 0x7f652806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:16.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.715+0000 7f65493fe640 1 --2- 172.21.15.132:0/1606609639 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f652806c8f0 0x7f652806edb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f65440b15c0 tx=0x7f6534008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:16.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.719+0000 7f653a7fc640 1 -- 172.21.15.132:0/1606609639 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f654005a110 con 0x7f6530004d40 2024-04-16T15:52:16.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.930+0000 7f654be63640 1 -- 172.21.15.132:0/1606609639 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f6544075510 con 0x7f6530004d40 2024-04-16T15:52:16.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.957+0000 7f653a7fc640 1 -- 172.21.15.132:0/1606609639 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) ==== 118+0+0 (secure 0 0 0) 0x7f6540059a10 con 0x7f6530004d40 2024-04-16T15:52:16.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.959+0000 7f654be63640 1 -- 172.21.15.132:0/1606609639 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f652806c8f0 msgr2=0x7f652806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:16.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.959+0000 7f654be63640 1 --2- 172.21.15.132:0/1606609639 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f652806c8f0 0x7f652806edb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f65440b15c0 tx=0x7f6534008040 comp rx=0 tx=0).stop 2024-04-16T15:52:16.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.959+0000 7f654be63640 1 -- 172.21.15.132:0/1606609639 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6530004d40 msgr2=0x7f654414fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:16.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.959+0000 7f654be63640 1 --2- 172.21.15.132:0/1606609639 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6530004d40 0x7f654414fe60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6540007340 tx=0x7f6540007800 comp rx=0 tx=0).stop 2024-04-16T15:52:16.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.959+0000 7f654be63640 1 -- 172.21.15.132:0/1606609639 shutdown_connections 2024-04-16T15:52:16.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.959+0000 7f654be63640 1 --2- 172.21.15.132:0/1606609639 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f652806c8f0 0x7f652806edb0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:16.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.959+0000 7f654be63640 1 --2- 172.21.15.132:0/1606609639 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65440c6c00 0x7f654415c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:16.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.959+0000 7f654be63640 1 --2- 172.21.15.132:0/1606609639 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65440ab300 0x7f65440c66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:16.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.959+0000 7f654be63640 1 --2- 172.21.15.132:0/1606609639 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6530004d40 0x7f654414fe60 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:16.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.959+0000 7f654be63640 1 -- 172.21.15.132:0/1606609639 >> 172.21.15.132:0/1606609639 conn(0x7f65440d0490 msgr2=0x7f6544071e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:16.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.960+0000 7f654be63640 1 -- 172.21.15.132:0/1606609639 shutdown_connections 2024-04-16T15:52:16.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:16.960+0000 7f654be63640 1 -- 172.21.15.132:0/1606609639 wait complete. 2024-04-16T15:52:16.970 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-16T15:52:16.970 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-16T15:52:17.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.077+0000 7fb890dc8640 1 Processor -- start 2024-04-16T15:52:17.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.077+0000 7fb890dc8640 1 -- start start 2024-04-16T15:52:17.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.078+0000 7fb890dc8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb88c0d1920 0x7fb88c0d1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:17.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.078+0000 7fb890dc8640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb88c0b7bb0 0x7fb88c0b8040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:17.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.078+0000 7fb890dc8640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb88c0d3850 con 0x7fb88c15ec20 2024-04-16T15:52:17.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.078+0000 7fb890dc8640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fb88c0d22c0 con 0x7fb88c0b7bb0 2024-04-16T15:52:17.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.078+0000 7fb890dc8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb88c0d3b30 con 0x7fb88c0d1920 2024-04-16T15:52:17.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.078+0000 7fb88a59c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fb88c15ec20 0x7fb88c0d2e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56528/0 (socket says 172.21.15.132:56528) 2024-04-16T15:52:17.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.078+0000 7fb88a59c640 1 -- 172.21.15.132:0/116450029 learned_addr learned my addr 172.21.15.132:0/116450029 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:17.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.079+0000 7fb889d9b640 1 --2- 172.21.15.132:0/116450029 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb88c0d1920 0x7fb88c0d1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:17.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.079+0000 7fb88959a640 1 -- 172.21.15.132:0/116450029 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3483934416 0 0) 0x7fb88c0d3850 con 0x7fb88c15ec20 2024-04-16T15:52:17.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.079+0000 7fb88959a640 1 -- 172.21.15.132:0/116450029 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb874003520 con 0x7fb88c15ec20 2024-04-16T15:52:17.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.079+0000 7fb88ad9d640 1 --2- 172.21.15.132:0/116450029 >> v2:172.21.15.179:3300/0 conn(0x7fb88c0b7bb0 0x7fb88c0b8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:17.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.079+0000 7fb88959a640 1 -- 172.21.15.132:0/116450029 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 612164000 0 0) 0x7fb874003520 con 0x7fb88c15ec20 2024-04-16T15:52:17.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.079+0000 7fb88959a640 1 -- 172.21.15.132:0/116450029 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb88c0d1920 msgr2=0x7fb88c0d1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:17.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.079+0000 7fb88959a640 1 --2- 172.21.15.132:0/116450029 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb88c0d1920 0x7fb88c0d1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:17.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.079+0000 7fb88959a640 1 -- 172.21.15.132:0/116450029 >> v2:172.21.15.179:3300/0 conn(0x7fb88c0b7bb0 msgr2=0x7fb88c0b8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:17.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.079+0000 7fb88959a640 1 --2- 172.21.15.132:0/116450029 >> v2:172.21.15.179:3300/0 conn(0x7fb88c0b7bb0 0x7fb88c0b8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:17.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.079+0000 7fb88959a640 1 -- 172.21.15.132:0/116450029 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb88c0d3e10 con 0x7fb88c15ec20 2024-04-16T15:52:17.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.079+0000 7fb88959a640 1 -- 172.21.15.132:0/116450029 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2803668828 0 0) 0x7fb87c001670 con 0x7fb88c15ec20 2024-04-16T15:52:17.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.079+0000 7fb88959a640 1 -- 172.21.15.132:0/116450029 >> v1:172.21.15.132:6789/0 conn(0x7fb88c15ec20 legacy=0x7fb88c0d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:17.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.079+0000 7fb88959a640 1 --2- 172.21.15.132:0/116450029 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb88c0d1920 0x7fb8740039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:17.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.079+0000 7fb88959a640 1 --2- 172.21.15.132:0/116450029 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb874003f30 0x7fb874004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:17.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.079+0000 7fb88959a640 1 --2- 172.21.15.132:0/116450029 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb874004d40 0x7fb8740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:17.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.079+0000 7fb88959a640 1 -- 172.21.15.132:0/116450029 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fb88c0d3b30 con 0x7fb874003f30 2024-04-16T15:52:17.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.079+0000 7fb88959a640 1 -- 172.21.15.132:0/116450029 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb87400b9c0 con 0x7fb874004d40 2024-04-16T15:52:17.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.079+0000 7fb88959a640 1 -- 172.21.15.132:0/116450029 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb87400bb70 con 0x7fb88c0d1920 2024-04-16T15:52:17.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.079+0000 7fb889d9b640 1 --2- 172.21.15.132:0/116450029 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb874003f30 0x7fb874004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:17.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.079+0000 7fb88a59c640 1 --2- 172.21.15.132:0/116450029 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb88c0d1920 0x7fb8740039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:17.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.079+0000 7fb88ad9d640 1 --2- 172.21.15.132:0/116450029 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb874004d40 0x7fb8740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:17.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.079+0000 7fb889d9b640 1 -- 172.21.15.132:0/116450029 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb88c0d1920 msgr2=0x7fb8740039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:17.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.079+0000 7fb889d9b640 1 --2- 172.21.15.132:0/116450029 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb88c0d1920 0x7fb8740039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:17.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.079+0000 7fb889d9b640 1 -- 172.21.15.132:0/116450029 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb874004d40 msgr2=0x7fb8740051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:17.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.079+0000 7fb889d9b640 1 --2- 172.21.15.132:0/116450029 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb874004d40 0x7fb8740051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:17.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.079+0000 7fb889d9b640 1 -- 172.21.15.132:0/116450029 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb874003520 con 0x7fb874003f30 2024-04-16T15:52:17.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.079+0000 7fb88a59c640 1 --2- 172.21.15.132:0/116450029 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb88c0d1920 0x7fb8740039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:17.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.079+0000 7fb88ad9d640 1 --2- 172.21.15.132:0/116450029 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb874004d40 0x7fb8740051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:17.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.080+0000 7fb889d9b640 1 --2- 172.21.15.132:0/116450029 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb874003f30 0x7fb874004800 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb880009ac0 tx=0x7fb874005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73b100e504a171d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:17.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.080+0000 7fb88959a640 1 -- 172.21.15.132:0/116450029 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb880039070 con 0x7fb874003f30 2024-04-16T15:52:17.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.080+0000 7fb88959a640 1 -- 172.21.15.132:0/116450029 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb88002c6b0 con 0x7fb874003f30 2024-04-16T15:52:17.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.080+0000 7fb88959a640 1 -- 172.21.15.132:0/116450029 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb880009690 con 0x7fb874003f30 2024-04-16T15:52:17.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.081+0000 7fb890dc8640 1 -- 172.21.15.132:0/116450029 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb874003f30 msgr2=0x7fb874004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:17.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.081+0000 7fb890dc8640 1 --2- 172.21.15.132:0/116450029 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb874003f30 0x7fb874004800 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb880009ac0 tx=0x7fb874005830 comp rx=0 tx=0).stop 2024-04-16T15:52:17.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.081+0000 7fb88ad9d640 1 -- 172.21.15.132:0/116450029 reap_dead start 2024-04-16T15:52:17.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.081+0000 7fb890dc8640 1 -- 172.21.15.132:0/116450029 shutdown_connections 2024-04-16T15:52:17.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.081+0000 7fb890dc8640 1 -- 172.21.15.132:0/116450029 >> 172.21.15.132:0/116450029 conn(0x7fb88c06d2d0 msgr2=0x7fb88c06d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:17.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.081+0000 7fb890dc8640 1 -- 172.21.15.132:0/116450029 shutdown_connections 2024-04-16T15:52:17.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.081+0000 7fb890dc8640 1 -- 172.21.15.132:0/116450029 wait complete. 2024-04-16T15:52:17.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.082+0000 7fb890dc8640 1 Processor -- start 2024-04-16T15:52:17.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.082+0000 7fb890dc8640 1 -- start start 2024-04-16T15:52:17.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.083+0000 7fb890dc8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb874003f30 0x7fb88c15ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:17.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.083+0000 7fb890dc8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb88c161720 0x7fb88c14c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:17.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.083+0000 7fb890dc8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb88c0ab2d0 0x7fb88c0ab780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:17.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.083+0000 7fb890dc8640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fb88c0d3510 con 0x7fb88c161720 2024-04-16T15:52:17.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.083+0000 7fb890dc8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb88c0d43d0 con 0x7fb874003f30 2024-04-16T15:52:17.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.083+0000 7fb890dc8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb88c15f000 con 0x7fb88c0ab2d0 2024-04-16T15:52:17.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.083+0000 7fb889d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb88c161720 0x7fb88c14c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:17.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.083+0000 7fb889d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb88c161720 0x7fb88c14c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37356/0 (socket says 172.21.15.132:37356) 2024-04-16T15:52:17.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.083+0000 7fb889d9b640 1 -- 172.21.15.132:0/3399597192 learned_addr learned my addr 172.21.15.132:0/3399597192 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:17.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.083+0000 7fb88ad9d640 1 --2- 172.21.15.132:0/3399597192 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb88c0ab2d0 0x7fb88c0ab780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:17.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.083+0000 7fb88a59c640 1 --2- 172.21.15.132:0/3399597192 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb874003f30 0x7fb88c15ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:17.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.083+0000 7fb889d9b640 1 -- 172.21.15.132:0/3399597192 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb88c0ab2d0 msgr2=0x7fb88c0ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:17.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.083+0000 7fb889d9b640 1 --2- 172.21.15.132:0/3399597192 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb88c0ab2d0 0x7fb88c0ab780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:17.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.083+0000 7fb889d9b640 1 -- 172.21.15.132:0/3399597192 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb874003f30 msgr2=0x7fb88c15ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:17.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.083+0000 7fb889d9b640 1 --2- 172.21.15.132:0/3399597192 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb874003f30 0x7fb88c15ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:17.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.083+0000 7fb889d9b640 1 -- 172.21.15.132:0/3399597192 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb88c14db00 con 0x7fb88c161720 2024-04-16T15:52:17.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.083+0000 7fb889d9b640 1 --2- 172.21.15.132:0/3399597192 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb88c161720 0x7fb88c14c6c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb880000c00 tx=0x7fb880004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:17.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.083+0000 7fb87affd640 1 -- 172.21.15.132:0/3399597192 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb880042020 con 0x7fb88c161720 2024-04-16T15:52:17.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.083+0000 7fb87affd640 1 -- 172.21.15.132:0/3399597192 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb88003a040 con 0x7fb88c161720 2024-04-16T15:52:17.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.083+0000 7fb890dc8640 1 -- 172.21.15.132:0/3399597192 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb88c14cf80 con 0x7fb88c161720 2024-04-16T15:52:17.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.083+0000 7fb87affd640 1 -- 172.21.15.132:0/3399597192 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb880039070 con 0x7fb88c161720 2024-04-16T15:52:17.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.084+0000 7fb890dc8640 1 -- 172.21.15.132:0/3399597192 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb88c14d540 con 0x7fb88c161720 2024-04-16T15:52:17.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.084+0000 7fb890dc8640 1 -- 172.21.15.132:0/3399597192 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb88c0caed0 con 0x7fb88c161720 2024-04-16T15:52:17.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.085+0000 7fb87affd640 1 -- 172.21.15.132:0/3399597192 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb880045020 con 0x7fb88c161720 2024-04-16T15:52:17.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.085+0000 7fb87affd640 1 --2- 172.21.15.132:0/3399597192 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fb86c06c8f0 0x7fb86c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:17.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.085+0000 7fb87affd640 1 -- 172.21.15.132:0/3399597192 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb8800ace90 con 0x7fb88c161720 2024-04-16T15:52:17.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.085+0000 7fb88a59c640 1 --2- 172.21.15.132:0/3399597192 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fb86c06c8f0 0x7fb86c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:17.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.086+0000 7fb88a59c640 1 --2- 172.21.15.132:0/3399597192 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fb86c06c8f0 0x7fb86c06edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb88c075470 tx=0x7fb87c007040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:17.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.090+0000 7fb87affd640 1 -- 172.21.15.132:0/3399597192 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb88004c070 con 0x7fb88c161720 2024-04-16T15:52:17.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.304+0000 7fb890dc8640 1 -- 172.21.15.132:0/3399597192 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fb88c15f640 con 0x7fb88c161720 2024-04-16T15:52:17.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.962+0000 7fb87affd640 1 -- 172.21.15.132:0/3399597192 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) ==== 122+0+0 (secure 0 0 0) 0x7fb88007ac70 con 0x7fb88c161720 2024-04-16T15:52:17.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.965+0000 7fb890dc8640 1 -- 172.21.15.132:0/3399597192 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fb86c06c8f0 msgr2=0x7fb86c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:17.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.965+0000 7fb890dc8640 1 --2- 172.21.15.132:0/3399597192 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fb86c06c8f0 0x7fb86c06edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb88c075470 tx=0x7fb87c007040 comp rx=0 tx=0).stop 2024-04-16T15:52:17.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.965+0000 7fb890dc8640 1 -- 172.21.15.132:0/3399597192 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb88c161720 msgr2=0x7fb88c14c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:17.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.965+0000 7fb890dc8640 1 --2- 172.21.15.132:0/3399597192 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb88c161720 0x7fb88c14c6c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb880000c00 tx=0x7fb880004730 comp rx=0 tx=0).stop 2024-04-16T15:52:17.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.965+0000 7fb890dc8640 1 -- 172.21.15.132:0/3399597192 shutdown_connections 2024-04-16T15:52:17.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.965+0000 7fb890dc8640 1 --2- 172.21.15.132:0/3399597192 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fb86c06c8f0 0x7fb86c06edb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:17.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.965+0000 7fb890dc8640 1 --2- 172.21.15.132:0/3399597192 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb88c0ab2d0 0x7fb88c0ab780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:17.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.965+0000 7fb890dc8640 1 --2- 172.21.15.132:0/3399597192 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb88c161720 0x7fb88c14c6c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:17.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.965+0000 7fb890dc8640 1 --2- 172.21.15.132:0/3399597192 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb874003f30 0x7fb88c15ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:17.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.965+0000 7fb890dc8640 1 -- 172.21.15.132:0/3399597192 >> 172.21.15.132:0/3399597192 conn(0x7fb88c06d2d0 msgr2=0x7fb88c15dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:17.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.965+0000 7fb890dc8640 1 -- 172.21.15.132:0/3399597192 shutdown_connections 2024-04-16T15:52:17.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:17.965+0000 7fb890dc8640 1 -- 172.21.15.132:0/3399597192 wait complete. 2024-04-16T15:52:17.977 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-16T15:52:17.977 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T15:52:18.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.087+0000 7fa8f35db640 1 Processor -- start 2024-04-16T15:52:18.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.087+0000 7fa8f35db640 1 -- start start 2024-04-16T15:52:18.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.088+0000 7fa8f35db640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa8ec09aa30 0x7fa8ec06cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:18.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.088+0000 7fa8f35db640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa8ec06df50 0x7fa8ec0d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:18.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.088+0000 7fa8f35db640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8ec0d1fe0 con 0x7fa8ec15ede0 2024-04-16T15:52:18.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.088+0000 7fa8f35db640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fa8ec0b1c00 con 0x7fa8ec06df50 2024-04-16T15:52:18.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.088+0000 7fa8f35db640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fa8ec0cd530 con 0x7fa8ec09aa30 2024-04-16T15:52:18.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.088+0000 7fa8f1b78640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa8ec06df50 0x7fa8ec0d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:18.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.088+0000 7fa8f0b76640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fa8ec15ede0 0x7fa8ec09ae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56544/0 (socket says 172.21.15.132:56544) 2024-04-16T15:52:18.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.088+0000 7fa8f0b76640 1 -- 172.21.15.132:0/3496522375 learned_addr learned my addr 172.21.15.132:0/3496522375 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:18.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.088+0000 7fa8f1377640 1 --2- 172.21.15.132:0/3496522375 >> v2:172.21.15.179:3300/0 conn(0x7fa8ec09aa30 0x7fa8ec06cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:18.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.088+0000 7fa8f1b78640 1 -- 172.21.15.132:0/3496522375 >> v2:172.21.15.179:3300/0 conn(0x7fa8ec09aa30 msgr2=0x7fa8ec06cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:18.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.088+0000 7fa8f1b78640 1 --2- 172.21.15.132:0/3496522375 >> v2:172.21.15.179:3300/0 conn(0x7fa8ec09aa30 0x7fa8ec06cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:18.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.088+0000 7fa8f1b78640 1 -- 172.21.15.132:0/3496522375 >> v1:172.21.15.132:6789/0 conn(0x7fa8ec15ede0 legacy=0x7fa8ec09ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:18.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.088+0000 7fa8e3fff640 1 -- 172.21.15.132:0/3496522375 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 58616347 0 0) 0x7fa8ec0d1fe0 con 0x7fa8ec15ede0 2024-04-16T15:52:18.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.088+0000 7fa8f1b78640 1 -- 172.21.15.132:0/3496522375 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8ec0ccee0 con 0x7fa8ec06df50 2024-04-16T15:52:18.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.089+0000 7fa8f1b78640 1 --2- 172.21.15.132:0/3496522375 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8ec06df50 0x7fa8ec0d0af0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec073590 tx=0x7fa8e402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c9c11f1a24d6b8c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:18.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.089+0000 7fa8e3fff640 1 -- 172.21.15.132:0/3496522375 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e4039070 con 0x7fa8ec06df50 2024-04-16T15:52:18.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.089+0000 7fa8e3fff640 1 -- 172.21.15.132:0/3496522375 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8e402cc80 con 0x7fa8ec06df50 2024-04-16T15:52:18.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.089+0000 7fa8e3fff640 1 -- 172.21.15.132:0/3496522375 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e4034660 con 0x7fa8ec06df50 2024-04-16T15:52:18.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.090+0000 7fa8f35db640 1 -- 172.21.15.132:0/3496522375 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8ec06df50 msgr2=0x7fa8ec0d0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:18.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.090+0000 7fa8f35db640 1 --2- 172.21.15.132:0/3496522375 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8ec06df50 0x7fa8ec0d0af0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec073590 tx=0x7fa8e402bed0 comp rx=0 tx=0).stop 2024-04-16T15:52:18.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.090+0000 7fa8f35db640 1 -- 172.21.15.132:0/3496522375 shutdown_connections 2024-04-16T15:52:18.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.090+0000 7fa8f35db640 1 --2- 172.21.15.132:0/3496522375 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8ec06df50 0x7fa8ec0d0af0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:18.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.090+0000 7fa8f35db640 1 --2- 172.21.15.132:0/3496522375 >> v2:172.21.15.179:3300/0 conn(0x7fa8ec09aa30 0x7fa8ec06cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:18.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.090+0000 7fa8f35db640 1 -- 172.21.15.132:0/3496522375 >> 172.21.15.132:0/3496522375 conn(0x7fa8ec0b41e0 msgr2=0x7fa8ec0b45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:18.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.090+0000 7fa8f35db640 1 -- 172.21.15.132:0/3496522375 shutdown_connections 2024-04-16T15:52:18.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.090+0000 7fa8f35db640 1 -- 172.21.15.132:0/3496522375 wait complete. 2024-04-16T15:52:18.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.091+0000 7fa8f35db640 1 Processor -- start 2024-04-16T15:52:18.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.091+0000 7fa8f35db640 1 -- start start 2024-04-16T15:52:18.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.092+0000 7fa8f35db640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8ec06df50 0x7fa8ec151950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:18.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.092+0000 7fa8f35db640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8ec09aa30 0x7fa8ec1607d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:18.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.092+0000 7fa8f35db640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8ec15c0b0 0x7fa8ec160d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:18.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.092+0000 7fa8f35db640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fa8ec0ceb50 con 0x7fa8ec09aa30 2024-04-16T15:52:18.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.092+0000 7fa8f35db640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa8ec0ce9d0 con 0x7fa8ec06df50 2024-04-16T15:52:18.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.092+0000 7fa8f35db640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fa8ec0d1030 con 0x7fa8ec15c0b0 2024-04-16T15:52:18.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.092+0000 7fa8f0b76640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8ec09aa30 0x7fa8ec1607d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:18.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.092+0000 7fa8f0b76640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8ec09aa30 0x7fa8ec1607d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37364/0 (socket says 172.21.15.132:37364) 2024-04-16T15:52:18.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.092+0000 7fa8f0b76640 1 -- 172.21.15.132:0/885534749 learned_addr learned my addr 172.21.15.132:0/885534749 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:18.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.092+0000 7fa8f1377640 1 --2- 172.21.15.132:0/885534749 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8ec06df50 0x7fa8ec151950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:18.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.092+0000 7fa8f1b78640 1 --2- 172.21.15.132:0/885534749 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8ec15c0b0 0x7fa8ec160d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:18.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.092+0000 7fa8f0b76640 1 -- 172.21.15.132:0/885534749 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8ec15c0b0 msgr2=0x7fa8ec160d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:18.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.092+0000 7fa8f0b76640 1 --2- 172.21.15.132:0/885534749 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8ec15c0b0 0x7fa8ec160d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:18.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.092+0000 7fa8f0b76640 1 -- 172.21.15.132:0/885534749 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8ec06df50 msgr2=0x7fa8ec151950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:18.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.092+0000 7fa8f0b76640 1 --2- 172.21.15.132:0/885534749 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8ec06df50 0x7fa8ec151950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:18.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.092+0000 7fa8f0b76640 1 -- 172.21.15.132:0/885534749 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8ec161370 con 0x7fa8ec09aa30 2024-04-16T15:52:18.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.092+0000 7fa8f0b76640 1 --2- 172.21.15.132:0/885534749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8ec09aa30 0x7fa8ec1607d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc00c460 tx=0x7fa8dc00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:18.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.092+0000 7fa8e1ffb640 1 -- 172.21.15.132:0/885534749 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc018070 con 0x7fa8ec09aa30 2024-04-16T15:52:18.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.093+0000 7fa8e1ffb640 1 -- 172.21.15.132:0/885534749 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8dc007500 con 0x7fa8ec09aa30 2024-04-16T15:52:18.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.093+0000 7fa8f35db640 1 -- 172.21.15.132:0/885534749 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8ec15b5d0 con 0x7fa8ec09aa30 2024-04-16T15:52:18.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.093+0000 7fa8e1ffb640 1 -- 172.21.15.132:0/885534749 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc004a20 con 0x7fa8ec09aa30 2024-04-16T15:52:18.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.093+0000 7fa8f35db640 1 -- 172.21.15.132:0/885534749 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8ec151e90 con 0x7fa8ec09aa30 2024-04-16T15:52:18.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.094+0000 7fa8f35db640 1 -- 172.21.15.132:0/885534749 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8ec075510 con 0x7fa8ec09aa30 2024-04-16T15:52:18.097 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.094+0000 7fa8e1ffb640 1 -- 172.21.15.132:0/885534749 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa8dc01b070 con 0x7fa8ec09aa30 2024-04-16T15:52:18.097 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.095+0000 7fa8e1ffb640 1 --2- 172.21.15.132:0/885534749 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fa8d006c8f0 0x7fa8d006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:18.097 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.095+0000 7fa8f1377640 1 --2- 172.21.15.132:0/885534749 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fa8d006c8f0 0x7fa8d006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:18.097 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.095+0000 7fa8e1ffb640 1 -- 172.21.15.132:0/885534749 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa8dc08adc0 con 0x7fa8ec09aa30 2024-04-16T15:52:18.097 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.095+0000 7fa8f1377640 1 --2- 172.21.15.132:0/885534749 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fa8d006c8f0 0x7fa8d006edb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa8e800aac0 tx=0x7fa8e8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:18.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.099+0000 7fa8e1ffb640 1 -- 172.21.15.132:0/885534749 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa8dc058b10 con 0x7fa8ec09aa30 2024-04-16T15:52:18.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.316+0000 7fa8f35db640 1 -- 172.21.15.132:0/885534749 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa8ec0b3da0 con 0x7fa8ec09aa30 2024-04-16T15:52:18.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.317+0000 7fa8e1ffb640 1 -- 172.21.15.132:0/885534749 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5175 (secure 0 0 0) 0x7fa8dc05ce10 con 0x7fa8ec09aa30 2024-04-16T15:52:18.319 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:52:18.319 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/659108212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":659108212},{"type":"v1","addr":"172.21.15.132:6835","nonce":659108212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/811468074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":811468074},{"type":"v1","addr":"172.21.15.132:6837","nonce":811468074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/493922944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":493922944},{"type":"v1","addr":"172.21.15.179:6834","nonce":493922944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T15:52:15.286161+0000","modified":"2024-04-16T15:52:17.305756+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/202618568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":202618568},{"type":"v1","addr":"172.21.15.179:6835","nonce":202618568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1}]} 2024-04-16T15:52:18.320 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 6 2024-04-16T15:52:18.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.319+0000 7fa8f35db640 1 -- 172.21.15.132:0/885534749 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fa8d006c8f0 msgr2=0x7fa8d006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:18.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.319+0000 7fa8f35db640 1 --2- 172.21.15.132:0/885534749 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fa8d006c8f0 0x7fa8d006edb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa8e800aac0 tx=0x7fa8e8008040 comp rx=0 tx=0).stop 2024-04-16T15:52:18.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.319+0000 7fa8f35db640 1 -- 172.21.15.132:0/885534749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8ec09aa30 msgr2=0x7fa8ec1607d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:18.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.319+0000 7fa8f35db640 1 --2- 172.21.15.132:0/885534749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8ec09aa30 0x7fa8ec1607d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc00c460 tx=0x7fa8dc00c920 comp rx=0 tx=0).stop 2024-04-16T15:52:18.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.319+0000 7fa8f35db640 1 -- 172.21.15.132:0/885534749 shutdown_connections 2024-04-16T15:52:18.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.319+0000 7fa8f35db640 1 --2- 172.21.15.132:0/885534749 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fa8d006c8f0 0x7fa8d006edb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:18.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.319+0000 7fa8f35db640 1 --2- 172.21.15.132:0/885534749 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8ec15c0b0 0x7fa8ec160d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:18.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.319+0000 7fa8f35db640 1 --2- 172.21.15.132:0/885534749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8ec09aa30 0x7fa8ec1607d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:18.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.319+0000 7fa8f35db640 1 --2- 172.21.15.132:0/885534749 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8ec06df50 0x7fa8ec151950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:18.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.319+0000 7fa8f35db640 1 -- 172.21.15.132:0/885534749 >> 172.21.15.132:0/885534749 conn(0x7fa8ec0b41e0 msgr2=0x7fa8ec0712a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:18.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.319+0000 7fa8f35db640 1 -- 172.21.15.132:0/885534749 shutdown_connections 2024-04-16T15:52:18.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.319+0000 7fa8f35db640 1 -- 172.21.15.132:0/885534749 wait complete. 2024-04-16T15:52:18.329 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:52:18.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.433+0000 7fbfebc1b640 1 Processor -- start 2024-04-16T15:52:18.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.433+0000 7fbfebc1b640 1 -- start start 2024-04-16T15:52:18.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.434+0000 7fbfebc1b640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbfe40cdf70 0x7fbfe40d13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:18.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.434+0000 7fbfebc1b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbfe40cd310 0x7fbfe40b4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:18.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.434+0000 7fbfebc1b640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfe40ccc50 con 0x7fbfe415c7f0 2024-04-16T15:52:18.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.434+0000 7fbfebc1b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fbfe40b3930 con 0x7fbfe40cd310 2024-04-16T15:52:18.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.434+0000 7fbfebc1b640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fbfe40b3ef0 con 0x7fbfe40cdf70 2024-04-16T15:52:18.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.434+0000 7fbfea1b8640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbfe40cd310 0x7fbfe40b4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:18.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.434+0000 7fbfe99b7640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fbfe415c7f0 0x7fbfe40cd860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56552/0 (socket says 172.21.15.132:56552) 2024-04-16T15:52:18.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.434+0000 7fbfe99b7640 1 -- 172.21.15.132:0/3900569904 learned_addr learned my addr 172.21.15.132:0/3900569904 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:18.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.434+0000 7fbfe91b6640 1 --2- 172.21.15.132:0/3900569904 >> v2:172.21.15.179:3300/0 conn(0x7fbfe40cdf70 0x7fbfe40d13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:18.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.434+0000 7fbfea1b8640 1 -- 172.21.15.132:0/3900569904 >> v2:172.21.15.179:3300/0 conn(0x7fbfe40cdf70 msgr2=0x7fbfe40d13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:18.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.434+0000 7fbfea1b8640 1 --2- 172.21.15.132:0/3900569904 >> v2:172.21.15.179:3300/0 conn(0x7fbfe40cdf70 0x7fbfe40d13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:18.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.434+0000 7fbfea1b8640 1 -- 172.21.15.132:0/3900569904 >> v1:172.21.15.132:6789/0 conn(0x7fbfe415c7f0 legacy=0x7fbfe40cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:18.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.434+0000 7fbfea1b8640 1 -- 172.21.15.132:0/3900569904 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfe415cbd0 con 0x7fbfe40cd310 2024-04-16T15:52:18.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.434+0000 7fbfe89b5640 1 -- 172.21.15.132:0/3900569904 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1373452169 0 0) 0x7fbfe40ccc50 con 0x7fbfe415c7f0 2024-04-16T15:52:18.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.434+0000 7fbfe91b6640 1 --2- 172.21.15.132:0/3900569904 >> v2:172.21.15.179:3300/0 conn(0x7fbfe40cdf70 0x7fbfe40d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:18.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.435+0000 7fbfea1b8640 1 --2- 172.21.15.132:0/3900569904 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbfe40cd310 0x7fbfe40b4380 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbfe40636d0 tx=0x7fbfdc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c96fa6c85cb4e6f server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:18.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.435+0000 7fbfe89b5640 1 -- 172.21.15.132:0/3900569904 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc039070 con 0x7fbfe40cd310 2024-04-16T15:52:18.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.435+0000 7fbfe89b5640 1 -- 172.21.15.132:0/3900569904 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfdc02cc80 con 0x7fbfe40cd310 2024-04-16T15:52:18.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.435+0000 7fbfe89b5640 1 -- 172.21.15.132:0/3900569904 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc034660 con 0x7fbfe40cd310 2024-04-16T15:52:18.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.436+0000 7fbfebc1b640 1 -- 172.21.15.132:0/3900569904 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbfe40cd310 msgr2=0x7fbfe40b4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:18.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.436+0000 7fbfebc1b640 1 --2- 172.21.15.132:0/3900569904 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbfe40cd310 0x7fbfe40b4380 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbfe40636d0 tx=0x7fbfdc02bed0 comp rx=0 tx=0).stop 2024-04-16T15:52:18.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.436+0000 7fbfebc1b640 1 -- 172.21.15.132:0/3900569904 shutdown_connections 2024-04-16T15:52:18.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.436+0000 7fbfebc1b640 1 --2- 172.21.15.132:0/3900569904 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbfe40cd310 0x7fbfe40b4380 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:18.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.436+0000 7fbfebc1b640 1 --2- 172.21.15.132:0/3900569904 >> v2:172.21.15.179:3300/0 conn(0x7fbfe40cdf70 0x7fbfe40d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:18.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.436+0000 7fbfebc1b640 1 -- 172.21.15.132:0/3900569904 >> 172.21.15.132:0/3900569904 conn(0x7fbfe40d08a0 msgr2=0x7fbfe40d0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:18.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.436+0000 7fbfebc1b640 1 -- 172.21.15.132:0/3900569904 shutdown_connections 2024-04-16T15:52:18.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.436+0000 7fbfebc1b640 1 -- 172.21.15.132:0/3900569904 wait complete. 2024-04-16T15:52:18.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.437+0000 7fbfebc1b640 1 Processor -- start 2024-04-16T15:52:18.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.437+0000 7fbfebc1b640 1 -- start start 2024-04-16T15:52:18.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.438+0000 7fbfebc1b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfe40cd310 0x7fbfe414d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:18.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.438+0000 7fbfebc1b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbfe40cdf70 0x7fbfe414ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:18.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.438+0000 7fbfebc1b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfe415c7f0 0x7fbfe41504c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:18.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.438+0000 7fbfebc1b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe40d0520 con 0x7fbfe40cdf70 2024-04-16T15:52:18.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.438+0000 7fbfebc1b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe40b3b80 con 0x7fbfe40cd310 2024-04-16T15:52:18.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.438+0000 7fbfebc1b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fbfe40b48c0 con 0x7fbfe415c7f0 2024-04-16T15:52:18.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.438+0000 7fbfe91b6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbfe40cdf70 0x7fbfe414ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:18.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.438+0000 7fbfe91b6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbfe40cdf70 0x7fbfe414ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37368/0 (socket says 172.21.15.132:37368) 2024-04-16T15:52:18.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.438+0000 7fbfe91b6640 1 -- 172.21.15.132:0/1695124503 learned_addr learned my addr 172.21.15.132:0/1695124503 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:18.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.438+0000 7fbfe91b6640 1 -- 172.21.15.132:0/1695124503 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfe415c7f0 msgr2=0x7fbfe41504c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:18.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.438+0000 7fbfe91b6640 1 --2- 172.21.15.132:0/1695124503 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfe415c7f0 0x7fbfe41504c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:18.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.438+0000 7fbfe91b6640 1 -- 172.21.15.132:0/1695124503 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfe40cd310 msgr2=0x7fbfe414d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:18.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.438+0000 7fbfe91b6640 1 --2- 172.21.15.132:0/1695124503 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfe40cd310 0x7fbfe414d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:18.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.438+0000 7fbfe91b6640 1 -- 172.21.15.132:0/1695124503 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfe40ad940 con 0x7fbfe40cdf70 2024-04-16T15:52:18.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.438+0000 7fbfe91b6640 1 --2- 172.21.15.132:0/1695124503 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbfe40cdf70 0x7fbfe414ff80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbfd400e7e0 tx=0x7fbfd400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:18.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.438+0000 7fbfda7fc640 1 -- 172.21.15.132:0/1695124503 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd400f040 con 0x7fbfe40cdf70 2024-04-16T15:52:18.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.439+0000 7fbfda7fc640 1 -- 172.21.15.132:0/1695124503 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfd4004030 con 0x7fbfe40cdf70 2024-04-16T15:52:18.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.439+0000 7fbfebc1b640 1 -- 172.21.15.132:0/1695124503 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfe40adbe0 con 0x7fbfe40cdf70 2024-04-16T15:52:18.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.439+0000 7fbfda7fc640 1 -- 172.21.15.132:0/1695124503 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd4004400 con 0x7fbfe40cdf70 2024-04-16T15:52:18.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.439+0000 7fbfebc1b640 1 -- 172.21.15.132:0/1695124503 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfe40ae1a0 con 0x7fbfe40cdf70 2024-04-16T15:52:18.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.439+0000 7fbfebc1b640 1 -- 172.21.15.132:0/1695124503 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfe4075510 con 0x7fbfe40cdf70 2024-04-16T15:52:18.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.440+0000 7fbfda7fc640 1 -- 172.21.15.132:0/1695124503 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbfd400c6d0 con 0x7fbfe40cdf70 2024-04-16T15:52:18.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.440+0000 7fbfda7fc640 1 --2- 172.21.15.132:0/1695124503 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fbfc806c8f0 0x7fbfc806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:18.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.441+0000 7fbfe99b7640 1 --2- 172.21.15.132:0/1695124503 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fbfc806c8f0 0x7fbfc806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:18.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.441+0000 7fbfda7fc640 1 -- 172.21.15.132:0/1695124503 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fbfd408b8e0 con 0x7fbfe40cdf70 2024-04-16T15:52:18.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.441+0000 7fbfe99b7640 1 --2- 172.21.15.132:0/1695124503 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fbfc806c8f0 0x7fbfc806edb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbfe0007fd0 tx=0x7fbfe0007960 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:18.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.445+0000 7fbfda7fc640 1 -- 172.21.15.132:0/1695124503 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbfd4017020 con 0x7fbfe40cdf70 2024-04-16T15:52:18.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.621+0000 7fbfebc1b640 1 -- 172.21.15.132:0/1695124503 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbfe4069280 con 0x7fbfe40cdf70 2024-04-16T15:52:18.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.623+0000 7fbfda7fc640 1 -- 172.21.15.132:0/1695124503 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7fbfd4059d10 con 0x7fbfe40cdf70 2024-04-16T15:52:18.622 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:52:18.622 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"6bdec5d9-f406-43ad-8584-0503b32f6f0d","created":"2024-04-16T15:51:51.073040+0000","modified":"2024-04-16T15:52:16.950186+0000","last_up_change":"2024-04-16T15:52:02.280496+0000","last_in_change":"2024-04-16T15:51:53.376468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:52:03.284927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:52:13.363758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T15:52:14.246647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d45908b-6e22-4619-b190-897af594b712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6801","nonce":1170594668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6803","nonce":1170594668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6807","nonce":1170594668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6805","nonce":1170594668}]},"public_addr":"172.21.15.132:6801/1170594668","cluster_addr":"172.21.15.132:6803/1170594668","heartbeat_back_addr":"172.21.15.132:6807/1170594668","heartbeat_front_addr":"172.21.15.132:6805/1170594668","state":["exists","up"]},{"osd":1,"uuid":"c88bf082-e51f-4ee6-815a-025f6ce0d67b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6809","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6811","nonce":2494780358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6815","nonce":2494780358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6823","nonce":2494780358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6819","nonce":2494780358}]},"public_addr":"172.21.15.132:6811/2494780358","cluster_addr":"172.21.15.132:6815/2494780358","heartbeat_back_addr":"172.21.15.132:6823/2494780358","heartbeat_front_addr":"172.21.15.132:6819/2494780358","state":["exists","up"]},{"osd":2,"uuid":"e5dbd6b4-4e7b-47e4-ad4e-35b4b81696c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6825","nonce":27655483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6827","nonce":27655483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6831","nonce":27655483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6829","nonce":27655483}]},"public_addr":"172.21.15.132:6825/27655483","cluster_addr":"172.21.15.132:6827/27655483","heartbeat_back_addr":"172.21.15.132:6831/27655483","heartbeat_front_addr":"172.21.15.132:6829/27655483","state":["exists","up"]},{"osd":3,"uuid":"9d75cd67-3b8a-4424-8884-5f3660e1f5f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6810","nonce":3100919191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6814","nonce":3100919191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6821","nonce":3100919191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6818","nonce":3100919191}]},"public_addr":"172.21.15.132:6810/3100919191","cluster_addr":"172.21.15.132:6814/3100919191","heartbeat_back_addr":"172.21.15.132:6821/3100919191","heartbeat_front_addr":"172.21.15.132:6818/3100919191","state":["exists","up"]},{"osd":4,"uuid":"83aea46a-8642-4777-912b-c130e5890da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6825","nonce":123637799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6827","nonce":123637799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6831","nonce":123637799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6829","nonce":123637799}]},"public_addr":"172.21.15.179:6825/123637799","cluster_addr":"172.21.15.179:6827/123637799","heartbeat_back_addr":"172.21.15.179:6831/123637799","heartbeat_front_addr":"172.21.15.179:6829/123637799","state":["exists","up"]},{"osd":5,"uuid":"534117c8-3317-48d6-b436-afd5709f71e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6801","nonce":2224750370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6803","nonce":2224750370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6807","nonce":2224750370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6805","nonce":2224750370}]},"public_addr":"172.21.15.179:6801/2224750370","cluster_addr":"172.21.15.179:6803/2224750370","heartbeat_back_addr":"172.21.15.179:6807/2224750370","heartbeat_front_addr":"172.21.15.179:6805/2224750370","state":["exists","up"]},{"osd":6,"uuid":"0ba363e7-fa9d-42b1-ae09-a6a0f57d41f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6809","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6811","nonce":101498164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6813","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6815","nonce":101498164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6823","nonce":101498164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6819","nonce":101498164}]},"public_addr":"172.21.15.179:6811/101498164","cluster_addr":"172.21.15.179:6815/101498164","heartbeat_back_addr":"172.21.15.179:6823/101498164","heartbeat_front_addr":"172.21.15.179:6819/101498164","state":["exists","up"]},{"osd":7,"uuid":"e6830c77-2f2d-4067-9866-ee7625afc1a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6810","nonce":872148365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6814","nonce":872148365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6822","nonce":872148365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6818","nonce":872148365}]},"public_addr":"172.21.15.179:6810/872148365","cluster_addr":"172.21.15.179:6814/872148365","heartbeat_back_addr":"172.21.15.179:6822/872148365","heartbeat_front_addr":"172.21.15.179:6818/872148365","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.535221+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.563769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.520765+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.526264+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.517058+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.500842+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.534332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.512486+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:52:18.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.625+0000 7fbfebc1b640 1 -- 172.21.15.132:0/1695124503 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fbfc806c8f0 msgr2=0x7fbfc806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:18.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.625+0000 7fbfebc1b640 1 --2- 172.21.15.132:0/1695124503 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fbfc806c8f0 0x7fbfc806edb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbfe0007fd0 tx=0x7fbfe0007960 comp rx=0 tx=0).stop 2024-04-16T15:52:18.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.625+0000 7fbfebc1b640 1 -- 172.21.15.132:0/1695124503 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbfe40cdf70 msgr2=0x7fbfe414ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:18.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.625+0000 7fbfebc1b640 1 --2- 172.21.15.132:0/1695124503 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbfe40cdf70 0x7fbfe414ff80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbfd400e7e0 tx=0x7fbfd400eca0 comp rx=0 tx=0).stop 2024-04-16T15:52:18.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.625+0000 7fbfebc1b640 1 -- 172.21.15.132:0/1695124503 shutdown_connections 2024-04-16T15:52:18.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.625+0000 7fbfebc1b640 1 --2- 172.21.15.132:0/1695124503 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fbfc806c8f0 0x7fbfc806edb0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:18.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.625+0000 7fbfebc1b640 1 --2- 172.21.15.132:0/1695124503 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfe415c7f0 0x7fbfe41504c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:18.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.625+0000 7fbfebc1b640 1 --2- 172.21.15.132:0/1695124503 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbfe40cdf70 0x7fbfe414ff80 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:18.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.625+0000 7fbfebc1b640 1 --2- 172.21.15.132:0/1695124503 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfe40cd310 0x7fbfe414d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:18.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.625+0000 7fbfebc1b640 1 -- 172.21.15.132:0/1695124503 >> 172.21.15.132:0/1695124503 conn(0x7fbfe40d08a0 msgr2=0x7fbfe4072380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:18.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.625+0000 7fbfebc1b640 1 -- 172.21.15.132:0/1695124503 shutdown_connections 2024-04-16T15:52:18.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.625+0000 7fbfebc1b640 1 -- 172.21.15.132:0/1695124503 wait complete. 2024-04-16T15:52:18.635 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-16T15:52:18.635 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T15:52:18.738 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.739+0000 7f997d104640 1 Processor -- start 2024-04-16T15:52:18.738 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.739+0000 7f997d104640 1 -- start start 2024-04-16T15:52:18.740 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.739+0000 7f997d104640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f997815ead0 0x7f99780b7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:18.740 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.739+0000 7f997d104640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99780b63f0 0x7f99780b6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:18.740 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.739+0000 7f997d104640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f99780cf6b0 0x7f99780cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:18.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.739+0000 7f997d104640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f997806d060 con 0x7f99780cf6b0 2024-04-16T15:52:18.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.739+0000 7f997d104640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f997806d340 con 0x7f997815ead0 2024-04-16T15:52:18.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.739+0000 7f997d104640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f997806d620 con 0x7f99780b63f0 2024-04-16T15:52:18.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.740+0000 7f997759e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f99780cf6b0 0x7f99780cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:18.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.740+0000 7f997759e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f99780cf6b0 0x7f99780cfb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37382/0 (socket says 172.21.15.132:37382) 2024-04-16T15:52:18.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.740+0000 7f997759e640 1 -- 172.21.15.132:0/350284166 learned_addr learned my addr 172.21.15.132:0/350284166 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:18.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.740+0000 7f9976d9d640 1 --2- 172.21.15.132:0/350284166 >> v2:172.21.15.179:3300/0 conn(0x7f997815ead0 0x7f99780b7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:18.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.740+0000 7f996ffff640 1 --2- 172.21.15.132:0/350284166 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99780b63f0 0x7f99780b6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:18.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.740+0000 7f997759e640 1 -- 172.21.15.132:0/350284166 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99780b63f0 msgr2=0x7f99780b6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:18.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.740+0000 7f997759e640 1 --2- 172.21.15.132:0/350284166 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99780b63f0 0x7f99780b6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:18.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.740+0000 7f997759e640 1 -- 172.21.15.132:0/350284166 >> v2:172.21.15.179:3300/0 conn(0x7f997815ead0 msgr2=0x7f99780b7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:18.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.740+0000 7f997759e640 1 --2- 172.21.15.132:0/350284166 >> v2:172.21.15.179:3300/0 conn(0x7f997815ead0 0x7f99780b7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:18.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.740+0000 7f997759e640 1 -- 172.21.15.132:0/350284166 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f997806d900 con 0x7f99780cf6b0 2024-04-16T15:52:18.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.741+0000 7f997759e640 1 --2- 172.21.15.132:0/350284166 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99780cf6b0 0x7f99780cfb00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f997808d090 tx=0x7f997002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=395bace47df9a5af server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:18.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.741+0000 7f997659c640 1 -- 172.21.15.132:0/350284166 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f997002ca70 con 0x7f99780cf6b0 2024-04-16T15:52:18.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.741+0000 7f997659c640 1 -- 172.21.15.132:0/350284166 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f997002cc10 con 0x7f99780cf6b0 2024-04-16T15:52:18.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.741+0000 7f997659c640 1 -- 172.21.15.132:0/350284166 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99700343f0 con 0x7f99780cf6b0 2024-04-16T15:52:18.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.741+0000 7f997d104640 1 -- 172.21.15.132:0/350284166 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99780cf6b0 msgr2=0x7f99780cfb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:18.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.741+0000 7f997d104640 1 --2- 172.21.15.132:0/350284166 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99780cf6b0 0x7f99780cfb00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f997808d090 tx=0x7f997002bed0 comp rx=0 tx=0).stop 2024-04-16T15:52:18.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.741+0000 7f997d104640 1 -- 172.21.15.132:0/350284166 shutdown_connections 2024-04-16T15:52:18.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.741+0000 7f997d104640 1 --2- 172.21.15.132:0/350284166 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99780cf6b0 0x7f99780cfb00 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:18.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.741+0000 7f997d104640 1 --2- 172.21.15.132:0/350284166 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99780b63f0 0x7f99780b6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:18.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.741+0000 7f997d104640 1 --2- 172.21.15.132:0/350284166 >> v2:172.21.15.179:3300/0 conn(0x7f997815ead0 0x7f99780b7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:18.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.741+0000 7f997d104640 1 -- 172.21.15.132:0/350284166 >> 172.21.15.132:0/350284166 conn(0x7f99780d13f0 msgr2=0x7f99780d1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:18.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.741+0000 7f997d104640 1 -- 172.21.15.132:0/350284166 shutdown_connections 2024-04-16T15:52:18.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.741+0000 7f997d104640 1 -- 172.21.15.132:0/350284166 wait complete. 2024-04-16T15:52:18.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.743+0000 7f997d104640 1 Processor -- start 2024-04-16T15:52:18.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.743+0000 7f997d104640 1 -- start start 2024-04-16T15:52:18.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.743+0000 7f997d104640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99780b63f0 0x7f99780cab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:18.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.743+0000 7f997d104640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99780cf6b0 0x7f997814ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:18.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.743+0000 7f997d104640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f997815ead0 0x7f99780cca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:18.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.743+0000 7f997d104640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f997815f030 con 0x7f997815ead0 2024-04-16T15:52:18.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.743+0000 7f997d104640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f997815eeb0 con 0x7f99780cf6b0 2024-04-16T15:52:18.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.743+0000 7f997d104640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f99780d0040 con 0x7f99780b63f0 2024-04-16T15:52:18.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.744+0000 7f997759e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f997815ead0 0x7f99780cca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:18.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.744+0000 7f997759e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f997815ead0 0x7f99780cca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37392/0 (socket says 172.21.15.132:37392) 2024-04-16T15:52:18.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.744+0000 7f997759e640 1 -- 172.21.15.132:0/617142389 learned_addr learned my addr 172.21.15.132:0/617142389 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:18.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.744+0000 7f9976d9d640 1 --2- 172.21.15.132:0/617142389 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99780b63f0 0x7f99780cab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:18.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.744+0000 7f996ffff640 1 --2- 172.21.15.132:0/617142389 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99780cf6b0 0x7f997814ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:18.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.744+0000 7f997759e640 1 -- 172.21.15.132:0/617142389 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99780b63f0 msgr2=0x7f99780cab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:18.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.744+0000 7f997759e640 1 --2- 172.21.15.132:0/617142389 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99780b63f0 0x7f99780cab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:18.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.744+0000 7f997759e640 1 -- 172.21.15.132:0/617142389 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99780cf6b0 msgr2=0x7f997814ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:18.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.744+0000 7f997759e640 1 --2- 172.21.15.132:0/617142389 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99780cf6b0 0x7f997814ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:18.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.744+0000 7f997759e640 1 -- 172.21.15.132:0/617142389 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9978162230 con 0x7f997815ead0 2024-04-16T15:52:18.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.744+0000 7f996ffff640 1 --2- 172.21.15.132:0/617142389 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99780cf6b0 0x7f997814ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:18.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.744+0000 7f997759e640 1 --2- 172.21.15.132:0/617142389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f997815ead0 0x7f99780cca90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9970009f40 tx=0x7f9970004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:18.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.744+0000 7f996f7fe640 1 -- 172.21.15.132:0/617142389 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9970043020 con 0x7f997815ead0 2024-04-16T15:52:18.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.744+0000 7f996f7fe640 1 -- 172.21.15.132:0/617142389 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f997003e450 con 0x7f997815ead0 2024-04-16T15:52:18.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.744+0000 7f996f7fe640 1 -- 172.21.15.132:0/617142389 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9970009510 con 0x7f997815ead0 2024-04-16T15:52:18.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.744+0000 7f997d104640 1 -- 172.21.15.132:0/617142389 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99780c81e0 con 0x7f997815ead0 2024-04-16T15:52:18.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.744+0000 7f997d104640 1 -- 172.21.15.132:0/617142389 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99780c8480 con 0x7f997815ead0 2024-04-16T15:52:18.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.745+0000 7f997d104640 1 -- 172.21.15.132:0/617142389 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9978075510 con 0x7f997815ead0 2024-04-16T15:52:18.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.746+0000 7f996f7fe640 1 -- 172.21.15.132:0/617142389 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9970046020 con 0x7f997815ead0 2024-04-16T15:52:18.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.746+0000 7f996f7fe640 1 --2- 172.21.15.132:0/617142389 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f995806c8f0 0x7f995806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:18.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.746+0000 7f9976d9d640 1 --2- 172.21.15.132:0/617142389 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f995806c8f0 0x7f995806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:18.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.746+0000 7f996f7fe640 1 -- 172.21.15.132:0/617142389 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f99700ae220 con 0x7f997815ead0 2024-04-16T15:52:18.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.746+0000 7f9976d9d640 1 --2- 172.21.15.132:0/617142389 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f995806c8f0 0x7f995806edb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f99680079a0 tx=0x7f9968008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:18.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.750+0000 7f996f7fe640 1 -- 172.21.15.132:0/617142389 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f997004d030 con 0x7f997815ead0 2024-04-16T15:52:18.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.926+0000 7f997d104640 1 -- 172.21.15.132:0/617142389 --> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f99780d26f0 con 0x7f995806c8f0 2024-04-16T15:52:18.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.932+0000 7f996f7fe640 1 -- 172.21.15.132:0/617142389 <== mgr.4101 v2:172.21.15.132:6832/3896387465 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237079 (secure 0 0 0) 0x7f99780d26f0 con 0x7f995806c8f0 2024-04-16T15:52:18.938 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:52:18.940 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2024-04-16T15:52:18.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.935+0000 7f997d104640 1 -- 172.21.15.132:0/617142389 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f995806c8f0 msgr2=0x7f995806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:18.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.935+0000 7f997d104640 1 --2- 172.21.15.132:0/617142389 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f995806c8f0 0x7f995806edb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f99680079a0 tx=0x7f9968008040 comp rx=0 tx=0).stop 2024-04-16T15:52:18.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.935+0000 7f997d104640 1 -- 172.21.15.132:0/617142389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f997815ead0 msgr2=0x7f99780cca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:18.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.935+0000 7f997d104640 1 --2- 172.21.15.132:0/617142389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f997815ead0 0x7f99780cca90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9970009f40 tx=0x7f9970004a40 comp rx=0 tx=0).stop 2024-04-16T15:52:18.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.935+0000 7f997d104640 1 -- 172.21.15.132:0/617142389 shutdown_connections 2024-04-16T15:52:18.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.935+0000 7f997d104640 1 --2- 172.21.15.132:0/617142389 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f995806c8f0 0x7f995806edb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:18.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.935+0000 7f997d104640 1 --2- 172.21.15.132:0/617142389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f997815ead0 0x7f99780cca90 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:18.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.935+0000 7f997d104640 1 --2- 172.21.15.132:0/617142389 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99780cf6b0 0x7f997814ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:18.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.935+0000 7f997d104640 1 --2- 172.21.15.132:0/617142389 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99780b63f0 0x7f99780cab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:18.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.935+0000 7f997d104640 1 -- 172.21.15.132:0/617142389 >> 172.21.15.132:0/617142389 conn(0x7f99780d13f0 msgr2=0x7f997815c950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:18.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.935+0000 7f997d104640 1 -- 172.21.15.132:0/617142389 shutdown_connections 2024-04-16T15:52:18.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:18.935+0000 7f997d104640 1 -- 172.21.15.132:0/617142389 wait complete. 2024-04-16T15:52:18.945 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-04-16T15:52:17.270129+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":218564,"kb_used_data":2376,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756156,"statfs":{"total":773094113280,"available":772870303744,"internally_reserved":0,"allocated":2433024,"data_stored":1546872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000584"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:13.920439+0000","last_change":"2024-04-16T15:52:13.920439+0000","last_active":"2024-04-16T15:52:13.920439+0000","last_peered":"2024-04-16T15:52:13.920439+0000","last_clean":"2024-04-16T15:52:13.920439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:13.920439+0000","last_undegraded":"2024-04-16T15:52:13.920439+0000","last_fullsized":"2024-04-16T15:52:13.920439+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:13.920439+0000","last_change":"2024-04-16T15:52:13.920439+0000","last_active":"2024-04-16T15:52:13.920439+0000","last_peered":"2024-04-16T15:52:13.920439+0000","last_clean":"2024-04-16T15:52:13.920439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:13.920439+0000","last_undegraded":"2024-04-16T15:52:13.920439+0000","last_fullsized":"2024-04-16T15:52:13.920439+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:13.920439+0000","last_change":"2024-04-16T15:52:13.920439+0000","last_active":"2024-04-16T15:52:13.920439+0000","last_peered":"2024-04-16T15:52:13.920439+0000","last_clean":"2024-04-16T15:52:13.920439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:13.920439+0000","last_undegraded":"2024-04-16T15:52:13.920439+0000","last_fullsized":"2024-04-16T15:52:13.920439+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:13.920439+0000","last_change":"2024-04-16T15:52:13.920439+0000","last_active":"2024-04-16T15:52:13.920439+0000","last_peered":"2024-04-16T15:52:13.920439+0000","last_clean":"2024-04-16T15:52:13.920439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:13.920439+0000","last_undegraded":"2024-04-16T15:52:13.920439+0000","last_fullsized":"2024-04-16T15:52:13.920439+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:13.920439+0000","last_change":"2024-04-16T15:52:13.920439+0000","last_active":"2024-04-16T15:52:13.920439+0000","last_peered":"2024-04-16T15:52:13.920439+0000","last_clean":"2024-04-16T15:52:13.920439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:13.920439+0000","last_undegraded":"2024-04-16T15:52:13.920439+0000","last_fullsized":"2024-04-16T15:52:13.920439+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:13.920439+0000","last_change":"2024-04-16T15:52:13.920439+0000","last_active":"2024-04-16T15:52:13.920439+0000","last_peered":"2024-04-16T15:52:13.920439+0000","last_clean":"2024-04-16T15:52:13.920439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:13.920439+0000","last_undegraded":"2024-04-16T15:52:13.920439+0000","last_fullsized":"2024-04-16T15:52:13.920439+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:13.920439+0000","last_change":"2024-04-16T15:52:13.920439+0000","last_active":"2024-04-16T15:52:13.920439+0000","last_peered":"2024-04-16T15:52:13.920439+0000","last_clean":"2024-04-16T15:52:13.920439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:13.920439+0000","last_undegraded":"2024-04-16T15:52:13.920439+0000","last_fullsized":"2024-04-16T15:52:13.920439+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:13.920439+0000","last_change":"2024-04-16T15:52:13.920439+0000","last_active":"2024-04-16T15:52:13.920439+0000","last_peered":"2024-04-16T15:52:13.920439+0000","last_clean":"2024-04-16T15:52:13.920439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:13.920439+0000","last_undegraded":"2024-04-16T15:52:13.920439+0000","last_fullsized":"2024-04-16T15:52:13.920439+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:13.920439+0000","last_change":"2024-04-16T15:52:13.920439+0000","last_active":"2024-04-16T15:52:13.920439+0000","last_peered":"2024-04-16T15:52:13.920439+0000","last_clean":"2024-04-16T15:52:13.920439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:13.920439+0000","last_undegraded":"2024-04-16T15:52:13.920439+0000","last_fullsized":"2024-04-16T15:52:13.920439+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:13.920439+0000","last_change":"2024-04-16T15:52:13.920439+0000","last_active":"2024-04-16T15:52:13.920439+0000","last_peered":"2024-04-16T15:52:13.920439+0000","last_clean":"2024-04-16T15:52:13.920439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:13.920439+0000","last_undegraded":"2024-04-16T15:52:13.920439+0000","last_fullsized":"2024-04-16T15:52:13.920439+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:13.920439+0000","last_change":"2024-04-16T15:52:13.920439+0000","last_active":"2024-04-16T15:52:13.920439+0000","last_peered":"2024-04-16T15:52:13.920439+0000","last_clean":"2024-04-16T15:52:13.920439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:13.920439+0000","last_undegraded":"2024-04-16T15:52:13.920439+0000","last_fullsized":"2024-04-16T15:52:13.920439+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:13.920439+0000","last_change":"2024-04-16T15:52:13.920439+0000","last_active":"2024-04-16T15:52:13.920439+0000","last_peered":"2024-04-16T15:52:13.920439+0000","last_clean":"2024-04-16T15:52:13.920439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:13.920439+0000","last_undegraded":"2024-04-16T15:52:13.920439+0000","last_fullsized":"2024-04-16T15:52:13.920439+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:13.920439+0000","last_change":"2024-04-16T15:52:13.920439+0000","last_active":"2024-04-16T15:52:13.920439+0000","last_peered":"2024-04-16T15:52:13.920439+0000","last_clean":"2024-04-16T15:52:13.920439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:13.920439+0000","last_undegraded":"2024-04-16T15:52:13.920439+0000","last_fullsized":"2024-04-16T15:52:13.920439+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:13.920439+0000","last_change":"2024-04-16T15:52:13.920439+0000","last_active":"2024-04-16T15:52:13.920439+0000","last_peered":"2024-04-16T15:52:13.920439+0000","last_clean":"2024-04-16T15:52:13.920439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:13.920439+0000","last_undegraded":"2024-04-16T15:52:13.920439+0000","last_fullsized":"2024-04-16T15:52:13.920439+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:13.920439+0000","last_change":"2024-04-16T15:52:13.920439+0000","last_active":"2024-04-16T15:52:13.920439+0000","last_peered":"2024-04-16T15:52:13.920439+0000","last_clean":"2024-04-16T15:52:13.920439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:13.920439+0000","last_undegraded":"2024-04-16T15:52:13.920439+0000","last_fullsized":"2024-04-16T15:52:13.920439+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:13.920439+0000","last_change":"2024-04-16T15:52:13.920439+0000","last_active":"2024-04-16T15:52:13.920439+0000","last_peered":"2024-04-16T15:52:13.920439+0000","last_clean":"2024-04-16T15:52:13.920439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:13.920439+0000","last_undegraded":"2024-04-16T15:52:13.920439+0000","last_fullsized":"2024-04-16T15:52:13.920439+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":162,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-16T15:52:05.661296+0000","last_change":"2024-04-16T15:52:04.356095+0000","last_active":"2024-04-16T15:52:05.661296+0000","last_peered":"2024-04-16T15:52:05.661296+0000","last_clean":"2024-04-16T15:52:05.661296+0000","last_became_active":"2024-04-16T15:52:04.355126+0000","last_became_peered":"2024-04-16T15:52:04.355126+0000","last_unstale":"2024-04-16T15:52:05.661296+0000","last_undegraded":"2024-04-16T15:52:05.661296+0000","last_fullsized":"2024-04-16T15:52:05.661296+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:03.285037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:03.285037+0000","last_clean_scrub_stamp":"2024-04-16T15:52:03.285037+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:19.005024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:13.920439+0000","last_change":"2024-04-16T15:52:13.920439+0000","last_active":"2024-04-16T15:52:13.920439+0000","last_peered":"2024-04-16T15:52:13.920439+0000","last_clean":"2024-04-16T15:52:13.920439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:13.920439+0000","last_undegraded":"2024-04-16T15:52:13.920439+0000","last_fullsized":"2024-04-16T15:52:13.920439+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:13.920439+0000","last_change":"2024-04-16T15:52:13.920439+0000","last_active":"2024-04-16T15:52:13.920439+0000","last_peered":"2024-04-16T15:52:13.920439+0000","last_clean":"2024-04-16T15:52:13.920439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:13.920439+0000","last_undegraded":"2024-04-16T15:52:13.920439+0000","last_fullsized":"2024-04-16T15:52:13.920439+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:13.920439+0000","last_change":"2024-04-16T15:52:13.920439+0000","last_active":"2024-04-16T15:52:13.920439+0000","last_peered":"2024-04-16T15:52:13.920439+0000","last_clean":"2024-04-16T15:52:13.920439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:13.920439+0000","last_undegraded":"2024-04-16T15:52:13.920439+0000","last_fullsized":"2024-04-16T15:52:13.920439+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:13.920439+0000","last_change":"2024-04-16T15:52:13.920439+0000","last_active":"2024-04-16T15:52:13.920439+0000","last_peered":"2024-04-16T15:52:13.920439+0000","last_clean":"2024-04-16T15:52:13.920439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:13.920439+0000","last_undegraded":"2024-04-16T15:52:13.920439+0000","last_fullsized":"2024-04-16T15:52:13.920439+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:13.920439+0000","last_change":"2024-04-16T15:52:13.920439+0000","last_active":"2024-04-16T15:52:13.920439+0000","last_peered":"2024-04-16T15:52:13.920439+0000","last_clean":"2024-04-16T15:52:13.920439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:13.920439+0000","last_undegraded":"2024-04-16T15:52:13.920439+0000","last_fullsized":"2024-04-16T15:52:13.920439+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:13.920439+0000","last_change":"2024-04-16T15:52:13.920439+0000","last_active":"2024-04-16T15:52:13.920439+0000","last_peered":"2024-04-16T15:52:13.920439+0000","last_clean":"2024-04-16T15:52:13.920439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:13.920439+0000","last_undegraded":"2024-04-16T15:52:13.920439+0000","last_fullsized":"2024-04-16T15:52:13.920439+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:13.920439+0000","last_change":"2024-04-16T15:52:13.920439+0000","last_active":"2024-04-16T15:52:13.920439+0000","last_peered":"2024-04-16T15:52:13.920439+0000","last_clean":"2024-04-16T15:52:13.920439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:13.920439+0000","last_undegraded":"2024-04-16T15:52:13.920439+0000","last_fullsized":"2024-04-16T15:52:13.920439+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:13.920439+0000","last_change":"2024-04-16T15:52:13.920439+0000","last_active":"2024-04-16T15:52:13.920439+0000","last_peered":"2024-04-16T15:52:13.920439+0000","last_clean":"2024-04-16T15:52:13.920439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:13.920439+0000","last_undegraded":"2024-04-16T15:52:13.920439+0000","last_fullsized":"2024-04-16T15:52:13.920439+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:13.920439+0000","last_change":"2024-04-16T15:52:13.920439+0000","last_active":"2024-04-16T15:52:13.920439+0000","last_peered":"2024-04-16T15:52:13.920439+0000","last_clean":"2024-04-16T15:52:13.920439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:13.920439+0000","last_undegraded":"2024-04-16T15:52:13.920439+0000","last_fullsized":"2024-04-16T15:52:13.920439+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:13.920439+0000","last_change":"2024-04-16T15:52:13.920439+0000","last_active":"2024-04-16T15:52:13.920439+0000","last_peered":"2024-04-16T15:52:13.920439+0000","last_clean":"2024-04-16T15:52:13.920439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:13.920439+0000","last_undegraded":"2024-04-16T15:52:13.920439+0000","last_fullsized":"2024-04-16T15:52:13.920439+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:13.920439+0000","last_change":"2024-04-16T15:52:13.920439+0000","last_active":"2024-04-16T15:52:13.920439+0000","last_peered":"2024-04-16T15:52:13.920439+0000","last_clean":"2024-04-16T15:52:13.920439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:13.920439+0000","last_undegraded":"2024-04-16T15:52:13.920439+0000","last_fullsized":"2024-04-16T15:52:13.920439+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:13.920439+0000","last_change":"2024-04-16T15:52:13.920439+0000","last_active":"2024-04-16T15:52:13.920439+0000","last_peered":"2024-04-16T15:52:13.920439+0000","last_clean":"2024-04-16T15:52:13.920439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:13.920439+0000","last_undegraded":"2024-04-16T15:52:13.920439+0000","last_fullsized":"2024-04-16T15:52:13.920439+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:13.920439+0000","last_change":"2024-04-16T15:52:13.920439+0000","last_active":"2024-04-16T15:52:13.920439+0000","last_peered":"2024-04-16T15:52:13.920439+0000","last_clean":"2024-04-16T15:52:13.920439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:13.920439+0000","last_undegraded":"2024-04-16T15:52:13.920439+0000","last_fullsized":"2024-04-16T15:52:13.920439+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:13.920439+0000","last_change":"2024-04-16T15:52:13.920439+0000","last_active":"2024-04-16T15:52:13.920439+0000","last_peered":"2024-04-16T15:52:13.920439+0000","last_clean":"2024-04-16T15:52:13.920439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:13.920439+0000","last_undegraded":"2024-04-16T15:52:13.920439+0000","last_fullsized":"2024-04-16T15:52:13.920439+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:13.920439+0000","last_change":"2024-04-16T15:52:13.920439+0000","last_active":"2024-04-16T15:52:13.920439+0000","last_peered":"2024-04-16T15:52:13.920439+0000","last_clean":"2024-04-16T15:52:13.920439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:13.920439+0000","last_undegraded":"2024-04-16T15:52:13.920439+0000","last_fullsized":"2024-04-16T15:52:13.920439+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:14.924992+0000","last_change":"2024-04-16T15:52:14.924992+0000","last_active":"2024-04-16T15:52:14.924992+0000","last_peered":"2024-04-16T15:52:14.924992+0000","last_clean":"2024-04-16T15:52:14.924992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:14.924992+0000","last_undegraded":"2024-04-16T15:52:14.924992+0000","last_fullsized":"2024-04-16T15:52:14.924992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:52:13.920439+0000","last_change":"2024-04-16T15:52:13.920439+0000","last_active":"2024-04-16T15:52:13.920439+0000","last_peered":"2024-04-16T15:52:13.920439+0000","last_clean":"2024-04-16T15:52:13.920439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:52:13.920439+0000","last_undegraded":"2024-04-16T15:52:13.920439+0000","last_fullsized":"2024-04-16T15:52:13.920439+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":749568,"data_stored":636135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27180,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":749568,"data_stored":636135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T15:52:18.950 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T15:52:19.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.092+0000 7fe1f5d32640 1 Processor -- start 2024-04-16T15:52:19.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.093+0000 7fe1f5d32640 1 -- start start 2024-04-16T15:52:19.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.093+0000 7fe1f5d32640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1f015ede0 0x7fe1f006cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:19.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.093+0000 7fe1f5d32640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe1f006df50 0x7fe1f00d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:19.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.093+0000 7fe1f5d32640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1f00d1fe0 con 0x7fe1f009aa30 2024-04-16T15:52:19.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.093+0000 7fe1f5d32640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fe1f00b1c00 con 0x7fe1f006df50 2024-04-16T15:52:19.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.093+0000 7fe1f5d32640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe1f00cd530 con 0x7fe1f015ede0 2024-04-16T15:52:19.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.093+0000 7fe1effff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe1f006df50 0x7fe1f00d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:19.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.093+0000 7fe1effff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe1f006df50 0x7fe1f00d0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37398/0 (socket says 172.21.15.132:37398) 2024-04-16T15:52:19.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.093+0000 7fe1effff640 1 -- 172.21.15.132:0/2190112389 learned_addr learned my addr 172.21.15.132:0/2190112389 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:19.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.094+0000 7fe1eeffd640 1 --2- 172.21.15.132:0/2190112389 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1f015ede0 0x7fe1f006cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:19.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.094+0000 7fe1effff640 1 -- 172.21.15.132:0/2190112389 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1f015ede0 msgr2=0x7fe1f006cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:19.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.094+0000 7fe1effff640 1 --2- 172.21.15.132:0/2190112389 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1f015ede0 0x7fe1f006cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:19.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.094+0000 7fe1effff640 1 -- 172.21.15.132:0/2190112389 >> v1:172.21.15.179:6789/0 conn(0x7fe1f009aa30 legacy=0x7fe1f009ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:19.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.094+0000 7fe1effff640 1 -- 172.21.15.132:0/2190112389 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1f00ccee0 con 0x7fe1f006df50 2024-04-16T15:52:19.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.094+0000 7fe1effff640 1 --2- 172.21.15.132:0/2190112389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1f006df50 0x7fe1f00d0af0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8009870 tx=0x7fe1e802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f67f99f38cade9de server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:19.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.095+0000 7fe1ee7fc640 1 -- 172.21.15.132:0/2190112389 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e8035020 con 0x7fe1f006df50 2024-04-16T15:52:19.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.095+0000 7fe1ee7fc640 1 -- 172.21.15.132:0/2190112389 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1e8031640 con 0x7fe1f006df50 2024-04-16T15:52:19.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.095+0000 7fe1ee7fc640 1 -- 172.21.15.132:0/2190112389 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e802d040 con 0x7fe1f006df50 2024-04-16T15:52:19.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.095+0000 7fe1f5d32640 1 -- 172.21.15.132:0/2190112389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1f006df50 msgr2=0x7fe1f00d0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:19.097 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.095+0000 7fe1f5d32640 1 --2- 172.21.15.132:0/2190112389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1f006df50 0x7fe1f00d0af0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8009870 tx=0x7fe1e802b8f0 comp rx=0 tx=0).stop 2024-04-16T15:52:19.097 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.095+0000 7fe1f5d32640 1 -- 172.21.15.132:0/2190112389 shutdown_connections 2024-04-16T15:52:19.097 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.095+0000 7fe1f5d32640 1 --2- 172.21.15.132:0/2190112389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1f006df50 0x7fe1f00d0af0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:19.097 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.095+0000 7fe1f5d32640 1 --2- 172.21.15.132:0/2190112389 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1f015ede0 0x7fe1f006cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:19.097 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.095+0000 7fe1f5d32640 1 -- 172.21.15.132:0/2190112389 >> 172.21.15.132:0/2190112389 conn(0x7fe1f00b41e0 msgr2=0x7fe1f00b45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:19.097 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.095+0000 7fe1f5d32640 1 -- 172.21.15.132:0/2190112389 shutdown_connections 2024-04-16T15:52:19.097 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.095+0000 7fe1f5d32640 1 -- 172.21.15.132:0/2190112389 wait complete. 2024-04-16T15:52:19.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.096+0000 7fe1f5d32640 1 Processor -- start 2024-04-16T15:52:19.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.097+0000 7fe1f5d32640 1 -- start start 2024-04-16T15:52:19.101 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.097+0000 7fe1f5d32640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1f006df50 0x7fe1f00c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:19.101 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.097+0000 7fe1f5d32640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1f009aa30 0x7fe1f0151b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:19.102 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.097+0000 7fe1f5d32640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1f0161a50 0x7fe1f015c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:19.102 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.097+0000 7fe1f5d32640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f00ceb50 con 0x7fe1f009aa30 2024-04-16T15:52:19.102 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.097+0000 7fe1f5d32640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f00ce9d0 con 0x7fe1f006df50 2024-04-16T15:52:19.102 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.097+0000 7fe1f5d32640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe1f00d1030 con 0x7fe1f0161a50 2024-04-16T15:52:19.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.097+0000 7fe1eeffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1f009aa30 0x7fe1f0151b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:19.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.098+0000 7fe1eeffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1f009aa30 0x7fe1f0151b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37408/0 (socket says 172.21.15.132:37408) 2024-04-16T15:52:19.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.098+0000 7fe1eeffd640 1 -- 172.21.15.132:0/3913720884 learned_addr learned my addr 172.21.15.132:0/3913720884 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:19.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.098+0000 7fe1effff640 1 --2- 172.21.15.132:0/3913720884 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1f0161a50 0x7fe1f015c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:19.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.098+0000 7fe1ef7fe640 1 --2- 172.21.15.132:0/3913720884 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1f006df50 0x7fe1f00c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:19.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.098+0000 7fe1eeffd640 1 -- 172.21.15.132:0/3913720884 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1f0161a50 msgr2=0x7fe1f015c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:19.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.098+0000 7fe1eeffd640 1 --2- 172.21.15.132:0/3913720884 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1f0161a50 0x7fe1f015c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:19.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.098+0000 7fe1eeffd640 1 -- 172.21.15.132:0/3913720884 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1f006df50 msgr2=0x7fe1f00c97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:19.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.098+0000 7fe1eeffd640 1 --2- 172.21.15.132:0/3913720884 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1f006df50 0x7fe1f00c97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:19.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.098+0000 7fe1eeffd640 1 -- 172.21.15.132:0/3913720884 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1f01621b0 con 0x7fe1f009aa30 2024-04-16T15:52:19.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.098+0000 7fe1eeffd640 1 --2- 172.21.15.132:0/3913720884 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1f009aa30 0x7fe1f0151b80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe1d800c7f0 tx=0x7fe1d800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:19.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.098+0000 7fe1e7fff640 1 -- 172.21.15.132:0/3913720884 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d8015070 con 0x7fe1f009aa30 2024-04-16T15:52:19.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.098+0000 7fe1e7fff640 1 -- 172.21.15.132:0/3913720884 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1d8004220 con 0x7fe1f009aa30 2024-04-16T15:52:19.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.098+0000 7fe1e7fff640 1 -- 172.21.15.132:0/3913720884 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d8007620 con 0x7fe1f009aa30 2024-04-16T15:52:19.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.098+0000 7fe1f5d32640 1 -- 172.21.15.132:0/3913720884 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1f0161ed0 con 0x7fe1f009aa30 2024-04-16T15:52:19.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.098+0000 7fe1f5d32640 1 -- 172.21.15.132:0/3913720884 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1f00b70e0 con 0x7fe1f009aa30 2024-04-16T15:52:19.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.099+0000 7fe1f5d32640 1 -- 172.21.15.132:0/3913720884 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1f0075510 con 0x7fe1f009aa30 2024-04-16T15:52:19.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.100+0000 7fe1e7fff640 1 -- 172.21.15.132:0/3913720884 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe1d80079d0 con 0x7fe1f009aa30 2024-04-16T15:52:19.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.100+0000 7fe1e7fff640 1 --2- 172.21.15.132:0/3913720884 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fe1d006c8f0 0x7fe1d006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:19.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.100+0000 7fe1e7fff640 1 -- 172.21.15.132:0/3913720884 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe1d808bd30 con 0x7fe1f009aa30 2024-04-16T15:52:19.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.100+0000 7fe1ef7fe640 1 --2- 172.21.15.132:0/3913720884 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fe1d006c8f0 0x7fe1d006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:19.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.100+0000 7fe1ef7fe640 1 --2- 172.21.15.132:0/3913720884 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fe1d006c8f0 0x7fe1d006edb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0005660 tx=0x7fe1e0003d90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:19.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.104+0000 7fe1e7fff640 1 -- 172.21.15.132:0/3913720884 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe1f01621b0 con 0x7fe1f009aa30 2024-04-16T15:52:19.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.275+0000 7fe1f5d32640 1 -- 172.21.15.132:0/3913720884 --> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe1f00cfef0 con 0x7fe1d006c8f0 2024-04-16T15:52:19.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.281+0000 7fe1e7fff640 1 -- 172.21.15.132:0/3913720884 <== mgr.4101 v2:172.21.15.132:6832/3896387465 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251909 (secure 0 0 0) 0x7fe1f00cfef0 con 0x7fe1d006c8f0 2024-04-16T15:52:19.284 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:52:19.286 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2024-04-16T15:52:19.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.284+0000 7fe1f5d32640 1 -- 172.21.15.132:0/3913720884 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fe1d006c8f0 msgr2=0x7fe1d006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:19.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.284+0000 7fe1f5d32640 1 --2- 172.21.15.132:0/3913720884 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fe1d006c8f0 0x7fe1d006edb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0005660 tx=0x7fe1e0003d90 comp rx=0 tx=0).stop 2024-04-16T15:52:19.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.284+0000 7fe1f5d32640 1 -- 172.21.15.132:0/3913720884 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1f009aa30 msgr2=0x7fe1f0151b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:19.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.284+0000 7fe1f5d32640 1 --2- 172.21.15.132:0/3913720884 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1f009aa30 0x7fe1f0151b80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe1d800c7f0 tx=0x7fe1d800ccb0 comp rx=0 tx=0).stop 2024-04-16T15:52:19.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.284+0000 7fe1f5d32640 1 -- 172.21.15.132:0/3913720884 shutdown_connections 2024-04-16T15:52:19.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.284+0000 7fe1f5d32640 1 --2- 172.21.15.132:0/3913720884 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fe1d006c8f0 0x7fe1d006edb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:19.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.284+0000 7fe1f5d32640 1 --2- 172.21.15.132:0/3913720884 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1f0161a50 0x7fe1f015c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:19.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.284+0000 7fe1f5d32640 1 --2- 172.21.15.132:0/3913720884 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1f009aa30 0x7fe1f0151b80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:19.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.284+0000 7fe1f5d32640 1 --2- 172.21.15.132:0/3913720884 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1f006df50 0x7fe1f00c97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:19.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.284+0000 7fe1f5d32640 1 -- 172.21.15.132:0/3913720884 >> 172.21.15.132:0/3913720884 conn(0x7fe1f00b41e0 msgr2=0x7fe1f009ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:19.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.284+0000 7fe1f5d32640 1 -- 172.21.15.132:0/3913720884 shutdown_connections 2024-04-16T15:52:19.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.284+0000 7fe1f5d32640 1 -- 172.21.15.132:0/3913720884 wait complete. 2024-04-16T15:52:19.294 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-04-16T15:52:19.270430+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":75,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218928,"kb_used_data":2752,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755792,"statfs":{"total":773094113280,"available":772869931008,"internally_reserved":0,"allocated":2818048,"data_stored":1715228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.344988"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-16T15:52:15.973457+0000","last_change":"2024-04-16T15:52:15.966421+0000","last_active":"2024-04-16T15:52:15.973457+0000","last_peered":"2024-04-16T15:52:15.973457+0000","last_clean":"2024-04-16T15:52:15.973457+0000","last_became_active":"2024-04-16T15:52:15.966130+0000","last_became_peered":"2024-04-16T15:52:15.966130+0000","last_unstale":"2024-04-16T15:52:15.973457+0000","last_undegraded":"2024-04-16T15:52:15.973457+0000","last_fullsized":"2024-04-16T15:52:15.973457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:47:47.685958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.953509+0000","last_change":"2024-04-16T15:52:15.960231+0000","last_active":"2024-04-16T15:52:16.953509+0000","last_peered":"2024-04-16T15:52:16.953509+0000","last_clean":"2024-04-16T15:52:16.953509+0000","last_became_active":"2024-04-16T15:52:15.959916+0000","last_became_peered":"2024-04-16T15:52:15.959916+0000","last_unstale":"2024-04-16T15:52:16.953509+0000","last_undegraded":"2024-04-16T15:52:16.953509+0000","last_fullsized":"2024-04-16T15:52:16.953509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:12:51.264278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-16T15:52:15.960843+0000","last_change":"2024-04-16T15:52:15.958351+0000","last_active":"2024-04-16T15:52:15.960843+0000","last_peered":"2024-04-16T15:52:15.960843+0000","last_clean":"2024-04-16T15:52:15.960843+0000","last_became_active":"2024-04-16T15:52:15.956927+0000","last_became_peered":"2024-04-16T15:52:15.956927+0000","last_unstale":"2024-04-16T15:52:15.960843+0000","last_undegraded":"2024-04-16T15:52:15.960843+0000","last_fullsized":"2024-04-16T15:52:15.960843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:50:26.319554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.958233+0000","last_change":"2024-04-16T15:52:15.961429+0000","last_active":"2024-04-16T15:52:16.958233+0000","last_peered":"2024-04-16T15:52:16.958233+0000","last_clean":"2024-04-16T15:52:16.958233+0000","last_became_active":"2024-04-16T15:52:15.961162+0000","last_became_peered":"2024-04-16T15:52:15.961162+0000","last_unstale":"2024-04-16T15:52:16.958233+0000","last_undegraded":"2024-04-16T15:52:16.958233+0000","last_fullsized":"2024-04-16T15:52:16.958233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:43:19.355250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-16T15:52:15.965594+0000","last_change":"2024-04-16T15:52:15.960864+0000","last_active":"2024-04-16T15:52:15.965594+0000","last_peered":"2024-04-16T15:52:15.965594+0000","last_clean":"2024-04-16T15:52:15.965594+0000","last_became_active":"2024-04-16T15:52:15.960590+0000","last_became_peered":"2024-04-16T15:52:15.960590+0000","last_unstale":"2024-04-16T15:52:15.965594+0000","last_undegraded":"2024-04-16T15:52:15.965594+0000","last_fullsized":"2024-04-16T15:52:15.965594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:29:56.924883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.957714+0000","last_change":"2024-04-16T15:52:15.960295+0000","last_active":"2024-04-16T15:52:16.957714+0000","last_peered":"2024-04-16T15:52:16.957714+0000","last_clean":"2024-04-16T15:52:16.957714+0000","last_became_active":"2024-04-16T15:52:15.959540+0000","last_became_peered":"2024-04-16T15:52:15.959540+0000","last_unstale":"2024-04-16T15:52:16.957714+0000","last_undegraded":"2024-04-16T15:52:16.957714+0000","last_fullsized":"2024-04-16T15:52:16.957714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:31:45.732213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-16T15:52:15.965557+0000","last_change":"2024-04-16T15:52:15.960729+0000","last_active":"2024-04-16T15:52:15.965557+0000","last_peered":"2024-04-16T15:52:15.965557+0000","last_clean":"2024-04-16T15:52:15.965557+0000","last_became_active":"2024-04-16T15:52:15.960436+0000","last_became_peered":"2024-04-16T15:52:15.960436+0000","last_unstale":"2024-04-16T15:52:15.965557+0000","last_undegraded":"2024-04-16T15:52:15.965557+0000","last_fullsized":"2024-04-16T15:52:15.965557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:55:11.299922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-16T15:52:15.970343+0000","last_change":"2024-04-16T15:52:15.966326+0000","last_active":"2024-04-16T15:52:15.970343+0000","last_peered":"2024-04-16T15:52:15.970343+0000","last_clean":"2024-04-16T15:52:15.970343+0000","last_became_active":"2024-04-16T15:52:15.966012+0000","last_became_peered":"2024-04-16T15:52:15.966012+0000","last_unstale":"2024-04-16T15:52:15.970343+0000","last_undegraded":"2024-04-16T15:52:15.970343+0000","last_fullsized":"2024-04-16T15:52:15.970343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:09:22.888070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-16T15:52:15.974053+0000","last_change":"2024-04-16T15:52:15.969843+0000","last_active":"2024-04-16T15:52:15.974053+0000","last_peered":"2024-04-16T15:52:15.974053+0000","last_clean":"2024-04-16T15:52:15.974053+0000","last_became_active":"2024-04-16T15:52:15.969569+0000","last_became_peered":"2024-04-16T15:52:15.969569+0000","last_unstale":"2024-04-16T15:52:15.974053+0000","last_undegraded":"2024-04-16T15:52:15.974053+0000","last_fullsized":"2024-04-16T15:52:15.974053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:26:03.155698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.959521+0000","last_change":"2024-04-16T15:52:15.964277+0000","last_active":"2024-04-16T15:52:17.959521+0000","last_peered":"2024-04-16T15:52:17.959521+0000","last_clean":"2024-04-16T15:52:17.959521+0000","last_became_active":"2024-04-16T15:52:15.963999+0000","last_became_peered":"2024-04-16T15:52:15.963999+0000","last_unstale":"2024-04-16T15:52:17.959521+0000","last_undegraded":"2024-04-16T15:52:17.959521+0000","last_fullsized":"2024-04-16T15:52:17.959521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:06:46.464243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.959461+0000","last_change":"2024-04-16T15:52:15.962038+0000","last_active":"2024-04-16T15:52:17.959461+0000","last_peered":"2024-04-16T15:52:17.959461+0000","last_clean":"2024-04-16T15:52:17.959461+0000","last_became_active":"2024-04-16T15:52:15.961769+0000","last_became_peered":"2024-04-16T15:52:15.961769+0000","last_unstale":"2024-04-16T15:52:17.959461+0000","last_undegraded":"2024-04-16T15:52:17.959461+0000","last_fullsized":"2024-04-16T15:52:17.959461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:32:03.549437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.957704+0000","last_change":"2024-04-16T15:52:15.955262+0000","last_active":"2024-04-16T15:52:16.957704+0000","last_peered":"2024-04-16T15:52:16.957704+0000","last_clean":"2024-04-16T15:52:16.957704+0000","last_became_active":"2024-04-16T15:52:15.955026+0000","last_became_peered":"2024-04-16T15:52:15.955026+0000","last_unstale":"2024-04-16T15:52:16.957704+0000","last_undegraded":"2024-04-16T15:52:16.957704+0000","last_fullsized":"2024-04-16T15:52:16.957704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:25:37.505791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-16T15:52:15.959362+0000","last_change":"2024-04-16T15:52:15.957719+0000","last_active":"2024-04-16T15:52:15.959362+0000","last_peered":"2024-04-16T15:52:15.959362+0000","last_clean":"2024-04-16T15:52:15.959362+0000","last_became_active":"2024-04-16T15:52:15.957420+0000","last_became_peered":"2024-04-16T15:52:15.957420+0000","last_unstale":"2024-04-16T15:52:15.959362+0000","last_undegraded":"2024-04-16T15:52:15.959362+0000","last_fullsized":"2024-04-16T15:52:15.959362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:05:33.664541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-16T15:52:15.959498+0000","last_change":"2024-04-16T15:52:15.954658+0000","last_active":"2024-04-16T15:52:15.959498+0000","last_peered":"2024-04-16T15:52:15.959498+0000","last_clean":"2024-04-16T15:52:15.959498+0000","last_became_active":"2024-04-16T15:52:15.954415+0000","last_became_peered":"2024-04-16T15:52:15.954415+0000","last_unstale":"2024-04-16T15:52:15.959498+0000","last_undegraded":"2024-04-16T15:52:15.959498+0000","last_fullsized":"2024-04-16T15:52:15.959498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:56:17.065473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.953491+0000","last_change":"2024-04-16T15:52:15.963146+0000","last_active":"2024-04-16T15:52:16.953491+0000","last_peered":"2024-04-16T15:52:16.953491+0000","last_clean":"2024-04-16T15:52:16.953491+0000","last_became_active":"2024-04-16T15:52:15.962757+0000","last_became_peered":"2024-04-16T15:52:15.962757+0000","last_unstale":"2024-04-16T15:52:16.953491+0000","last_undegraded":"2024-04-16T15:52:16.953491+0000","last_fullsized":"2024-04-16T15:52:16.953491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:06:46.464243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.957014+0000","last_change":"2024-04-16T15:52:15.964964+0000","last_active":"2024-04-16T15:52:16.957014+0000","last_peered":"2024-04-16T15:52:16.957014+0000","last_clean":"2024-04-16T15:52:16.957014+0000","last_became_active":"2024-04-16T15:52:15.964719+0000","last_became_peered":"2024-04-16T15:52:15.964719+0000","last_unstale":"2024-04-16T15:52:16.957014+0000","last_undegraded":"2024-04-16T15:52:16.957014+0000","last_fullsized":"2024-04-16T15:52:16.957014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:06:46.464243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.958319+0000","last_change":"2024-04-16T15:52:15.964462+0000","last_active":"2024-04-16T15:52:16.958319+0000","last_peered":"2024-04-16T15:52:16.958319+0000","last_clean":"2024-04-16T15:52:16.958319+0000","last_became_active":"2024-04-16T15:52:15.962472+0000","last_became_peered":"2024-04-16T15:52:15.962472+0000","last_unstale":"2024-04-16T15:52:16.958319+0000","last_undegraded":"2024-04-16T15:52:16.958319+0000","last_fullsized":"2024-04-16T15:52:16.958319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:19:17.423858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.166342+0000","last_change":"2024-04-16T15:52:15.957070+0000","last_active":"2024-04-16T15:52:17.166342+0000","last_peered":"2024-04-16T15:52:17.166342+0000","last_clean":"2024-04-16T15:52:17.166342+0000","last_became_active":"2024-04-16T15:52:15.956709+0000","last_became_peered":"2024-04-16T15:52:15.956709+0000","last_unstale":"2024-04-16T15:52:17.166342+0000","last_undegraded":"2024-04-16T15:52:17.166342+0000","last_fullsized":"2024-04-16T15:52:17.166342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:09:22.888070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-16T15:52:15.965675+0000","last_change":"2024-04-16T15:52:15.962038+0000","last_active":"2024-04-16T15:52:15.965675+0000","last_peered":"2024-04-16T15:52:15.965675+0000","last_clean":"2024-04-16T15:52:15.965675+0000","last_became_active":"2024-04-16T15:52:15.961798+0000","last_became_peered":"2024-04-16T15:52:15.961798+0000","last_unstale":"2024-04-16T15:52:15.965675+0000","last_undegraded":"2024-04-16T15:52:15.965675+0000","last_fullsized":"2024-04-16T15:52:15.965675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:30:06.435878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.959273+0000","last_change":"2024-04-16T15:52:15.957366+0000","last_active":"2024-04-16T15:52:17.959273+0000","last_peered":"2024-04-16T15:52:17.959273+0000","last_clean":"2024-04-16T15:52:17.959273+0000","last_became_active":"2024-04-16T15:52:15.956820+0000","last_became_peered":"2024-04-16T15:52:15.956820+0000","last_unstale":"2024-04-16T15:52:17.959273+0000","last_undegraded":"2024-04-16T15:52:17.959273+0000","last_fullsized":"2024-04-16T15:52:17.959273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:38:40.918721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-16T15:52:15.964134+0000","last_change":"2024-04-16T15:52:15.960508+0000","last_active":"2024-04-16T15:52:15.964134+0000","last_peered":"2024-04-16T15:52:15.964134+0000","last_clean":"2024-04-16T15:52:15.964134+0000","last_became_active":"2024-04-16T15:52:15.960254+0000","last_became_peered":"2024-04-16T15:52:15.960254+0000","last_unstale":"2024-04-16T15:52:15.964134+0000","last_undegraded":"2024-04-16T15:52:15.964134+0000","last_fullsized":"2024-04-16T15:52:15.964134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:52:38.940563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.957878+0000","last_change":"2024-04-16T15:52:15.954611+0000","last_active":"2024-04-16T15:52:16.957878+0000","last_peered":"2024-04-16T15:52:16.957878+0000","last_clean":"2024-04-16T15:52:16.957878+0000","last_became_active":"2024-04-16T15:52:15.954303+0000","last_became_peered":"2024-04-16T15:52:15.954303+0000","last_unstale":"2024-04-16T15:52:16.957878+0000","last_undegraded":"2024-04-16T15:52:16.957878+0000","last_fullsized":"2024-04-16T15:52:16.957878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:12:23.633108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-16T15:52:15.976219+0000","last_change":"2024-04-16T15:52:15.971774+0000","last_active":"2024-04-16T15:52:15.976219+0000","last_peered":"2024-04-16T15:52:15.976219+0000","last_clean":"2024-04-16T15:52:15.976219+0000","last_became_active":"2024-04-16T15:52:15.971186+0000","last_became_peered":"2024-04-16T15:52:15.971186+0000","last_unstale":"2024-04-16T15:52:15.976219+0000","last_undegraded":"2024-04-16T15:52:15.976219+0000","last_fullsized":"2024-04-16T15:52:15.976219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:30:06.435878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.957191+0000","last_change":"2024-04-16T15:52:15.960952+0000","last_active":"2024-04-16T15:52:16.957191+0000","last_peered":"2024-04-16T15:52:16.957191+0000","last_clean":"2024-04-16T15:52:16.957191+0000","last_became_active":"2024-04-16T15:52:15.960676+0000","last_became_peered":"2024-04-16T15:52:15.960676+0000","last_unstale":"2024-04-16T15:52:16.957191+0000","last_undegraded":"2024-04-16T15:52:16.957191+0000","last_fullsized":"2024-04-16T15:52:16.957191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:12.609412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-16T15:52:15.971715+0000","last_change":"2024-04-16T15:52:15.968822+0000","last_active":"2024-04-16T15:52:15.971715+0000","last_peered":"2024-04-16T15:52:15.971715+0000","last_clean":"2024-04-16T15:52:15.971715+0000","last_became_active":"2024-04-16T15:52:15.968422+0000","last_became_peered":"2024-04-16T15:52:15.968422+0000","last_unstale":"2024-04-16T15:52:15.971715+0000","last_undegraded":"2024-04-16T15:52:15.971715+0000","last_fullsized":"2024-04-16T15:52:15.971715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:55:11.299922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.959596+0000","last_change":"2024-04-16T15:52:15.961136+0000","last_active":"2024-04-16T15:52:17.959596+0000","last_peered":"2024-04-16T15:52:17.959596+0000","last_clean":"2024-04-16T15:52:17.959596+0000","last_became_active":"2024-04-16T15:52:15.960894+0000","last_became_peered":"2024-04-16T15:52:15.960894+0000","last_unstale":"2024-04-16T15:52:17.959596+0000","last_undegraded":"2024-04-16T15:52:17.959596+0000","last_fullsized":"2024-04-16T15:52:17.959596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:12:51.264278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.953334+0000","last_change":"2024-04-16T15:52:15.955537+0000","last_active":"2024-04-16T15:52:16.953334+0000","last_peered":"2024-04-16T15:52:16.953334+0000","last_clean":"2024-04-16T15:52:16.953334+0000","last_became_active":"2024-04-16T15:52:15.955225+0000","last_became_peered":"2024-04-16T15:52:15.955225+0000","last_unstale":"2024-04-16T15:52:16.953334+0000","last_undegraded":"2024-04-16T15:52:16.953334+0000","last_fullsized":"2024-04-16T15:52:16.953334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:38:40.918721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-16T15:52:15.971608+0000","last_change":"2024-04-16T15:52:15.962164+0000","last_active":"2024-04-16T15:52:15.971608+0000","last_peered":"2024-04-16T15:52:15.971608+0000","last_clean":"2024-04-16T15:52:15.971608+0000","last_became_active":"2024-04-16T15:52:15.961616+0000","last_became_peered":"2024-04-16T15:52:15.961616+0000","last_unstale":"2024-04-16T15:52:15.971608+0000","last_undegraded":"2024-04-16T15:52:15.971608+0000","last_fullsized":"2024-04-16T15:52:15.971608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:52:38.940563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-16T15:52:15.964108+0000","last_change":"2024-04-16T15:52:15.960482+0000","last_active":"2024-04-16T15:52:15.964108+0000","last_peered":"2024-04-16T15:52:15.964108+0000","last_clean":"2024-04-16T15:52:15.964108+0000","last_became_active":"2024-04-16T15:52:15.960230+0000","last_became_peered":"2024-04-16T15:52:15.960230+0000","last_unstale":"2024-04-16T15:52:15.964108+0000","last_undegraded":"2024-04-16T15:52:15.964108+0000","last_fullsized":"2024-04-16T15:52:15.964108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:25:37.505791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.958035+0000","last_change":"2024-04-16T15:52:15.959288+0000","last_active":"2024-04-16T15:52:16.958035+0000","last_peered":"2024-04-16T15:52:16.958035+0000","last_clean":"2024-04-16T15:52:16.958035+0000","last_became_active":"2024-04-16T15:52:15.958870+0000","last_became_peered":"2024-04-16T15:52:15.958870+0000","last_unstale":"2024-04-16T15:52:16.958035+0000","last_undegraded":"2024-04-16T15:52:16.958035+0000","last_fullsized":"2024-04-16T15:52:16.958035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:20:01.452180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.166079+0000","last_change":"2024-04-16T15:52:15.962345+0000","last_active":"2024-04-16T15:52:17.166079+0000","last_peered":"2024-04-16T15:52:17.166079+0000","last_clean":"2024-04-16T15:52:17.166079+0000","last_became_active":"2024-04-16T15:52:15.962070+0000","last_became_peered":"2024-04-16T15:52:15.962070+0000","last_unstale":"2024-04-16T15:52:17.166079+0000","last_undegraded":"2024-04-16T15:52:17.166079+0000","last_fullsized":"2024-04-16T15:52:17.166079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:43:14.139014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.959184+0000","last_change":"2024-04-16T15:52:15.964986+0000","last_active":"2024-04-16T15:52:17.959184+0000","last_peered":"2024-04-16T15:52:17.959184+0000","last_clean":"2024-04-16T15:52:17.959184+0000","last_became_active":"2024-04-16T15:52:15.964652+0000","last_became_peered":"2024-04-16T15:52:15.964652+0000","last_unstale":"2024-04-16T15:52:17.959184+0000","last_undegraded":"2024-04-16T15:52:17.959184+0000","last_fullsized":"2024-04-16T15:52:17.959184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:26:03.155698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.956966+0000","last_change":"2024-04-16T15:52:15.951020+0000","last_active":"2024-04-16T15:52:16.956966+0000","last_peered":"2024-04-16T15:52:16.956966+0000","last_clean":"2024-04-16T15:52:16.956966+0000","last_became_active":"2024-04-16T15:52:15.950740+0000","last_became_peered":"2024-04-16T15:52:15.950740+0000","last_unstale":"2024-04-16T15:52:16.956966+0000","last_undegraded":"2024-04-16T15:52:16.956966+0000","last_fullsized":"2024-04-16T15:52:16.956966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:56:17.065473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-16T15:52:15.974251+0000","last_change":"2024-04-16T15:52:14.949066+0000","last_active":"2024-04-16T15:52:15.974251+0000","last_peered":"2024-04-16T15:52:15.974251+0000","last_clean":"2024-04-16T15:52:15.974251+0000","last_became_active":"2024-04-16T15:52:14.948796+0000","last_became_peered":"2024-04-16T15:52:14.948796+0000","last_unstale":"2024-04-16T15:52:15.974251+0000","last_undegraded":"2024-04-16T15:52:15.974251+0000","last_fullsized":"2024-04-16T15:52:15.974251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:54:14.854467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-16T15:52:15.959457+0000","last_change":"2024-04-16T15:52:15.954656+0000","last_active":"2024-04-16T15:52:15.959457+0000","last_peered":"2024-04-16T15:52:15.959457+0000","last_clean":"2024-04-16T15:52:15.959457+0000","last_became_active":"2024-04-16T15:52:15.954391+0000","last_became_peered":"2024-04-16T15:52:15.954391+0000","last_unstale":"2024-04-16T15:52:15.959457+0000","last_undegraded":"2024-04-16T15:52:15.959457+0000","last_fullsized":"2024-04-16T15:52:15.959457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:57:53.297727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.959028+0000","last_change":"2024-04-16T15:52:14.942908+0000","last_active":"2024-04-16T15:52:17.959028+0000","last_peered":"2024-04-16T15:52:17.959028+0000","last_clean":"2024-04-16T15:52:17.959028+0000","last_became_active":"2024-04-16T15:52:14.942553+0000","last_became_peered":"2024-04-16T15:52:14.942553+0000","last_unstale":"2024-04-16T15:52:17.959028+0000","last_undegraded":"2024-04-16T15:52:17.959028+0000","last_fullsized":"2024-04-16T15:52:17.959028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:50:25.315001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-16T15:52:15.953733+0000","last_change":"2024-04-16T15:52:14.947686+0000","last_active":"2024-04-16T15:52:15.953733+0000","last_peered":"2024-04-16T15:52:15.953733+0000","last_clean":"2024-04-16T15:52:15.953733+0000","last_became_active":"2024-04-16T15:52:14.947418+0000","last_became_peered":"2024-04-16T15:52:14.947418+0000","last_unstale":"2024-04-16T15:52:15.953733+0000","last_undegraded":"2024-04-16T15:52:15.953733+0000","last_fullsized":"2024-04-16T15:52:15.953733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:57:52.293174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-16T15:52:15.971770+0000","last_change":"2024-04-16T15:52:15.968647+0000","last_active":"2024-04-16T15:52:15.971770+0000","last_peered":"2024-04-16T15:52:15.971770+0000","last_clean":"2024-04-16T15:52:15.971770+0000","last_became_active":"2024-04-16T15:52:15.968291+0000","last_became_peered":"2024-04-16T15:52:15.968291+0000","last_unstale":"2024-04-16T15:52:15.971770+0000","last_undegraded":"2024-04-16T15:52:15.971770+0000","last_fullsized":"2024-04-16T15:52:15.971770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:29:56.924883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.957300+0000","last_change":"2024-04-16T15:52:14.937235+0000","last_active":"2024-04-16T15:52:16.957300+0000","last_peered":"2024-04-16T15:52:16.957300+0000","last_clean":"2024-04-16T15:52:16.957300+0000","last_became_active":"2024-04-16T15:52:14.936933+0000","last_became_peered":"2024-04-16T15:52:14.936933+0000","last_unstale":"2024-04-16T15:52:16.957300+0000","last_undegraded":"2024-04-16T15:52:16.957300+0000","last_fullsized":"2024-04-16T15:52:16.957300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:56:16.060919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.953284+0000","last_change":"2024-04-16T15:52:15.956171+0000","last_active":"2024-04-16T15:52:16.953284+0000","last_peered":"2024-04-16T15:52:16.953284+0000","last_clean":"2024-04-16T15:52:16.953284+0000","last_became_active":"2024-04-16T15:52:15.955891+0000","last_became_peered":"2024-04-16T15:52:15.955891+0000","last_unstale":"2024-04-16T15:52:16.953284+0000","last_undegraded":"2024-04-16T15:52:16.953284+0000","last_fullsized":"2024-04-16T15:52:16.953284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:26:03.155698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.959498+0000","last_change":"2024-04-16T15:52:14.949780+0000","last_active":"2024-04-16T15:52:17.959498+0000","last_peered":"2024-04-16T15:52:17.959498+0000","last_clean":"2024-04-16T15:52:17.959498+0000","last_became_active":"2024-04-16T15:52:14.949488+0000","last_became_peered":"2024-04-16T15:52:14.949488+0000","last_unstale":"2024-04-16T15:52:17.959498+0000","last_undegraded":"2024-04-16T15:52:17.959498+0000","last_fullsized":"2024-04-16T15:52:17.959498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:57:52.293174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.957085+0000","last_change":"2024-04-16T15:52:15.963253+0000","last_active":"2024-04-16T15:52:16.957085+0000","last_peered":"2024-04-16T15:52:16.957085+0000","last_clean":"2024-04-16T15:52:16.957085+0000","last_became_active":"2024-04-16T15:52:15.962755+0000","last_became_peered":"2024-04-16T15:52:15.962755+0000","last_unstale":"2024-04-16T15:52:16.957085+0000","last_undegraded":"2024-04-16T15:52:16.957085+0000","last_fullsized":"2024-04-16T15:52:16.957085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:12:51.264278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.957206+0000","last_change":"2024-04-16T15:52:14.948736+0000","last_active":"2024-04-16T15:52:16.957206+0000","last_peered":"2024-04-16T15:52:16.957206+0000","last_clean":"2024-04-16T15:52:16.957206+0000","last_became_active":"2024-04-16T15:52:14.948413+0000","last_became_peered":"2024-04-16T15:52:14.948413+0000","last_unstale":"2024-04-16T15:52:16.957206+0000","last_undegraded":"2024-04-16T15:52:16.957206+0000","last_fullsized":"2024-04-16T15:52:16.957206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:05:32.659988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-16T15:52:15.968464+0000","last_change":"2024-04-16T15:52:15.962582+0000","last_active":"2024-04-16T15:52:15.968464+0000","last_peered":"2024-04-16T15:52:15.968464+0000","last_clean":"2024-04-16T15:52:15.968464+0000","last_became_active":"2024-04-16T15:52:15.962290+0000","last_became_peered":"2024-04-16T15:52:15.962290+0000","last_unstale":"2024-04-16T15:52:15.968464+0000","last_undegraded":"2024-04-16T15:52:15.968464+0000","last_fullsized":"2024-04-16T15:52:15.968464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:43:14.139014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.953451+0000","last_change":"2024-04-16T15:52:14.942420+0000","last_active":"2024-04-16T15:52:16.953451+0000","last_peered":"2024-04-16T15:52:16.953451+0000","last_clean":"2024-04-16T15:52:16.953451+0000","last_became_active":"2024-04-16T15:52:14.942185+0000","last_became_peered":"2024-04-16T15:52:14.942185+0000","last_unstale":"2024-04-16T15:52:16.953451+0000","last_undegraded":"2024-04-16T15:52:16.953451+0000","last_fullsized":"2024-04-16T15:52:16.953451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:25:36.501237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.957745+0000","last_change":"2024-04-16T15:52:15.968661+0000","last_active":"2024-04-16T15:52:16.957745+0000","last_peered":"2024-04-16T15:52:16.957745+0000","last_clean":"2024-04-16T15:52:16.957745+0000","last_became_active":"2024-04-16T15:52:15.968372+0000","last_became_peered":"2024-04-16T15:52:15.968372+0000","last_unstale":"2024-04-16T15:52:16.957745+0000","last_undegraded":"2024-04-16T15:52:16.957745+0000","last_fullsized":"2024-04-16T15:52:16.957745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:52:38.940563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.959249+0000","last_change":"2024-04-16T15:52:14.947183+0000","last_active":"2024-04-16T15:52:17.959249+0000","last_peered":"2024-04-16T15:52:17.959249+0000","last_clean":"2024-04-16T15:52:17.959249+0000","last_became_active":"2024-04-16T15:52:14.946917+0000","last_became_peered":"2024-04-16T15:52:14.946917+0000","last_unstale":"2024-04-16T15:52:17.959249+0000","last_undegraded":"2024-04-16T15:52:17.959249+0000","last_fullsized":"2024-04-16T15:52:17.959249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:25:36.501237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-16T15:52:15.965654+0000","last_change":"2024-04-16T15:52:15.960326+0000","last_active":"2024-04-16T15:52:15.965654+0000","last_peered":"2024-04-16T15:52:15.965654+0000","last_clean":"2024-04-16T15:52:15.965654+0000","last_became_active":"2024-04-16T15:52:15.960019+0000","last_became_peered":"2024-04-16T15:52:15.960019+0000","last_unstale":"2024-04-16T15:52:15.965654+0000","last_undegraded":"2024-04-16T15:52:15.965654+0000","last_fullsized":"2024-04-16T15:52:15.965654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:59:49.394608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-16T15:52:15.974521+0000","last_change":"2024-04-16T15:52:14.943977+0000","last_active":"2024-04-16T15:52:15.974521+0000","last_peered":"2024-04-16T15:52:15.974521+0000","last_clean":"2024-04-16T15:52:15.974521+0000","last_became_active":"2024-04-16T15:52:14.942113+0000","last_became_peered":"2024-04-16T15:52:14.942113+0000","last_unstale":"2024-04-16T15:52:15.974521+0000","last_undegraded":"2024-04-16T15:52:15.974521+0000","last_fullsized":"2024-04-16T15:52:15.974521+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:54:14.854467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-16T15:52:15.967819+0000","last_change":"2024-04-16T15:52:15.963253+0000","last_active":"2024-04-16T15:52:15.967819+0000","last_peered":"2024-04-16T15:52:15.967819+0000","last_clean":"2024-04-16T15:52:15.967819+0000","last_became_active":"2024-04-16T15:52:15.963021+0000","last_became_peered":"2024-04-16T15:52:15.963021+0000","last_unstale":"2024-04-16T15:52:15.967819+0000","last_undegraded":"2024-04-16T15:52:15.967819+0000","last_fullsized":"2024-04-16T15:52:15.967819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:09:22.888070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.958161+0000","last_change":"2024-04-16T15:52:14.947713+0000","last_active":"2024-04-16T15:52:16.958161+0000","last_peered":"2024-04-16T15:52:16.958161+0000","last_clean":"2024-04-16T15:52:16.958161+0000","last_became_active":"2024-04-16T15:52:14.947256+0000","last_became_peered":"2024-04-16T15:52:14.947256+0000","last_unstale":"2024-04-16T15:52:16.958161+0000","last_undegraded":"2024-04-16T15:52:16.958161+0000","last_fullsized":"2024-04-16T15:52:16.958161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:50:25.315001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-16T15:52:15.974123+0000","last_change":"2024-04-16T15:52:15.971167+0000","last_active":"2024-04-16T15:52:15.974123+0000","last_peered":"2024-04-16T15:52:15.974123+0000","last_clean":"2024-04-16T15:52:15.974123+0000","last_became_active":"2024-04-16T15:52:15.970297+0000","last_became_peered":"2024-04-16T15:52:15.970297+0000","last_unstale":"2024-04-16T15:52:15.974123+0000","last_undegraded":"2024-04-16T15:52:15.974123+0000","last_fullsized":"2024-04-16T15:52:15.974123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:06:46.464243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.959001+0000","last_change":"2024-04-16T15:52:14.944001+0000","last_active":"2024-04-16T15:52:17.959001+0000","last_peered":"2024-04-16T15:52:17.959001+0000","last_clean":"2024-04-16T15:52:17.959001+0000","last_became_active":"2024-04-16T15:52:14.943399+0000","last_became_peered":"2024-04-16T15:52:14.943399+0000","last_unstale":"2024-04-16T15:52:17.959001+0000","last_undegraded":"2024-04-16T15:52:17.959001+0000","last_fullsized":"2024-04-16T15:52:17.959001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:56:16.060919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.959076+0000","last_change":"2024-04-16T15:52:15.966108+0000","last_active":"2024-04-16T15:52:17.959076+0000","last_peered":"2024-04-16T15:52:17.959076+0000","last_clean":"2024-04-16T15:52:17.959076+0000","last_became_active":"2024-04-16T15:52:15.965453+0000","last_became_peered":"2024-04-16T15:52:15.965453+0000","last_unstale":"2024-04-16T15:52:17.959076+0000","last_undegraded":"2024-04-16T15:52:17.959076+0000","last_fullsized":"2024-04-16T15:52:17.959076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:47:47.685958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.166026+0000","last_change":"2024-04-16T15:52:14.942830+0000","last_active":"2024-04-16T15:52:17.166026+0000","last_peered":"2024-04-16T15:52:17.166026+0000","last_clean":"2024-04-16T15:52:17.166026+0000","last_became_active":"2024-04-16T15:52:14.942553+0000","last_became_peered":"2024-04-16T15:52:14.942553+0000","last_unstale":"2024-04-16T15:52:17.166026+0000","last_undegraded":"2024-04-16T15:52:17.166026+0000","last_fullsized":"2024-04-16T15:52:17.166026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:56:16.060919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-16T15:52:15.974104+0000","last_change":"2024-04-16T15:52:15.970722+0000","last_active":"2024-04-16T15:52:15.974104+0000","last_peered":"2024-04-16T15:52:15.974104+0000","last_clean":"2024-04-16T15:52:15.974104+0000","last_became_active":"2024-04-16T15:52:15.970463+0000","last_became_peered":"2024-04-16T15:52:15.970463+0000","last_unstale":"2024-04-16T15:52:15.974104+0000","last_undegraded":"2024-04-16T15:52:15.974104+0000","last_fullsized":"2024-04-16T15:52:15.974104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:32:03.549437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.958010+0000","last_change":"2024-04-16T15:52:14.945683+0000","last_active":"2024-04-16T15:52:16.958010+0000","last_peered":"2024-04-16T15:52:16.958010+0000","last_clean":"2024-04-16T15:52:16.958010+0000","last_became_active":"2024-04-16T15:52:14.945282+0000","last_became_peered":"2024-04-16T15:52:14.945282+0000","last_unstale":"2024-04-16T15:52:16.958010+0000","last_undegraded":"2024-04-16T15:52:16.958010+0000","last_fullsized":"2024-04-16T15:52:16.958010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:32:02.360792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-16T15:52:15.973615+0000","last_change":"2024-04-16T15:52:15.967350+0000","last_active":"2024-04-16T15:52:15.973615+0000","last_peered":"2024-04-16T15:52:15.973615+0000","last_clean":"2024-04-16T15:52:15.973615+0000","last_became_active":"2024-04-16T15:52:15.967083+0000","last_became_peered":"2024-04-16T15:52:15.967083+0000","last_unstale":"2024-04-16T15:52:15.973615+0000","last_undegraded":"2024-04-16T15:52:15.973615+0000","last_fullsized":"2024-04-16T15:52:15.973615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:37:47.713734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.166349+0000","last_change":"2024-04-16T15:52:14.946978+0000","last_active":"2024-04-16T15:52:17.166349+0000","last_peered":"2024-04-16T15:52:17.166349+0000","last_clean":"2024-04-16T15:52:17.166349+0000","last_became_active":"2024-04-16T15:52:14.946652+0000","last_became_peered":"2024-04-16T15:52:14.946652+0000","last_unstale":"2024-04-16T15:52:17.166349+0000","last_undegraded":"2024-04-16T15:52:17.166349+0000","last_fullsized":"2024-04-16T15:52:17.166349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:57:52.293174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-16T15:52:15.974081+0000","last_change":"2024-04-16T15:52:15.970506+0000","last_active":"2024-04-16T15:52:15.974081+0000","last_peered":"2024-04-16T15:52:15.974081+0000","last_clean":"2024-04-16T15:52:15.974081+0000","last_became_active":"2024-04-16T15:52:15.970199+0000","last_became_peered":"2024-04-16T15:52:15.970199+0000","last_unstale":"2024-04-16T15:52:15.974081+0000","last_undegraded":"2024-04-16T15:52:15.974081+0000","last_fullsized":"2024-04-16T15:52:15.974081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:38:40.918721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.953459+0000","last_change":"2024-04-16T15:52:14.941968+0000","last_active":"2024-04-16T15:52:16.953459+0000","last_peered":"2024-04-16T15:52:16.953459+0000","last_clean":"2024-04-16T15:52:16.953459+0000","last_became_active":"2024-04-16T15:52:14.941684+0000","last_became_peered":"2024-04-16T15:52:14.941684+0000","last_unstale":"2024-04-16T15:52:16.953459+0000","last_undegraded":"2024-04-16T15:52:16.953459+0000","last_fullsized":"2024-04-16T15:52:16.953459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:52:37.936009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.958409+0000","last_change":"2024-04-16T15:52:15.959098+0000","last_active":"2024-04-16T15:52:16.958409+0000","last_peered":"2024-04-16T15:52:16.958409+0000","last_clean":"2024-04-16T15:52:16.958409+0000","last_became_active":"2024-04-16T15:52:15.958816+0000","last_became_peered":"2024-04-16T15:52:15.958816+0000","last_unstale":"2024-04-16T15:52:16.958409+0000","last_undegraded":"2024-04-16T15:52:16.958409+0000","last_fullsized":"2024-04-16T15:52:16.958409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:32:53.550133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.166208+0000","last_change":"2024-04-16T15:52:14.941162+0000","last_active":"2024-04-16T15:52:17.166208+0000","last_peered":"2024-04-16T15:52:17.166208+0000","last_clean":"2024-04-16T15:52:17.166208+0000","last_became_active":"2024-04-16T15:52:14.940893+0000","last_became_peered":"2024-04-16T15:52:14.940893+0000","last_unstale":"2024-04-16T15:52:17.166208+0000","last_undegraded":"2024-04-16T15:52:17.166208+0000","last_fullsized":"2024-04-16T15:52:17.166208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:52:05.410477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-16T15:52:15.974234+0000","last_change":"2024-04-16T15:52:15.971577+0000","last_active":"2024-04-16T15:52:15.974234+0000","last_peered":"2024-04-16T15:52:15.974234+0000","last_clean":"2024-04-16T15:52:15.974234+0000","last_became_active":"2024-04-16T15:52:15.971055+0000","last_became_peered":"2024-04-16T15:52:15.971055+0000","last_unstale":"2024-04-16T15:52:15.974234+0000","last_undegraded":"2024-04-16T15:52:15.974234+0000","last_fullsized":"2024-04-16T15:52:15.974234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:12:51.264278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":168,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-16T15:52:15.957971+0000","last_change":"2024-04-16T15:52:04.356095+0000","last_active":"2024-04-16T15:52:15.957971+0000","last_peered":"2024-04-16T15:52:15.957971+0000","last_clean":"2024-04-16T15:52:15.957971+0000","last_became_active":"2024-04-16T15:52:04.355126+0000","last_became_peered":"2024-04-16T15:52:04.355126+0000","last_unstale":"2024-04-16T15:52:15.957971+0000","last_undegraded":"2024-04-16T15:52:15.957971+0000","last_fullsized":"2024-04-16T15:52:15.957971+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:03.285037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:03.285037+0000","last_clean_scrub_stamp":"2024-04-16T15:52:03.285037+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:19.005024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.957635+0000","last_change":"2024-04-16T15:52:14.939932+0000","last_active":"2024-04-16T15:52:16.957635+0000","last_peered":"2024-04-16T15:52:16.957635+0000","last_clean":"2024-04-16T15:52:16.957635+0000","last_became_active":"2024-04-16T15:52:14.939347+0000","last_became_peered":"2024-04-16T15:52:14.939347+0000","last_unstale":"2024-04-16T15:52:16.957635+0000","last_undegraded":"2024-04-16T15:52:16.957635+0000","last_fullsized":"2024-04-16T15:52:16.957635+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:57:52.293174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-16T15:52:15.970443+0000","last_change":"2024-04-16T15:52:15.966920+0000","last_active":"2024-04-16T15:52:15.970443+0000","last_peered":"2024-04-16T15:52:15.970443+0000","last_clean":"2024-04-16T15:52:15.970443+0000","last_became_active":"2024-04-16T15:52:15.966702+0000","last_became_peered":"2024-04-16T15:52:15.966702+0000","last_unstale":"2024-04-16T15:52:15.970443+0000","last_undegraded":"2024-04-16T15:52:15.970443+0000","last_fullsized":"2024-04-16T15:52:15.970443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:59:49.394608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-16T15:52:15.958711+0000","last_change":"2024-04-16T15:52:14.949823+0000","last_active":"2024-04-16T15:52:15.958711+0000","last_peered":"2024-04-16T15:52:15.958711+0000","last_clean":"2024-04-16T15:52:15.958711+0000","last_became_active":"2024-04-16T15:52:14.949402+0000","last_became_peered":"2024-04-16T15:52:14.949402+0000","last_unstale":"2024-04-16T15:52:15.958711+0000","last_undegraded":"2024-04-16T15:52:15.958711+0000","last_fullsized":"2024-04-16T15:52:15.958711+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:09:21.883516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-16T15:52:15.967880+0000","last_change":"2024-04-16T15:52:15.965283+0000","last_active":"2024-04-16T15:52:15.967880+0000","last_peered":"2024-04-16T15:52:15.967880+0000","last_clean":"2024-04-16T15:52:15.967880+0000","last_became_active":"2024-04-16T15:52:15.964965+0000","last_became_peered":"2024-04-16T15:52:15.964965+0000","last_unstale":"2024-04-16T15:52:15.967880+0000","last_undegraded":"2024-04-16T15:52:15.967880+0000","last_fullsized":"2024-04-16T15:52:15.967880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:59:49.394608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.166130+0000","last_change":"2024-04-16T15:52:14.948651+0000","last_active":"2024-04-16T15:52:17.166130+0000","last_peered":"2024-04-16T15:52:17.166130+0000","last_clean":"2024-04-16T15:52:17.166130+0000","last_became_active":"2024-04-16T15:52:14.948371+0000","last_became_peered":"2024-04-16T15:52:14.948371+0000","last_unstale":"2024-04-16T15:52:17.166130+0000","last_undegraded":"2024-04-16T15:52:17.166130+0000","last_fullsized":"2024-04-16T15:52:17.166130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:05:32.659988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.953291+0000","last_change":"2024-04-16T15:52:15.955167+0000","last_active":"2024-04-16T15:52:16.953291+0000","last_peered":"2024-04-16T15:52:16.953291+0000","last_clean":"2024-04-16T15:52:16.953291+0000","last_became_active":"2024-04-16T15:52:15.954877+0000","last_became_peered":"2024-04-16T15:52:15.954877+0000","last_unstale":"2024-04-16T15:52:16.953291+0000","last_undegraded":"2024-04-16T15:52:16.953291+0000","last_fullsized":"2024-04-16T15:52:16.953291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:37:47.713734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.958193+0000","last_change":"2024-04-16T15:52:14.943461+0000","last_active":"2024-04-16T15:52:16.958193+0000","last_peered":"2024-04-16T15:52:16.958193+0000","last_clean":"2024-04-16T15:52:16.958193+0000","last_became_active":"2024-04-16T15:52:14.943188+0000","last_became_peered":"2024-04-16T15:52:14.943188+0000","last_unstale":"2024-04-16T15:52:16.958193+0000","last_undegraded":"2024-04-16T15:52:16.958193+0000","last_fullsized":"2024-04-16T15:52:16.958193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:25:36.501237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.957431+0000","last_change":"2024-04-16T15:52:15.955147+0000","last_active":"2024-04-16T15:52:16.957431+0000","last_peered":"2024-04-16T15:52:16.957431+0000","last_clean":"2024-04-16T15:52:16.957431+0000","last_became_active":"2024-04-16T15:52:15.954234+0000","last_became_peered":"2024-04-16T15:52:15.954234+0000","last_unstale":"2024-04-16T15:52:16.957431+0000","last_undegraded":"2024-04-16T15:52:16.957431+0000","last_fullsized":"2024-04-16T15:52:16.957431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:50:26.319554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.953318+0000","last_change":"2024-04-16T15:52:14.943962+0000","last_active":"2024-04-16T15:52:16.953318+0000","last_peered":"2024-04-16T15:52:16.953318+0000","last_clean":"2024-04-16T15:52:16.953318+0000","last_became_active":"2024-04-16T15:52:14.943709+0000","last_became_peered":"2024-04-16T15:52:14.943709+0000","last_unstale":"2024-04-16T15:52:16.953318+0000","last_undegraded":"2024-04-16T15:52:16.953318+0000","last_fullsized":"2024-04-16T15:52:16.953318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:43:13.134461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.958129+0000","last_change":"2024-04-16T15:52:15.953840+0000","last_active":"2024-04-16T15:52:16.958129+0000","last_peered":"2024-04-16T15:52:16.958129+0000","last_clean":"2024-04-16T15:52:16.958129+0000","last_became_active":"2024-04-16T15:52:15.953574+0000","last_became_peered":"2024-04-16T15:52:15.953574+0000","last_unstale":"2024-04-16T15:52:16.958129+0000","last_undegraded":"2024-04-16T15:52:16.958129+0000","last_fullsized":"2024-04-16T15:52:16.958129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:15:54.440902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-16T15:52:15.957471+0000","last_change":"2024-04-16T15:52:14.950797+0000","last_active":"2024-04-16T15:52:15.957471+0000","last_peered":"2024-04-16T15:52:15.957471+0000","last_clean":"2024-04-16T15:52:15.957471+0000","last_became_active":"2024-04-16T15:52:14.950474+0000","last_became_peered":"2024-04-16T15:52:14.950474+0000","last_unstale":"2024-04-16T15:52:15.957471+0000","last_undegraded":"2024-04-16T15:52:15.957471+0000","last_fullsized":"2024-04-16T15:52:15.957471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:52:37.936009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.953360+0000","last_change":"2024-04-16T15:52:15.954764+0000","last_active":"2024-04-16T15:52:16.953360+0000","last_peered":"2024-04-16T15:52:16.953360+0000","last_clean":"2024-04-16T15:52:16.953360+0000","last_became_active":"2024-04-16T15:52:15.954454+0000","last_became_peered":"2024-04-16T15:52:15.954454+0000","last_unstale":"2024-04-16T15:52:16.953360+0000","last_undegraded":"2024-04-16T15:52:16.953360+0000","last_fullsized":"2024-04-16T15:52:16.953360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:32:03.549437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.953472+0000","last_change":"2024-04-16T15:52:14.945505+0000","last_active":"2024-04-16T15:52:16.953472+0000","last_peered":"2024-04-16T15:52:16.953472+0000","last_clean":"2024-04-16T15:52:16.953472+0000","last_became_active":"2024-04-16T15:52:14.945275+0000","last_became_peered":"2024-04-16T15:52:14.945275+0000","last_unstale":"2024-04-16T15:52:16.953472+0000","last_undegraded":"2024-04-16T15:52:16.953472+0000","last_fullsized":"2024-04-16T15:52:16.953472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:50:25.315001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-16T15:52:15.970079+0000","last_change":"2024-04-16T15:52:15.962328+0000","last_active":"2024-04-16T15:52:15.970079+0000","last_peered":"2024-04-16T15:52:15.970079+0000","last_clean":"2024-04-16T15:52:15.970079+0000","last_became_active":"2024-04-16T15:52:15.961856+0000","last_became_peered":"2024-04-16T15:52:15.961856+0000","last_unstale":"2024-04-16T15:52:15.970079+0000","last_undegraded":"2024-04-16T15:52:15.970079+0000","last_fullsized":"2024-04-16T15:52:15.970079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:43:14.139014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.959506+0000","last_change":"2024-04-16T15:52:14.948103+0000","last_active":"2024-04-16T15:52:17.959506+0000","last_peered":"2024-04-16T15:52:17.959506+0000","last_clean":"2024-04-16T15:52:17.959506+0000","last_became_active":"2024-04-16T15:52:14.947827+0000","last_became_peered":"2024-04-16T15:52:14.947827+0000","last_unstale":"2024-04-16T15:52:17.959506+0000","last_undegraded":"2024-04-16T15:52:17.959506+0000","last_fullsized":"2024-04-16T15:52:17.959506+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:05:32.659988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-16T15:52:15.959257+0000","last_change":"2024-04-16T15:52:15.954129+0000","last_active":"2024-04-16T15:52:15.959257+0000","last_peered":"2024-04-16T15:52:15.959257+0000","last_clean":"2024-04-16T15:52:15.959257+0000","last_became_active":"2024-04-16T15:52:15.953833+0000","last_became_peered":"2024-04-16T15:52:15.953833+0000","last_unstale":"2024-04-16T15:52:15.959257+0000","last_undegraded":"2024-04-16T15:52:15.959257+0000","last_fullsized":"2024-04-16T15:52:15.959257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:52:06.415030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-16T15:52:15.956127+0000","last_change":"2024-04-16T15:52:14.951279+0000","last_active":"2024-04-16T15:52:15.956127+0000","last_peered":"2024-04-16T15:52:15.956127+0000","last_clean":"2024-04-16T15:52:15.956127+0000","last_became_active":"2024-04-16T15:52:14.950928+0000","last_became_peered":"2024-04-16T15:52:14.950928+0000","last_unstale":"2024-04-16T15:52:15.956127+0000","last_undegraded":"2024-04-16T15:52:15.956127+0000","last_fullsized":"2024-04-16T15:52:15.956127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:50:25.315001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.958003+0000","last_change":"2024-04-16T15:52:15.959257+0000","last_active":"2024-04-16T15:52:16.958003+0000","last_peered":"2024-04-16T15:52:16.958003+0000","last_clean":"2024-04-16T15:52:16.958003+0000","last_became_active":"2024-04-16T15:52:15.957931+0000","last_became_peered":"2024-04-16T15:52:15.957931+0000","last_unstale":"2024-04-16T15:52:16.958003+0000","last_undegraded":"2024-04-16T15:52:16.958003+0000","last_fullsized":"2024-04-16T15:52:16.958003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:43:14.139014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.953380+0000","last_change":"2024-04-16T15:52:14.947381+0000","last_active":"2024-04-16T15:52:16.953380+0000","last_peered":"2024-04-16T15:52:16.953380+0000","last_clean":"2024-04-16T15:52:16.953380+0000","last_became_active":"2024-04-16T15:52:14.947124+0000","last_became_peered":"2024-04-16T15:52:14.947124+0000","last_unstale":"2024-04-16T15:52:16.953380+0000","last_undegraded":"2024-04-16T15:52:16.953380+0000","last_fullsized":"2024-04-16T15:52:16.953380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:05:32.659988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-16T15:52:15.969849+0000","last_change":"2024-04-16T15:52:15.962034+0000","last_active":"2024-04-16T15:52:15.969849+0000","last_peered":"2024-04-16T15:52:15.969849+0000","last_clean":"2024-04-16T15:52:15.969849+0000","last_became_active":"2024-04-16T15:52:15.954240+0000","last_became_peered":"2024-04-16T15:52:15.954240+0000","last_unstale":"2024-04-16T15:52:15.969849+0000","last_undegraded":"2024-04-16T15:52:15.969849+0000","last_fullsized":"2024-04-16T15:52:15.969849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:25:37.505791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.953436+0000","last_change":"2024-04-16T15:52:14.946919+0000","last_active":"2024-04-16T15:52:16.953436+0000","last_peered":"2024-04-16T15:52:16.953436+0000","last_clean":"2024-04-16T15:52:16.953436+0000","last_became_active":"2024-04-16T15:52:14.946666+0000","last_became_peered":"2024-04-16T15:52:14.946666+0000","last_unstale":"2024-04-16T15:52:16.953436+0000","last_undegraded":"2024-04-16T15:52:16.953436+0000","last_fullsized":"2024-04-16T15:52:16.953436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:56:16.060919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-16T15:52:15.964695+0000","last_change":"2024-04-16T15:52:15.961288+0000","last_active":"2024-04-16T15:52:15.964695+0000","last_peered":"2024-04-16T15:52:15.964695+0000","last_clean":"2024-04-16T15:52:15.964695+0000","last_became_active":"2024-04-16T15:52:15.961033+0000","last_became_peered":"2024-04-16T15:52:15.961033+0000","last_unstale":"2024-04-16T15:52:15.964695+0000","last_undegraded":"2024-04-16T15:52:15.964695+0000","last_fullsized":"2024-04-16T15:52:15.964695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:50:26.319554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-16T15:52:15.973493+0000","last_change":"2024-04-16T15:52:14.951317+0000","last_active":"2024-04-16T15:52:15.973493+0000","last_peered":"2024-04-16T15:52:15.973493+0000","last_clean":"2024-04-16T15:52:15.973493+0000","last_became_active":"2024-04-16T15:52:14.950992+0000","last_became_peered":"2024-04-16T15:52:14.950992+0000","last_unstale":"2024-04-16T15:52:15.973493+0000","last_undegraded":"2024-04-16T15:52:15.973493+0000","last_fullsized":"2024-04-16T15:52:15.973493+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:25:36.501237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.959215+0000","last_change":"2024-04-16T15:52:15.958425+0000","last_active":"2024-04-16T15:52:17.959215+0000","last_peered":"2024-04-16T15:52:17.959215+0000","last_clean":"2024-04-16T15:52:17.959215+0000","last_became_active":"2024-04-16T15:52:15.957473+0000","last_became_peered":"2024-04-16T15:52:15.957473+0000","last_unstale":"2024-04-16T15:52:17.959215+0000","last_undegraded":"2024-04-16T15:52:17.959215+0000","last_fullsized":"2024-04-16T15:52:17.959215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:37:47.713734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.957965+0000","last_change":"2024-04-16T15:52:15.960621+0000","last_active":"2024-04-16T15:52:16.957965+0000","last_peered":"2024-04-16T15:52:16.957965+0000","last_clean":"2024-04-16T15:52:16.957965+0000","last_became_active":"2024-04-16T15:52:15.959965+0000","last_became_peered":"2024-04-16T15:52:15.959965+0000","last_unstale":"2024-04-16T15:52:16.957965+0000","last_undegraded":"2024-04-16T15:52:16.957965+0000","last_fullsized":"2024-04-16T15:52:16.957965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:49:00.138512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-16T15:52:15.973434+0000","last_change":"2024-04-16T15:52:14.951351+0000","last_active":"2024-04-16T15:52:15.973434+0000","last_peered":"2024-04-16T15:52:15.973434+0000","last_clean":"2024-04-16T15:52:15.973434+0000","last_became_active":"2024-04-16T15:52:14.950926+0000","last_became_peered":"2024-04-16T15:52:14.950926+0000","last_unstale":"2024-04-16T15:52:15.973434+0000","last_undegraded":"2024-04-16T15:52:15.973434+0000","last_fullsized":"2024-04-16T15:52:15.973434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:56:16.060919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.958390+0000","last_change":"2024-04-16T15:52:15.959396+0000","last_active":"2024-04-16T15:52:16.958390+0000","last_peered":"2024-04-16T15:52:16.958390+0000","last_clean":"2024-04-16T15:52:16.958390+0000","last_became_active":"2024-04-16T15:52:15.959074+0000","last_became_peered":"2024-04-16T15:52:15.959074+0000","last_unstale":"2024-04-16T15:52:16.958390+0000","last_undegraded":"2024-04-16T15:52:16.958390+0000","last_fullsized":"2024-04-16T15:52:16.958390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:55:42.881235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-16T15:52:15.972394+0000","last_change":"2024-04-16T15:52:14.951186+0000","last_active":"2024-04-16T15:52:15.972394+0000","last_peered":"2024-04-16T15:52:15.972394+0000","last_clean":"2024-04-16T15:52:15.972394+0000","last_became_active":"2024-04-16T15:52:14.950881+0000","last_became_peered":"2024-04-16T15:52:14.950881+0000","last_unstale":"2024-04-16T15:52:15.972394+0000","last_undegraded":"2024-04-16T15:52:15.972394+0000","last_fullsized":"2024-04-16T15:52:15.972394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:43:13.134461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-16T15:52:15.959476+0000","last_change":"2024-04-16T15:52:15.954875+0000","last_active":"2024-04-16T15:52:15.959476+0000","last_peered":"2024-04-16T15:52:15.959476+0000","last_clean":"2024-04-16T15:52:15.959476+0000","last_became_active":"2024-04-16T15:52:15.953628+0000","last_became_peered":"2024-04-16T15:52:15.953628+0000","last_unstale":"2024-04-16T15:52:15.959476+0000","last_undegraded":"2024-04-16T15:52:15.959476+0000","last_fullsized":"2024-04-16T15:52:15.959476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:05:33.664541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-16T15:52:15.976414+0000","last_change":"2024-04-16T15:52:14.948410+0000","last_active":"2024-04-16T15:52:15.976414+0000","last_peered":"2024-04-16T15:52:15.976414+0000","last_clean":"2024-04-16T15:52:15.976414+0000","last_became_active":"2024-04-16T15:52:14.947833+0000","last_became_peered":"2024-04-16T15:52:14.947833+0000","last_unstale":"2024-04-16T15:52:15.976414+0000","last_undegraded":"2024-04-16T15:52:15.976414+0000","last_fullsized":"2024-04-16T15:52:15.976414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:52:05.410477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-16T15:52:15.961021+0000","last_change":"2024-04-16T15:52:15.958174+0000","last_active":"2024-04-16T15:52:15.961021+0000","last_peered":"2024-04-16T15:52:15.961021+0000","last_clean":"2024-04-16T15:52:15.961021+0000","last_became_active":"2024-04-16T15:52:15.957886+0000","last_became_peered":"2024-04-16T15:52:15.957886+0000","last_unstale":"2024-04-16T15:52:15.961021+0000","last_undegraded":"2024-04-16T15:52:15.961021+0000","last_fullsized":"2024-04-16T15:52:15.961021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:56:17.065473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-16T15:52:15.974667+0000","last_change":"2024-04-16T15:52:14.948721+0000","last_active":"2024-04-16T15:52:15.974667+0000","last_peered":"2024-04-16T15:52:15.974667+0000","last_clean":"2024-04-16T15:52:15.974667+0000","last_became_active":"2024-04-16T15:52:14.948417+0000","last_became_peered":"2024-04-16T15:52:14.948417+0000","last_unstale":"2024-04-16T15:52:15.974667+0000","last_undegraded":"2024-04-16T15:52:15.974667+0000","last_fullsized":"2024-04-16T15:52:15.974667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:41:48.115342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":790528,"data_stored":655584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":66246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":64760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":66246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":200704,"data_stored":64794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":798720,"data_stored":655640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T15:52:19.300 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-16T15:52:19.301 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-16T15:52:19.301 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-16T15:52:19.301 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-16T15:52:19.301 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-16T15:52:19.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.439+0000 7ff0f7c16640 1 Processor -- start 2024-04-16T15:52:19.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.439+0000 7ff0f7c16640 1 -- start start 2024-04-16T15:52:19.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.440+0000 7ff0f7c16640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff0f006d140 0x7ff0f00b03f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:19.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.440+0000 7ff0f7c16640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0f015ee90 0x7ff0f00cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:19.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.440+0000 7ff0f7c16640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0f0072f50 con 0x7ff0f015eab0 2024-04-16T15:52:19.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.440+0000 7ff0f7c16640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7ff0f00b4010 con 0x7ff0f006d140 2024-04-16T15:52:19.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.440+0000 7ff0f7c16640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff0f006ee90 con 0x7ff0f015ee90 2024-04-16T15:52:19.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.440+0000 7ff0f51b1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff0f006d140 0x7ff0f00b03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:19.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.440+0000 7ff0f59b2640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7ff0f015eab0 0x7ff0f006ca30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56564/0 (socket says 172.21.15.132:56564) 2024-04-16T15:52:19.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.440+0000 7ff0f59b2640 1 -- 172.21.15.132:0/1657679504 learned_addr learned my addr 172.21.15.132:0/1657679504 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:19.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.440+0000 7ff0f51b1640 1 -- 172.21.15.132:0/1657679504 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0f015ee90 msgr2=0x7ff0f00cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:19.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.440+0000 7ff0f51b1640 1 --2- 172.21.15.132:0/1657679504 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0f015ee90 0x7ff0f00cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:19.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.440+0000 7ff0f51b1640 1 -- 172.21.15.132:0/1657679504 >> v1:172.21.15.132:6789/0 conn(0x7ff0f015eab0 legacy=0x7ff0f006ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:19.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.440+0000 7ff0f49b0640 1 -- 172.21.15.132:0/1657679504 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 158995175 0 0) 0x7ff0f0072f50 con 0x7ff0f015eab0 2024-04-16T15:52:19.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.440+0000 7ff0f51b1640 1 -- 172.21.15.132:0/1657679504 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0f006f170 con 0x7ff0f006d140 2024-04-16T15:52:19.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.441+0000 7ff0f51b1640 1 --2- 172.21.15.132:0/1657679504 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0f006d140 0x7ff0f00b03f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff0e40097a0 tx=0x7ff0e402b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ab12bfea0baf437 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:19.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.441+0000 7ff0f49b0640 1 -- 172.21.15.132:0/1657679504 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e4034070 con 0x7ff0f006d140 2024-04-16T15:52:19.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.441+0000 7ff0f49b0640 1 -- 172.21.15.132:0/1657679504 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0e4030800 con 0x7ff0f006d140 2024-04-16T15:52:19.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.441+0000 7ff0f49b0640 1 -- 172.21.15.132:0/1657679504 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e4030bd0 con 0x7ff0f006d140 2024-04-16T15:52:19.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.441+0000 7ff0f7c16640 1 -- 172.21.15.132:0/1657679504 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0f006d140 msgr2=0x7ff0f00b03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:19.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.441+0000 7ff0f7c16640 1 --2- 172.21.15.132:0/1657679504 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0f006d140 0x7ff0f00b03f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff0e40097a0 tx=0x7ff0e402b940 comp rx=0 tx=0).stop 2024-04-16T15:52:19.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.441+0000 7ff0f7c16640 1 -- 172.21.15.132:0/1657679504 shutdown_connections 2024-04-16T15:52:19.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.441+0000 7ff0f7c16640 1 --2- 172.21.15.132:0/1657679504 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0f015ee90 0x7ff0f00cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:19.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.442+0000 7ff0f7c16640 1 --2- 172.21.15.132:0/1657679504 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0f006d140 0x7ff0f00b03f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:19.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.442+0000 7ff0f7c16640 1 -- 172.21.15.132:0/1657679504 >> 172.21.15.132:0/1657679504 conn(0x7ff0f00ce6b0 msgr2=0x7ff0f00727a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:19.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.442+0000 7ff0f7c16640 1 -- 172.21.15.132:0/1657679504 shutdown_connections 2024-04-16T15:52:19.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.442+0000 7ff0f7c16640 1 -- 172.21.15.132:0/1657679504 wait complete. 2024-04-16T15:52:19.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.443+0000 7ff0f7c16640 1 Processor -- start 2024-04-16T15:52:19.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.443+0000 7ff0f7c16640 1 -- start start 2024-04-16T15:52:19.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.443+0000 7ff0f7c16640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0f006d140 0x7ff0f0159720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:19.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.443+0000 7ff0f7c16640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0f015eab0 0x7ff0f00c6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:19.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.443+0000 7ff0f7c16640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0f015ee90 0x7ff0f00c73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:19.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.443+0000 7ff0f7c16640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f00739c0 con 0x7ff0f015eab0 2024-04-16T15:52:19.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.443+0000 7ff0f7c16640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f00734a0 con 0x7ff0f015ee90 2024-04-16T15:52:19.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.443+0000 7ff0f7c16640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff0f006f450 con 0x7ff0f006d140 2024-04-16T15:52:19.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.444+0000 7ff0f51b1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0f015eab0 0x7ff0f00c6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:19.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.444+0000 7ff0f51b1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0f015eab0 0x7ff0f00c6e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37430/0 (socket says 172.21.15.132:37430) 2024-04-16T15:52:19.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.444+0000 7ff0f51b1640 1 -- 172.21.15.132:0/1707937646 learned_addr learned my addr 172.21.15.132:0/1707937646 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:19.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.444+0000 7ff0f51b1640 1 -- 172.21.15.132:0/1707937646 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0f006d140 msgr2=0x7ff0f0159720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:19.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.444+0000 7ff0f51b1640 1 --2- 172.21.15.132:0/1707937646 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0f006d140 0x7ff0f0159720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:19.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.444+0000 7ff0f51b1640 1 -- 172.21.15.132:0/1707937646 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0f015ee90 msgr2=0x7ff0f00c73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:19.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.444+0000 7ff0f51b1640 1 --2- 172.21.15.132:0/1707937646 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0f015ee90 0x7ff0f00c73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:19.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.444+0000 7ff0f51b1640 1 -- 172.21.15.132:0/1707937646 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0f0159c60 con 0x7ff0f015eab0 2024-04-16T15:52:19.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.444+0000 7ff0f51b1640 1 --2- 172.21.15.132:0/1707937646 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0f015eab0 0x7ff0f00c6e80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff0e402bf50 tx=0x7ff0e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:19.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.444+0000 7ff0e27fc640 1 -- 172.21.15.132:0/1707937646 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e4034040 con 0x7ff0f015eab0 2024-04-16T15:52:19.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.444+0000 7ff0e27fc640 1 -- 172.21.15.132:0/1707937646 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0e403ada0 con 0x7ff0f015eab0 2024-04-16T15:52:19.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.444+0000 7ff0f7c16640 1 -- 172.21.15.132:0/1707937646 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0f0162110 con 0x7ff0f015eab0 2024-04-16T15:52:19.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.444+0000 7ff0e27fc640 1 -- 172.21.15.132:0/1707937646 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e4044630 con 0x7ff0f015eab0 2024-04-16T15:52:19.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.444+0000 7ff0f7c16640 1 -- 172.21.15.132:0/1707937646 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0f0161870 con 0x7ff0f015eab0 2024-04-16T15:52:19.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.445+0000 7ff0f7c16640 1 -- 172.21.15.132:0/1707937646 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0f0075510 con 0x7ff0f015eab0 2024-04-16T15:52:19.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.446+0000 7ff0e27fc640 1 -- 172.21.15.132:0/1707937646 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff0e4037070 con 0x7ff0f015eab0 2024-04-16T15:52:19.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.446+0000 7ff0e27fc640 1 --2- 172.21.15.132:0/1707937646 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7ff0d406c920 0x7ff0d406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:19.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.446+0000 7ff0e27fc640 1 -- 172.21.15.132:0/1707937646 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff0e40adbc0 con 0x7ff0f015eab0 2024-04-16T15:52:19.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.446+0000 7ff0f59b2640 1 --2- 172.21.15.132:0/1707937646 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7ff0d406c920 0x7ff0d406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:19.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.447+0000 7ff0f59b2640 1 --2- 172.21.15.132:0/1707937646 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7ff0d406c920 0x7ff0d406ede0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec007fd0 tx=0x7ff0ec007920 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:19.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.451+0000 7ff0e27fc640 1 -- 172.21.15.132:0/1707937646 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff0e403f070 con 0x7ff0f015eab0 2024-04-16T15:52:19.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.676+0000 7ff0f7c16640 1 -- 172.21.15.132:0/1707937646 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7ff0f0067c00 con 0x7ff0f015eab0 2024-04-16T15:52:19.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.679+0000 7ff0e27fc640 1 -- 172.21.15.132:0/1707937646 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+174142 (secure 0 0 0) 0x7ff0e407c1a0 con 0x7ff0f015eab0 2024-04-16T15:52:19.680 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:52:19.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.682+0000 7ff0f7c16640 1 -- 172.21.15.132:0/1707937646 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7ff0d406c920 msgr2=0x7ff0d406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:19.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.682+0000 7ff0f7c16640 1 --2- 172.21.15.132:0/1707937646 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7ff0d406c920 0x7ff0d406ede0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec007fd0 tx=0x7ff0ec007920 comp rx=0 tx=0).stop 2024-04-16T15:52:19.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.682+0000 7ff0f7c16640 1 -- 172.21.15.132:0/1707937646 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0f015eab0 msgr2=0x7ff0f00c6e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:19.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.682+0000 7ff0f7c16640 1 --2- 172.21.15.132:0/1707937646 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0f015eab0 0x7ff0f00c6e80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff0e402bf50 tx=0x7ff0e40046c0 comp rx=0 tx=0).stop 2024-04-16T15:52:19.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.682+0000 7ff0f7c16640 1 -- 172.21.15.132:0/1707937646 shutdown_connections 2024-04-16T15:52:19.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.682+0000 7ff0f7c16640 1 --2- 172.21.15.132:0/1707937646 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7ff0d406c920 0x7ff0d406ede0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:19.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.682+0000 7ff0f7c16640 1 --2- 172.21.15.132:0/1707937646 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0f015ee90 0x7ff0f00c73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:19.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.682+0000 7ff0f7c16640 1 --2- 172.21.15.132:0/1707937646 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0f015eab0 0x7ff0f00c6e80 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:19.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.682+0000 7ff0f7c16640 1 --2- 172.21.15.132:0/1707937646 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0f006d140 0x7ff0f0159720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:19.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.682+0000 7ff0f7c16640 1 -- 172.21.15.132:0/1707937646 >> 172.21.15.132:0/1707937646 conn(0x7ff0f00ce6b0 msgr2=0x7ff0f00b0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:19.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.683+0000 7ff0f7c16640 1 -- 172.21.15.132:0/1707937646 shutdown_connections 2024-04-16T15:52:19.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.683+0000 7ff0f7c16640 1 -- 172.21.15.132:0/1707937646 wait complete. 2024-04-16T15:52:19.692 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":5,"flags":0,"active_gid":4101,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":3896387465},{"type":"v1","addr":"172.21.15.132:6833","nonce":3896387465}]},"active_addr":"172.21.15.132:6833/3896387465","active_change":"2024-04-16T15:51:55.262239+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4114,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.132:0","nonce":1128543459}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.132:0","nonce":907647516}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.132:0","nonce":3447655485}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.132:0","nonce":434786832}]}]} 2024-04-16T15:52:19.696 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-16T15:52:19.696 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-16T15:52:19.697 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:52:19.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.801+0000 7ff88e863640 1 Processor -- start 2024-04-16T15:52:19.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.801+0000 7ff88e863640 1 -- start start 2024-04-16T15:52:19.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.802+0000 7ff88e863640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff88809aa30 0x7ff88806cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:19.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.802+0000 7ff88e863640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff88815ede0 0x7ff88809ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:19.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.802+0000 7ff88e863640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff88809b350 con 0x7ff88806df50 2024-04-16T15:52:19.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.802+0000 7ff88e863640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7ff8880b1c00 con 0x7ff88815ede0 2024-04-16T15:52:19.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.802+0000 7ff88e863640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff8880cd530 con 0x7ff88809aa30 2024-04-16T15:52:19.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.803+0000 7ff887fff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff88809aa30 0x7ff88806cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:19.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.803+0000 7ff87f7fe640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff88815ede0 0x7ff88809ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:19.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.803+0000 7ff87f7fe640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff88815ede0 0x7ff88809ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.132:34054/0 (socket says 172.21.15.132:34054) 2024-04-16T15:52:19.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.803+0000 7ff887fff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff88809aa30 0x7ff88806cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.132:57906/0 (socket says 172.21.15.132:57906) 2024-04-16T15:52:19.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.803+0000 7ff87f7fe640 1 -- 172.21.15.132:0/2617418213 learned_addr learned my addr 172.21.15.132:0/2617418213 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:19.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.803+0000 7ff87f7fe640 1 -- 172.21.15.132:0/2617418213 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff88809aa30 msgr2=0x7ff88806cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:19.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.803+0000 7ff87f7fe640 1 --2- 172.21.15.132:0/2617418213 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff88809aa30 0x7ff88806cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:19.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.803+0000 7ff87f7fe640 1 -- 172.21.15.132:0/2617418213 >> v1:172.21.15.179:6789/0 conn(0x7ff88806df50 legacy=0x7ff8880cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:19.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.803+0000 7ff87f7fe640 1 -- 172.21.15.132:0/2617418213 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8880d1fe0 con 0x7ff88815ede0 2024-04-16T15:52:19.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.803+0000 7ff887fff640 1 --2- 172.21.15.132:0/2617418213 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff88809aa30 0x7ff88806cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:52:19.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.804+0000 7ff87f7fe640 1 --2- 172.21.15.132:0/2617418213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff88815ede0 0x7ff88809ae10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff870009870 tx=0x7ff87002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb45c5e3d672b3c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:19.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.804+0000 7ff8877fe640 1 -- 172.21.15.132:0/2617418213 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff870034070 con 0x7ff88815ede0 2024-04-16T15:52:19.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.804+0000 7ff8877fe640 1 -- 172.21.15.132:0/2617418213 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff870030840 con 0x7ff88815ede0 2024-04-16T15:52:19.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.804+0000 7ff8877fe640 1 -- 172.21.15.132:0/2617418213 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff870030c10 con 0x7ff88815ede0 2024-04-16T15:52:19.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.804+0000 7ff88e863640 1 -- 172.21.15.132:0/2617418213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff88815ede0 msgr2=0x7ff88809ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:19.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.804+0000 7ff88e863640 1 --2- 172.21.15.132:0/2617418213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff88815ede0 0x7ff88809ae10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff870009870 tx=0x7ff87002b980 comp rx=0 tx=0).stop 2024-04-16T15:52:19.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.805+0000 7ff88e863640 1 -- 172.21.15.132:0/2617418213 shutdown_connections 2024-04-16T15:52:19.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.805+0000 7ff88e863640 1 --2- 172.21.15.132:0/2617418213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff88815ede0 0x7ff88809ae10 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:19.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.805+0000 7ff88e863640 1 --2- 172.21.15.132:0/2617418213 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff88809aa30 0x7ff88806cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:19.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.805+0000 7ff88e863640 1 -- 172.21.15.132:0/2617418213 >> 172.21.15.132:0/2617418213 conn(0x7ff8880b41e0 msgr2=0x7ff8880b45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:19.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.805+0000 7ff88e863640 1 -- 172.21.15.132:0/2617418213 shutdown_connections 2024-04-16T15:52:19.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.805+0000 7ff88e863640 1 -- 172.21.15.132:0/2617418213 wait complete. 2024-04-16T15:52:19.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.806+0000 7ff88e863640 1 Processor -- start 2024-04-16T15:52:19.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.806+0000 7ff88e863640 1 -- start start 2024-04-16T15:52:19.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.807+0000 7ff88e863640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff88806df50 0x7ff8881608d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:19.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.807+0000 7ff88e863640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff88809aa30 0x7ff888161ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:19.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.807+0000 7ff88e863640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8881578b0 0x7ff88815cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:19.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.807+0000 7ff88e863640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff8880d1b00 con 0x7ff88809aa30 2024-04-16T15:52:19.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.807+0000 7ff88e863640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff8880cd1c0 con 0x7ff8881578b0 2024-04-16T15:52:19.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.807+0000 7ff88e863640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff8880d1c80 con 0x7ff88806df50 2024-04-16T15:52:19.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.807+0000 7ff87f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff88809aa30 0x7ff888161ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:19.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.807+0000 7ff87f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff88809aa30 0x7ff888161ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37442/0 (socket says 172.21.15.132:37442) 2024-04-16T15:52:19.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.807+0000 7ff87f7fe640 1 -- 172.21.15.132:0/1638392684 learned_addr learned my addr 172.21.15.132:0/1638392684 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:19.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.807+0000 7ff887fff640 1 --2- 172.21.15.132:0/1638392684 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff88806df50 0x7ff8881608d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:19.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.807+0000 7ff88ce00640 1 --2- 172.21.15.132:0/1638392684 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8881578b0 0x7ff88815cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:19.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.807+0000 7ff87f7fe640 1 -- 172.21.15.132:0/1638392684 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff88806df50 msgr2=0x7ff8881608d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:19.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.807+0000 7ff87f7fe640 1 --2- 172.21.15.132:0/1638392684 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff88806df50 0x7ff8881608d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:19.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.807+0000 7ff87f7fe640 1 -- 172.21.15.132:0/1638392684 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8881578b0 msgr2=0x7ff88815cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:19.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.807+0000 7ff87f7fe640 1 --2- 172.21.15.132:0/1638392684 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8881578b0 0x7ff88815cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:19.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.807+0000 7ff87f7fe640 1 -- 172.21.15.132:0/1638392684 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff888162020 con 0x7ff88809aa30 2024-04-16T15:52:19.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.807+0000 7ff87f7fe640 1 --2- 172.21.15.132:0/1638392684 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff88809aa30 0x7ff888161ae0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff87002b9c0 tx=0x7ff870004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:19.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.807+0000 7ff8857fa640 1 -- 172.21.15.132:0/1638392684 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff870048070 con 0x7ff88809aa30 2024-04-16T15:52:19.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.807+0000 7ff8857fa640 1 -- 172.21.15.132:0/1638392684 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff870030640 con 0x7ff88809aa30 2024-04-16T15:52:19.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.807+0000 7ff88e863640 1 -- 172.21.15.132:0/1638392684 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff888160f20 con 0x7ff88809aa30 2024-04-16T15:52:19.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.807+0000 7ff8857fa640 1 -- 172.21.15.132:0/1638392684 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff870034040 con 0x7ff88809aa30 2024-04-16T15:52:19.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.807+0000 7ff88e863640 1 -- 172.21.15.132:0/1638392684 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8880c6680 con 0x7ff88809aa30 2024-04-16T15:52:19.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.809+0000 7ff88e863640 1 -- 172.21.15.132:0/1638392684 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff888075510 con 0x7ff88809aa30 2024-04-16T15:52:19.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.809+0000 7ff8857fa640 1 -- 172.21.15.132:0/1638392684 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff870037070 con 0x7ff88809aa30 2024-04-16T15:52:19.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.809+0000 7ff8857fa640 1 --2- 172.21.15.132:0/1638392684 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7ff86806c8f0 0x7ff86806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:19.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.809+0000 7ff8857fa640 1 -- 172.21.15.132:0/1638392684 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff8700ad740 con 0x7ff88809aa30 2024-04-16T15:52:19.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.809+0000 7ff887fff640 1 --2- 172.21.15.132:0/1638392684 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7ff86806c8f0 0x7ff86806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:19.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.810+0000 7ff887fff640 1 --2- 172.21.15.132:0/1638392684 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7ff86806c8f0 0x7ff86806edb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff878009560 tx=0x7ff878009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:19.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.814+0000 7ff8857fa640 1 -- 172.21.15.132:0/1638392684 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff888162020 con 0x7ff88809aa30 2024-04-16T15:52:19.907 INFO:tasks.ceph.mds.b.smithi179.stderr:2024-04-16T15:52:19.908+0000 7f5e552b5640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-16T15:52:19.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.989+0000 7ff88e863640 1 -- 172.21.15.132:0/1638392684 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff8880c92a0 con 0x7ff88809aa30 2024-04-16T15:52:19.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.990+0000 7ff8857fa640 1 -- 172.21.15.132:0/1638392684 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7ff87007b5c0 con 0x7ff88809aa30 2024-04-16T15:52:19.989 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:52:19.989 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"6bdec5d9-f406-43ad-8584-0503b32f6f0d","created":"2024-04-16T15:51:51.073040+0000","modified":"2024-04-16T15:52:16.950186+0000","last_up_change":"2024-04-16T15:52:02.280496+0000","last_in_change":"2024-04-16T15:51:53.376468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:52:03.284927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:52:13.363758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T15:52:14.246647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d45908b-6e22-4619-b190-897af594b712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6801","nonce":1170594668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6803","nonce":1170594668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6807","nonce":1170594668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6805","nonce":1170594668}]},"public_addr":"172.21.15.132:6801/1170594668","cluster_addr":"172.21.15.132:6803/1170594668","heartbeat_back_addr":"172.21.15.132:6807/1170594668","heartbeat_front_addr":"172.21.15.132:6805/1170594668","state":["exists","up"]},{"osd":1,"uuid":"c88bf082-e51f-4ee6-815a-025f6ce0d67b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6809","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6811","nonce":2494780358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6815","nonce":2494780358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6823","nonce":2494780358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6819","nonce":2494780358}]},"public_addr":"172.21.15.132:6811/2494780358","cluster_addr":"172.21.15.132:6815/2494780358","heartbeat_back_addr":"172.21.15.132:6823/2494780358","heartbeat_front_addr":"172.21.15.132:6819/2494780358","state":["exists","up"]},{"osd":2,"uuid":"e5dbd6b4-4e7b-47e4-ad4e-35b4b81696c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6825","nonce":27655483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6827","nonce":27655483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6831","nonce":27655483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6829","nonce":27655483}]},"public_addr":"172.21.15.132:6825/27655483","cluster_addr":"172.21.15.132:6827/27655483","heartbeat_back_addr":"172.21.15.132:6831/27655483","heartbeat_front_addr":"172.21.15.132:6829/27655483","state":["exists","up"]},{"osd":3,"uuid":"9d75cd67-3b8a-4424-8884-5f3660e1f5f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6810","nonce":3100919191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6814","nonce":3100919191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6821","nonce":3100919191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6818","nonce":3100919191}]},"public_addr":"172.21.15.132:6810/3100919191","cluster_addr":"172.21.15.132:6814/3100919191","heartbeat_back_addr":"172.21.15.132:6821/3100919191","heartbeat_front_addr":"172.21.15.132:6818/3100919191","state":["exists","up"]},{"osd":4,"uuid":"83aea46a-8642-4777-912b-c130e5890da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6825","nonce":123637799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6827","nonce":123637799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6831","nonce":123637799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6829","nonce":123637799}]},"public_addr":"172.21.15.179:6825/123637799","cluster_addr":"172.21.15.179:6827/123637799","heartbeat_back_addr":"172.21.15.179:6831/123637799","heartbeat_front_addr":"172.21.15.179:6829/123637799","state":["exists","up"]},{"osd":5,"uuid":"534117c8-3317-48d6-b436-afd5709f71e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6801","nonce":2224750370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6803","nonce":2224750370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6807","nonce":2224750370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6805","nonce":2224750370}]},"public_addr":"172.21.15.179:6801/2224750370","cluster_addr":"172.21.15.179:6803/2224750370","heartbeat_back_addr":"172.21.15.179:6807/2224750370","heartbeat_front_addr":"172.21.15.179:6805/2224750370","state":["exists","up"]},{"osd":6,"uuid":"0ba363e7-fa9d-42b1-ae09-a6a0f57d41f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6809","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6811","nonce":101498164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6813","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6815","nonce":101498164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6823","nonce":101498164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6819","nonce":101498164}]},"public_addr":"172.21.15.179:6811/101498164","cluster_addr":"172.21.15.179:6815/101498164","heartbeat_back_addr":"172.21.15.179:6823/101498164","heartbeat_front_addr":"172.21.15.179:6819/101498164","state":["exists","up"]},{"osd":7,"uuid":"e6830c77-2f2d-4067-9866-ee7625afc1a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6810","nonce":872148365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6814","nonce":872148365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6822","nonce":872148365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6818","nonce":872148365}]},"public_addr":"172.21.15.179:6810/872148365","cluster_addr":"172.21.15.179:6814/872148365","heartbeat_back_addr":"172.21.15.179:6822/872148365","heartbeat_front_addr":"172.21.15.179:6818/872148365","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.535221+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.563769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.520765+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.526264+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.517058+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.500842+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.534332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.512486+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:52:19.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.992+0000 7ff88e863640 1 -- 172.21.15.132:0/1638392684 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7ff86806c8f0 msgr2=0x7ff86806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:19.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.992+0000 7ff88e863640 1 --2- 172.21.15.132:0/1638392684 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7ff86806c8f0 0x7ff86806edb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff878009560 tx=0x7ff878009190 comp rx=0 tx=0).stop 2024-04-16T15:52:19.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.992+0000 7ff88e863640 1 -- 172.21.15.132:0/1638392684 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff88809aa30 msgr2=0x7ff888161ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:19.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.992+0000 7ff88e863640 1 --2- 172.21.15.132:0/1638392684 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff88809aa30 0x7ff888161ae0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff87002b9c0 tx=0x7ff870004730 comp rx=0 tx=0).stop 2024-04-16T15:52:19.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.992+0000 7ff88e863640 1 -- 172.21.15.132:0/1638392684 shutdown_connections 2024-04-16T15:52:19.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.992+0000 7ff88e863640 1 --2- 172.21.15.132:0/1638392684 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7ff86806c8f0 0x7ff86806edb0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:19.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.992+0000 7ff88e863640 1 --2- 172.21.15.132:0/1638392684 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8881578b0 0x7ff88815cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:19.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.992+0000 7ff88e863640 1 --2- 172.21.15.132:0/1638392684 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff88809aa30 0x7ff888161ae0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:19.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.992+0000 7ff88e863640 1 --2- 172.21.15.132:0/1638392684 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff88806df50 0x7ff8881608d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:19.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.992+0000 7ff88e863640 1 -- 172.21.15.132:0/1638392684 >> 172.21.15.132:0/1638392684 conn(0x7ff8880b41e0 msgr2=0x7ff888070a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:19.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.992+0000 7ff88e863640 1 -- 172.21.15.132:0/1638392684 shutdown_connections 2024-04-16T15:52:19.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:19.992+0000 7ff88e863640 1 -- 172.21.15.132:0/1638392684 wait complete. 2024-04-16T15:52:20.003 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-16T15:52:20.003 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:52:20.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.107+0000 7fbb7e315640 1 Processor -- start 2024-04-16T15:52:20.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.108+0000 7fbb7e315640 1 -- start start 2024-04-16T15:52:20.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.108+0000 7fbb7e315640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb78161180 0x7fbb7809aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.108+0000 7fbb7e315640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbb7809afe0 0x7fbb780cd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.108+0000 7fbb7e315640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb780b28b0 con 0x7fbb780cec60 2024-04-16T15:52:20.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.108+0000 7fbb7e315640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fbb780cf040 con 0x7fbb7809afe0 2024-04-16T15:52:20.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.108+0000 7fbb7e315640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fbb780b34c0 con 0x7fbb78161180 2024-04-16T15:52:20.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.108+0000 7fbb7c8b2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbb7809afe0 0x7fbb780cd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.109+0000 7fbb7c8b2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbb7809afe0 0x7fbb780cd0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37446/0 (socket says 172.21.15.132:37446) 2024-04-16T15:52:20.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.109+0000 7fbb7c8b2640 1 -- 172.21.15.132:0/4028130839 learned_addr learned my addr 172.21.15.132:0/4028130839 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:20.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.109+0000 7fbb777fe640 1 --2- 172.21.15.132:0/4028130839 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb78161180 0x7fbb7809aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.109+0000 7fbb7c8b2640 1 -- 172.21.15.132:0/4028130839 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb78161180 msgr2=0x7fbb7809aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:20.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.109+0000 7fbb7c8b2640 1 --2- 172.21.15.132:0/4028130839 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb78161180 0x7fbb7809aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.109+0000 7fbb7c8b2640 1 -- 172.21.15.132:0/4028130839 >> v1:172.21.15.179:6789/0 conn(0x7fbb780cec60 legacy=0x7fbb780b20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.109+0000 7fbb7c8b2640 1 -- 172.21.15.132:0/4028130839 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb780b2b90 con 0x7fbb7809afe0 2024-04-16T15:52:20.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.109+0000 7fbb7c8b2640 1 --2- 172.21.15.132:0/4028130839 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb7809afe0 0x7fbb780cd0b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbb70009e50 tx=0x7fbb7002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=396c42d47f7ecd20 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.110+0000 7fbb76ffd640 1 -- 172.21.15.132:0/4028130839 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb7002ca70 con 0x7fbb7809afe0 2024-04-16T15:52:20.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.110+0000 7fbb76ffd640 1 -- 172.21.15.132:0/4028130839 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb7002cc10 con 0x7fbb7809afe0 2024-04-16T15:52:20.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.110+0000 7fbb76ffd640 1 -- 172.21.15.132:0/4028130839 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb700343f0 con 0x7fbb7809afe0 2024-04-16T15:52:20.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.110+0000 7fbb7e315640 1 -- 172.21.15.132:0/4028130839 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb7809afe0 msgr2=0x7fbb780cd0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.110+0000 7fbb7e315640 1 --2- 172.21.15.132:0/4028130839 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb7809afe0 0x7fbb780cd0b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbb70009e50 tx=0x7fbb7002bed0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.110+0000 7fbb7e315640 1 -- 172.21.15.132:0/4028130839 shutdown_connections 2024-04-16T15:52:20.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.110+0000 7fbb7e315640 1 --2- 172.21.15.132:0/4028130839 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb7809afe0 0x7fbb780cd0b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.110+0000 7fbb7e315640 1 --2- 172.21.15.132:0/4028130839 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb78161180 0x7fbb7809aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.110+0000 7fbb7e315640 1 -- 172.21.15.132:0/4028130839 >> 172.21.15.132:0/4028130839 conn(0x7fbb780d2740 msgr2=0x7fbb780d2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:20.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.110+0000 7fbb7e315640 1 -- 172.21.15.132:0/4028130839 shutdown_connections 2024-04-16T15:52:20.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.110+0000 7fbb7e315640 1 -- 172.21.15.132:0/4028130839 wait complete. 2024-04-16T15:52:20.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.111+0000 7fbb7e315640 1 Processor -- start 2024-04-16T15:52:20.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.112+0000 7fbb7e315640 1 -- start start 2024-04-16T15:52:20.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.112+0000 7fbb7e315640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb7809afe0 0x7fbb78156640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.112+0000 7fbb7e315640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb780cec60 0x7fbb78158000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.112+0000 7fbb7e315640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb78161180 0x7fbb780b1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.112+0000 7fbb7e315640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fbb780b3950 con 0x7fbb7809afe0 2024-04-16T15:52:20.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.112+0000 7fbb7e315640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fbb780b3150 con 0x7fbb780cec60 2024-04-16T15:52:20.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.112+0000 7fbb7e315640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fbb780cd5f0 con 0x7fbb78161180 2024-04-16T15:52:20.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.113+0000 7fbb77fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb7809afe0 0x7fbb78156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.113+0000 7fbb77fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb7809afe0 0x7fbb78156640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37462/0 (socket says 172.21.15.132:37462) 2024-04-16T15:52:20.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.113+0000 7fbb77fff640 1 -- 172.21.15.132:0/3057851846 learned_addr learned my addr 172.21.15.132:0/3057851846 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:20.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.113+0000 7fbb777fe640 1 --2- 172.21.15.132:0/3057851846 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb780cec60 0x7fbb78158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.113+0000 7fbb7c8b2640 1 --2- 172.21.15.132:0/3057851846 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb78161180 0x7fbb780b1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.113+0000 7fbb77fff640 1 -- 172.21.15.132:0/3057851846 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb78161180 msgr2=0x7fbb780b1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.113+0000 7fbb77fff640 1 --2- 172.21.15.132:0/3057851846 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb78161180 0x7fbb780b1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.113+0000 7fbb77fff640 1 -- 172.21.15.132:0/3057851846 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb780cec60 msgr2=0x7fbb78158000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.113+0000 7fbb77fff640 1 --2- 172.21.15.132:0/3057851846 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb780cec60 0x7fbb78158000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.113+0000 7fbb77fff640 1 -- 172.21.15.132:0/3057851846 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb78155880 con 0x7fbb7809afe0 2024-04-16T15:52:20.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.113+0000 7fbb777fe640 1 --2- 172.21.15.132:0/3057851846 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb780cec60 0x7fbb78158000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:52:20.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.113+0000 7fbb77fff640 1 --2- 172.21.15.132:0/3057851846 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb7809afe0 0x7fbb78156640 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbb6800c430 tx=0x7fbb6800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.113+0000 7fbb74ff9640 1 -- 172.21.15.132:0/3057851846 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb680052d0 con 0x7fbb7809afe0 2024-04-16T15:52:20.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.113+0000 7fbb74ff9640 1 -- 172.21.15.132:0/3057851846 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb68005490 con 0x7fbb7809afe0 2024-04-16T15:52:20.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.113+0000 7fbb74ff9640 1 -- 172.21.15.132:0/3057851846 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb68007260 con 0x7fbb7809afe0 2024-04-16T15:52:20.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.113+0000 7fbb7e315640 1 -- 172.21.15.132:0/3057851846 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb78155b60 con 0x7fbb7809afe0 2024-04-16T15:52:20.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.113+0000 7fbb7e315640 1 -- 172.21.15.132:0/3057851846 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb78156120 con 0x7fbb7809afe0 2024-04-16T15:52:20.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.114+0000 7fbb7e315640 1 -- 172.21.15.132:0/3057851846 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb78075510 con 0x7fbb7809afe0 2024-04-16T15:52:20.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.115+0000 7fbb74ff9640 1 -- 172.21.15.132:0/3057851846 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbb68007400 con 0x7fbb7809afe0 2024-04-16T15:52:20.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.115+0000 7fbb74ff9640 1 --2- 172.21.15.132:0/3057851846 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fbb6406c8f0 0x7fbb6406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.115+0000 7fbb74ff9640 1 -- 172.21.15.132:0/3057851846 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fbb6808b0b0 con 0x7fbb7809afe0 2024-04-16T15:52:20.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.115+0000 7fbb777fe640 1 --2- 172.21.15.132:0/3057851846 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fbb6406c8f0 0x7fbb6406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.116+0000 7fbb777fe640 1 --2- 172.21.15.132:0/3057851846 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fbb6406c8f0 0x7fbb6406edb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c006fd0 tx=0x7fbb6c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.119+0000 7fbb74ff9640 1 -- 172.21.15.132:0/3057851846 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbb680594e0 con 0x7fbb7809afe0 2024-04-16T15:52:20.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.293+0000 7fbb7e315640 1 -- 172.21.15.132:0/3057851846 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbb781562f0 con 0x7fbb7809afe0 2024-04-16T15:52:20.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.294+0000 7fbb74ff9640 1 -- 172.21.15.132:0/3057851846 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7fbb68058de0 con 0x7fbb7809afe0 2024-04-16T15:52:20.294 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:52:20.294 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"6bdec5d9-f406-43ad-8584-0503b32f6f0d","created":"2024-04-16T15:51:51.073040+0000","modified":"2024-04-16T15:52:16.950186+0000","last_up_change":"2024-04-16T15:52:02.280496+0000","last_in_change":"2024-04-16T15:51:53.376468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:52:03.284927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:52:13.363758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T15:52:14.246647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d45908b-6e22-4619-b190-897af594b712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6801","nonce":1170594668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6803","nonce":1170594668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6807","nonce":1170594668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6805","nonce":1170594668}]},"public_addr":"172.21.15.132:6801/1170594668","cluster_addr":"172.21.15.132:6803/1170594668","heartbeat_back_addr":"172.21.15.132:6807/1170594668","heartbeat_front_addr":"172.21.15.132:6805/1170594668","state":["exists","up"]},{"osd":1,"uuid":"c88bf082-e51f-4ee6-815a-025f6ce0d67b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6809","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6811","nonce":2494780358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6815","nonce":2494780358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6823","nonce":2494780358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6819","nonce":2494780358}]},"public_addr":"172.21.15.132:6811/2494780358","cluster_addr":"172.21.15.132:6815/2494780358","heartbeat_back_addr":"172.21.15.132:6823/2494780358","heartbeat_front_addr":"172.21.15.132:6819/2494780358","state":["exists","up"]},{"osd":2,"uuid":"e5dbd6b4-4e7b-47e4-ad4e-35b4b81696c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6825","nonce":27655483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6827","nonce":27655483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6831","nonce":27655483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6829","nonce":27655483}]},"public_addr":"172.21.15.132:6825/27655483","cluster_addr":"172.21.15.132:6827/27655483","heartbeat_back_addr":"172.21.15.132:6831/27655483","heartbeat_front_addr":"172.21.15.132:6829/27655483","state":["exists","up"]},{"osd":3,"uuid":"9d75cd67-3b8a-4424-8884-5f3660e1f5f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6810","nonce":3100919191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6814","nonce":3100919191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6821","nonce":3100919191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6818","nonce":3100919191}]},"public_addr":"172.21.15.132:6810/3100919191","cluster_addr":"172.21.15.132:6814/3100919191","heartbeat_back_addr":"172.21.15.132:6821/3100919191","heartbeat_front_addr":"172.21.15.132:6818/3100919191","state":["exists","up"]},{"osd":4,"uuid":"83aea46a-8642-4777-912b-c130e5890da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6825","nonce":123637799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6827","nonce":123637799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6831","nonce":123637799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6829","nonce":123637799}]},"public_addr":"172.21.15.179:6825/123637799","cluster_addr":"172.21.15.179:6827/123637799","heartbeat_back_addr":"172.21.15.179:6831/123637799","heartbeat_front_addr":"172.21.15.179:6829/123637799","state":["exists","up"]},{"osd":5,"uuid":"534117c8-3317-48d6-b436-afd5709f71e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6801","nonce":2224750370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6803","nonce":2224750370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6807","nonce":2224750370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6805","nonce":2224750370}]},"public_addr":"172.21.15.179:6801/2224750370","cluster_addr":"172.21.15.179:6803/2224750370","heartbeat_back_addr":"172.21.15.179:6807/2224750370","heartbeat_front_addr":"172.21.15.179:6805/2224750370","state":["exists","up"]},{"osd":6,"uuid":"0ba363e7-fa9d-42b1-ae09-a6a0f57d41f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6809","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6811","nonce":101498164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6813","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6815","nonce":101498164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6823","nonce":101498164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6819","nonce":101498164}]},"public_addr":"172.21.15.179:6811/101498164","cluster_addr":"172.21.15.179:6815/101498164","heartbeat_back_addr":"172.21.15.179:6823/101498164","heartbeat_front_addr":"172.21.15.179:6819/101498164","state":["exists","up"]},{"osd":7,"uuid":"e6830c77-2f2d-4067-9866-ee7625afc1a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6810","nonce":872148365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6814","nonce":872148365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6822","nonce":872148365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6818","nonce":872148365}]},"public_addr":"172.21.15.179:6810/872148365","cluster_addr":"172.21.15.179:6814/872148365","heartbeat_back_addr":"172.21.15.179:6822/872148365","heartbeat_front_addr":"172.21.15.179:6818/872148365","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.535221+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.563769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.520765+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.526264+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.517058+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.500842+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.534332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.512486+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:52:20.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.297+0000 7fbb7e315640 1 -- 172.21.15.132:0/3057851846 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fbb6406c8f0 msgr2=0x7fbb6406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.297+0000 7fbb7e315640 1 --2- 172.21.15.132:0/3057851846 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fbb6406c8f0 0x7fbb6406edb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c006fd0 tx=0x7fbb6c008040 comp rx=0 tx=0).stop 2024-04-16T15:52:20.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.297+0000 7fbb7e315640 1 -- 172.21.15.132:0/3057851846 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb7809afe0 msgr2=0x7fbb78156640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.297+0000 7fbb7e315640 1 --2- 172.21.15.132:0/3057851846 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb7809afe0 0x7fbb78156640 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbb6800c430 tx=0x7fbb6800c8f0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.297+0000 7fbb7e315640 1 -- 172.21.15.132:0/3057851846 shutdown_connections 2024-04-16T15:52:20.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.297+0000 7fbb7e315640 1 --2- 172.21.15.132:0/3057851846 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fbb6406c8f0 0x7fbb6406edb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.297+0000 7fbb7e315640 1 --2- 172.21.15.132:0/3057851846 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb78161180 0x7fbb780b1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.297+0000 7fbb7e315640 1 --2- 172.21.15.132:0/3057851846 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb780cec60 0x7fbb78158000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.297+0000 7fbb7e315640 1 --2- 172.21.15.132:0/3057851846 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb7809afe0 0x7fbb78156640 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.297+0000 7fbb7e315640 1 -- 172.21.15.132:0/3057851846 >> 172.21.15.132:0/3057851846 conn(0x7fbb780d2740 msgr2=0x7fbb7815e630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:20.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.297+0000 7fbb7e315640 1 -- 172.21.15.132:0/3057851846 shutdown_connections 2024-04-16T15:52:20.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.297+0000 7fbb7e315640 1 -- 172.21.15.132:0/3057851846 wait complete. 2024-04-16T15:52:20.308 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-16T15:52:20.308 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-16T15:52:20.309 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-16T15:52:20.309 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-16T15:52:20.309 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-16T15:52:20.310 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-16T15:52:20.310 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-16T15:52:20.311 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-16T15:52:20.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.486+0000 7f5b4a689640 1 Processor -- start 2024-04-16T15:52:20.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.486+0000 7fdf81d34640 1 Processor -- start 2024-04-16T15:52:20.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.486+0000 7fdf81d34640 1 -- start start 2024-04-16T15:52:20.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.486+0000 7f5b4a689640 1 -- start start 2024-04-16T15:52:20.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.487+0000 7f5b4a689640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5b3c004af0 0x7f5b3c03a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.487+0000 7f5b4a689640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b3c0defa0 0x7f5b3c0e2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.488+0000 7f5b49687640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5b3c004af0 0x7f5b3c03a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.488+0000 7f5b49687640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5b3c004af0 0x7f5b3c03a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.132:34096/0 (socket says 172.21.15.132:34096) 2024-04-16T15:52:20.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.488+0000 7f5b49687640 1 -- 172.21.15.132:0/1421531520 learned_addr learned my addr 172.21.15.132:0/1421531520 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:20.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.488+0000 7f8296a14640 1 Processor -- start 2024-04-16T15:52:20.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.488+0000 7f8296a14640 1 -- start start 2024-04-16T15:52:20.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.488+0000 7f5b4a689640 1 -- 172.21.15.132:0/1421531520 --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b3c054910 con 0x7f5b3c0df400 2024-04-16T15:52:20.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.487+0000 7fdf81d34640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdf7403ad40 0x7fdf740df650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.487+0000 7fdf81d34640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf74053c20 con 0x7fdf74050080 2024-04-16T15:52:20.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.487+0000 7fdf81d34640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf74053f00 con 0x7fdf74054cc0 2024-04-16T15:52:20.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.487+0000 7fdf81d34640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fdf74055170 con 0x7fdf7403ad40 2024-04-16T15:52:20.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.488+0000 7fdf80d32640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdf7403ad40 0x7fdf740df650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.488+0000 7fdf80d32640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdf7403ad40 0x7fdf740df650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.132:34084/0 (socket says 172.21.15.132:34084) 2024-04-16T15:52:20.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.488+0000 7fdf80d32640 1 -- 172.21.15.132:0/4086548036 learned_addr learned my addr 172.21.15.132:0/4086548036 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:20.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.488+0000 7fdf80d32640 1 -- 172.21.15.132:0/4086548036 >> v1:172.21.15.179:6789/0 conn(0x7fdf74054cc0 legacy=0x7fdf740533f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-16T15:52:20.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.488+0000 7fdf80d32640 1 -- 172.21.15.132:0/4086548036 >> v1:172.21.15.132:6789/0 conn(0x7fdf74050080 legacy=0x7fdf74050490 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-16T15:52:20.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.488+0000 7fdf80d32640 1 -- 172.21.15.132:0/4086548036 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf740541e0 con 0x7fdf7403ad40 2024-04-16T15:52:20.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.488+0000 7f5b4a689640 1 -- 172.21.15.132:0/1421531520 --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f5b3c054bf0 con 0x7f5b3c004af0 2024-04-16T15:52:20.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.488+0000 7f5b4a689640 1 -- 172.21.15.132:0/1421531520 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f5b3c0062d0 con 0x7f5b3c0defa0 2024-04-16T15:52:20.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.488+0000 7f5b3bfff640 1 -- 172.21.15.132:0/1421531520 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3776717748 0 0) 0x7f5b3c054910 con 0x7f5b3c0df400 2024-04-16T15:52:20.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.489+0000 7f5b3bfff640 1 -- 172.21.15.132:0/1421531520 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b30003520 con 0x7f5b3c0df400 2024-04-16T15:52:20.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.489+0000 7f5b49687640 1 -- 172.21.15.132:0/1421531520 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b3c0defa0 msgr2=0x7f5b3c0e2d70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-16T15:52:20.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.489+0000 7f5b49687640 1 --2- 172.21.15.132:0/1421531520 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b3c0defa0 0x7f5b3c0e2d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.489+0000 7f5b49687640 1 -- 172.21.15.132:0/1421531520 >> v1:172.21.15.132:6789/0 conn(0x7f5b3c0df400 legacy=0x7f5b3c0533d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.489+0000 7f5b49687640 1 -- 172.21.15.132:0/1421531520 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b3c0065b0 con 0x7f5b3c004af0 2024-04-16T15:52:20.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.489+0000 7f4e51a0c640 1 Processor -- start 2024-04-16T15:52:20.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.489+0000 7fd42ef74640 1 Processor -- start 2024-04-16T15:52:20.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.489+0000 7f4e51a0c640 1 -- start start 2024-04-16T15:52:20.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.489+0000 7fd42ef74640 1 -- start start 2024-04-16T15:52:20.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.489+0000 7f8296a14640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f82900b3640 0x7f8290144f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.490+0000 7f5dc9d53640 1 Processor -- start 2024-04-16T15:52:20.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.490+0000 7fdf80d32640 1 --2- 172.21.15.132:0/4086548036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf7403ad40 0x7fdf740df650 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdf740552f0 tx=0x7fdf6802b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a1d1c6171f0751f server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.490+0000 7f4e51a0c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4e4c162c90 0x7f4e4c06fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.490+0000 7f4e51a0c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4e4c167300 0x7f4e4c0cf230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.490+0000 7f828ffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f82900b3640 0x7f8290144f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.490+0000 7f828ffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f82900b3640 0x7f8290144f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37472/0 (socket says 172.21.15.132:37472) 2024-04-16T15:52:20.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.490+0000 7f828ffff640 1 -- 172.21.15.132:0/2275372096 learned_addr learned my addr 172.21.15.132:0/2275372096 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:20.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.490+0000 7f5b49687640 1 --2- 172.21.15.132:0/1421531520 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b3c004af0 0x7f5b3c03a7e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5b34009870 tx=0x7f5b3402b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f4420ec668aeb96 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.490+0000 7f4e51a0c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e4c1677a0 con 0x7f4e4c071de0 2024-04-16T15:52:20.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.490+0000 7fd42ef74640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd428163040 0x7fd4280adf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.490+0000 7fd42ef74640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd428067760 0x7fd428067bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.490+0000 7fd42ef74640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd42806e910 con 0x7fd42806ca30 2024-04-16T15:52:20.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.490+0000 7fd42ef74640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fd42806f520 con 0x7fd428067760 2024-04-16T15:52:20.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.490+0000 7fd42ef74640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fd42806ebf0 con 0x7fd428163040 2024-04-16T15:52:20.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.490+0000 7f201a0c7640 1 Processor -- start 2024-04-16T15:52:20.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.490+0000 7f4e51a0c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f4e4c0ce470 con 0x7f4e4c162c90 2024-04-16T15:52:20.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.490+0000 7f4e51a0c640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f4e4c0ce750 con 0x7f4e4c167300 2024-04-16T15:52:20.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.490+0000 7f4e4a7fc640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4e4c167300 0x7f4e4c0cf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.490+0000 7f5dc9d53640 1 -- start start 2024-04-16T15:52:20.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.490+0000 7f5b3bfff640 1 -- 172.21.15.132:0/1421531520 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b34035020 con 0x7f5b3c004af0 2024-04-16T15:52:20.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.490+0000 7f4e4a7fc640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4e4c167300 0x7f4e4c0cf230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.132:34106/0 (socket says 172.21.15.132:34106) 2024-04-16T15:52:20.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.490+0000 7f4e4a7fc640 1 -- 172.21.15.132:0/2875177 learned_addr learned my addr 172.21.15.132:0/2875177 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:20.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.490+0000 7f5b3bfff640 1 -- 172.21.15.132:0/1421531520 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b34031870 con 0x7f5b3c004af0 2024-04-16T15:52:20.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.490+0000 7fd42d511640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd428067760 0x7fd428067bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.490+0000 7f4e4affd640 1 --2- 172.21.15.132:0/2875177 >> v2:172.21.15.132:3300/0 conn(0x7f4e4c162c90 0x7f4e4c06fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.490+0000 7fd42cd10640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fd42806ca30 0x7fd42806ce10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.132:39768/0 (socket says 172.21.15.132:39768) 2024-04-16T15:52:20.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.490+0000 7fd427fff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd428163040 0x7fd4280adf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.491+0000 7fd42cd10640 1 -- 172.21.15.132:0/1564594184 learned_addr learned my addr 172.21.15.132:0/1564594184 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:20.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.491+0000 7f4e4a7fc640 1 -- 172.21.15.132:0/2875177 >> v2:172.21.15.132:3300/0 conn(0x7f4e4c162c90 msgr2=0x7f4e4c06fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:20.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.491+0000 7f4e4a7fc640 1 --2- 172.21.15.132:0/2875177 >> v2:172.21.15.132:3300/0 conn(0x7f4e4c162c90 0x7f4e4c06fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.491+0000 7f4e4a7fc640 1 -- 172.21.15.132:0/2875177 >> v1:172.21.15.132:6789/0 conn(0x7f4e4c071de0 legacy=0x7f4e4c0721e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.491+0000 7f4e4a7fc640 1 -- 172.21.15.132:0/2875177 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e4c0cea30 con 0x7f4e4c167300 2024-04-16T15:52:20.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.489+0000 7f151c972640 1 Processor -- start 2024-04-16T15:52:20.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.489+0000 7f151c972640 1 -- start start 2024-04-16T15:52:20.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.491+0000 7f151c972640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1518070360 0x7f151806e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.491+0000 7f151c972640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f151806edf0 con 0x7f1518160790 2024-04-16T15:52:20.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.491+0000 7f151c972640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f151806f0d0 con 0x7f151806e600 2024-04-16T15:52:20.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.491+0000 7f151c972640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f151806f3b0 con 0x7f1518070360 2024-04-16T15:52:20.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.491+0000 7f4e4affd640 1 --2- 172.21.15.132:0/2875177 >> v2:172.21.15.132:3300/0 conn(0x7f4e4c162c90 0x7f4e4c06fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:20.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.491+0000 7fd42d511640 1 -- 172.21.15.132:0/1564594184 >> v2:172.21.15.179:3300/0 conn(0x7fd428163040 msgr2=0x7fd4280adf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:20.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.491+0000 7f1517fff640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f151806e600 0x7f15180ce560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.132:39784/0 (socket says 172.21.15.132:39784) 2024-04-16T15:52:20.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.491+0000 7f1517fff640 1 -- 172.21.15.132:0/1233943472 learned_addr learned my addr 172.21.15.132:0/1233943472 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:20.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.491+0000 7f8296a14640 1 --2- 172.21.15.132:0/2275372096 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f829015f9c0 0x7f829006dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.491+0000 7f8296a14640 1 -- 172.21.15.132:0/2275372096 --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82900b4750 con 0x7f82900cdac0 2024-04-16T15:52:20.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.491+0000 7f8296a14640 1 -- 172.21.15.132:0/2275372096 --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f829015bcf0 con 0x7f82900b3640 2024-04-16T15:52:20.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.491+0000 7f8296a14640 1 -- 172.21.15.132:0/2275372096 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f8290145490 con 0x7f829015f9c0 2024-04-16T15:52:20.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.491+0000 7fd42d511640 1 --2- 172.21.15.132:0/1564594184 >> v2:172.21.15.179:3300/0 conn(0x7fd428163040 0x7fd4280adf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.491+0000 7fd42d511640 1 -- 172.21.15.132:0/1564594184 >> v1:172.21.15.179:6789/0 conn(0x7fd42806ca30 legacy=0x7fd42806ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.491+0000 7fd42d511640 1 -- 172.21.15.132:0/1564594184 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd42806eed0 con 0x7fd428067760 2024-04-16T15:52:20.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.491+0000 7f5b4a689640 1 -- 172.21.15.132:0/1421531520 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b3c004af0 msgr2=0x7f5b3c03a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.491+0000 7f5b4a689640 1 --2- 172.21.15.132:0/1421531520 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b3c004af0 0x7f5b3c03a7e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5b34009870 tx=0x7f5b3402b910 comp rx=0 tx=0).stop 2024-04-16T15:52:20.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.490+0000 7f201a0c7640 1 -- start start 2024-04-16T15:52:20.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.491+0000 7f5b4a689640 1 -- 172.21.15.132:0/1421531520 shutdown_connections 2024-04-16T15:52:20.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.491+0000 7f5b4a689640 1 --2- 172.21.15.132:0/1421531520 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b3c0defa0 0x7f5b3c0e2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.491+0000 7f5b4a689640 1 --2- 172.21.15.132:0/1421531520 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b3c004af0 0x7f5b3c03a7e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.492+0000 7f5b4a689640 1 -- 172.21.15.132:0/1421531520 >> 172.21.15.132:0/1421531520 conn(0x7f5b3c00a3f0 msgr2=0x7f5b3c00a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:20.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.491+0000 7f8294fb1640 1 --2- 172.21.15.132:0/2275372096 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f829015f9c0 0x7f829006dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.491+0000 7f828ffff640 1 -- 172.21.15.132:0/2275372096 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f829015f9c0 msgr2=0x7f829006dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:20.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.491+0000 7f828ffff640 1 --2- 172.21.15.132:0/2275372096 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f829015f9c0 0x7f829006dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.491+0000 7f828ffff640 1 -- 172.21.15.132:0/2275372096 >> v1:172.21.15.132:6789/0 conn(0x7f82900cdac0 legacy=0x7f829015f2b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-16T15:52:20.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.492+0000 7f828ffff640 1 -- 172.21.15.132:0/2275372096 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82900b3b40 con 0x7f82900b3640 2024-04-16T15:52:20.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.491+0000 7f150effd640 1 --2- 172.21.15.132:0/1233943472 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1518070360 0x7f151806e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.491+0000 7f5dc9d53640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5dc415eae0 0x7f5dc40cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.492+0000 7f5b4a689640 1 -- 172.21.15.132:0/1421531520 shutdown_connections 2024-04-16T15:52:20.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.491+0000 7f5dc9d53640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5dc40ba050 0x7f5dc40cf940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.491+0000 7f5dc9d53640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dc4162c90 con 0x7f5dc415e700 2024-04-16T15:52:20.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.491+0000 7f5dc9d53640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f5dc4162f70 con 0x7f5dc415eae0 2024-04-16T15:52:20.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.492+0000 7f5dc9552640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5dc40ba050 0x7f5dc40cf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.492+0000 7f5dc9552640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5dc40ba050 0x7f5dc40cf940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.132:57992/0 (socket says 172.21.15.132:57992) 2024-04-16T15:52:20.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.492+0000 7f5dc9552640 1 -- 172.21.15.132:0/360594998 learned_addr learned my addr 172.21.15.132:0/360594998 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:20.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.491+0000 7f5dc9d53640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f5dc4163250 con 0x7f5dc40ba050 2024-04-16T15:52:20.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.492+0000 7f5dbb7fe640 1 -- 172.21.15.132:0/360594998 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3419036659 0 0) 0x7f5dc4162c90 con 0x7f5dc415e700 2024-04-16T15:52:20.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.492+0000 7f201a0c7640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f200c005e80 0x7f200c0062c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.492+0000 7f201a0c7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f200c006800 0x7f200c006c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.492+0000 7f201a0c7640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f200c053710 con 0x7f200c0eacf0 2024-04-16T15:52:20.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.492+0000 7f201a0c7640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f200c054320 con 0x7f200c006800 2024-04-16T15:52:20.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.492+0000 7f201a0c7640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f200c0539f0 con 0x7f200c005e80 2024-04-16T15:52:20.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.492+0000 7f2013fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f200c006800 0x7f200c006c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.492+0000 7f2013fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f200c006800 0x7f200c006c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37478/0 (socket says 172.21.15.132:37478) 2024-04-16T15:52:20.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.492+0000 7f2013fff640 1 -- 172.21.15.132:0/2685153142 learned_addr learned my addr 172.21.15.132:0/2685153142 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:20.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.492+0000 7f5dbb7fe640 1 -- 172.21.15.132:0/360594998 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5dac003520 con 0x7f5dc415e700 2024-04-16T15:52:20.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.492+0000 7f5dbbfff640 1 --2- 172.21.15.132:0/360594998 >> v2:172.21.15.179:3300/0 conn(0x7f5dc415eae0 0x7f5dc40cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.492+0000 7f5dc9552640 1 -- 172.21.15.132:0/360594998 >> v2:172.21.15.179:3300/0 conn(0x7f5dc415eae0 msgr2=0x7f5dc40cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:20.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.492+0000 7f2012ffd640 1 --2- 172.21.15.132:0/2685153142 >> v2:172.21.15.179:3300/0 conn(0x7f200c005e80 0x7f200c0062c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.492+0000 7f5dc9552640 1 --2- 172.21.15.132:0/360594998 >> v2:172.21.15.179:3300/0 conn(0x7f5dc415eae0 0x7f5dc40cf400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.492+0000 7f5dc9552640 1 -- 172.21.15.132:0/360594998 >> v1:172.21.15.179:6789/0 conn(0x7f5dc415e700 legacy=0x7f5dc4162440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.492+0000 7f5b4a689640 1 -- 172.21.15.132:0/1421531520 wait complete. 2024-04-16T15:52:20.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.492+0000 7f5dc9552640 1 -- 172.21.15.132:0/360594998 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dc40d2b00 con 0x7f5dc40ba050 2024-04-16T15:52:20.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.492+0000 7f2013fff640 1 -- 172.21.15.132:0/2685153142 >> v2:172.21.15.179:3300/0 conn(0x7f200c005e80 msgr2=0x7f200c0062c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:20.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.492+0000 7fd427fff640 1 --2- 172.21.15.132:0/1564594184 >> v2:172.21.15.179:3300/0 conn(0x7fd428163040 0x7fd4280adf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:20.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.492+0000 7f2013fff640 1 --2- 172.21.15.132:0/2685153142 >> v2:172.21.15.179:3300/0 conn(0x7f200c005e80 0x7f200c0062c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.492+0000 7fdf7b7fe640 1 -- 172.21.15.132:0/4086548036 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf680317c0 con 0x7fdf7403ad40 2024-04-16T15:52:20.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.492+0000 7fdf7b7fe640 1 -- 172.21.15.132:0/4086548036 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf68037070 con 0x7fdf7403ad40 2024-04-16T15:52:20.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.492+0000 7fdf7b7fe640 1 -- 172.21.15.132:0/4086548036 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf68031b80 con 0x7fdf7403ad40 2024-04-16T15:52:20.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.492+0000 7f2013fff640 1 -- 172.21.15.132:0/2685153142 >> v1:172.21.15.132:6789/0 conn(0x7f200c0eacf0 legacy=0x7f200c04fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.492+0000 7f2013fff640 1 -- 172.21.15.132:0/2685153142 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f200c053cd0 con 0x7f200c006800 2024-04-16T15:52:20.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.492+0000 7f20127fc640 1 -- 172.21.15.132:0/2685153142 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2100704475 0 0) 0x7f200c053710 con 0x7f200c0eacf0 2024-04-16T15:52:20.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.493+0000 7f4e4a7fc640 1 --2- 172.21.15.132:0/2875177 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e4c167300 0x7f4e4c0cf230 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c06cae0 tx=0x7f4e4002b9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc5b6b53da5c6464 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.493+0000 7f828ffff640 1 --2- 172.21.15.132:0/2275372096 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f82900b3640 0x7f8290144f50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8290071ec0 tx=0x7f828802c120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24374b73c3989255 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.493+0000 7f828effd640 1 -- 172.21.15.132:0/2275372096 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f828802cac0 con 0x7f82900b3640 2024-04-16T15:52:20.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.493+0000 7f1516ffd640 1 -- 172.21.15.132:0/1233943472 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4185541860 0 0) 0x7f151806f0d0 con 0x7f151806e600 2024-04-16T15:52:20.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.493+0000 7f828effd640 1 -- 172.21.15.132:0/2275372096 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f828802cc60 con 0x7f82900b3640 2024-04-16T15:52:20.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.493+0000 7f5dbbfff640 1 --2- 172.21.15.132:0/360594998 >> v2:172.21.15.179:3300/0 conn(0x7f5dc415eae0 0x7f5dc40cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:52:20.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.493+0000 7f828effd640 1 -- 172.21.15.132:0/2275372096 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8288034610 con 0x7f82900b3640 2024-04-16T15:52:20.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.493+0000 7f2013fff640 1 --2- 172.21.15.132:0/2685153142 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f200c006800 0x7f200c006c70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f201406b370 tx=0x7f2014069820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85ed6a78341e839b server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.516 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.493+0000 7f1516ffd640 1 -- 172.21.15.132:0/1233943472 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1504003520 con 0x7f151806e600 2024-04-16T15:52:20.516 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.493+0000 7f5b4a689640 1 Processor -- start 2024-04-16T15:52:20.516 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.493+0000 7f1516ffd640 1 -- 172.21.15.132:0/1233943472 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 743104992 0 0) 0x7f151806edf0 con 0x7f1518160790 2024-04-16T15:52:20.516 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.493+0000 7f1516ffd640 1 -- 172.21.15.132:0/1233943472 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f151806f0d0 con 0x7f1518160790 2024-04-16T15:52:20.516 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.493+0000 7f4e49ffb640 1 -- 172.21.15.132:0/2875177 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e40034070 con 0x7f4e4c167300 2024-04-16T15:52:20.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.493+0000 7f4e49ffb640 1 -- 172.21.15.132:0/2875177 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e40030870 con 0x7f4e4c167300 2024-04-16T15:52:20.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.493+0000 7f4e49ffb640 1 -- 172.21.15.132:0/2875177 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e40030c40 con 0x7f4e4c167300 2024-04-16T15:52:20.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.493+0000 7f150effd640 1 -- 172.21.15.132:0/1233943472 >> v1:172.21.15.179:6789/0 conn(0x7f151806e600 legacy=0x7f15180ce560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.493+0000 7f150effd640 1 -- 172.21.15.132:0/1233943472 >> v1:172.21.15.132:6789/0 conn(0x7f1518160790 legacy=0x7f151806fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.493+0000 7f150effd640 1 -- 172.21.15.132:0/1233943472 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f151806f690 con 0x7f1518070360 2024-04-16T15:52:20.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.493+0000 7f5dc9552640 1 --2- 172.21.15.132:0/360594998 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5dc40ba050 0x7f5dc40cf940 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc014a30 tx=0x7f5dbc034990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba1b8de26594b710 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.494+0000 7f20127fc640 1 -- 172.21.15.132:0/2685153142 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20140b3070 con 0x7f200c006800 2024-04-16T15:52:20.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.494+0000 7fdf81d34640 1 -- 172.21.15.132:0/4086548036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf7403ad40 msgr2=0x7fdf740df650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.494+0000 7fdf81d34640 1 --2- 172.21.15.132:0/4086548036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf7403ad40 0x7fdf740df650 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdf740552f0 tx=0x7fdf6802b860 comp rx=0 tx=0).stop 2024-04-16T15:52:20.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.493+0000 7fd42d511640 1 --2- 172.21.15.132:0/1564594184 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd428067760 0x7fd428067bf0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd4280b7040 tx=0x7fd42002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeb1992de0bb91ae server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.494+0000 7fd4277fe640 1 -- 172.21.15.132:0/1564594184 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd420039070 con 0x7fd428067760 2024-04-16T15:52:20.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.494+0000 7fd4277fe640 1 -- 172.21.15.132:0/1564594184 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd42002cc90 con 0x7fd428067760 2024-04-16T15:52:20.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.494+0000 7fd4277fe640 1 -- 172.21.15.132:0/1564594184 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd420034660 con 0x7fd428067760 2024-04-16T15:52:20.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.494+0000 7f5b4a689640 1 -- start start 2024-04-16T15:52:20.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.494+0000 7f8296a14640 1 -- 172.21.15.132:0/2275372096 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f82900b3640 msgr2=0x7f8290144f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.494+0000 7f8296a14640 1 --2- 172.21.15.132:0/2275372096 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f82900b3640 0x7f8290144f50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8290071ec0 tx=0x7f828802c120 comp rx=0 tx=0).stop 2024-04-16T15:52:20.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.494+0000 7fdf81d34640 1 -- 172.21.15.132:0/4086548036 shutdown_connections 2024-04-16T15:52:20.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.494+0000 7f20127fc640 1 -- 172.21.15.132:0/2685153142 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20140ac7d0 con 0x7f200c006800 2024-04-16T15:52:20.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.494+0000 7f20127fc640 1 -- 172.21.15.132:0/2685153142 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20140a7e60 con 0x7f200c006800 2024-04-16T15:52:20.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.494+0000 7f8296a14640 1 -- 172.21.15.132:0/2275372096 shutdown_connections 2024-04-16T15:52:20.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.494+0000 7f8296a14640 1 --2- 172.21.15.132:0/2275372096 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f829015f9c0 0x7f829006dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.494+0000 7f8296a14640 1 --2- 172.21.15.132:0/2275372096 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f82900b3640 0x7f8290144f50 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.494+0000 7f8296a14640 1 -- 172.21.15.132:0/2275372096 >> 172.21.15.132:0/2275372096 conn(0x7f82900b2d50 msgr2=0x7f829006ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:20.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.494+0000 7fdf81d34640 1 --2- 172.21.15.132:0/4086548036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf7403ad40 0x7fdf740df650 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.494+0000 7fdf81d34640 1 -- 172.21.15.132:0/4086548036 >> 172.21.15.132:0/4086548036 conn(0x7fdf74055340 msgr2=0x7fdf74055750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:20.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.494+0000 7fdf81d34640 1 -- 172.21.15.132:0/4086548036 shutdown_connections 2024-04-16T15:52:20.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.494+0000 7fdf81d34640 1 -- 172.21.15.132:0/4086548036 wait complete. 2024-04-16T15:52:20.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.494+0000 7f8296a14640 1 -- 172.21.15.132:0/2275372096 shutdown_connections 2024-04-16T15:52:20.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.494+0000 7f8296a14640 1 -- 172.21.15.132:0/2275372096 wait complete. 2024-04-16T15:52:20.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.495+0000 7f5b4a689640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b3c004af0 0x7f5b3c035890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.495+0000 7f5dbb7fe640 1 -- 172.21.15.132:0/360594998 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc03d020 con 0x7f5dc40ba050 2024-04-16T15:52:20.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.495+0000 7f5dbb7fe640 1 -- 172.21.15.132:0/360594998 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dbc0114e0 con 0x7f5dc40ba050 2024-04-16T15:52:20.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.495+0000 7f5b4a689640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b3c0defa0 0x7f5b3c037330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.495+0000 7f5b49687640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b3c004af0 0x7f5b3c035890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.495+0000 7f5b49687640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b3c004af0 0x7f5b3c035890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37494/0 (socket says 172.21.15.132:37494) 2024-04-16T15:52:20.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.495+0000 7f150effd640 1 --2- 172.21.15.132:0/1233943472 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1518070360 0x7f151806e0c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f15000097d0 tx=0x7f150002b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cd3df186069be75 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.495+0000 7f5b49687640 1 -- 172.21.15.132:0/4060372039 learned_addr learned my addr 172.21.15.132:0/4060372039 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:20.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.495+0000 7f5b4a689640 1 --2- 172.21.15.132:0/4060372039 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b3c0df400 0x7f5b3c0d12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.495+0000 7fd42ef74640 1 -- 172.21.15.132:0/1564594184 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd428067760 msgr2=0x7fd428067bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.495+0000 7f5dbb7fe640 1 -- 172.21.15.132:0/360594998 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc0118f0 con 0x7f5dc40ba050 2024-04-16T15:52:20.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.495+0000 7fd42ef74640 1 --2- 172.21.15.132:0/1564594184 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd428067760 0x7fd428067bf0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd4280b7040 tx=0x7fd42002bee0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.495+0000 7f1516ffd640 1 -- 172.21.15.132:0/1233943472 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1500035020 con 0x7f1518070360 2024-04-16T15:52:20.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.495+0000 7f1516ffd640 1 -- 172.21.15.132:0/1233943472 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1500031890 con 0x7f1518070360 2024-04-16T15:52:20.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.495+0000 7f1516ffd640 1 -- 172.21.15.132:0/1233943472 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1500031c60 con 0x7f1518070360 2024-04-16T15:52:20.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.495+0000 7f5b4a689640 1 -- 172.21.15.132:0/4060372039 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f5b3c0380e0 con 0x7f5b3c004af0 2024-04-16T15:52:20.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.495+0000 7f5b4a689640 1 -- 172.21.15.132:0/4060372039 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5b3c037f60 con 0x7f5b3c0defa0 2024-04-16T15:52:20.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.495+0000 7f5b48e86640 1 --2- 172.21.15.132:0/4060372039 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b3c0defa0 0x7f5b3c037330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.495+0000 7f5b4a689640 1 -- 172.21.15.132:0/4060372039 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f5b3c03ad20 con 0x7f5b3c0df400 2024-04-16T15:52:20.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.495+0000 7f5b49e88640 1 --2- 172.21.15.132:0/4060372039 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b3c0df400 0x7f5b3c0d12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.495+0000 7fd42ef74640 1 -- 172.21.15.132:0/1564594184 shutdown_connections 2024-04-16T15:52:20.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.495+0000 7fd42ef74640 1 --2- 172.21.15.132:0/1564594184 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd428067760 0x7fd428067bf0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.495+0000 7fd42ef74640 1 --2- 172.21.15.132:0/1564594184 >> v2:172.21.15.179:3300/0 conn(0x7fd428163040 0x7fd4280adf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.496+0000 7fd42ef74640 1 -- 172.21.15.132:0/1564594184 >> 172.21.15.132:0/1564594184 conn(0x7fd428072810 msgr2=0x7fd428072c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:20.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.495+0000 7f5b49e88640 1 -- 172.21.15.132:0/4060372039 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b3c0defa0 msgr2=0x7f5b3c037330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.495+0000 7f5b49e88640 1 --2- 172.21.15.132:0/4060372039 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b3c0defa0 0x7f5b3c037330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.496+0000 7f5dc9d53640 1 -- 172.21.15.132:0/360594998 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5dc40ba050 msgr2=0x7f5dc40cf940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.496+0000 7f5dc9d53640 1 --2- 172.21.15.132:0/360594998 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5dc40ba050 0x7f5dc40cf940 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc014a30 tx=0x7f5dbc034990 comp rx=0 tx=0).stop 2024-04-16T15:52:20.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.496+0000 7f5dc9d53640 1 -- 172.21.15.132:0/360594998 shutdown_connections 2024-04-16T15:52:20.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.496+0000 7f5dc9d53640 1 --2- 172.21.15.132:0/360594998 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5dc40ba050 0x7f5dc40cf940 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.496+0000 7f5dc9d53640 1 --2- 172.21.15.132:0/360594998 >> v2:172.21.15.179:3300/0 conn(0x7f5dc415eae0 0x7f5dc40cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.496+0000 7f5dc9d53640 1 -- 172.21.15.132:0/360594998 >> 172.21.15.132:0/360594998 conn(0x7f5dc406ce40 msgr2=0x7f5dc406d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:20.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.496+0000 7f201a0c7640 1 -- 172.21.15.132:0/2685153142 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f200c006800 msgr2=0x7f200c006c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.496+0000 7f201a0c7640 1 --2- 172.21.15.132:0/2685153142 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f200c006800 0x7f200c006c70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f201406b370 tx=0x7f2014069820 comp rx=0 tx=0).stop 2024-04-16T15:52:20.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.496+0000 7fdf81d34640 1 Processor -- start 2024-04-16T15:52:20.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.495+0000 7f5b49e88640 1 -- 172.21.15.132:0/4060372039 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b3c004af0 msgr2=0x7f5b3c035890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.496+0000 7f201a0c7640 1 -- 172.21.15.132:0/2685153142 shutdown_connections 2024-04-16T15:52:20.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.496+0000 7fdf81d34640 1 -- start start 2024-04-16T15:52:20.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.496+0000 7f5b49e88640 1 --2- 172.21.15.132:0/4060372039 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b3c004af0 0x7f5b3c035890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.496+0000 7f5b49e88640 1 -- 172.21.15.132:0/4060372039 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b3c0d1810 con 0x7f5b3c0df400 2024-04-16T15:52:20.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.496+0000 7f201a0c7640 1 --2- 172.21.15.132:0/2685153142 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f200c006800 0x7f200c006c70 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.496+0000 7f201a0c7640 1 --2- 172.21.15.132:0/2685153142 >> v2:172.21.15.179:3300/0 conn(0x7f200c005e80 0x7f200c0062c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.496+0000 7f5b49687640 1 --2- 172.21.15.132:0/4060372039 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b3c004af0 0x7f5b3c035890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:52:20.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.496+0000 7f4e51a0c640 1 -- 172.21.15.132:0/2875177 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e4c167300 msgr2=0x7f4e4c0cf230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.496+0000 7f4e51a0c640 1 --2- 172.21.15.132:0/2875177 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e4c167300 0x7f4e4c0cf230 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c06cae0 tx=0x7f4e4002b9b0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.496+0000 7f201a0c7640 1 -- 172.21.15.132:0/2685153142 >> 172.21.15.132:0/2685153142 conn(0x7f200c009fa0 msgr2=0x7f200c00a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:20.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.496+0000 7f151c972640 1 -- 172.21.15.132:0/1233943472 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1518070360 msgr2=0x7f151806e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.496+0000 7f151c972640 1 --2- 172.21.15.132:0/1233943472 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1518070360 0x7f151806e0c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f15000097d0 tx=0x7f150002b930 comp rx=0 tx=0).stop 2024-04-16T15:52:20.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.496+0000 7f151c972640 1 -- 172.21.15.132:0/1233943472 shutdown_connections 2024-04-16T15:52:20.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.496+0000 7f151c972640 1 --2- 172.21.15.132:0/1233943472 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1518070360 0x7f151806e0c0 secure :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f15000097d0 tx=0x7f150002b930 comp rx=0 tx=0).stop 2024-04-16T15:52:20.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.496+0000 7f5dc9d53640 1 -- 172.21.15.132:0/360594998 shutdown_connections 2024-04-16T15:52:20.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.496+0000 7f151c972640 1 -- 172.21.15.132:0/1233943472 >> 172.21.15.132:0/1233943472 conn(0x7f151806ba20 msgr2=0x7f151806be30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:20.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.496+0000 7f4e51a0c640 1 -- 172.21.15.132:0/2875177 shutdown_connections 2024-04-16T15:52:20.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.496+0000 7f4e51a0c640 1 --2- 172.21.15.132:0/2875177 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e4c167300 0x7f4e4c0cf230 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.496+0000 7f4e51a0c640 1 --2- 172.21.15.132:0/2875177 >> v2:172.21.15.132:3300/0 conn(0x7f4e4c162c90 0x7f4e4c06fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.496+0000 7f4e51a0c640 1 -- 172.21.15.132:0/2875177 >> 172.21.15.132:0/2875177 conn(0x7f4e4c067d90 msgr2=0x7f4e4c06ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:20.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.496+0000 7f8296a14640 1 Processor -- start 2024-04-16T15:52:20.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.496+0000 7f5b49e88640 1 --2- 172.21.15.132:0/4060372039 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b3c0df400 0x7f5b3c0d12d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5b44050b40 tx=0x7f5b44075050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.496+0000 7f151c972640 1 -- 172.21.15.132:0/1233943472 shutdown_connections 2024-04-16T15:52:20.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.496+0000 7fd42ef74640 1 -- 172.21.15.132:0/1564594184 shutdown_connections 2024-04-16T15:52:20.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.496+0000 7fd42ef74640 1 -- 172.21.15.132:0/1564594184 wait complete. 2024-04-16T15:52:20.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.496+0000 7f201a0c7640 1 -- 172.21.15.132:0/2685153142 shutdown_connections 2024-04-16T15:52:20.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.496+0000 7f5b39ffb640 1 -- 172.21.15.132:0/4060372039 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b4408f070 con 0x7f5b3c0df400 2024-04-16T15:52:20.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.496+0000 7f201a0c7640 1 -- 172.21.15.132:0/2685153142 wait complete. 2024-04-16T15:52:20.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.496+0000 7f5dc9d53640 1 -- 172.21.15.132:0/360594998 wait complete. 2024-04-16T15:52:20.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.497+0000 7f8296a14640 1 -- start start 2024-04-16T15:52:20.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.496+0000 7f151c972640 1 -- 172.21.15.132:0/1233943472 wait complete. 2024-04-16T15:52:20.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.497+0000 7f4e51a0c640 1 -- 172.21.15.132:0/2875177 shutdown_connections 2024-04-16T15:52:20.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.497+0000 7fdf81d34640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf7403ad40 0x7fdf740e22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.497+0000 7fdf81d34640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf74050080 0x7fdf740d7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.498+0000 7fdf81d34640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf74054cc0 0x7fdf7404b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.498+0000 7fdf81d34640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fdf74006290 con 0x7fdf7403ad40 2024-04-16T15:52:20.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.498+0000 7fdf81d34640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdf740547a0 con 0x7fdf74054cc0 2024-04-16T15:52:20.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.498+0000 7fdf81d34640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fdf74006410 con 0x7fdf74050080 2024-04-16T15:52:20.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.496+0000 7f5b4a689640 1 -- 172.21.15.132:0/4060372039 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b3c035e70 con 0x7f5b3c0df400 2024-04-16T15:52:20.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.497+0000 7f5b4a689640 1 -- 172.21.15.132:0/4060372039 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b3c036430 con 0x7f5b3c0df400 2024-04-16T15:52:20.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.498+0000 7f8296a14640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f82900b3640 0x7f82901427b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.498+0000 7f5dc9d53640 1 Processor -- start 2024-04-16T15:52:20.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.498+0000 7f5b39ffb640 1 -- 172.21.15.132:0/4060372039 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b440756d0 con 0x7f5b3c0df400 2024-04-16T15:52:20.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.498+0000 7f828ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f82900b3640 0x7f82901427b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.498+0000 7f828ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f82900b3640 0x7f82901427b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37506/0 (socket says 172.21.15.132:37506) 2024-04-16T15:52:20.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.498+0000 7f828ffff640 1 -- 172.21.15.132:0/3054646931 learned_addr learned my addr 172.21.15.132:0/3054646931 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:20.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.498+0000 7f8296a14640 1 --2- 172.21.15.132:0/3054646931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82900cdac0 0x7f8290158790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.498+0000 7fdf80d32640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf7403ad40 0x7fdf740e22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.498+0000 7fdf80d32640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf7403ad40 0x7fdf740e22c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37498/0 (socket says 172.21.15.132:37498) 2024-04-16T15:52:20.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.498+0000 7fdf80d32640 1 -- 172.21.15.132:0/730136662 learned_addr learned my addr 172.21.15.132:0/730136662 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:20.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.498+0000 7f5dc9d53640 1 -- start start 2024-04-16T15:52:20.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.498+0000 7f8296a14640 1 --2- 172.21.15.132:0/3054646931 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f829015f9c0 0x7f82900c7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.498+0000 7f8296a14640 1 -- 172.21.15.132:0/3054646931 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f82900b43e0 con 0x7f82900b3640 2024-04-16T15:52:20.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.498+0000 7fd42ef74640 1 Processor -- start 2024-04-16T15:52:20.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.498+0000 7f8296a14640 1 -- 172.21.15.132:0/3054646931 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f82900b4100 con 0x7f82900cdac0 2024-04-16T15:52:20.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.498+0000 7f8296a14640 1 -- 172.21.15.132:0/3054646931 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f82900b5e90 con 0x7f829015f9c0 2024-04-16T15:52:20.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.498+0000 7fd42ef74640 1 -- start start 2024-04-16T15:52:20.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.499+0000 7f8294fb1640 1 --2- 172.21.15.132:0/3054646931 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f829015f9c0 0x7f82900c7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.497+0000 7f4e51a0c640 1 -- 172.21.15.132:0/2875177 wait complete. 2024-04-16T15:52:20.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.499+0000 7fdf80d32640 1 -- 172.21.15.132:0/730136662 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf74050080 msgr2=0x7fdf740d7180 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-16T15:52:20.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.499+0000 7fdf80d32640 1 --2- 172.21.15.132:0/730136662 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf74050080 0x7fdf740d7180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.499+0000 7fdf80d32640 1 -- 172.21.15.132:0/730136662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf74054cc0 msgr2=0x7fdf7404b050 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-16T15:52:20.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.499+0000 7fdf80d32640 1 --2- 172.21.15.132:0/730136662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf74054cc0 0x7fdf7404b050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.499+0000 7fdf80d32640 1 -- 172.21.15.132:0/730136662 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf740d76c0 con 0x7fdf7403ad40 2024-04-16T15:52:20.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.499+0000 7f4e51a0c640 1 Processor -- start 2024-04-16T15:52:20.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.499+0000 7f828ffff640 1 -- 172.21.15.132:0/3054646931 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f829015f9c0 msgr2=0x7f82900c7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.499+0000 7f828ffff640 1 --2- 172.21.15.132:0/3054646931 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f829015f9c0 0x7f82900c7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.499+0000 7f828ffff640 1 -- 172.21.15.132:0/3054646931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82900cdac0 msgr2=0x7f8290158790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.499+0000 7f828ffff640 1 --2- 172.21.15.132:0/3054646931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82900cdac0 0x7f8290158790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.499+0000 7f828ffff640 1 -- 172.21.15.132:0/3054646931 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8290143310 con 0x7f82900b3640 2024-04-16T15:52:20.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.499+0000 7f4e51a0c640 1 -- start start 2024-04-16T15:52:20.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.499+0000 7fdf80d32640 1 --2- 172.21.15.132:0/730136662 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf7403ad40 0x7fdf740e22c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdf68000c00 tx=0x7fdf680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.499+0000 7f5dc9d53640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5dc40ba050 0x7f5dc40b79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.500+0000 7f5dc9d53640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5dc415e700 0x7f5dc41617e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.500+0000 7f5dc9d53640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5dc415eae0 0x7f5dc414f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.500+0000 7fdf797fa640 1 -- 172.21.15.132:0/730136662 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf68032860 con 0x7fdf7403ad40 2024-04-16T15:52:20.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.500+0000 7fdf797fa640 1 -- 172.21.15.132:0/730136662 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf68032a00 con 0x7fdf7403ad40 2024-04-16T15:52:20.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.500+0000 7fdf797fa640 1 -- 172.21.15.132:0/730136662 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf68032dd0 con 0x7fdf7403ad40 2024-04-16T15:52:20.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.500+0000 7f5dc9d53640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc40d3300 con 0x7f5dc415e700 2024-04-16T15:52:20.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.500+0000 7f5dc9d53640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc40b7860 con 0x7f5dc415eae0 2024-04-16T15:52:20.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.500+0000 7f5dc9d53640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f5dc40d3480 con 0x7f5dc40ba050 2024-04-16T15:52:20.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.498+0000 7f151c972640 1 Processor -- start 2024-04-16T15:52:20.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.498+0000 7f151c972640 1 -- start start 2024-04-16T15:52:20.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.500+0000 7f151c972640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f151806e600 0x7f151814cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.500+0000 7f151c972640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1518160790 0x7f1518149190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.500+0000 7f151c972640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15181496d0 0x7f1518161ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.500+0000 7f151c972640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f1518160cf0 con 0x7f1518160790 2024-04-16T15:52:20.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.500+0000 7f5dbbfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5dc415e700 0x7f5dc41617e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.500+0000 7f151c972640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1518160b70 con 0x7f151806e600 2024-04-16T15:52:20.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.500+0000 7f151c972640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f15180cec70 con 0x7f15181496d0 2024-04-16T15:52:20.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.500+0000 7fd42ef74640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd428067760 0x7fd4281f9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.500+0000 7f1517fff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15181496d0 0x7f1518161ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.500+0000 7f15177fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f151806e600 0x7f151814cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.500+0000 7f5dbbfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5dc415e700 0x7f5dc41617e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37534/0 (socket says 172.21.15.132:37534) 2024-04-16T15:52:20.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.500+0000 7f1517fff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15181496d0 0x7f1518161ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.132:58040/0 (socket says 172.21.15.132:58040) 2024-04-16T15:52:20.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.500+0000 7f1517fff640 1 -- 172.21.15.132:0/2475068223 learned_addr learned my addr 172.21.15.132:0/2475068223 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:20.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.500+0000 7fd42ef74640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd42806ca30 0x7fd4281fbf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.498+0000 7f201a0c7640 1 Processor -- start 2024-04-16T15:52:20.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.498+0000 7f201a0c7640 1 -- start start 2024-04-16T15:52:20.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.500+0000 7f201a0c7640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f200c005e80 0x7f200c0e9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.500+0000 7f201a0c7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f200c006800 0x7f200c188ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.500+0000 7f150effd640 1 --2- 172.21.15.132:0/2475068223 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1518160790 0x7f1518149190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.500+0000 7fd42cd10640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd428067760 0x7fd4281f9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.500+0000 7fd42cd10640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd428067760 0x7fd4281f9520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.132:58066/0 (socket says 172.21.15.132:58066) 2024-04-16T15:52:20.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.500+0000 7f828ffff640 1 --2- 172.21.15.132:0/3054646931 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f82900b3640 0x7f82901427b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8288036040 tx=0x7f8288004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.500+0000 7f201a0c7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f200c0eacf0 0x7f200c033070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.500+0000 7fd42cd10640 1 -- 172.21.15.132:0/416905094 learned_addr learned my addr 172.21.15.132:0/416905094 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:20.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.500+0000 7fd42ef74640 1 --2- 172.21.15.132:0/416905094 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd428163040 0x7fd428160e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.500+0000 7f20137fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f200c005e80 0x7f200c0e9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.501+0000 7fd42ef74640 1 -- 172.21.15.132:0/416905094 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fd42806f9b0 con 0x7fd42806ca30 2024-04-16T15:52:20.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.501+0000 7fd42ef74640 1 -- 172.21.15.132:0/416905094 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd4280b4360 con 0x7fd428163040 2024-04-16T15:52:20.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.500+0000 7f20137fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f200c005e80 0x7f200c0e9680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.132:58052/0 (socket says 172.21.15.132:58052) 2024-04-16T15:52:20.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.500+0000 7f20137fe640 1 -- 172.21.15.132:0/1486611166 learned_addr learned my addr 172.21.15.132:0/1486611166 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:20.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.500+0000 7f2013fff640 1 --2- 172.21.15.132:0/1486611166 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f200c0eacf0 0x7f200c033070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.500+0000 7f201a0c7640 1 -- 172.21.15.132:0/1486611166 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f200c0547b0 con 0x7f200c0eacf0 2024-04-16T15:52:20.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.500+0000 7f201a0c7640 1 -- 172.21.15.132:0/1486611166 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f200c050190 con 0x7f200c006800 2024-04-16T15:52:20.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.500+0000 7f201a0c7640 1 -- 172.21.15.132:0/1486611166 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f200c054930 con 0x7f200c005e80 2024-04-16T15:52:20.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.500+0000 7f2012ffd640 1 --2- 172.21.15.132:0/1486611166 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f200c006800 0x7f200c188ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.501+0000 7fd42ef74640 1 -- 172.21.15.132:0/416905094 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fd42806fb30 con 0x7fd428067760 2024-04-16T15:52:20.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.501+0000 7f2013fff640 1 -- 172.21.15.132:0/1486611166 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f200c005e80 msgr2=0x7f200c0e9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.501+0000 7f2013fff640 1 --2- 172.21.15.132:0/1486611166 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f200c005e80 0x7f200c0e9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.501+0000 7f2013fff640 1 -- 172.21.15.132:0/1486611166 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f200c006800 msgr2=0x7f200c188ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.501+0000 7f2013fff640 1 --2- 172.21.15.132:0/1486611166 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f200c006800 0x7f200c188ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.501+0000 7f2013fff640 1 -- 172.21.15.132:0/1486611166 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f200c189620 con 0x7f200c0eacf0 2024-04-16T15:52:20.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.500+0000 7fdf81d34640 1 -- 172.21.15.132:0/730136662 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf740e2900 con 0x7fdf7403ad40 2024-04-16T15:52:20.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.500+0000 7fdf81d34640 1 -- 172.21.15.132:0/730136662 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf741810b0 con 0x7fdf7403ad40 2024-04-16T15:52:20.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.501+0000 7fd42d511640 1 --2- 172.21.15.132:0/416905094 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd428163040 0x7fd428160e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.500+0000 7f5b39ffb640 1 -- 172.21.15.132:0/4060372039 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b440758a0 con 0x7f5b3c0df400 2024-04-16T15:52:20.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.500+0000 7f5b4a689640 1 -- 172.21.15.132:0/4060372039 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5b24001030 con 0x7f5b3c0df400 2024-04-16T15:52:20.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.501+0000 7f1517fff640 1 -- 172.21.15.132:0/2475068223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f151806e600 msgr2=0x7f151814cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.501+0000 7f1517fff640 1 --2- 172.21.15.132:0/2475068223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f151806e600 0x7f151814cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.501+0000 7f1517fff640 1 -- 172.21.15.132:0/2475068223 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1518160790 msgr2=0x7f1518149190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.501+0000 7f1517fff640 1 --2- 172.21.15.132:0/2475068223 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1518160790 0x7f1518149190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.501+0000 7f1517fff640 1 -- 172.21.15.132:0/2475068223 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1518149d70 con 0x7f15181496d0 2024-04-16T15:52:20.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.501+0000 7f4e51a0c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e4c071de0 0x7f4e4c151510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.501+0000 7f4e51a0c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e4c162c90 0x7f4e4c06de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.501+0000 7f4e51a0c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e4c167300 0x7f4e4c06e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.501+0000 7f4e51a0c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f4e4c0afc40 con 0x7f4e4c162c90 2024-04-16T15:52:20.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.501+0000 7f4e51a0c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4e4c0cf770 con 0x7f4e4c071de0 2024-04-16T15:52:20.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.501+0000 7f4e51a0c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f4e4c163070 con 0x7f4e4c167300 2024-04-16T15:52:20.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.500+0000 7f5dc9552640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5dc415eae0 0x7f5dc414f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.500+0000 7f5dc8d51640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5dc40ba050 0x7f5dc40b79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.500+0000 7f5dc8d51640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5dc40ba050 0x7f5dc40b79e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.132:58032/0 (socket says 172.21.15.132:58032) 2024-04-16T15:52:20.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.500+0000 7f5dc8d51640 1 -- 172.21.15.132:0/4010813878 learned_addr learned my addr 172.21.15.132:0/4010813878 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:20.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.501+0000 7f5dc8d51640 1 -- 172.21.15.132:0/4010813878 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5dc415eae0 msgr2=0x7f5dc414f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.501+0000 7f5dc8d51640 1 --2- 172.21.15.132:0/4010813878 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5dc415eae0 0x7f5dc414f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.501+0000 7f5dc8d51640 1 -- 172.21.15.132:0/4010813878 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5dc415e700 msgr2=0x7f5dc41617e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.501+0000 7f5dc8d51640 1 --2- 172.21.15.132:0/4010813878 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5dc415e700 0x7f5dc41617e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.501+0000 7f5dc8d51640 1 -- 172.21.15.132:0/4010813878 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dc40b80e0 con 0x7f5dc40ba050 2024-04-16T15:52:20.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.501+0000 7f828cff9640 1 -- 172.21.15.132:0/3054646931 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8288043020 con 0x7f82900b3640 2024-04-16T15:52:20.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.501+0000 7f20137fe640 1 --2- 172.21.15.132:0/1486611166 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f200c005e80 0x7f200c0e9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:20.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.501+0000 7f2012ffd640 1 --2- 172.21.15.132:0/1486611166 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f200c006800 0x7f200c188ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:20.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.501+0000 7f1517fff640 1 --2- 172.21.15.132:0/2475068223 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15181496d0 0x7f1518161ec0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f151000cb40 tx=0x7f151000a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.501+0000 7f5dbbfff640 1 --2- 172.21.15.132:0/4010813878 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5dc415e700 0x7f5dc41617e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:52:20.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.501+0000 7f8296a14640 1 -- 172.21.15.132:0/3054646931 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8290143030 con 0x7f82900b3640 2024-04-16T15:52:20.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.501+0000 7f8296a14640 1 -- 172.21.15.132:0/3054646931 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f829013ac70 con 0x7f82900b3640 2024-04-16T15:52:20.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.501+0000 7f5dc8d51640 1 --2- 172.21.15.132:0/4010813878 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5dc40ba050 0x7f5dc40b79e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5dc000c500 tx=0x7f5dc000c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.501+0000 7f2013fff640 1 --2- 172.21.15.132:0/1486611166 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f200c0eacf0 0x7f200c033070 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2014069c60 tx=0x7f2014063800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.502+0000 7f4e4b7fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e4c167300 0x7f4e4c06e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.501+0000 7f828cff9640 1 -- 172.21.15.132:0/3054646931 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82880094d0 con 0x7f82900b3640 2024-04-16T15:52:20.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.501+0000 7f828cff9640 1 -- 172.21.15.132:0/3054646931 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f828803e690 con 0x7f82900b3640 2024-04-16T15:52:20.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.502+0000 7f1514ff9640 1 -- 172.21.15.132:0/2475068223 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1510017070 con 0x7f15181496d0 2024-04-16T15:52:20.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.502+0000 7f4e4b7fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e4c167300 0x7f4e4c06e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.132:58078/0 (socket says 172.21.15.132:58078) 2024-04-16T15:52:20.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.502+0000 7f4e4b7fe640 1 -- 172.21.15.132:0/2621183247 learned_addr learned my addr 172.21.15.132:0/2621183247 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:20.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.502+0000 7f5b39ffb640 1 -- 172.21.15.132:0/4060372039 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5b44063020 con 0x7f5b3c0df400 2024-04-16T15:52:20.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.502+0000 7f4e4affd640 1 --2- 172.21.15.132:0/2621183247 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e4c071de0 0x7f4e4c151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.502+0000 7f5db97fa640 1 -- 172.21.15.132:0/4010813878 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc00052d0 con 0x7f5dc40ba050 2024-04-16T15:52:20.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.502+0000 7f5db97fa640 1 -- 172.21.15.132:0/4010813878 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dc0005490 con 0x7f5dc40ba050 2024-04-16T15:52:20.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.502+0000 7f5db97fa640 1 -- 172.21.15.132:0/4010813878 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc0012870 con 0x7f5dc40ba050 2024-04-16T15:52:20.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.502+0000 7fd427fff640 1 --2- 172.21.15.132:0/416905094 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd42806ca30 0x7fd4281fbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.502+0000 7fd42cd10640 1 -- 172.21.15.132:0/416905094 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd428163040 msgr2=0x7fd428160e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.502+0000 7fd42cd10640 1 --2- 172.21.15.132:0/416905094 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd428163040 0x7fd428160e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.502+0000 7fd42cd10640 1 -- 172.21.15.132:0/416905094 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd42806ca30 msgr2=0x7fd4281fbf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.502+0000 7fd42cd10640 1 --2- 172.21.15.132:0/416905094 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd42806ca30 0x7fd4281fbf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.502+0000 7f5b39ffb640 1 --2- 172.21.15.132:0/4060372039 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f5b2806c9c0 0x7f5b2806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.502+0000 7fd42cd10640 1 -- 172.21.15.132:0/416905094 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd428164510 con 0x7fd428067760 2024-04-16T15:52:20.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.502+0000 7fd42d511640 1 --2- 172.21.15.132:0/416905094 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd428163040 0x7fd428160e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:20.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.502+0000 7fdf81d34640 1 -- 172.21.15.132:0/730136662 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdf5c001030 con 0x7fdf7403ad40 2024-04-16T15:52:20.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.502+0000 7f8296a14640 1 -- 172.21.15.132:0/3054646931 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8270001030 con 0x7f82900b3640 2024-04-16T15:52:20.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.503+0000 7fd42cd10640 1 --2- 172.21.15.132:0/416905094 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd428067760 0x7fd4281f9520 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd41c00c4a0 tx=0x7fd41c00c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.503+0000 7f5b49687640 1 --2- 172.21.15.132:0/4060372039 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f5b2806c9c0 0x7f5b2806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.503+0000 7f5b39ffb640 1 -- 172.21.15.132:0/4060372039 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5b441065d0 con 0x7f5b3c0df400 2024-04-16T15:52:20.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.503+0000 7f4e4a7fc640 1 --2- 172.21.15.132:0/2621183247 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e4c162c90 0x7f4e4c06de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.503+0000 7f5b39ffb640 1 --2- 172.21.15.132:0/4060372039 >> [v2:172.21.15.132:6800/1170594668,v1:172.21.15.132:6801/1170594668] conn(0x7f5b28074be0 0x7f5b28077000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.503+0000 7fd4257fa640 1 -- 172.21.15.132:0/416905094 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd41c017070 con 0x7fd428067760 2024-04-16T15:52:20.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.503+0000 7fd4257fa640 1 -- 172.21.15.132:0/416905094 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd41c005ce0 con 0x7fd428067760 2024-04-16T15:52:20.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.503+0000 7fd4257fa640 1 -- 172.21.15.132:0/416905094 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd41c007270 con 0x7fd428067760 2024-04-16T15:52:20.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.503+0000 7fd42ef74640 1 -- 172.21.15.132:0/416905094 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4281fca80 con 0x7fd428067760 2024-04-16T15:52:20.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.503+0000 7fd42ef74640 1 -- 172.21.15.132:0/416905094 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4281fc490 con 0x7fd428067760 2024-04-16T15:52:20.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.503+0000 7f5dc9d53640 1 -- 172.21.15.132:0/4010813878 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dc40b83c0 con 0x7f5dc40ba050 2024-04-16T15:52:20.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.503+0000 7f5dc9d53640 1 -- 172.21.15.132:0/4010813878 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dc40b8980 con 0x7f5dc40ba050 2024-04-16T15:52:20.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.503+0000 7f4e4affd640 1 -- 172.21.15.132:0/2621183247 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e4c167300 msgr2=0x7f4e4c06e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.503+0000 7f4e4affd640 1 --2- 172.21.15.132:0/2621183247 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e4c167300 0x7f4e4c06e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.503+0000 7f4e4affd640 1 -- 172.21.15.132:0/2621183247 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e4c162c90 msgr2=0x7f4e4c06de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.503+0000 7f4e4affd640 1 --2- 172.21.15.132:0/2621183247 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e4c162c90 0x7f4e4c06de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.504+0000 7f4e4affd640 1 -- 172.21.15.132:0/2621183247 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e4c1f8a50 con 0x7f4e4c071de0 2024-04-16T15:52:20.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.504+0000 7f4e4affd640 1 --2- 172.21.15.132:0/2621183247 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e4c071de0 0x7f4e4c151510 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c00e7e0 tx=0x7f4e3c00eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.504+0000 7f4e33fff640 1 -- 172.21.15.132:0/2621183247 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c00f040 con 0x7f4e4c071de0 2024-04-16T15:52:20.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.503+0000 7f1ffffff640 1 -- 172.21.15.132:0/1486611166 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20140b3050 con 0x7f200c0eacf0 2024-04-16T15:52:20.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.503+0000 7f1ffffff640 1 -- 172.21.15.132:0/1486611166 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20140b4040 con 0x7f200c0eacf0 2024-04-16T15:52:20.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.504+0000 7f1ffffff640 1 -- 172.21.15.132:0/1486611166 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20140a7e60 con 0x7f200c0eacf0 2024-04-16T15:52:20.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.503+0000 7f5b39ffb640 1 -- 172.21.15.132:0/4060372039 --> [v2:172.21.15.132:6800/1170594668,v1:172.21.15.132:6801/1170594668] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5b44094e50 con 0x7f5b28074be0 2024-04-16T15:52:20.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.503+0000 7f5b39ffb640 1 -- 172.21.15.132:0/4060372039 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f5b4410d050 con 0x7f5b3c0df400 2024-04-16T15:52:20.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.504+0000 7f5b48e86640 1 --2- 172.21.15.132:0/4060372039 >> [v2:172.21.15.132:6800/1170594668,v1:172.21.15.132:6801/1170594668] conn(0x7f5b28074be0 0x7f5b28077000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.504+0000 7f4e51a0c640 1 -- 172.21.15.132:0/2621183247 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e4c1f8d30 con 0x7f4e4c071de0 2024-04-16T15:52:20.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.504+0000 7f4e51a0c640 1 -- 172.21.15.132:0/2621183247 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e4c1f92f0 con 0x7f4e4c071de0 2024-04-16T15:52:20.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.505+0000 7fd42ef74640 1 -- 172.21.15.132:0/416905094 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd428075510 con 0x7fd428067760 2024-04-16T15:52:20.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.505+0000 7f5dc9d53640 1 -- 172.21.15.132:0/4010813878 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5dc4161d20 con 0x7f5dc40ba050 2024-04-16T15:52:20.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.504+0000 7f828cff9640 1 -- 172.21.15.132:0/3054646931 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8288046020 con 0x7f82900b3640 2024-04-16T15:52:20.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.505+0000 7f828cff9640 1 --2- 172.21.15.132:0/3054646931 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f827c06c9c0 0x7f827c06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.505+0000 7f828cff9640 1 -- 172.21.15.132:0/3054646931 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f82880aea30 con 0x7f82900b3640 2024-04-16T15:52:20.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.505+0000 7f201a0c7640 1 -- 172.21.15.132:0/1486611166 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f200c189900 con 0x7f200c0eacf0 2024-04-16T15:52:20.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.502+0000 7f151c972640 1 -- 172.21.15.132:0/2475068223 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f151814a050 con 0x7f15181496d0 2024-04-16T15:52:20.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.502+0000 7f151c972640 1 -- 172.21.15.132:0/2475068223 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f151814e6f0 con 0x7f15181496d0 2024-04-16T15:52:20.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.505+0000 7f828cff9640 1 --2- 172.21.15.132:0/3054646931 >> [v2:172.21.15.179:6824/123637799,v1:172.21.15.179:6825/123637799] conn(0x7f827c074be0 0x7f827c077000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.505+0000 7f828cff9640 1 -- 172.21.15.132:0/3054646931 --> [v2:172.21.15.179:6824/123637799,v1:172.21.15.179:6825/123637799] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8288035e90 con 0x7f827c074be0 2024-04-16T15:52:20.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.505+0000 7f828cff9640 1 -- 172.21.15.132:0/3054646931 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f82880aee20 con 0x7f82900b3640 2024-04-16T15:52:20.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.505+0000 7f201a0c7640 1 -- 172.21.15.132:0/1486611166 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f200c0e49b0 con 0x7f200c0eacf0 2024-04-16T15:52:20.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.504+0000 7fdf797fa640 1 -- 172.21.15.132:0/730136662 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdf6804d3f0 con 0x7fdf7403ad40 2024-04-16T15:52:20.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.505+0000 7fdf797fa640 1 --2- 172.21.15.132:0/730136662 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fdf6006c9c0 0x7fdf6006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.505+0000 7fdf797fa640 1 -- 172.21.15.132:0/730136662 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fdf680ad870 con 0x7fdf7403ad40 2024-04-16T15:52:20.574 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.505+0000 7fdf797fa640 1 --2- 172.21.15.132:0/730136662 >> [v2:172.21.15.179:6800/2224750370,v1:172.21.15.179:6801/2224750370] conn(0x7fdf60074be0 0x7fdf60077000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.574 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.505+0000 7fdf797fa640 1 -- 172.21.15.132:0/730136662 --> [v2:172.21.15.179:6800/2224750370,v1:172.21.15.179:6801/2224750370] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdf600776b0 con 0x7fdf60074be0 2024-04-16T15:52:20.574 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.505+0000 7fdf797fa640 1 -- 172.21.15.132:0/730136662 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fdf680b22a0 con 0x7fdf7403ad40 2024-04-16T15:52:20.574 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.505+0000 7f4e33fff640 1 -- 172.21.15.132:0/2621183247 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e3c004030 con 0x7f4e4c071de0 2024-04-16T15:52:20.574 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.505+0000 7f4e33fff640 1 -- 172.21.15.132:0/2621183247 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c004420 con 0x7f4e4c071de0 2024-04-16T15:52:20.574 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.505+0000 7fdf7bfff640 1 --2- 172.21.15.132:0/730136662 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fdf6006c9c0 0x7fdf6006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.575 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.506+0000 7f828f7fe640 1 --2- 172.21.15.132:0/3054646931 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f827c06c9c0 0x7f827c06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.575 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.506+0000 7f5db97fa640 1 -- 172.21.15.132:0/4010813878 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5dc0012a10 con 0x7f5dc40ba050 2024-04-16T15:52:20.575 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.506+0000 7fd4257fa640 1 -- 172.21.15.132:0/416905094 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd41c01a070 con 0x7fd428067760 2024-04-16T15:52:20.576 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.506+0000 7f8294fb1640 1 --2- 172.21.15.132:0/3054646931 >> [v2:172.21.15.179:6824/123637799,v1:172.21.15.179:6825/123637799] conn(0x7f827c074be0 0x7f827c077000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.576 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.507+0000 7f5db97fa640 1 --2- 172.21.15.132:0/4010813878 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f5db006c9c0 0x7f5db006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.576 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.506+0000 7fdf81533640 1 --2- 172.21.15.132:0/730136662 >> [v2:172.21.15.179:6800/2224750370,v1:172.21.15.179:6801/2224750370] conn(0x7fdf60074be0 0x7fdf60077000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.576 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.506+0000 7fdf7bfff640 1 --2- 172.21.15.132:0/730136662 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fdf6006c9c0 0x7fdf6006ee80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c065520 tx=0x7fdf7c06b830 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.507+0000 7f201a0c7640 1 -- 172.21.15.132:0/1486611166 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f200c189e20 con 0x7f200c0eacf0 2024-04-16T15:52:20.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.507+0000 7fdf81533640 1 --2- 172.21.15.132:0/730136662 >> [v2:172.21.15.179:6800/2224750370,v1:172.21.15.179:6801/2224750370] conn(0x7fdf60074be0 0x7fdf60077000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.507+0000 7f5db97fa640 1 -- 172.21.15.132:0/4010813878 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5dc008b7a0 con 0x7f5dc40ba050 2024-04-16T15:52:20.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.505+0000 7f1514ff9640 1 -- 172.21.15.132:0/2475068223 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f151000aca0 con 0x7f15181496d0 2024-04-16T15:52:20.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.505+0000 7f1514ff9640 1 -- 172.21.15.132:0/2475068223 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1510012640 con 0x7f15181496d0 2024-04-16T15:52:20.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.505+0000 7f1514ff9640 1 -- 172.21.15.132:0/2475068223 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f151001a070 con 0x7f15181496d0 2024-04-16T15:52:20.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.507+0000 7fd4257fa640 1 --2- 172.21.15.132:0/416905094 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fd41406c9c0 0x7fd41406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.506+0000 7f151c972640 1 -- 172.21.15.132:0/2475068223 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1518073850 con 0x7f15181496d0 2024-04-16T15:52:20.579 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.507+0000 7f5db97fa640 1 --2- 172.21.15.132:0/4010813878 >> [v2:172.21.15.179:6808/872148365,v1:172.21.15.179:6810/872148365] conn(0x7f5db0074be0 0x7f5db0077000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.579 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.506+0000 7f5b48e86640 1 --2- 172.21.15.132:0/4060372039 >> [v2:172.21.15.132:6800/1170594668,v1:172.21.15.132:6801/1170594668] conn(0x7f5b28074be0 0x7f5b28077000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.579 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.507+0000 7f5db97fa640 1 -- 172.21.15.132:0/4010813878 --> [v2:172.21.15.179:6808/872148365,v1:172.21.15.179:6810/872148365] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5dc0004ec0 con 0x7f5db0074be0 2024-04-16T15:52:20.580 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.507+0000 7f5db97fa640 1 -- 172.21.15.132:0/4010813878 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f5dc0092050 con 0x7f5dc40ba050 2024-04-16T15:52:20.580 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.507+0000 7f5b39ffb640 1 -- 172.21.15.132:0/4060372039 <== osd.0 v2:172.21.15.132:6800/1170594668 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5b44094e50 con 0x7f5b28074be0 2024-04-16T15:52:20.580 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.507+0000 7f1ffffff640 1 -- 172.21.15.132:0/1486611166 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f20140c1030 con 0x7f200c0eacf0 2024-04-16T15:52:20.580 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.507+0000 7fd4257fa640 1 -- 172.21.15.132:0/416905094 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd41c08ade0 con 0x7fd428067760 2024-04-16T15:52:20.581 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.507+0000 7f5dbbfff640 1 --2- 172.21.15.132:0/4010813878 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f5db006c9c0 0x7f5db006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.581 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.507+0000 7f4e33fff640 1 -- 172.21.15.132:0/2621183247 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4e3c00c6d0 con 0x7f4e4c071de0 2024-04-16T15:52:20.581 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.507+0000 7fd4257fa640 1 --2- 172.21.15.132:0/416905094 >> [v2:172.21.15.132:6808/3100919191,v1:172.21.15.132:6810/3100919191] conn(0x7fd414074be0 0x7fd414077000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.581 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.507+0000 7f5dc9552640 1 --2- 172.21.15.132:0/4010813878 >> [v2:172.21.15.179:6808/872148365,v1:172.21.15.179:6810/872148365] conn(0x7f5db0074be0 0x7f5db0077000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.507+0000 7fd4257fa640 1 -- 172.21.15.132:0/416905094 --> [v2:172.21.15.132:6808/3100919191,v1:172.21.15.132:6810/3100919191] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd4140776b0 con 0x7fd414074be0 2024-04-16T15:52:20.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.508+0000 7fd4257fa640 1 -- 172.21.15.132:0/416905094 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fd41c08d440 con 0x7fd428067760 2024-04-16T15:52:20.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.508+0000 7f4e31ffb640 1 -- 172.21.15.132:0/2621183247 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4e4c073820 con 0x7f4e4c071de0 2024-04-16T15:52:20.583 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.508+0000 7fd42d511640 1 --2- 172.21.15.132:0/416905094 >> [v2:172.21.15.132:6808/3100919191,v1:172.21.15.132:6810/3100919191] conn(0x7fd414074be0 0x7fd414077000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.583 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.507+0000 7f8294fb1640 1 --2- 172.21.15.132:0/3054646931 >> [v2:172.21.15.179:6824/123637799,v1:172.21.15.179:6825/123637799] conn(0x7f827c074be0 0x7f827c077000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.583 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.508+0000 7f1ffffff640 1 --2- 172.21.15.132:0/1486611166 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f1ff806c9c0 0x7f1ff806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.583 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.508+0000 7f5b49687640 1 --2- 172.21.15.132:0/4060372039 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f5b2806c9c0 0x7f5b2806ee80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5b34009870 tx=0x7f5b3403c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.584 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.508+0000 7f1ffffff640 1 -- 172.21.15.132:0/1486611166 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2014128d30 con 0x7f200c0eacf0 2024-04-16T15:52:20.584 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.508+0000 7f4e33fff640 1 --2- 172.21.15.132:0/2621183247 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f4e3806c9c0 0x7f4e3806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.584 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.508+0000 7f828cff9640 1 -- 172.21.15.132:0/3054646931 <== osd.4 v2:172.21.15.179:6824/123637799 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8288035e90 con 0x7f827c074be0 2024-04-16T15:52:20.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.508+0000 7f5dbbfff640 1 --2- 172.21.15.132:0/4010813878 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f5db006c9c0 0x7f5db006ee80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5db4006fd0 tx=0x7f5db4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.508+0000 7f5dc9552640 1 --2- 172.21.15.132:0/4010813878 >> [v2:172.21.15.179:6808/872148365,v1:172.21.15.179:6810/872148365] conn(0x7f5db0074be0 0x7f5db0077000 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.508+0000 7f828f7fe640 1 --2- 172.21.15.132:0/3054646931 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f827c06c9c0 0x7f827c06ee80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f829013a7c0 tx=0x7f8280006c40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.507+0000 7f1514ff9640 1 --2- 172.21.15.132:0/2475068223 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f14f806ca20 0x7f14f806eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.507+0000 7f1514ff9640 1 -- 172.21.15.132:0/2475068223 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f151008b8f0 con 0x7f15181496d0 2024-04-16T15:52:20.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.508+0000 7f1514ff9640 1 --2- 172.21.15.132:0/2475068223 >> [v2:172.21.15.132:6809/2494780358,v1:172.21.15.132:6811/2494780358] conn(0x7f14f8074c40 0x7f14f8077060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.586 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.508+0000 7f1514ff9640 1 -- 172.21.15.132:0/2475068223 --> [v2:172.21.15.132:6809/2494780358,v1:172.21.15.132:6811/2494780358] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f151000ae50 con 0x7f14f8074c40 2024-04-16T15:52:20.586 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.508+0000 7f1514ff9640 1 -- 172.21.15.132:0/2475068223 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f1510092050 con 0x7f15181496d0 2024-04-16T15:52:20.586 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.508+0000 7f15177fe640 1 --2- 172.21.15.132:0/2475068223 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f14f806ca20 0x7f14f806eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.586 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.508+0000 7f150effd640 1 --2- 172.21.15.132:0/2475068223 >> [v2:172.21.15.132:6809/2494780358,v1:172.21.15.132:6811/2494780358] conn(0x7f14f8074c40 0x7f14f8077060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.586 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.508+0000 7f4e33fff640 1 -- 172.21.15.132:0/2621183247 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4e3c08b850 con 0x7f4e4c071de0 2024-04-16T15:52:20.586 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.508+0000 7f4e4a7fc640 1 --2- 172.21.15.132:0/2621183247 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f4e3806c9c0 0x7f4e3806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.586 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.509+0000 7f4e33fff640 1 --2- 172.21.15.132:0/2621183247 >> [v2:172.21.15.132:6824/27655483,v1:172.21.15.132:6825/27655483] conn(0x7f4e38074c40 0x7f4e38077060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.586 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.509+0000 7f4e33fff640 1 -- 172.21.15.132:0/2621183247 --> [v2:172.21.15.132:6824/27655483,v1:172.21.15.132:6825/27655483] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4e3c013e50 con 0x7f4e38074c40 2024-04-16T15:52:20.586 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.509+0000 7f4e33fff640 1 -- 172.21.15.132:0/2621183247 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f4e3c092050 con 0x7f4e4c071de0 2024-04-16T15:52:20.587 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.508+0000 7fd427fff640 1 --2- 172.21.15.132:0/416905094 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fd41406c9c0 0x7fd41406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.587 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.508+0000 7fd42d511640 1 --2- 172.21.15.132:0/416905094 >> [v2:172.21.15.132:6808/3100919191,v1:172.21.15.132:6810/3100919191] conn(0x7fd414074be0 0x7fd414077000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.587 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.508+0000 7f20137fe640 1 --2- 172.21.15.132:0/1486611166 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f1ff806c9c0 0x7f1ff806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.587 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.508+0000 7f1ffffff640 1 --2- 172.21.15.132:0/1486611166 >> [v2:172.21.15.179:6809/101498164,v1:172.21.15.179:6811/101498164] conn(0x7f1ff8074be0 0x7f1ff8077000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.587 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.508+0000 7f1ffffff640 1 -- 172.21.15.132:0/1486611166 --> [v2:172.21.15.179:6809/101498164,v1:172.21.15.179:6811/101498164] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f20140c4e70 con 0x7f1ff8074be0 2024-04-16T15:52:20.587 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.508+0000 7f1ffffff640 1 -- 172.21.15.132:0/1486611166 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f201412f330 con 0x7f200c0eacf0 2024-04-16T15:52:20.587 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.509+0000 7f2012ffd640 1 --2- 172.21.15.132:0/1486611166 >> [v2:172.21.15.179:6809/101498164,v1:172.21.15.179:6811/101498164] conn(0x7f1ff8074be0 0x7f1ff8077000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.509+0000 7f2012ffd640 1 --2- 172.21.15.132:0/1486611166 >> [v2:172.21.15.179:6809/101498164,v1:172.21.15.179:6811/101498164] conn(0x7f1ff8074be0 0x7f1ff8077000 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.509+0000 7f20137fe640 1 --2- 172.21.15.132:0/1486611166 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f1ff806c9c0 0x7f1ff806ee80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2008007fd0 tx=0x7f2008007dc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.509+0000 7f5db97fa640 1 -- 172.21.15.132:0/4010813878 <== osd.7 v2:172.21.15.179:6808/872148365 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5dc0004ec0 con 0x7f5db0074be0 2024-04-16T15:52:20.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.509+0000 7f4e4a7fc640 1 --2- 172.21.15.132:0/2621183247 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f4e3806c9c0 0x7f4e3806ee80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4e40036000 tx=0x7f4e4003b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.509+0000 7f4e4b7fe640 1 --2- 172.21.15.132:0/2621183247 >> [v2:172.21.15.132:6824/27655483,v1:172.21.15.132:6825/27655483] conn(0x7f4e38074c40 0x7f4e38077060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.509+0000 7f15177fe640 1 --2- 172.21.15.132:0/2475068223 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f14f806ca20 0x7f14f806eee0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1508001010 tx=0x7f1508009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.509+0000 7fd427fff640 1 --2- 172.21.15.132:0/416905094 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fd41406c9c0 0x7fd41406ee80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd4281f9a60 tx=0x7fd418008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.510+0000 7fdf797fa640 1 -- 172.21.15.132:0/730136662 <== osd.5 v2:172.21.15.179:6800/2224750370 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdf600776b0 con 0x7fdf60074be0 2024-04-16T15:52:20.590 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.510+0000 7f1ffffff640 1 -- 172.21.15.132:0/1486611166 <== osd.6 v2:172.21.15.179:6809/101498164 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f20140c4e70 con 0x7f1ff8074be0 2024-04-16T15:52:20.590 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.510+0000 7f150effd640 1 --2- 172.21.15.132:0/2475068223 >> [v2:172.21.15.132:6809/2494780358,v1:172.21.15.132:6811/2494780358] conn(0x7f14f8074c40 0x7f14f8077060 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.590 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.510+0000 7f4e4b7fe640 1 --2- 172.21.15.132:0/2621183247 >> [v2:172.21.15.132:6824/27655483,v1:172.21.15.132:6825/27655483] conn(0x7f4e38074c40 0x7f4e38077060 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.590 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.510+0000 7fd4257fa640 1 -- 172.21.15.132:0/416905094 <== osd.3 v2:172.21.15.132:6808/3100919191 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd4140776b0 con 0x7fd414074be0 2024-04-16T15:52:20.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.511+0000 7f4e33fff640 1 -- 172.21.15.132:0/2621183247 <== osd.2 v2:172.21.15.132:6824/27655483 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4e3c013e50 con 0x7f4e38074c40 2024-04-16T15:52:20.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.511+0000 7f1514ff9640 1 -- 172.21.15.132:0/2475068223 <== osd.1 v2:172.21.15.132:6809/2494780358 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f151000ae50 con 0x7f14f8074c40 2024-04-16T15:52:20.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.540+0000 7f5b4a689640 1 -- 172.21.15.132:0/4060372039 --> [v2:172.21.15.132:6800/1170594668,v1:172.21.15.132:6801/1170594668] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5b24002dd0 con 0x7f5b28074be0 2024-04-16T15:52:20.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.540+0000 7f5b39ffb640 1 -- 172.21.15.132:0/4060372039 <== osd.0 v2:172.21.15.132:6800/1170594668 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5b24002dd0 con 0x7f5b28074be0 2024-04-16T15:52:20.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.541+0000 7f8296a14640 1 -- 172.21.15.132:0/3054646931 --> [v2:172.21.15.179:6824/123637799,v1:172.21.15.179:6825/123637799] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8270002d50 con 0x7f827c074be0 2024-04-16T15:52:20.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.541+0000 7f5b2f7fe640 1 -- 172.21.15.132:0/4060372039 >> [v2:172.21.15.132:6800/1170594668,v1:172.21.15.132:6801/1170594668] conn(0x7f5b28074be0 msgr2=0x7f5b28077000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.541+0000 7f5b2f7fe640 1 --2- 172.21.15.132:0/4060372039 >> [v2:172.21.15.132:6800/1170594668,v1:172.21.15.132:6801/1170594668] conn(0x7f5b28074be0 0x7f5b28077000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.541+0000 7f5b2f7fe640 1 -- 172.21.15.132:0/4060372039 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f5b2806c9c0 msgr2=0x7f5b2806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.541+0000 7f5dc9d53640 1 -- 172.21.15.132:0/4010813878 --> [v2:172.21.15.179:6808/872148365,v1:172.21.15.179:6810/872148365] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5dc406e1f0 con 0x7f5db0074be0 2024-04-16T15:52:20.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.541+0000 7f5b2f7fe640 1 --2- 172.21.15.132:0/4060372039 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f5b2806c9c0 0x7f5b2806ee80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5b34009870 tx=0x7f5b3403c040 comp rx=0 tx=0).stop 2024-04-16T15:52:20.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.541+0000 7f5b2f7fe640 1 -- 172.21.15.132:0/4060372039 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b3c0df400 msgr2=0x7f5b3c0d12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.541+0000 7f5b2f7fe640 1 --2- 172.21.15.132:0/4060372039 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b3c0df400 0x7f5b3c0d12d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5b44050b40 tx=0x7f5b44075050 comp rx=0 tx=0).stop 2024-04-16T15:52:20.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.542+0000 7f828cff9640 1 -- 172.21.15.132:0/3054646931 <== osd.4 v2:172.21.15.179:6824/123637799 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8270002d50 con 0x7f827c074be0 2024-04-16T15:52:20.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.541+0000 7f5b49e88640 1 -- 172.21.15.132:0/4060372039 reap_dead start 2024-04-16T15:52:20.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.542+0000 7f5b2f7fe640 1 -- 172.21.15.132:0/4060372039 shutdown_connections 2024-04-16T15:52:20.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.542+0000 7f5b2f7fe640 1 -- 172.21.15.132:0/4060372039 >> 172.21.15.132:0/4060372039 conn(0x7f5b3c00a3f0 msgr2=0x7f5b3c0de320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:20.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.542+0000 7f5db97fa640 1 -- 172.21.15.132:0/4010813878 <== osd.7 v2:172.21.15.179:6808/872148365 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5dc406e1f0 con 0x7f5db0074be0 2024-04-16T15:52:20.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.542+0000 7f201a0c7640 1 -- 172.21.15.132:0/1486611166 --> [v2:172.21.15.179:6809/101498164,v1:172.21.15.179:6811/101498164] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f200c17c820 con 0x7f1ff8074be0 2024-04-16T15:52:20.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.542+0000 7f5b2f7fe640 1 -- 172.21.15.132:0/4060372039 shutdown_connections 2024-04-16T15:52:20.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.542+0000 7f5b2f7fe640 1 -- 172.21.15.132:0/4060372039 wait complete. 2024-04-16T15:52:20.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.542+0000 7fd42ef74640 1 -- 172.21.15.132:0/416905094 --> [v2:172.21.15.132:6808/3100919191,v1:172.21.15.132:6810/3100919191] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd4280736b0 con 0x7fd414074be0 2024-04-16T15:52:20.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.542+0000 7f82767fc640 1 -- 172.21.15.132:0/3054646931 >> [v2:172.21.15.179:6824/123637799,v1:172.21.15.179:6825/123637799] conn(0x7f827c074be0 msgr2=0x7f827c077000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.542+0000 7f82767fc640 1 --2- 172.21.15.132:0/3054646931 >> [v2:172.21.15.179:6824/123637799,v1:172.21.15.179:6825/123637799] conn(0x7f827c074be0 0x7f827c077000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.542+0000 7f82767fc640 1 -- 172.21.15.132:0/3054646931 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f827c06c9c0 msgr2=0x7f827c06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.542+0000 7f82767fc640 1 --2- 172.21.15.132:0/3054646931 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f827c06c9c0 0x7f827c06ee80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f829013a7c0 tx=0x7f8280006c40 comp rx=0 tx=0).stop 2024-04-16T15:52:20.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.543+0000 7f82767fc640 1 -- 172.21.15.132:0/3054646931 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f82900b3640 msgr2=0x7f82901427b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.543+0000 7f82767fc640 1 --2- 172.21.15.132:0/3054646931 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f82900b3640 0x7f82901427b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8288036040 tx=0x7f8288004a40 comp rx=0 tx=0).stop 2024-04-16T15:52:20.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.542+0000 7f1ffffff640 1 -- 172.21.15.132:0/1486611166 <== osd.6 v2:172.21.15.179:6809/101498164 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f200c17c820 con 0x7f1ff8074be0 2024-04-16T15:52:20.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.543+0000 7f8294fb1640 1 -- 172.21.15.132:0/3054646931 reap_dead start 2024-04-16T15:52:20.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.543+0000 7fdf81d34640 1 -- 172.21.15.132:0/730136662 --> [v2:172.21.15.179:6800/2224750370,v1:172.21.15.179:6801/2224750370] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdf5c002dd0 con 0x7fdf60074be0 2024-04-16T15:52:20.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.543+0000 7f82767fc640 1 -- 172.21.15.132:0/3054646931 shutdown_connections 2024-04-16T15:52:20.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.543+0000 7f82767fc640 1 -- 172.21.15.132:0/3054646931 >> 172.21.15.132:0/3054646931 conn(0x7f82900b2d50 msgr2=0x7f829006dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:20.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.543+0000 7fd4257fa640 1 -- 172.21.15.132:0/416905094 <== osd.3 v2:172.21.15.132:6808/3100919191 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd4280736b0 con 0x7fd414074be0 2024-04-16T15:52:20.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.543+0000 7f5dc9d53640 1 -- 172.21.15.132:0/4010813878 >> [v2:172.21.15.179:6808/872148365,v1:172.21.15.179:6810/872148365] conn(0x7f5db0074be0 msgr2=0x7f5db0077000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.543+0000 7f5dc9d53640 1 --2- 172.21.15.132:0/4010813878 >> [v2:172.21.15.179:6808/872148365,v1:172.21.15.179:6810/872148365] conn(0x7f5db0074be0 0x7f5db0077000 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.543+0000 7f82767fc640 1 -- 172.21.15.132:0/3054646931 shutdown_connections 2024-04-16T15:52:20.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.543+0000 7fdf797fa640 1 -- 172.21.15.132:0/730136662 <== osd.5 v2:172.21.15.179:6800/2224750370 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fdf5c002dd0 con 0x7fdf60074be0 2024-04-16T15:52:20.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.543+0000 7f82767fc640 1 -- 172.21.15.132:0/3054646931 wait complete. 2024-04-16T15:52:20.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.543+0000 7f201a0c7640 1 -- 172.21.15.132:0/1486611166 >> [v2:172.21.15.179:6809/101498164,v1:172.21.15.179:6811/101498164] conn(0x7f1ff8074be0 msgr2=0x7f1ff8077000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.543+0000 7f201a0c7640 1 --2- 172.21.15.132:0/1486611166 >> [v2:172.21.15.179:6809/101498164,v1:172.21.15.179:6811/101498164] conn(0x7f1ff8074be0 0x7f1ff8077000 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.543+0000 7fd42ef74640 1 -- 172.21.15.132:0/416905094 >> [v2:172.21.15.132:6808/3100919191,v1:172.21.15.132:6810/3100919191] conn(0x7fd414074be0 msgr2=0x7fd414077000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.543+0000 7fd42ef74640 1 --2- 172.21.15.132:0/416905094 >> [v2:172.21.15.132:6808/3100919191,v1:172.21.15.132:6810/3100919191] conn(0x7fd414074be0 0x7fd414077000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.543+0000 7f5dc9d53640 1 -- 172.21.15.132:0/4010813878 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f5db006c9c0 msgr2=0x7f5db006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.543+0000 7f5dc9d53640 1 --2- 172.21.15.132:0/4010813878 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f5db006c9c0 0x7f5db006ee80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5db4006fd0 tx=0x7f5db4008040 comp rx=0 tx=0).stop 2024-04-16T15:52:20.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.543+0000 7f201a0c7640 1 -- 172.21.15.132:0/1486611166 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f1ff806c9c0 msgr2=0x7f1ff806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.543+0000 7f201a0c7640 1 --2- 172.21.15.132:0/1486611166 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f1ff806c9c0 0x7f1ff806ee80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2008007fd0 tx=0x7f2008007dc0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.543+0000 7f201a0c7640 1 -- 172.21.15.132:0/1486611166 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f200c0eacf0 msgr2=0x7f200c033070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.543+0000 7f201a0c7640 1 --2- 172.21.15.132:0/1486611166 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f200c0eacf0 0x7f200c033070 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2014069c60 tx=0x7f2014063800 comp rx=0 tx=0).stop 2024-04-16T15:52:20.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.543+0000 7f5dc9d53640 1 -- 172.21.15.132:0/4010813878 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5dc40ba050 msgr2=0x7f5dc40b79e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.543+0000 7fd42ef74640 1 -- 172.21.15.132:0/416905094 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fd41406c9c0 msgr2=0x7fd41406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.543+0000 7fd42ef74640 1 --2- 172.21.15.132:0/416905094 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fd41406c9c0 0x7fd41406ee80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd4281f9a60 tx=0x7fd418008040 comp rx=0 tx=0).stop 2024-04-16T15:52:20.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.543+0000 7fd42ef74640 1 -- 172.21.15.132:0/416905094 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd428067760 msgr2=0x7fd4281f9520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.543+0000 7fd42ef74640 1 --2- 172.21.15.132:0/416905094 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd428067760 0x7fd4281f9520 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd41c00c4a0 tx=0x7fd41c00c960 comp rx=0 tx=0).stop 2024-04-16T15:52:20.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.543+0000 7f5dc9d53640 1 --2- 172.21.15.132:0/4010813878 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5dc40ba050 0x7f5dc40b79e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5dc000c500 tx=0x7f5dc000c9c0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.543+0000 7f5dc9552640 1 -- 172.21.15.132:0/4010813878 reap_dead start 2024-04-16T15:52:20.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.543+0000 7fd42d511640 1 -- 172.21.15.132:0/416905094 reap_dead start 2024-04-16T15:52:20.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.544+0000 7fd42ef74640 1 -- 172.21.15.132:0/416905094 shutdown_connections 2024-04-16T15:52:20.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.544+0000 7f5dc9d53640 1 -- 172.21.15.132:0/4010813878 shutdown_connections 2024-04-16T15:52:20.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.544+0000 7fd42ef74640 1 -- 172.21.15.132:0/416905094 >> 172.21.15.132:0/416905094 conn(0x7fd428072810 msgr2=0x7fd428162280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:20.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.544+0000 7f5dc9d53640 1 -- 172.21.15.132:0/4010813878 >> 172.21.15.132:0/4010813878 conn(0x7f5dc406ce40 msgr2=0x7f5dc40cf0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:20.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.544+0000 7f5dc9d53640 1 -- 172.21.15.132:0/4010813878 shutdown_connections 2024-04-16T15:52:20.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.544+0000 7f5dc9d53640 1 -- 172.21.15.132:0/4010813878 wait complete. 2024-04-16T15:52:20.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.544+0000 7fd42ef74640 1 -- 172.21.15.132:0/416905094 shutdown_connections 2024-04-16T15:52:20.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.544+0000 7fdf81d34640 1 -- 172.21.15.132:0/730136662 >> [v2:172.21.15.179:6800/2224750370,v1:172.21.15.179:6801/2224750370] conn(0x7fdf60074be0 msgr2=0x7fdf60077000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.544+0000 7fdf81d34640 1 --2- 172.21.15.132:0/730136662 >> [v2:172.21.15.179:6800/2224750370,v1:172.21.15.179:6801/2224750370] conn(0x7fdf60074be0 0x7fdf60077000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.544+0000 7fd42ef74640 1 -- 172.21.15.132:0/416905094 wait complete. 2024-04-16T15:52:20.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.544+0000 7fdf81d34640 1 -- 172.21.15.132:0/730136662 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fdf6006c9c0 msgr2=0x7fdf6006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.544+0000 7fdf81d34640 1 --2- 172.21.15.132:0/730136662 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fdf6006c9c0 0x7fdf6006ee80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c065520 tx=0x7fdf7c06b830 comp rx=0 tx=0).stop 2024-04-16T15:52:20.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.544+0000 7f2013fff640 1 -- 172.21.15.132:0/1486611166 reap_dead start 2024-04-16T15:52:20.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.544+0000 7f201a0c7640 1 -- 172.21.15.132:0/1486611166 shutdown_connections 2024-04-16T15:52:20.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.544+0000 7f201a0c7640 1 -- 172.21.15.132:0/1486611166 >> 172.21.15.132:0/1486611166 conn(0x7f200c009fa0 msgr2=0x7f200c04db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:20.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.544+0000 7fdf81d34640 1 -- 172.21.15.132:0/730136662 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf7403ad40 msgr2=0x7fdf740e22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.544+0000 7f151c972640 1 -- 172.21.15.132:0/2475068223 --> [v2:172.21.15.132:6809/2494780358,v1:172.21.15.132:6811/2494780358] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1518167840 con 0x7f14f8074c40 2024-04-16T15:52:20.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.544+0000 7f4e31ffb640 1 -- 172.21.15.132:0/2621183247 --> [v2:172.21.15.132:6824/27655483,v1:172.21.15.132:6825/27655483] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4e4c073820 con 0x7f4e38074c40 2024-04-16T15:52:20.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.544+0000 7fdf81d34640 1 --2- 172.21.15.132:0/730136662 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf7403ad40 0x7fdf740e22c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdf68000c00 tx=0x7fdf680046c0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.544+0000 7fdf81533640 1 -- 172.21.15.132:0/730136662 reap_dead start 2024-04-16T15:52:20.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.545+0000 7f201a0c7640 1 -- 172.21.15.132:0/1486611166 shutdown_connections 2024-04-16T15:52:20.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.545+0000 7f201a0c7640 1 -- 172.21.15.132:0/1486611166 wait complete. 2024-04-16T15:52:20.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.545+0000 7f1514ff9640 1 -- 172.21.15.132:0/2475068223 <== osd.1 v2:172.21.15.132:6809/2494780358 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1518167840 con 0x7f14f8074c40 2024-04-16T15:52:20.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.545+0000 7f4e33fff640 1 -- 172.21.15.132:0/2621183247 <== osd.2 v2:172.21.15.132:6824/27655483 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4e4c073820 con 0x7f4e38074c40 2024-04-16T15:52:20.610 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.545+0000 7fdf81d34640 1 -- 172.21.15.132:0/730136662 shutdown_connections 2024-04-16T15:52:20.610 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.545+0000 7fdf81d34640 1 -- 172.21.15.132:0/730136662 >> 172.21.15.132:0/730136662 conn(0x7fdf74055340 msgr2=0x7fdf740ddd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:20.610 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.545+0000 7fdf81d34640 1 -- 172.21.15.132:0/730136662 shutdown_connections 2024-04-16T15:52:20.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.545+0000 7fdf81d34640 1 -- 172.21.15.132:0/730136662 wait complete. 2024-04-16T15:52:20.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.545+0000 7f4e31ffb640 1 -- 172.21.15.132:0/2621183247 >> [v2:172.21.15.132:6824/27655483,v1:172.21.15.132:6825/27655483] conn(0x7f4e38074c40 msgr2=0x7f4e38077060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.546+0000 7f151c972640 1 -- 172.21.15.132:0/2475068223 >> [v2:172.21.15.132:6809/2494780358,v1:172.21.15.132:6811/2494780358] conn(0x7f14f8074c40 msgr2=0x7f14f8077060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.546+0000 7f151c972640 1 --2- 172.21.15.132:0/2475068223 >> [v2:172.21.15.132:6809/2494780358,v1:172.21.15.132:6811/2494780358] conn(0x7f14f8074c40 0x7f14f8077060 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.546+0000 7f4e31ffb640 1 --2- 172.21.15.132:0/2621183247 >> [v2:172.21.15.132:6824/27655483,v1:172.21.15.132:6825/27655483] conn(0x7f4e38074c40 0x7f4e38077060 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.612 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.546+0000 7f151c972640 1 -- 172.21.15.132:0/2475068223 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f14f806ca20 msgr2=0x7f14f806eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.612 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.546+0000 7f151c972640 1 --2- 172.21.15.132:0/2475068223 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f14f806ca20 0x7f14f806eee0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1508001010 tx=0x7f1508009040 comp rx=0 tx=0).stop 2024-04-16T15:52:20.612 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.546+0000 7f151c972640 1 -- 172.21.15.132:0/2475068223 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15181496d0 msgr2=0x7f1518161ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.612 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.546+0000 7f151c972640 1 --2- 172.21.15.132:0/2475068223 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15181496d0 0x7f1518161ec0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f151000cb40 tx=0x7f151000a060 comp rx=0 tx=0).stop 2024-04-16T15:52:20.612 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.546+0000 7f1517fff640 1 -- 172.21.15.132:0/2475068223 reap_dead start 2024-04-16T15:52:20.612 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.546+0000 7f151c972640 1 -- 172.21.15.132:0/2475068223 shutdown_connections 2024-04-16T15:52:20.612 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.546+0000 7f151c972640 1 -- 172.21.15.132:0/2475068223 >> 172.21.15.132:0/2475068223 conn(0x7f151806ba20 msgr2=0x7f15180b14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:20.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.546+0000 7f4e31ffb640 1 -- 172.21.15.132:0/2621183247 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f4e3806c9c0 msgr2=0x7f4e3806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.546+0000 7f4e31ffb640 1 --2- 172.21.15.132:0/2621183247 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f4e3806c9c0 0x7f4e3806ee80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4e40036000 tx=0x7f4e4003b040 comp rx=0 tx=0).stop 2024-04-16T15:52:20.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.546+0000 7f4e31ffb640 1 -- 172.21.15.132:0/2621183247 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e4c071de0 msgr2=0x7f4e4c151510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.546+0000 7f4e31ffb640 1 --2- 172.21.15.132:0/2621183247 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e4c071de0 0x7f4e4c151510 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c00e7e0 tx=0x7f4e3c00eca0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.546+0000 7f4e4b7fe640 1 -- 172.21.15.132:0/2621183247 reap_dead start 2024-04-16T15:52:20.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.546+0000 7f4e31ffb640 1 -- 172.21.15.132:0/2621183247 shutdown_connections 2024-04-16T15:52:20.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.546+0000 7f4e31ffb640 1 -- 172.21.15.132:0/2621183247 >> 172.21.15.132:0/2621183247 conn(0x7f4e4c067d90 msgr2=0x7f4e4c0b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:20.614 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.546+0000 7f151c972640 1 -- 172.21.15.132:0/2475068223 shutdown_connections 2024-04-16T15:52:20.614 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.547+0000 7f151c972640 1 -- 172.21.15.132:0/2475068223 wait complete. 2024-04-16T15:52:20.614 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.547+0000 7f4e31ffb640 1 -- 172.21.15.132:0/2621183247 shutdown_connections 2024-04-16T15:52:20.614 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.547+0000 7f4e31ffb640 1 -- 172.21.15.132:0/2621183247 wait complete. 2024-04-16T15:52:20.615 INFO:teuthology.orchestra.run.smithi132.stdout:55834574855 2024-04-16T15:52:20.615 INFO:teuthology.orchestra.run.smithi132.stdout:55834574854 2024-04-16T15:52:20.616 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-16T15:52:20.616 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-16T15:52:20.617 INFO:teuthology.orchestra.run.smithi132.stdout:55834574855 2024-04-16T15:52:20.617 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-16T15:52:20.618 INFO:teuthology.orchestra.run.smithi132.stdout:55834574854 2024-04-16T15:52:20.619 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-16T15:52:20.619 INFO:teuthology.orchestra.run.smithi132.stdout:55834574855 2024-04-16T15:52:20.620 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-16T15:52:20.620 INFO:teuthology.orchestra.run.smithi132.stdout:55834574855 2024-04-16T15:52:20.621 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-16T15:52:20.621 INFO:teuthology.orchestra.run.smithi132.stdout:55834574854 2024-04-16T15:52:20.622 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-16T15:52:20.623 INFO:teuthology.orchestra.run.smithi132.stdout:55834574853 2024-04-16T15:52:20.623 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-16T15:52:20.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.833+0000 7fa0773bd640 1 Processor -- start 2024-04-16T15:52:20.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.833+0000 7fa0773bd640 1 -- start start 2024-04-16T15:52:20.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.834+0000 7f820c7b5640 1 Processor -- start 2024-04-16T15:52:20.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.834+0000 7f971359e640 1 Processor -- start 2024-04-16T15:52:20.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.834+0000 7f971359e640 1 -- start start 2024-04-16T15:52:20.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.834+0000 7fa0773bd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa07015cb70 0x7fa0700ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.834+0000 7fa0773bd640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa0700d0430 0x7fa070160f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.835+0000 7fa07595a640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fa07009aa30 0x7fa0700af370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56632/0 (socket says 172.21.15.132:56632) 2024-04-16T15:52:20.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.835+0000 7fa07595a640 1 -- 172.21.15.132:0/2513628070 learned_addr learned my addr 172.21.15.132:0/2513628070 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:20.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.835+0000 7fa0773bd640 1 -- 172.21.15.132:0/2513628070 --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0700cd740 con 0x7fa07009aa30 2024-04-16T15:52:20.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.835+0000 7fa0773bd640 1 -- 172.21.15.132:0/2513628070 --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fa070161490 con 0x7fa07015cb70 2024-04-16T15:52:20.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.835+0000 7fa0773bd640 1 -- 172.21.15.132:0/2513628070 --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fa0700cda20 con 0x7fa0700d0430 2024-04-16T15:52:20.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.835+0000 7fa067fff640 1 -- 172.21.15.132:0/2513628070 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2612777653 0 0) 0x7fa0700cd740 con 0x7fa07009aa30 2024-04-16T15:52:20.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.835+0000 7fa067fff640 1 -- 172.21.15.132:0/2513628070 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa05c003520 con 0x7fa07009aa30 2024-04-16T15:52:20.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.834+0000 7f3cbfdba640 1 Processor -- start 2024-04-16T15:52:20.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.834+0000 7f3cbfdba640 1 -- start start 2024-04-16T15:52:20.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.835+0000 7f3cbfdba640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3cb815a850 0x7f3cb8070440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.835+0000 7f3cbfdba640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3cb815ea90 0x7f3cb80cf360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.836+0000 7f3cbfdba640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cb815bc40 con 0x7f3cb8070980 2024-04-16T15:52:20.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.836+0000 7f3cbfdba640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f3cb815f1f0 con 0x7f3cb815a850 2024-04-16T15:52:20.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.836+0000 7f3cbfdba640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f3cb806f1a0 con 0x7f3cb815ea90 2024-04-16T15:52:20.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.834+0000 7f820c7b5640 1 -- start start 2024-04-16T15:52:20.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.836+0000 7f3cbdb56640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3cb815a850 0x7f3cb8070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.836+0000 7f820c7b5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8204154ec0 0x7f82040b5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.836+0000 7f820c7b5640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f82040b5680 0x7f8204071ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.836+0000 7f820c7b5640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82040b3820 con 0x7f8204072430 2024-04-16T15:52:20.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.836+0000 7f820c7b5640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f82040b3b00 con 0x7f82040b5680 2024-04-16T15:52:20.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.836+0000 7f820c7b5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f82040b3de0 con 0x7f8204154ec0 2024-04-16T15:52:20.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.836+0000 7fb270f0d640 1 Processor -- start 2024-04-16T15:52:20.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.834+0000 7f6ab2890640 1 Processor -- start 2024-04-16T15:52:20.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.834+0000 7f6ab2890640 1 -- start start 2024-04-16T15:52:20.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.836+0000 7f6ab2890640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6aa40df220 0x7f6aa4038080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.836+0000 7f6ab2890640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6aa40544c0 con 0x7f6aa40501a0 2024-04-16T15:52:20.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.836+0000 7f6ab2890640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6aa40541e0 con 0x7f6aa4053c70 2024-04-16T15:52:20.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.836+0000 7f6ab2890640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f6aa4005f30 con 0x7f6aa40df220 2024-04-16T15:52:20.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.836+0000 7f820ad52640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f8204072430 0x7f820415e550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56638/0 (socket says 172.21.15.132:56638) 2024-04-16T15:52:20.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.836+0000 7f820ad52640 1 -- 172.21.15.132:0/2808477840 learned_addr learned my addr 172.21.15.132:0/2808477840 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:20.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.836+0000 7f971359e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f970c0501a0 0x7f970c038080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.836+0000 7fa074958640 1 --2- 172.21.15.132:0/2513628070 >> v2:172.21.15.179:3300/0 conn(0x7fa0700d0430 0x7fa070160f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.836+0000 7fb270f0d640 1 -- start start 2024-04-16T15:52:20.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.836+0000 7f3cbd355640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f3cb8070980 0x7f3cb815e380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.132:39800/0 (socket says 172.21.15.132:39800) 2024-04-16T15:52:20.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.836+0000 7f3cbd355640 1 -- 172.21.15.132:0/3819332553 learned_addr learned my addr 172.21.15.132:0/3819332553 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:20.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.836+0000 7f3cbe357640 1 --2- 172.21.15.132:0/3819332553 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3cb815ea90 0x7f3cb80cf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.836+0000 7fa075159640 1 --2- 172.21.15.132:0/2513628070 >> v2:172.21.15.132:3300/0 conn(0x7fa07015cb70 0x7fa0700ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.836+0000 7f8209d50640 1 --2- 172.21.15.132:0/2808477840 >> v2:172.21.15.179:3300/0 conn(0x7f82040b5680 0x7f8204071ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.836+0000 7f6ab188e640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6aa40df220 0x7f6aa4038080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.836+0000 7f6ab188e640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6aa40df220 0x7f6aa4038080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.132:34230/0 (socket says 172.21.15.132:34230) 2024-04-16T15:52:20.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.836+0000 7f6ab188e640 1 -- 172.21.15.132:0/4050987683 learned_addr learned my addr 172.21.15.132:0/4050987683 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:20.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.836+0000 7f820a551640 1 --2- 172.21.15.132:0/2808477840 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8204154ec0 0x7f82040b5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.836+0000 7f971359e640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f970c053c70 0x7f970c006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.836+0000 7f971359e640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f970c0544c0 con 0x7f970c0df220 2024-04-16T15:52:20.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.836+0000 7fa074958640 1 -- 172.21.15.132:0/2513628070 >> v2:172.21.15.132:3300/0 conn(0x7fa07015cb70 msgr2=0x7fa0700ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:20.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.837+0000 7f6ab088c640 1 -- 172.21.15.132:0/4050987683 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2000091028 0 0) 0x7f6aa40541e0 con 0x7f6aa4053c70 2024-04-16T15:52:20.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.837+0000 7f6ab088c640 1 -- 172.21.15.132:0/4050987683 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a98003520 con 0x7f6aa4053c70 2024-04-16T15:52:20.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.837+0000 7f9711d9b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f970c0501a0 0x7f970c038080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.837+0000 7f6ab188e640 1 -- 172.21.15.132:0/4050987683 >> v1:172.21.15.179:6789/0 conn(0x7f6aa4053c70 legacy=0x7f6aa404fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.837+0000 7f6ab188e640 1 -- 172.21.15.132:0/4050987683 >> v1:172.21.15.132:6789/0 conn(0x7f6aa40501a0 legacy=0x7f6aa4006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:20.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.837+0000 7f9711d9b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f970c0501a0 0x7f970c038080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.132:58110/0 (socket says 172.21.15.132:58110) 2024-04-16T15:52:20.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.837+0000 7f9711d9b640 1 -- 172.21.15.132:0/2390253761 learned_addr learned my addr 172.21.15.132:0/2390253761 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:20.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.837+0000 7f971359e640 1 -- 172.21.15.132:0/2390253761 --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f970c0541e0 con 0x7f970c053c70 2024-04-16T15:52:20.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.837+0000 7f971359e640 1 -- 172.21.15.132:0/2390253761 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f970c005f30 con 0x7f970c0501a0 2024-04-16T15:52:20.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.837+0000 7f9712d9d640 1 --2- 172.21.15.132:0/2390253761 >> v2:172.21.15.179:3300/0 conn(0x7f970c053c70 0x7f970c006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.837+0000 7f820a551640 1 -- 172.21.15.132:0/2808477840 >> v2:172.21.15.179:3300/0 conn(0x7f82040b5680 msgr2=0x7f8204071ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:20.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.837+0000 7f2f88463640 1 Processor -- start 2024-04-16T15:52:20.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.837+0000 7fb9dabe8640 1 Processor -- start 2024-04-16T15:52:20.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.838+0000 7fb9dabe8640 1 -- start start 2024-04-16T15:52:20.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.837+0000 7fb270f0d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2640df1c0 0x7fb26404fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.838+0000 7fb270f0d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb264054690 0x7fb2640df5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.838+0000 7fb270f0d640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb264053310 con 0x7fb2640dfae0 2024-04-16T15:52:20.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.838+0000 7fb270f0d640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fb2640535f0 con 0x7fb264054690 2024-04-16T15:52:20.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.838+0000 7fb270f0d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb2640538d0 con 0x7fb2640df1c0 2024-04-16T15:52:20.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.836+0000 7f3cbe357640 1 -- 172.21.15.132:0/3819332553 >> v2:172.21.15.179:3300/0 conn(0x7f3cb815a850 msgr2=0x7f3cb8070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:20.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.837+0000 7f2f88463640 1 -- start start 2024-04-16T15:52:20.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.836+0000 7f3cbe357640 1 --2- 172.21.15.132:0/3819332553 >> v2:172.21.15.179:3300/0 conn(0x7f3cb815a850 0x7f3cb8070440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.836+0000 7f3cbe357640 1 -- 172.21.15.132:0/3819332553 >> v1:172.21.15.179:6789/0 conn(0x7f3cb8070980 legacy=0x7f3cb815e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.837+0000 7f3cbe357640 1 -- 172.21.15.132:0/3819332553 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cb806f480 con 0x7f3cb815ea90 2024-04-16T15:52:20.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.837+0000 7fa074958640 1 --2- 172.21.15.132:0/2513628070 >> v2:172.21.15.132:3300/0 conn(0x7fa07015cb70 0x7fa0700ce7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.837+0000 7fa074958640 1 -- 172.21.15.132:0/2513628070 >> v1:172.21.15.132:6789/0 conn(0x7fa07009aa30 legacy=0x7fa0700af370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.837+0000 7fa074958640 1 -- 172.21.15.132:0/2513628070 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0700cdd00 con 0x7fa0700d0430 2024-04-16T15:52:20.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.837+0000 7f820a551640 1 --2- 172.21.15.132:0/2808477840 >> v2:172.21.15.179:3300/0 conn(0x7f82040b5680 0x7f8204071ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.837+0000 7f820a551640 1 -- 172.21.15.132:0/2808477840 >> v1:172.21.15.132:6789/0 conn(0x7f8204072430 legacy=0x7f820415e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.837+0000 7f820a551640 1 -- 172.21.15.132:0/2808477840 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82040b40c0 con 0x7f8204154ec0 2024-04-16T15:52:20.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.838+0000 7fa074958640 1 --2- 172.21.15.132:0/2513628070 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0700d0430 0x7fa070160f50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa0700d2120 tx=0x7fa06c02b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c9244799b52983a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.838+0000 7fb26a59c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2640df1c0 0x7fb26404fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.838+0000 7fb26a59c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2640df1c0 0x7fb26404fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.132:58112/0 (socket says 172.21.15.132:58112) 2024-04-16T15:52:20.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.838+0000 7fb26a59c640 1 -- 172.21.15.132:0/3890250672 learned_addr learned my addr 172.21.15.132:0/3890250672 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:20.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.838+0000 7f3cbe357640 1 --2- 172.21.15.132:0/3819332553 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3cb815ea90 0x7f3cb80cf360 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3ca80097a0 tx=0x7f3ca802b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a002ab861e8dd80e server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.837+0000 7f6ab188e640 1 -- 172.21.15.132:0/4050987683 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6aa4006210 con 0x7f6aa40df220 2024-04-16T15:52:20.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.838+0000 7f3cbcb54640 1 -- 172.21.15.132:0/3819332553 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca8035020 con 0x7f3cb815ea90 2024-04-16T15:52:20.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.838+0000 7f3cbcb54640 1 -- 172.21.15.132:0/3819332553 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ca8031810 con 0x7f3cb815ea90 2024-04-16T15:52:20.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.838+0000 7f3cbcb54640 1 -- 172.21.15.132:0/3819332553 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca8031be0 con 0x7f3cb815ea90 2024-04-16T15:52:20.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.838+0000 7fa067fff640 1 -- 172.21.15.132:0/2513628070 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa06c034070 con 0x7fa0700d0430 2024-04-16T15:52:20.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.839+0000 7fa067fff640 1 -- 172.21.15.132:0/2513628070 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa06c030840 con 0x7fa0700d0430 2024-04-16T15:52:20.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.839+0000 7fa067fff640 1 -- 172.21.15.132:0/2513628070 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa06c030bf0 con 0x7fa0700d0430 2024-04-16T15:52:20.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.838+0000 7f6ab188e640 1 --2- 172.21.15.132:0/4050987683 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6aa40df220 0x7f6aa4038080 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c0091e0 tx=0x7f6a9c02ccc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6a605e14103e6d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.839+0000 7f6ab088c640 1 -- 172.21.15.132:0/4050987683 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c03a070 con 0x7f6aa40df220 2024-04-16T15:52:20.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.838+0000 7fb269d9b640 1 --2- 172.21.15.132:0/3890250672 >> v2:172.21.15.132:3300/0 conn(0x7fb264054690 0x7fb2640df5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.839+0000 7fb26959a640 1 -- 172.21.15.132:0/3890250672 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3189710111 0 0) 0x7fb264053310 con 0x7fb2640dfae0 2024-04-16T15:52:20.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.839+0000 7fb26959a640 1 -- 172.21.15.132:0/3890250672 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb254007930 con 0x7fb2640dfae0 2024-04-16T15:52:20.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.838+0000 7f9711d9b640 1 -- 172.21.15.132:0/2390253761 >> v2:172.21.15.179:3300/0 conn(0x7f970c053c70 msgr2=0x7f970c006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:20.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.838+0000 7f9711d9b640 1 --2- 172.21.15.132:0/2390253761 >> v2:172.21.15.179:3300/0 conn(0x7f970c053c70 0x7f970c006a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.838+0000 7f9711d9b640 1 -- 172.21.15.132:0/2390253761 >> v1:172.21.15.179:6789/0 conn(0x7f970c0df220 legacy=0x7f970c04fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:20.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.838+0000 7f9711d9b640 1 -- 172.21.15.132:0/2390253761 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f970c006210 con 0x7f970c0501a0 2024-04-16T15:52:20.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.839+0000 7fb9dabe8640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb9d40d2c40 0x7fb9d406d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.839+0000 7fb9dabe8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9d415ec10 0x7fb9d40b3210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.839+0000 7fb9dabe8640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9d406e0d0 con 0x7fb9d406db50 2024-04-16T15:52:20.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.839+0000 7fb9dabe8640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fb9d406e3b0 con 0x7fb9d40d2c40 2024-04-16T15:52:20.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.839+0000 7fb9dabe8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb9d406e690 con 0x7fb9d415ec10 2024-04-16T15:52:20.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.839+0000 7f820a551640 1 --2- 172.21.15.132:0/2808477840 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8204154ec0 0x7f82040b5140 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f820000ba40 tx=0x7f820002de60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9bb7c4968cba4246 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.840+0000 7f820954f640 1 -- 172.21.15.132:0/2808477840 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8200034070 con 0x7f8204154ec0 2024-04-16T15:52:20.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.840+0000 7f820954f640 1 -- 172.21.15.132:0/2808477840 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f820002ec10 con 0x7f8204154ec0 2024-04-16T15:52:20.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.840+0000 7f820954f640 1 -- 172.21.15.132:0/2808477840 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8200034070 con 0x7f8204154ec0 2024-04-16T15:52:20.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.839+0000 7f2f88463640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f800c45e0 0x7f2f800c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.839+0000 7f2f88463640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f8006c840 con 0x7f2f8006fd40 2024-04-16T15:52:20.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.839+0000 7f2f88463640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f800c4f00 con 0x7f2f800701c0 2024-04-16T15:52:20.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.839+0000 7f2f88463640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f2f800b0d00 con 0x7f2f800c45e0 2024-04-16T15:52:20.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.839+0000 7f2f859fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f2f8006fd40 0x7f2f8006ba20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56680/0 (socket says 172.21.15.132:56680) 2024-04-16T15:52:20.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.839+0000 7f2f859fe640 1 -- 172.21.15.132:0/924118608 learned_addr learned my addr 172.21.15.132:0/924118608 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:20.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.840+0000 7f2f861ff640 1 --2- 172.21.15.132:0/924118608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f800c45e0 0x7f2f800c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.840+0000 7f2f851fd640 1 -- 172.21.15.132:0/924118608 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2416907655 0 0) 0x7f2f8006c840 con 0x7f2f8006fd40 2024-04-16T15:52:20.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.840+0000 7f2f851fd640 1 -- 172.21.15.132:0/924118608 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f6c003520 con 0x7f2f8006fd40 2024-04-16T15:52:20.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.839+0000 7f6ab088c640 1 -- 172.21.15.132:0/4050987683 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a9c02da70 con 0x7f6aa40df220 2024-04-16T15:52:20.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.840+0000 7f6ab088c640 1 -- 172.21.15.132:0/4050987683 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c03a070 con 0x7f6aa40df220 2024-04-16T15:52:20.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.840+0000 7f6ab2890640 1 -- 172.21.15.132:0/4050987683 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6aa40df220 msgr2=0x7f6aa4038080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.840+0000 7f6ab2890640 1 --2- 172.21.15.132:0/4050987683 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6aa40df220 0x7f6aa4038080 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c0091e0 tx=0x7f6a9c02ccc0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.840+0000 7f9711d9b640 1 --2- 172.21.15.132:0/2390253761 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f970c0501a0 0x7f970c038080 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9708009870 tx=0x7f970802b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4602b53a1f865f2d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.840+0000 7fa0773bd640 1 -- 172.21.15.132:0/2513628070 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0700d0430 msgr2=0x7fa070160f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.840+0000 7fa0773bd640 1 --2- 172.21.15.132:0/2513628070 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0700d0430 0x7fa070160f50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa0700d2120 tx=0x7fa06c02b980 comp rx=0 tx=0).stop 2024-04-16T15:52:20.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.839+0000 7fb269d9b640 1 -- 172.21.15.132:0/3890250672 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2640df1c0 msgr2=0x7fb26404fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:20.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.839+0000 7fb269d9b640 1 --2- 172.21.15.132:0/3890250672 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2640df1c0 0x7fb26404fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.839+0000 7fb269d9b640 1 -- 172.21.15.132:0/3890250672 >> v1:172.21.15.132:6789/0 conn(0x7fb2640dfae0 legacy=0x7fb2640e2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.839+0000 7fb269d9b640 1 -- 172.21.15.132:0/3890250672 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb264053bb0 con 0x7fb264054690 2024-04-16T15:52:20.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.839+0000 7fb9d8984640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb9d40d2c40 0x7fb9d406d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.839+0000 7fb9d3fff640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fb9d406db50 0x7fb9d415e500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.132:39840/0 (socket says 172.21.15.132:39840) 2024-04-16T15:52:20.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.839+0000 7fb9d9185640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9d415ec10 0x7fb9d40b3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.839+0000 7fb9d3fff640 1 -- 172.21.15.132:0/405059431 learned_addr learned my addr 172.21.15.132:0/405059431 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:20.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.840+0000 7fa0773bd640 1 -- 172.21.15.132:0/2513628070 shutdown_connections 2024-04-16T15:52:20.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.840+0000 7fa0773bd640 1 --2- 172.21.15.132:0/2513628070 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0700d0430 0x7fa070160f50 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.840+0000 7fa0773bd640 1 --2- 172.21.15.132:0/2513628070 >> v2:172.21.15.132:3300/0 conn(0x7fa07015cb70 0x7fa0700ce7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.840+0000 7fa0773bd640 1 -- 172.21.15.132:0/2513628070 >> 172.21.15.132:0/2513628070 conn(0x7fa0700b4190 msgr2=0x7fa0700b45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:20.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.840+0000 7f3cbfdba640 1 -- 172.21.15.132:0/3819332553 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3cb815ea90 msgr2=0x7f3cb80cf360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.840+0000 7f3cbfdba640 1 --2- 172.21.15.132:0/3819332553 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3cb815ea90 0x7f3cb80cf360 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3ca80097a0 tx=0x7f3ca802b8b0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.839+0000 7fb9d9185640 1 -- 172.21.15.132:0/405059431 >> v2:172.21.15.132:3300/0 conn(0x7fb9d40d2c40 msgr2=0x7fb9d406d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:20.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.839+0000 7fb9d9185640 1 --2- 172.21.15.132:0/405059431 >> v2:172.21.15.132:3300/0 conn(0x7fb9d40d2c40 0x7fb9d406d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.839+0000 7fb9d9185640 1 -- 172.21.15.132:0/405059431 >> v1:172.21.15.179:6789/0 conn(0x7fb9d406db50 legacy=0x7fb9d415e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.839+0000 7fb9d9185640 1 -- 172.21.15.132:0/405059431 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9d406e970 con 0x7fb9d415ec10 2024-04-16T15:52:20.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.840+0000 7fb9d8984640 1 --2- 172.21.15.132:0/405059431 >> v2:172.21.15.132:3300/0 conn(0x7fb9d40d2c40 0x7fb9d406d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:20.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.840+0000 7f971159a640 1 -- 172.21.15.132:0/2390253761 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97080317c0 con 0x7f970c0501a0 2024-04-16T15:52:20.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.840+0000 7f6ab2890640 1 -- 172.21.15.132:0/4050987683 shutdown_connections 2024-04-16T15:52:20.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.840+0000 7f6ab2890640 1 --2- 172.21.15.132:0/4050987683 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6aa40df220 0x7f6aa4038080 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.840+0000 7f6ab2890640 1 -- 172.21.15.132:0/4050987683 >> 172.21.15.132:0/4050987683 conn(0x7f6aa4009fb0 msgr2=0x7f6aa400a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:20.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.840+0000 7f971159a640 1 -- 172.21.15.132:0/2390253761 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9708037070 con 0x7f970c0501a0 2024-04-16T15:52:20.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.840+0000 7f2f851fd640 1 -- 172.21.15.132:0/924118608 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1212609941 0 0) 0x7f2f6c003520 con 0x7f2f8006fd40 2024-04-16T15:52:20.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.840+0000 7f2f851fd640 1 -- 172.21.15.132:0/924118608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f800c45e0 msgr2=0x7f2f800c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:20.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.840+0000 7f2f851fd640 1 --2- 172.21.15.132:0/924118608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f800c45e0 0x7f2f800c49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.840+0000 7f2f851fd640 1 -- 172.21.15.132:0/924118608 >> v1:172.21.15.179:6789/0 conn(0x7f2f800701c0 legacy=0x7f2f8006c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.840+0000 7f2f851fd640 1 -- 172.21.15.132:0/924118608 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f80070920 con 0x7f2f8006fd40 2024-04-16T15:52:20.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.840+0000 7f971159a640 1 -- 172.21.15.132:0/2390253761 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9708031b80 con 0x7f970c0501a0 2024-04-16T15:52:20.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.840+0000 7fa0773bd640 1 -- 172.21.15.132:0/2513628070 shutdown_connections 2024-04-16T15:52:20.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.840+0000 7f2f851fd640 1 -- 172.21.15.132:0/924118608 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2803668828 0 0) 0x7f2f780019d0 con 0x7f2f8006fd40 2024-04-16T15:52:20.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.840+0000 7f2f851fd640 1 -- 172.21.15.132:0/924118608 >> v1:172.21.15.132:6789/0 conn(0x7f2f8006fd40 legacy=0x7f2f8006ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.840+0000 7f6ab2890640 1 -- 172.21.15.132:0/4050987683 shutdown_connections 2024-04-16T15:52:20.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.840+0000 7fa0773bd640 1 -- 172.21.15.132:0/2513628070 wait complete. 2024-04-16T15:52:20.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.840+0000 7f2f851fd640 1 --2- 172.21.15.132:0/924118608 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f6c003a00 0x7f2f6c003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.840+0000 7f2f851fd640 1 --2- 172.21.15.132:0/924118608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f800c45e0 0x7f2f6c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.840+0000 7f2f851fd640 1 --2- 172.21.15.132:0/924118608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f6c004d40 0x7f2f6c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.840+0000 7f2f851fd640 1 -- 172.21.15.132:0/924118608 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f2f6c00bb00 con 0x7f2f6c003a00 2024-04-16T15:52:20.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.840+0000 7f2f851fd640 1 -- 172.21.15.132:0/924118608 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2f6c00bcb0 con 0x7f2f6c004d40 2024-04-16T15:52:20.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.840+0000 7f2f851fd640 1 -- 172.21.15.132:0/924118608 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f2f6c00beb0 con 0x7f2f800c45e0 2024-04-16T15:52:20.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.840+0000 7f3cbfdba640 1 -- 172.21.15.132:0/3819332553 shutdown_connections 2024-04-16T15:52:20.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.840+0000 7f3cbfdba640 1 --2- 172.21.15.132:0/3819332553 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3cb815ea90 0x7f3cb80cf360 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.840+0000 7f3cbfdba640 1 --2- 172.21.15.132:0/3819332553 >> v2:172.21.15.179:3300/0 conn(0x7f3cb815a850 0x7f3cb8070440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.840+0000 7f3cbfdba640 1 -- 172.21.15.132:0/3819332553 >> 172.21.15.132:0/3819332553 conn(0x7f3cb806ba20 msgr2=0x7f3cb806be00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:20.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.841+0000 7f3cbfdba640 1 -- 172.21.15.132:0/3819332553 shutdown_connections 2024-04-16T15:52:20.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.841+0000 7fb269d9b640 1 --2- 172.21.15.132:0/3890250672 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb264054690 0x7fb2640df5a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb25c0087a0 tx=0x7fb25c02bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10ca82507b392fa5 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.841+0000 7f2f859fe640 1 --2- 172.21.15.132:0/924118608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f800c45e0 0x7f2f6c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.841+0000 7f2f861ff640 1 --2- 172.21.15.132:0/924118608 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f6c003a00 0x7f2f6c003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.841+0000 7f2f86a00640 1 --2- 172.21.15.132:0/924118608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f6c004d40 0x7f2f6c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.841+0000 7fb26959a640 1 -- 172.21.15.132:0/3890250672 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb25c032070 con 0x7fb264054690 2024-04-16T15:52:20.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.841+0000 7fb26959a640 1 -- 172.21.15.132:0/3890250672 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb25c02ca90 con 0x7fb264054690 2024-04-16T15:52:20.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.841+0000 7fb9d9185640 1 --2- 172.21.15.132:0/405059431 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9d415ec10 0x7fb9d40b3210 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc009d90 tx=0x7fb9cc02bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35c59b12297a054e server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.865 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.841+0000 7f971359e640 1 -- 172.21.15.132:0/2390253761 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f970c0501a0 msgr2=0x7f970c038080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.865 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.841+0000 7f3cbfdba640 1 -- 172.21.15.132:0/3819332553 wait complete. 2024-04-16T15:52:20.865 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.841+0000 7f971359e640 1 --2- 172.21.15.132:0/2390253761 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f970c0501a0 0x7f970c038080 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9708009870 tx=0x7f970802b860 comp rx=0 tx=0).stop 2024-04-16T15:52:20.865 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.841+0000 7f820c7b5640 1 -- 172.21.15.132:0/2808477840 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8204154ec0 msgr2=0x7f82040b5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.866 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.841+0000 7f820c7b5640 1 --2- 172.21.15.132:0/2808477840 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8204154ec0 0x7f82040b5140 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f820000ba40 tx=0x7f820002de60 comp rx=0 tx=0).stop 2024-04-16T15:52:20.866 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.841+0000 7fb9d37fe640 1 -- 172.21.15.132:0/405059431 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc039070 con 0x7fb9d415ec10 2024-04-16T15:52:20.866 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.841+0000 7f820c7b5640 1 -- 172.21.15.132:0/2808477840 shutdown_connections 2024-04-16T15:52:20.866 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.841+0000 7f820c7b5640 1 --2- 172.21.15.132:0/2808477840 >> v2:172.21.15.179:3300/0 conn(0x7f82040b5680 0x7f8204071ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.866 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.841+0000 7f820c7b5640 1 --2- 172.21.15.132:0/2808477840 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8204154ec0 0x7f82040b5140 secure :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f820000ba40 tx=0x7f820002de60 comp rx=0 tx=0).stop 2024-04-16T15:52:20.866 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.841+0000 7f820c7b5640 1 -- 172.21.15.132:0/2808477840 >> 172.21.15.132:0/2808477840 conn(0x7f82040b23e0 msgr2=0x7f82040b27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:20.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.841+0000 7f971359e640 1 -- 172.21.15.132:0/2390253761 shutdown_connections 2024-04-16T15:52:20.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.841+0000 7f971359e640 1 --2- 172.21.15.132:0/2390253761 >> v2:172.21.15.179:3300/0 conn(0x7f970c053c70 0x7f970c006a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.841+0000 7fb9d37fe640 1 -- 172.21.15.132:0/405059431 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9cc02cc50 con 0x7fb9d415ec10 2024-04-16T15:52:20.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.841+0000 7fb9d37fe640 1 -- 172.21.15.132:0/405059431 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc034440 con 0x7fb9d415ec10 2024-04-16T15:52:20.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.841+0000 7f971359e640 1 --2- 172.21.15.132:0/2390253761 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f970c0501a0 0x7f970c038080 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.840+0000 7f6ab2890640 1 -- 172.21.15.132:0/4050987683 wait complete. 2024-04-16T15:52:20.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.842+0000 7f971359e640 1 -- 172.21.15.132:0/2390253761 >> 172.21.15.132:0/2390253761 conn(0x7f970c009fb0 msgr2=0x7f970c00a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:20.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.841+0000 7f2f859fe640 1 -- 172.21.15.132:0/924118608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f6c004d40 msgr2=0x7f2f6c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:20.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.841+0000 7f2f859fe640 1 --2- 172.21.15.132:0/924118608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f6c004d40 0x7f2f6c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.841+0000 7f2f859fe640 1 -- 172.21.15.132:0/924118608 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f6c003a00 msgr2=0x7f2f6c003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:20.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.841+0000 7f2f859fe640 1 --2- 172.21.15.132:0/924118608 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f6c003a00 0x7f2f6c003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.841+0000 7f2f859fe640 1 -- 172.21.15.132:0/924118608 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f6c00c170 con 0x7f2f800c45e0 2024-04-16T15:52:20.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.841+0000 7f2f861ff640 1 --2- 172.21.15.132:0/924118608 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f6c003a00 0x7f2f6c003e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:20.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.842+0000 7f820c7b5640 1 -- 172.21.15.132:0/2808477840 shutdown_connections 2024-04-16T15:52:20.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.842+0000 7f6ab2890640 1 Processor -- start 2024-04-16T15:52:20.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.842+0000 7f6ab2890640 1 -- start start 2024-04-16T15:52:20.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.842+0000 7fa0773bd640 1 Processor -- start 2024-04-16T15:52:20.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.842+0000 7f971359e640 1 -- 172.21.15.132:0/2390253761 shutdown_connections 2024-04-16T15:52:20.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.842+0000 7f971359e640 1 -- 172.21.15.132:0/2390253761 wait complete. 2024-04-16T15:52:20.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.842+0000 7fb26959a640 1 -- 172.21.15.132:0/3890250672 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb25c036400 con 0x7fb264054690 2024-04-16T15:52:20.871 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.842+0000 7f2f859fe640 1 --2- 172.21.15.132:0/924118608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f800c45e0 0x7f2f6c004800 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2f78002230 tx=0x7f2f6c005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b78cb9d411edf0c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.871 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.842+0000 7f3cbfdba640 1 Processor -- start 2024-04-16T15:52:20.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.842+0000 7fb9dabe8640 1 -- 172.21.15.132:0/405059431 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9d415ec10 msgr2=0x7fb9d40b3210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.842+0000 7fb9dabe8640 1 --2- 172.21.15.132:0/405059431 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9d415ec10 0x7fb9d40b3210 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc009d90 tx=0x7fb9cc02bea0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.843+0000 7f3cbfdba640 1 -- start start 2024-04-16T15:52:20.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.843+0000 7f2f851fd640 1 -- 172.21.15.132:0/924118608 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f7800a450 con 0x7f2f800c45e0 2024-04-16T15:52:20.873 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.843+0000 7fb270f0d640 1 -- 172.21.15.132:0/3890250672 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb264054690 msgr2=0x7fb2640df5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.873 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.843+0000 7fb270f0d640 1 --2- 172.21.15.132:0/3890250672 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb264054690 0x7fb2640df5a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb25c0087a0 tx=0x7fb25c02bce0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.873 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.843+0000 7fb9dabe8640 1 -- 172.21.15.132:0/405059431 shutdown_connections 2024-04-16T15:52:20.873 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.843+0000 7fb9dabe8640 1 --2- 172.21.15.132:0/405059431 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9d415ec10 0x7fb9d40b3210 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.873 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.843+0000 7fb9dabe8640 1 --2- 172.21.15.132:0/405059431 >> v2:172.21.15.132:3300/0 conn(0x7fb9d40d2c40 0x7fb9d406d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.873 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.843+0000 7fb9dabe8640 1 -- 172.21.15.132:0/405059431 >> 172.21.15.132:0/405059431 conn(0x7fb9d408bfc0 msgr2=0x7fb9d40d4680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:20.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.843+0000 7f2f851fd640 1 -- 172.21.15.132:0/924118608 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f78034630 con 0x7f2f800c45e0 2024-04-16T15:52:20.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.843+0000 7f2f851fd640 1 -- 172.21.15.132:0/924118608 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f7800a450 con 0x7f2f800c45e0 2024-04-16T15:52:20.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.842+0000 7f820c7b5640 1 -- 172.21.15.132:0/2808477840 wait complete. 2024-04-16T15:52:20.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.843+0000 7fb9dabe8640 1 -- 172.21.15.132:0/405059431 shutdown_connections 2024-04-16T15:52:20.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.843+0000 7fa0773bd640 1 -- start start 2024-04-16T15:52:20.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.843+0000 7fb270f0d640 1 -- 172.21.15.132:0/3890250672 shutdown_connections 2024-04-16T15:52:20.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.843+0000 7fb270f0d640 1 --2- 172.21.15.132:0/3890250672 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb264054690 0x7fb2640df5a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.843+0000 7fb270f0d640 1 --2- 172.21.15.132:0/3890250672 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2640df1c0 0x7fb26404fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.843+0000 7fb270f0d640 1 -- 172.21.15.132:0/3890250672 >> 172.21.15.132:0/3890250672 conn(0x7fb264009fe0 msgr2=0x7fb26400a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:20.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.843+0000 7f6ab2890640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6aa40501a0 0x7f6aa41857c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.843+0000 7f6ab2890640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6aa4053c70 0x7f6aa4035050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.843+0000 7f6ab2890640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6aa40df220 0x7f6aa4035590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.843+0000 7f6ab2890640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f6aa4037a90 con 0x7f6aa40501a0 2024-04-16T15:52:20.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.843+0000 7f6ab2890640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6aa4037910 con 0x7f6aa40df220 2024-04-16T15:52:20.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.843+0000 7fb9dabe8640 1 -- 172.21.15.132:0/405059431 wait complete. 2024-04-16T15:52:20.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.843+0000 7fb270f0d640 1 -- 172.21.15.132:0/3890250672 shutdown_connections 2024-04-16T15:52:20.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.843+0000 7f6ab2890640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6aa40df600 con 0x7f6aa4053c70 2024-04-16T15:52:20.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.843+0000 7f6ab188e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6aa40501a0 0x7f6aa41857c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.843+0000 7f6ab188e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6aa40501a0 0x7f6aa41857c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37612/0 (socket says 172.21.15.132:37612) 2024-04-16T15:52:20.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.843+0000 7f6ab188e640 1 -- 172.21.15.132:0/2859677222 learned_addr learned my addr 172.21.15.132:0/2859677222 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:20.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.844+0000 7f6ab208f640 1 --2- 172.21.15.132:0/2859677222 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6aa40df220 0x7f6aa4035590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.844+0000 7f820c7b5640 1 Processor -- start 2024-04-16T15:52:20.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.844+0000 7f3cbfdba640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3cb8070980 0x7f3cb815c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.844+0000 7f3cbfdba640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3cb815a850 0x7f3cb81f4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.844+0000 7f3cbfdba640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3cb815ea90 0x7f3cb8158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.844+0000 7f3cbfdba640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb80cea80 con 0x7f3cb815ea90 2024-04-16T15:52:20.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.844+0000 7f3cbfdba640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb80cee40 con 0x7f3cb815a850 2024-04-16T15:52:20.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.844+0000 7f3cbfdba640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f3cb80cec00 con 0x7f3cb8070980 2024-04-16T15:52:20.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.844+0000 7f820c7b5640 1 -- start start 2024-04-16T15:52:20.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.844+0000 7f6ab108d640 1 --2- 172.21.15.132:0/2859677222 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6aa4053c70 0x7f6aa4035050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.844+0000 7f6ab188e640 1 -- 172.21.15.132:0/2859677222 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6aa4053c70 msgr2=0x7f6aa4035050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.844+0000 7f6ab188e640 1 --2- 172.21.15.132:0/2859677222 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6aa4053c70 0x7f6aa4035050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.844+0000 7f6ab188e640 1 -- 172.21.15.132:0/2859677222 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6aa40df220 msgr2=0x7f6aa4035590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.844+0000 7f6ab188e640 1 --2- 172.21.15.132:0/2859677222 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6aa40df220 0x7f6aa4035590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.844+0000 7f6ab188e640 1 -- 172.21.15.132:0/2859677222 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6aa404bc30 con 0x7f6aa40501a0 2024-04-16T15:52:20.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.844+0000 7f6ab108d640 1 --2- 172.21.15.132:0/2859677222 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6aa4053c70 0x7f6aa4035050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:20.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.844+0000 7fb270f0d640 1 -- 172.21.15.132:0/3890250672 wait complete. 2024-04-16T15:52:20.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.844+0000 7f3cbdb56640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3cb8070980 0x7f3cb815c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.844+0000 7f3cbdb56640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3cb8070980 0x7f3cb815c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.132:58182/0 (socket says 172.21.15.132:58182) 2024-04-16T15:52:20.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.844+0000 7f3cbdb56640 1 -- 172.21.15.132:0/2603351378 learned_addr learned my addr 172.21.15.132:0/2603351378 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:20.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.844+0000 7f3cbd355640 1 --2- 172.21.15.132:0/2603351378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3cb815a850 0x7f3cb81f4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.844+0000 7f6ab188e640 1 --2- 172.21.15.132:0/2859677222 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6aa40501a0 0x7f6aa41857c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c0090b0 tx=0x7f6a9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.844+0000 7fa0773bd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa07009aa30 0x7fa0700cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.845+0000 7fa0773bd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0700d0430 0x7fa07015d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.845+0000 7f2f88463640 1 -- 172.21.15.132:0/924118608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f800c45e0 msgr2=0x7f2f6c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.845+0000 7f2f88463640 1 --2- 172.21.15.132:0/924118608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f800c45e0 0x7f2f6c004800 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2f78002230 tx=0x7f2f6c005830 comp rx=0 tx=0).stop 2024-04-16T15:52:20.883 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.845+0000 7fa0773bd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa07015cb70 0x7fa07015dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.883 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.845+0000 7fa075159640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa07009aa30 0x7fa0700cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.883 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.845+0000 7f3cbd355640 1 -- 172.21.15.132:0/2603351378 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3cb8070980 msgr2=0x7f3cb815c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.883 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.845+0000 7f3cbe357640 1 --2- 172.21.15.132:0/2603351378 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3cb815ea90 0x7f3cb8158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.883 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.845+0000 7f3cbd355640 1 --2- 172.21.15.132:0/2603351378 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3cb8070980 0x7f3cb815c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.884 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.845+0000 7f6aa27fc640 1 -- 172.21.15.132:0/2859677222 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c045070 con 0x7f6aa40501a0 2024-04-16T15:52:20.884 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.845+0000 7f6ab2890640 1 -- 172.21.15.132:0/2859677222 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6aa404bea0 con 0x7f6aa40501a0 2024-04-16T15:52:20.884 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.845+0000 7f6ab2890640 1 -- 172.21.15.132:0/2859677222 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6aa404c460 con 0x7f6aa40501a0 2024-04-16T15:52:20.884 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.845+0000 7f6aa27fc640 1 -- 172.21.15.132:0/2859677222 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a9c003c50 con 0x7f6aa40501a0 2024-04-16T15:52:20.884 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.845+0000 7f6aa27fc640 1 -- 172.21.15.132:0/2859677222 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c045070 con 0x7f6aa40501a0 2024-04-16T15:52:20.884 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.845+0000 7f3cbd355640 1 -- 172.21.15.132:0/2603351378 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3cb815ea90 msgr2=0x7f3cb8158f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.884 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.845+0000 7f3cbd355640 1 --2- 172.21.15.132:0/2603351378 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3cb815ea90 0x7f3cb8158f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.845+0000 7fa075159640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa07009aa30 0x7fa0700cbf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.132:58194/0 (socket says 172.21.15.132:58194) 2024-04-16T15:52:20.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.845+0000 7f3cbd355640 1 -- 172.21.15.132:0/2603351378 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cb815cde0 con 0x7f3cb815a850 2024-04-16T15:52:20.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.845+0000 7fa074958640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0700d0430 0x7fa07015d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.845+0000 7fa074958640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0700d0430 0x7fa07015d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.132:34274/0 (socket says 172.21.15.132:34274) 2024-04-16T15:52:20.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.845+0000 7f3cbe357640 1 --2- 172.21.15.132:0/2603351378 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3cb815ea90 0x7f3cb8158f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:52:20.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.845+0000 7f820c7b5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8204072430 0x7f8204140610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.845+0000 7f820c7b5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82040b5680 0x7f8204155e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.845+0000 7fa0773bd640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fa0700cd440 con 0x7fa07015cb70 2024-04-16T15:52:20.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.845+0000 7fa0773bd640 1 -- 172.21.15.132:0/1382046762 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa0700ce2c0 con 0x7fa0700d0430 2024-04-16T15:52:20.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.845+0000 7fa0773bd640 1 -- 172.21.15.132:0/1382046762 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fa07009aec0 con 0x7fa07009aa30 2024-04-16T15:52:20.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.845+0000 7f820c7b5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8204142d30 0x7f82041431e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.845+0000 7fa075159640 1 -- 172.21.15.132:0/1382046762 learned_addr learned my addr 172.21.15.132:0/1382046762 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:20.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.845+0000 7f2f86a00640 1 -- 172.21.15.132:0/924118608 reap_dead start 2024-04-16T15:52:20.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.845+0000 7f2f88463640 1 -- 172.21.15.132:0/924118608 shutdown_connections 2024-04-16T15:52:20.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.845+0000 7f2f88463640 1 -- 172.21.15.132:0/924118608 >> 172.21.15.132:0/924118608 conn(0x7f2f8009aa30 msgr2=0x7f2f800b31a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:20.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.846+0000 7f820c7b5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f82041552a0 con 0x7f8204142d30 2024-04-16T15:52:20.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.844+0000 7f971359e640 1 Processor -- start 2024-04-16T15:52:20.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.845+0000 7f971359e640 1 -- start start 2024-04-16T15:52:20.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.846+0000 7f820c7b5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f82040b34d0 con 0x7f82040b5680 2024-04-16T15:52:20.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.846+0000 7f3cbd355640 1 --2- 172.21.15.132:0/2603351378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3cb815a850 0x7f3cb81f4100 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8070da0 tx=0x7f3cb000cc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.846+0000 7f820c7b5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f820406ba20 con 0x7f8204072430 2024-04-16T15:52:20.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.846+0000 7f971359e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f970c0501a0 0x7f970c0485f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.846+0000 7f971359e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f970c053c70 0x7f970c0cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.846+0000 7fb9dabe8640 1 Processor -- start 2024-04-16T15:52:20.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.846+0000 7fa075159640 1 -- 172.21.15.132:0/1382046762 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0700d0430 msgr2=0x7fa07015d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.846+0000 7fa075159640 1 --2- 172.21.15.132:0/1382046762 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0700d0430 0x7fa07015d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.846+0000 7fa075159640 1 -- 172.21.15.132:0/1382046762 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa07015cb70 msgr2=0x7fa07015dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.846+0000 7fa075159640 1 --2- 172.21.15.132:0/1382046762 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa07015cb70 0x7fa07015dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.846+0000 7fa075159640 1 -- 172.21.15.132:0/1382046762 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa07015fdb0 con 0x7fa07009aa30 2024-04-16T15:52:20.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.846+0000 7fb270f0d640 1 Processor -- start 2024-04-16T15:52:20.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.846+0000 7f3cae7fc640 1 -- 172.21.15.132:0/2603351378 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb0017070 con 0x7f3cb815a850 2024-04-16T15:52:20.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.846+0000 7f3cbfdba640 1 -- 172.21.15.132:0/2603351378 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cb80cb8a0 con 0x7f3cb815a850 2024-04-16T15:52:20.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.846+0000 7f971359e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f970c0df220 0x7f970c0477b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.846+0000 7f971259c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f970c0501a0 0x7f970c0485f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.846+0000 7f3cbfdba640 1 -- 172.21.15.132:0/2603351378 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cb80ca700 con 0x7f3cb815a850 2024-04-16T15:52:20.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.846+0000 7f2f88463640 1 -- 172.21.15.132:0/924118608 shutdown_connections 2024-04-16T15:52:20.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.846+0000 7fb9dabe8640 1 -- start start 2024-04-16T15:52:20.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.846+0000 7f2f88463640 1 -- 172.21.15.132:0/924118608 wait complete. 2024-04-16T15:52:20.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.846+0000 7fa075159640 1 --2- 172.21.15.132:0/1382046762 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa07009aa30 0x7fa0700cbf40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa06000e870 tx=0x7fa06000ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.894 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.846+0000 7f971359e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f970c037a90 con 0x7f970c053c70 2024-04-16T15:52:20.894 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.846+0000 7f971359e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f970c037910 con 0x7f970c0501a0 2024-04-16T15:52:20.894 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.846+0000 7fb270f0d640 1 -- start start 2024-04-16T15:52:20.894 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.847+0000 7f971359e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f970c0df600 con 0x7f970c0df220 2024-04-16T15:52:20.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.846+0000 7f8209d50640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82040b5680 0x7f8204155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.846+0000 7f8209d50640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82040b5680 0x7f8204155e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.132:34280/0 (socket says 172.21.15.132:34280) 2024-04-16T15:52:20.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.846+0000 7f8209d50640 1 -- 172.21.15.132:0/1314685611 learned_addr learned my addr 172.21.15.132:0/1314685611 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:20.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.846+0000 7f820a551640 1 --2- 172.21.15.132:0/1314685611 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8204072430 0x7f8204140610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.846+0000 7f820ad52640 1 --2- 172.21.15.132:0/1314685611 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8204142d30 0x7f82041431e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.847+0000 7f820ad52640 1 -- 172.21.15.132:0/1314685611 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8204072430 msgr2=0x7f8204140610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.896 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.847+0000 7fa065ffb640 1 -- 172.21.15.132:0/1382046762 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa060017070 con 0x7fa07009aa30 2024-04-16T15:52:20.896 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.847+0000 7fa065ffb640 1 -- 172.21.15.132:0/1382046762 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa06000c940 con 0x7fa07009aa30 2024-04-16T15:52:20.896 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.847+0000 7fa065ffb640 1 -- 172.21.15.132:0/1382046762 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa06000cd30 con 0x7fa07009aa30 2024-04-16T15:52:20.896 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.847+0000 7fa0773bd640 1 -- 172.21.15.132:0/1382046762 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa07015e4e0 con 0x7fa07009aa30 2024-04-16T15:52:20.896 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.847+0000 7f3cae7fc640 1 -- 172.21.15.132:0/2603351378 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cb000ce50 con 0x7f3cb815a850 2024-04-16T15:52:20.896 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.847+0000 7f3cae7fc640 1 -- 172.21.15.132:0/2603351378 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb000aa80 con 0x7f3cb815a850 2024-04-16T15:52:20.897 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.847+0000 7fa0773bd640 1 -- 172.21.15.132:0/1382046762 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0700b6a50 con 0x7fa07009aa30 2024-04-16T15:52:20.897 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.847+0000 7f820ad52640 1 --2- 172.21.15.132:0/1314685611 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8204072430 0x7f8204140610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.897 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.847+0000 7f820ad52640 1 -- 172.21.15.132:0/1314685611 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82040b5680 msgr2=0x7f8204155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.847+0000 7f820ad52640 1 --2- 172.21.15.132:0/1314685611 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82040b5680 0x7f8204155e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.847+0000 7f820ad52640 1 -- 172.21.15.132:0/1314685611 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82041437f0 con 0x7f8204142d30 2024-04-16T15:52:20.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.848+0000 7f820ad52640 1 --2- 172.21.15.132:0/1314685611 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8204142d30 0x7f82041431e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f81fc001720 tx=0x7f81fc001be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.848+0000 7f6ab2890640 1 -- 172.21.15.132:0/2859677222 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6aa4005390 con 0x7f6aa40501a0 2024-04-16T15:52:20.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.847+0000 7fb9dabe8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9d406db50 0x7fb9d41e7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.847+0000 7fb9dabe8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9d40d2c40 0x7fb9d40c7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.848+0000 7fb9dabe8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9d415ec10 0x7fb9d415d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.848+0000 7fb9dabe8640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d40d3830 con 0x7fb9d406db50 2024-04-16T15:52:20.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.848+0000 7fb9dabe8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d40d36b0 con 0x7fb9d40d2c40 2024-04-16T15:52:20.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.848+0000 7fb9dabe8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb9d40d3020 con 0x7fb9d415ec10 2024-04-16T15:52:20.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.848+0000 7fb9d3fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9d40d2c40 0x7fb9d40c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.848+0000 7fb9d3fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9d40d2c40 0x7fb9d40c7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.132:34292/0 (socket says 172.21.15.132:34292) 2024-04-16T15:52:20.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.848+0000 7fb270f0d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb264054690 0x7fb2641743b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.848+0000 7fb270f0d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2640df1c0 0x7fb26404e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.848+0000 7fb270f0d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2640dfae0 0x7fb264005a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.848+0000 7fb270f0d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fb264050530 con 0x7fb2640dfae0 2024-04-16T15:52:20.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.848+0000 7fb270f0d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb264054170 con 0x7fb264054690 2024-04-16T15:52:20.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.848+0000 7fb270f0d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb2640e04e0 con 0x7fb2640df1c0 2024-04-16T15:52:20.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.848+0000 7f81faffd640 1 -- 172.21.15.132:0/1314685611 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81fc018070 con 0x7f8204142d30 2024-04-16T15:52:20.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.848+0000 7f820c7b5640 1 -- 172.21.15.132:0/1314685611 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8204143ad0 con 0x7f8204142d30 2024-04-16T15:52:20.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.848+0000 7fb26a59c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb264054690 0x7fb2641743b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.848+0000 7f2f88463640 1 Processor -- start 2024-04-16T15:52:20.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.848+0000 7f820c7b5640 1 -- 172.21.15.132:0/1314685611 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8204155910 con 0x7f8204142d30 2024-04-16T15:52:20.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.849+0000 7f2f88463640 1 -- start start 2024-04-16T15:52:20.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.847+0000 7f9712d9d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f970c0df220 0x7f970c0477b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.847+0000 7f971259c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f970c0501a0 0x7f970c0485f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.132:34284/0 (socket says 172.21.15.132:34284) 2024-04-16T15:52:20.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.847+0000 7f971259c640 1 -- 172.21.15.132:0/3548162096 learned_addr learned my addr 172.21.15.132:0/3548162096 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:20.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.847+0000 7f9711d9b640 1 --2- 172.21.15.132:0/3548162096 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f970c053c70 0x7f970c0cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.849+0000 7fa065ffb640 1 -- 172.21.15.132:0/1382046762 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa06001a070 con 0x7fa07009aa30 2024-04-16T15:52:20.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.848+0000 7fb9d3fff640 1 -- 172.21.15.132:0/671815809 learned_addr learned my addr 172.21.15.132:0/671815809 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:20.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.848+0000 7fb9d9185640 1 --2- 172.21.15.132:0/671815809 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9d415ec10 0x7fb9d415d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.848+0000 7fb9d8984640 1 --2- 172.21.15.132:0/671815809 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9d406db50 0x7fb9d41e7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.848+0000 7fb26ad9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2640dfae0 0x7fb264005a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.848+0000 7fb26a59c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb264054690 0x7fb2641743b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.132:34308/0 (socket says 172.21.15.132:34308) 2024-04-16T15:52:20.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.848+0000 7fb26a59c640 1 -- 172.21.15.132:0/3302809239 learned_addr learned my addr 172.21.15.132:0/3302809239 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:20.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.848+0000 7fb26ad9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2640dfae0 0x7fb264005a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37668/0 (socket says 172.21.15.132:37668) 2024-04-16T15:52:20.904 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.849+0000 7fb26ad9d640 1 -- 172.21.15.132:0/3302809239 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2640df1c0 msgr2=0x7fb26404e1c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-16T15:52:20.904 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.849+0000 7fb26ad9d640 1 --2- 172.21.15.132:0/3302809239 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2640df1c0 0x7fb26404e1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.849+0000 7fb26ad9d640 1 -- 172.21.15.132:0/3302809239 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb264054690 msgr2=0x7fb2641743b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.849+0000 7fb26ad9d640 1 --2- 172.21.15.132:0/3302809239 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb264054690 0x7fb2641743b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.849+0000 7fb26ad9d640 1 -- 172.21.15.132:0/3302809239 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2640dcc40 con 0x7fb2640dfae0 2024-04-16T15:52:20.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.849+0000 7fb26ad9d640 1 --2- 172.21.15.132:0/3302809239 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2640dfae0 0x7fb264005a40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb26c06b060 tx=0x7fb26c069580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.849+0000 7f3cbfdba640 1 -- 172.21.15.132:0/2603351378 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ca0005290 con 0x7f3cb815a850 2024-04-16T15:52:20.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.850+0000 7fb9d8984640 1 -- 172.21.15.132:0/671815809 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9d415ec10 msgr2=0x7fb9d415d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.850+0000 7fb9d8984640 1 --2- 172.21.15.132:0/671815809 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9d415ec10 0x7fb9d415d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.850+0000 7fb9d8984640 1 -- 172.21.15.132:0/671815809 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9d40d2c40 msgr2=0x7fb9d40c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.850+0000 7fb9d8984640 1 --2- 172.21.15.132:0/671815809 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9d40d2c40 0x7fb9d40c7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.850+0000 7fb9d8984640 1 -- 172.21.15.132:0/671815809 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9d41e80d0 con 0x7fb9d406db50 2024-04-16T15:52:20.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.850+0000 7f81faffd640 1 -- 172.21.15.132:0/1314685611 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81fc0064c0 con 0x7f8204142d30 2024-04-16T15:52:20.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.850+0000 7fa0773bd640 1 -- 172.21.15.132:0/1382046762 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa050005290 con 0x7fa07009aa30 2024-04-16T15:52:20.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.850+0000 7f2f88463640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f80157b10 0x7f2f80164ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.850+0000 7f81faffd640 1 -- 172.21.15.132:0/1314685611 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81fc006870 con 0x7f8204142d30 2024-04-16T15:52:20.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.850+0000 7f3cae7fc640 1 -- 172.21.15.132:0/2603351378 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3cb001a070 con 0x7f3cb815a850 2024-04-16T15:52:20.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.850+0000 7f2f88463640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f80165b50 0x7f2f801fa240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.850+0000 7fa065ffb640 1 --2- 172.21.15.132:0/1382046762 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fa05406c9c0 0x7fa05406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.850+0000 7f2f88463640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f80157ef0 0x7f2f800b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.850+0000 7f2f859fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f80165b50 0x7f2f801fa240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.850+0000 7f2f859fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f80165b50 0x7f2f801fa240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.132:58240/0 (socket says 172.21.15.132:58240) 2024-04-16T15:52:20.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.850+0000 7f2f859fe640 1 -- 172.21.15.132:0/70985013 learned_addr learned my addr 172.21.15.132:0/70985013 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:20.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.850+0000 7f2f86a00640 1 --2- 172.21.15.132:0/70985013 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f80157ef0 0x7f2f800b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.850+0000 7f2f88463640 1 -- 172.21.15.132:0/70985013 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f2f80163a90 con 0x7f2f80157b10 2024-04-16T15:52:20.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.850+0000 7fa065ffb640 1 -- 172.21.15.132:0/1382046762 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa06008ba20 con 0x7fa07009aa30 2024-04-16T15:52:20.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.850+0000 7fb25affd640 1 -- 172.21.15.132:0/3302809239 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb26c0751d0 con 0x7fb2640dfae0 2024-04-16T15:52:20.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.850+0000 7fb270f0d640 1 -- 172.21.15.132:0/3302809239 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2640dcf20 con 0x7fb2640dfae0 2024-04-16T15:52:20.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.850+0000 7fb270f0d640 1 -- 172.21.15.132:0/3302809239 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2640dd4e0 con 0x7fb2640dfae0 2024-04-16T15:52:20.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.850+0000 7f2f88463640 1 -- 172.21.15.132:0/70985013 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2f801637b0 con 0x7f2f80157ef0 2024-04-16T15:52:20.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.851+0000 7f2f88463640 1 -- 172.21.15.132:0/70985013 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f2f80070630 con 0x7f2f80165b50 2024-04-16T15:52:20.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.850+0000 7f9712d9d640 1 -- 172.21.15.132:0/3548162096 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f970c0501a0 msgr2=0x7f970c0485f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.850+0000 7f9712d9d640 1 --2- 172.21.15.132:0/3548162096 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f970c0501a0 0x7f970c0485f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.850+0000 7f9712d9d640 1 -- 172.21.15.132:0/3548162096 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f970c053c70 msgr2=0x7f970c0cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.850+0000 7f9712d9d640 1 --2- 172.21.15.132:0/3548162096 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f970c053c70 0x7f970c0cb7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.850+0000 7f9712d9d640 1 -- 172.21.15.132:0/3548162096 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f970c0df9e0 con 0x7f970c0df220 2024-04-16T15:52:20.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.851+0000 7fa074958640 1 --2- 172.21.15.132:0/1382046762 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fa05406c9c0 0x7fa05406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.850+0000 7f3cae7fc640 1 --2- 172.21.15.132:0/2603351378 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f3c9c06c8f0 0x7f3c9c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.851+0000 7f3cae7fc640 1 -- 172.21.15.132:0/2603351378 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3cb008af30 con 0x7f3cb815a850 2024-04-16T15:52:20.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.851+0000 7f81f8ff9640 1 -- 172.21.15.132:0/1314685611 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81e0005290 con 0x7f8204142d30 2024-04-16T15:52:20.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.851+0000 7f3cbdb56640 1 --2- 172.21.15.132:0/2603351378 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f3c9c06c8f0 0x7f3c9c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.851+0000 7f6aa27fc640 1 -- 172.21.15.132:0/2859677222 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6a9c048070 con 0x7f6aa40501a0 2024-04-16T15:52:20.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.851+0000 7fa074958640 1 --2- 172.21.15.132:0/1382046762 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fa05406c9c0 0x7fa05406ee80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa06c036000 tx=0x7fa06c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.851+0000 7fb25affd640 1 -- 172.21.15.132:0/3302809239 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb26c075370 con 0x7fb2640dfae0 2024-04-16T15:52:20.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.851+0000 7fb25affd640 1 -- 172.21.15.132:0/3302809239 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb26c075780 con 0x7fb2640dfae0 2024-04-16T15:52:20.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.851+0000 7f3cbdb56640 1 --2- 172.21.15.132:0/2603351378 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f3c9c06c8f0 0x7f3c9c06edb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3cb4006fd0 tx=0x7f3cb4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.851+0000 7f2f861ff640 1 --2- 172.21.15.132:0/70985013 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f80157b10 0x7f2f80164ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.851+0000 7f6aa27fc640 1 --2- 172.21.15.132:0/2859677222 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f6a9006caf0 0x7f6a9006efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.851+0000 7f9712d9d640 1 --2- 172.21.15.132:0/3548162096 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f970c0df220 0x7f970c0477b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9714051000 tx=0x7f9714069580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.851+0000 7fb9d8984640 1 --2- 172.21.15.132:0/671815809 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9d406db50 0x7fb9d41e7a40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb9c800e840 tx=0x7fb9c800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.852+0000 7f6aa27fc640 1 -- 172.21.15.132:0/2859677222 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6a9c0ad500 con 0x7f6aa40501a0 2024-04-16T15:52:20.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.852+0000 7f6ab108d640 1 --2- 172.21.15.132:0/2859677222 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f6a9006caf0 0x7f6a9006efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.852+0000 7f2f861ff640 1 -- 172.21.15.132:0/70985013 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f80165b50 msgr2=0x7f2f801fa240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.852+0000 7f2f861ff640 1 --2- 172.21.15.132:0/70985013 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f80165b50 0x7f2f801fa240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.852+0000 7f2f861ff640 1 -- 172.21.15.132:0/70985013 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f80157ef0 msgr2=0x7f2f800b61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:20.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.852+0000 7f2f861ff640 1 --2- 172.21.15.132:0/70985013 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f80157ef0 0x7f2f800b61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:20.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.852+0000 7f2f861ff640 1 -- 172.21.15.132:0/70985013 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f801fa780 con 0x7f2f80157b10 2024-04-16T15:52:20.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.852+0000 7f2f861ff640 1 --2- 172.21.15.132:0/70985013 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f80157b10 0x7f2f80164ea0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2f70011540 tx=0x7f2f70011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.852+0000 7f81faffd640 1 -- 172.21.15.132:0/1314685611 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f81fc01b070 con 0x7f8204142d30 2024-04-16T15:52:20.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.852+0000 7f6ab108d640 1 --2- 172.21.15.132:0/2859677222 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f6a9006caf0 0x7f6a9006efb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6aa41894e0 tx=0x7f6aa8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.852+0000 7fb270f0d640 1 -- 172.21.15.132:0/3302809239 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb250005290 con 0x7fb2640dfae0 2024-04-16T15:52:20.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.853+0000 7f81faffd640 1 --2- 172.21.15.132:0/1314685611 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f81e806c9c0 0x7f81e806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.853+0000 7f820a551640 1 --2- 172.21.15.132:0/1314685611 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f81e806c9c0 0x7f81e806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.853+0000 7f81faffd640 1 -- 172.21.15.132:0/1314685611 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f81fc08b010 con 0x7f8204142d30 2024-04-16T15:52:20.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.853+0000 7f820a551640 1 --2- 172.21.15.132:0/1314685611 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f81e806c9c0 0x7f81e806ee80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8200039000 tx=0x7f8200034000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.855+0000 7f9702ffd640 1 -- 172.21.15.132:0/3548162096 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9714099070 con 0x7f970c0df220 2024-04-16T15:52:20.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.855+0000 7f9702ffd640 1 -- 172.21.15.132:0/3548162096 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97140755c0 con 0x7f970c0df220 2024-04-16T15:52:20.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.855+0000 7f971359e640 1 -- 172.21.15.132:0/3548162096 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f970c04b140 con 0x7f970c0df220 2024-04-16T15:52:20.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.855+0000 7f9702ffd640 1 -- 172.21.15.132:0/3548162096 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9714068e50 con 0x7f970c0df220 2024-04-16T15:52:20.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.856+0000 7f971359e640 1 -- 172.21.15.132:0/3548162096 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f970c0dff30 con 0x7f970c0df220 2024-04-16T15:52:20.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.856+0000 7fa065ffb640 1 -- 172.21.15.132:0/1382046762 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa060059e30 con 0x7fa07009aa30 2024-04-16T15:52:20.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.856+0000 7f3cae7fc640 1 -- 172.21.15.132:0/2603351378 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3cb80cb8a0 con 0x7f3cb815a850 2024-04-16T15:52:20.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.857+0000 7f971359e640 1 -- 172.21.15.132:0/3548162096 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f970c04b4e0 con 0x7f970c0df220 2024-04-16T15:52:20.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.857+0000 7f9702ffd640 1 -- 172.21.15.132:0/3548162096 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f971409d3f0 con 0x7f970c0df220 2024-04-16T15:52:20.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.857+0000 7f9702ffd640 1 --2- 172.21.15.132:0/3548162096 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f96f406c8f0 0x7f96f406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.858+0000 7f9702ffd640 1 -- 172.21.15.132:0/3548162096 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9714106980 con 0x7f970c0df220 2024-04-16T15:52:20.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.858+0000 7f971259c640 1 --2- 172.21.15.132:0/3548162096 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f96f406c8f0 0x7f96f406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.858+0000 7f6aa27fc640 1 -- 172.21.15.132:0/2859677222 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6a9c07b240 con 0x7f6aa40501a0 2024-04-16T15:52:20.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.858+0000 7f971259c640 1 --2- 172.21.15.132:0/3548162096 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f96f406c8f0 0x7f96f406edb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9704005070 tx=0x7f9704007ef0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.858+0000 7f2f76ffd640 1 -- 172.21.15.132:0/70985013 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f70015930 con 0x7f2f80157b10 2024-04-16T15:52:20.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.859+0000 7f2f88463640 1 -- 172.21.15.132:0/70985013 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f80166010 con 0x7f2f80157b10 2024-04-16T15:52:20.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.859+0000 7f2f88463640 1 -- 172.21.15.132:0/70985013 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f801646a0 con 0x7f2f80157b10 2024-04-16T15:52:20.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.859+0000 7fb25affd640 1 -- 172.21.15.132:0/3302809239 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb26c09c3f0 con 0x7fb2640dfae0 2024-04-16T15:52:20.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.860+0000 7f2f88463640 1 -- 172.21.15.132:0/70985013 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f80075510 con 0x7f2f80157b10 2024-04-16T15:52:20.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.860+0000 7fb25affd640 1 --2- 172.21.15.132:0/3302809239 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fb24c06c8f0 0x7fb24c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.860+0000 7fb26a59c640 1 --2- 172.21.15.132:0/3302809239 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fb24c06c8f0 0x7fb24c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.860+0000 7fb26a59c640 1 --2- 172.21.15.132:0/3302809239 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fb24c06c8f0 0x7fb24c06edb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb2600094a0 tx=0x7fb260009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.862+0000 7f9702ffd640 1 -- 172.21.15.132:0/3548162096 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9714091070 con 0x7f970c0df220 2024-04-16T15:52:20.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.864+0000 7f81faffd640 1 -- 172.21.15.132:0/1314685611 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f81fc058dd0 con 0x7f8204142d30 2024-04-16T15:52:20.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.864+0000 7fb9d17fa640 1 -- 172.21.15.132:0/671815809 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c8017070 con 0x7fb9d406db50 2024-04-16T15:52:20.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.864+0000 7f2f76ffd640 1 -- 172.21.15.132:0/70985013 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f70015ad0 con 0x7f2f80157b10 2024-04-16T15:52:20.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.865+0000 7f2f76ffd640 1 -- 172.21.15.132:0/70985013 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f70005990 con 0x7f2f80157b10 2024-04-16T15:52:20.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.864+0000 7fb9dabe8640 1 -- 172.21.15.132:0/671815809 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9d40cd1b0 con 0x7fb9d406db50 2024-04-16T15:52:20.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.864+0000 7fb9dabe8640 1 -- 172.21.15.132:0/671815809 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9d40cd770 con 0x7fb9d406db50 2024-04-16T15:52:20.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.866+0000 7fb9d17fa640 1 -- 172.21.15.132:0/671815809 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9c800c8d0 con 0x7fb9d406db50 2024-04-16T15:52:20.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.866+0000 7fb9dabe8640 1 -- 172.21.15.132:0/671815809 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9d40a2570 con 0x7fb9d406db50 2024-04-16T15:52:20.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.866+0000 7fb25affd640 1 -- 172.21.15.132:0/3302809239 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb26c0d30c0 con 0x7fb2640dfae0 2024-04-16T15:52:20.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.866+0000 7fb9d17fa640 1 -- 172.21.15.132:0/671815809 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c800f040 con 0x7fb9d406db50 2024-04-16T15:52:20.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.870+0000 7fb25affd640 1 -- 172.21.15.132:0/3302809239 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb26c0a1020 con 0x7fb2640dfae0 2024-04-16T15:52:20.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.872+0000 7f2f76ffd640 1 -- 172.21.15.132:0/70985013 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2f7000f460 con 0x7f2f80157b10 2024-04-16T15:52:20.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.873+0000 7fb9d17fa640 1 -- 172.21.15.132:0/671815809 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb9c801a070 con 0x7fb9d406db50 2024-04-16T15:52:20.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.873+0000 7f2f76ffd640 1 --2- 172.21.15.132:0/70985013 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f2f6406c8f0 0x7f2f6406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.873+0000 7f2f76ffd640 1 -- 172.21.15.132:0/70985013 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2f7008c640 con 0x7f2f80157b10 2024-04-16T15:52:20.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.873+0000 7fb9d17fa640 1 --2- 172.21.15.132:0/671815809 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fb9b806c8f0 0x7fb9b806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:20.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.874+0000 7fb9d3fff640 1 --2- 172.21.15.132:0/671815809 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fb9b806c8f0 0x7fb9b806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.875+0000 7fb9d3fff640 1 --2- 172.21.15.132:0/671815809 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fb9b806c8f0 0x7fb9b806edb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb9d41fbfa0 tx=0x7fb9c0007f10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.875+0000 7fb9d17fa640 1 -- 172.21.15.132:0/671815809 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb9c808bb30 con 0x7fb9d406db50 2024-04-16T15:52:20.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.875+0000 7f2f859fe640 1 --2- 172.21.15.132:0/70985013 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f2f6406c8f0 0x7f2f6406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:20.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.876+0000 7f2f859fe640 1 --2- 172.21.15.132:0/70985013 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f2f6406c8f0 0x7f2f6406edb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2f800cc550 tx=0x7f2f7802f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:20.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.878+0000 7f2f76ffd640 1 -- 172.21.15.132:0/70985013 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2f801fa780 con 0x7f2f80157b10 2024-04-16T15:52:20.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:20.887+0000 7fb9d17fa640 1 -- 172.21.15.132:0/671815809 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb9c8059980 con 0x7fb9d406db50 2024-04-16T15:52:21.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.272+0000 7f3cbfdba640 1 -- 172.21.15.132:0/2603351378 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f3ca0005850 con 0x7f3cb815a850 2024-04-16T15:52:21.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.273+0000 7f3cae7fc640 1 -- 172.21.15.132:0/2603351378 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3cb0058da0 con 0x7f3cb815a850 2024-04-16T15:52:21.273 INFO:teuthology.orchestra.run.smithi132.stdout:55834574852 2024-04-16T15:52:21.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.277+0000 7f3c9bfff640 1 -- 172.21.15.132:0/2603351378 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f3c9c06c8f0 msgr2=0x7f3c9c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:21.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.277+0000 7f3c9bfff640 1 --2- 172.21.15.132:0/2603351378 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f3c9c06c8f0 0x7f3c9c06edb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3cb4006fd0 tx=0x7f3cb4008040 comp rx=0 tx=0).stop 2024-04-16T15:52:21.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.278+0000 7f3c9bfff640 1 -- 172.21.15.132:0/2603351378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3cb815a850 msgr2=0x7f3cb81f4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:21.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.278+0000 7f3c9bfff640 1 --2- 172.21.15.132:0/2603351378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3cb815a850 0x7f3cb81f4100 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8070da0 tx=0x7f3cb000cc00 comp rx=0 tx=0).stop 2024-04-16T15:52:21.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.278+0000 7f3c9bfff640 1 -- 172.21.15.132:0/2603351378 shutdown_connections 2024-04-16T15:52:21.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.278+0000 7f3c9bfff640 1 --2- 172.21.15.132:0/2603351378 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f3c9c06c8f0 0x7f3c9c06edb0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:21.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.278+0000 7f3c9bfff640 1 --2- 172.21.15.132:0/2603351378 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3cb815ea90 0x7f3cb8158f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:21.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.278+0000 7f3c9bfff640 1 --2- 172.21.15.132:0/2603351378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3cb815a850 0x7f3cb81f4100 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:21.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.278+0000 7f3c9bfff640 1 --2- 172.21.15.132:0/2603351378 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3cb8070980 0x7f3cb815c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:21.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.278+0000 7f3c9bfff640 1 -- 172.21.15.132:0/2603351378 >> 172.21.15.132:0/2603351378 conn(0x7f3cb806ba20 msgr2=0x7f3cb8157370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:21.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.279+0000 7f3c9bfff640 1 -- 172.21.15.132:0/2603351378 shutdown_connections 2024-04-16T15:52:21.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.279+0000 7f3c9bfff640 1 -- 172.21.15.132:0/2603351378 wait complete. 2024-04-16T15:52:21.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.279+0000 7f81f8ff9640 1 -- 172.21.15.132:0/1314685611 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f81e0005580 con 0x7f8204142d30 2024-04-16T15:52:21.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.279+0000 7f81faffd640 1 -- 172.21.15.132:0/1314685611 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f81fc05d0d0 con 0x7f8204142d30 2024-04-16T15:52:21.280 INFO:teuthology.orchestra.run.smithi132.stdout:55834574853 2024-04-16T15:52:21.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.283+0000 7f820c7b5640 1 -- 172.21.15.132:0/1314685611 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f81e806c9c0 msgr2=0x7f81e806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:21.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.283+0000 7f820c7b5640 1 --2- 172.21.15.132:0/1314685611 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f81e806c9c0 0x7f81e806ee80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8200039000 tx=0x7f8200034000 comp rx=0 tx=0).stop 2024-04-16T15:52:21.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.283+0000 7f820c7b5640 1 -- 172.21.15.132:0/1314685611 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8204142d30 msgr2=0x7f82041431e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:21.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.283+0000 7f820c7b5640 1 --2- 172.21.15.132:0/1314685611 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8204142d30 0x7f82041431e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f81fc001720 tx=0x7f81fc001be0 comp rx=0 tx=0).stop 2024-04-16T15:52:21.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.284+0000 7f820c7b5640 1 -- 172.21.15.132:0/1314685611 shutdown_connections 2024-04-16T15:52:21.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.284+0000 7f820c7b5640 1 --2- 172.21.15.132:0/1314685611 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f81e806c9c0 0x7f81e806ee80 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:21.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.284+0000 7f820c7b5640 1 --2- 172.21.15.132:0/1314685611 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8204142d30 0x7f82041431e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:21.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.284+0000 7f820c7b5640 1 --2- 172.21.15.132:0/1314685611 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82040b5680 0x7f8204155e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:21.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.284+0000 7f820c7b5640 1 --2- 172.21.15.132:0/1314685611 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8204072430 0x7f8204140610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:21.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.284+0000 7f6ab2890640 1 -- 172.21.15.132:0/2859677222 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f6aa4052be0 con 0x7f6aa40501a0 2024-04-16T15:52:21.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.284+0000 7f820c7b5640 1 -- 172.21.15.132:0/1314685611 >> 172.21.15.132:0/1314685611 conn(0x7f82040b23e0 msgr2=0x7f82040b0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:21.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.284+0000 7f820c7b5640 1 -- 172.21.15.132:0/1314685611 shutdown_connections 2024-04-16T15:52:21.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.285+0000 7f820c7b5640 1 -- 172.21.15.132:0/1314685611 wait complete. 2024-04-16T15:52:21.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.285+0000 7f6aa27fc640 1 -- 172.21.15.132:0/2859677222 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6a9c07f540 con 0x7f6aa40501a0 2024-04-16T15:52:21.286 INFO:teuthology.orchestra.run.smithi132.stdout:55834574854 2024-04-16T15:52:21.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.285+0000 7fa0773bd640 1 -- 172.21.15.132:0/1382046762 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fa050005580 con 0x7fa07009aa30 2024-04-16T15:52:21.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.285+0000 7fa065ffb640 1 -- 172.21.15.132:0/1382046762 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa060059730 con 0x7fa07009aa30 2024-04-16T15:52:21.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.287+0000 7f971359e640 1 -- 172.21.15.132:0/3548162096 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f970c005390 con 0x7f970c0df220 2024-04-16T15:52:21.287 INFO:teuthology.orchestra.run.smithi132.stdout:55834574854 2024-04-16T15:52:21.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.287+0000 7f9702ffd640 1 -- 172.21.15.132:0/3548162096 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f97140d4750 con 0x7f970c0df220 2024-04-16T15:52:21.288 INFO:teuthology.orchestra.run.smithi132.stdout:55834574853 2024-04-16T15:52:21.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.288+0000 7f6ab2890640 1 -- 172.21.15.132:0/2859677222 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f6a9006caf0 msgr2=0x7f6a9006efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:21.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.288+0000 7f6ab2890640 1 --2- 172.21.15.132:0/2859677222 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f6a9006caf0 0x7f6a9006efb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6aa41894e0 tx=0x7f6aa8009040 comp rx=0 tx=0).stop 2024-04-16T15:52:21.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.288+0000 7f6ab2890640 1 -- 172.21.15.132:0/2859677222 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6aa40501a0 msgr2=0x7f6aa41857c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:21.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.288+0000 7f6ab2890640 1 --2- 172.21.15.132:0/2859677222 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6aa40501a0 0x7f6aa41857c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c0090b0 tx=0x7f6a9c0046c0 comp rx=0 tx=0).stop 2024-04-16T15:52:21.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.288+0000 7f6ab2890640 1 -- 172.21.15.132:0/2859677222 shutdown_connections 2024-04-16T15:52:21.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.288+0000 7f6ab2890640 1 --2- 172.21.15.132:0/2859677222 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f6a9006caf0 0x7f6a9006efb0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:21.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.288+0000 7f6ab2890640 1 --2- 172.21.15.132:0/2859677222 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6aa40df220 0x7f6aa4035590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:21.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.288+0000 7f6ab2890640 1 --2- 172.21.15.132:0/2859677222 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6aa4053c70 0x7f6aa4035050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:21.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.288+0000 7f6ab2890640 1 --2- 172.21.15.132:0/2859677222 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6aa40501a0 0x7f6aa41857c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:21.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.288+0000 7f6ab2890640 1 -- 172.21.15.132:0/2859677222 >> 172.21.15.132:0/2859677222 conn(0x7f6aa4009fb0 msgr2=0x7f6aa40dfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:21.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.289+0000 7f6ab2890640 1 -- 172.21.15.132:0/2859677222 shutdown_connections 2024-04-16T15:52:21.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.289+0000 7f6ab2890640 1 -- 172.21.15.132:0/2859677222 wait complete. 2024-04-16T15:52:21.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.289+0000 7fa0773bd640 1 -- 172.21.15.132:0/1382046762 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fa05406c9c0 msgr2=0x7fa05406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:21.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.289+0000 7fa0773bd640 1 --2- 172.21.15.132:0/1382046762 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fa05406c9c0 0x7fa05406ee80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa06c036000 tx=0x7fa06c008030 comp rx=0 tx=0).stop 2024-04-16T15:52:21.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.289+0000 7fa0773bd640 1 -- 172.21.15.132:0/1382046762 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa07009aa30 msgr2=0x7fa0700cbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:21.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.289+0000 7fa0773bd640 1 --2- 172.21.15.132:0/1382046762 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa07009aa30 0x7fa0700cbf40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa06000e870 tx=0x7fa06000ed30 comp rx=0 tx=0).stop 2024-04-16T15:52:21.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.289+0000 7fb270f0d640 1 -- 172.21.15.132:0/3302809239 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fb250005850 con 0x7fb2640dfae0 2024-04-16T15:52:21.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.289+0000 7fb25affd640 1 -- 172.21.15.132:0/3302809239 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb26c08f030 con 0x7fb2640dfae0 2024-04-16T15:52:21.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.289+0000 7fa0773bd640 1 -- 172.21.15.132:0/1382046762 shutdown_connections 2024-04-16T15:52:21.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.289+0000 7fa0773bd640 1 --2- 172.21.15.132:0/1382046762 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fa05406c9c0 0x7fa05406ee80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:21.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.289+0000 7fa0773bd640 1 --2- 172.21.15.132:0/1382046762 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa07015cb70 0x7fa07015dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:21.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.289+0000 7fa0773bd640 1 --2- 172.21.15.132:0/1382046762 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0700d0430 0x7fa07015d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:21.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.289+0000 7fa0773bd640 1 --2- 172.21.15.132:0/1382046762 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa07009aa30 0x7fa0700cbf40 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:21.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.289+0000 7fa0773bd640 1 -- 172.21.15.132:0/1382046762 >> 172.21.15.132:0/1382046762 conn(0x7fa0700b4190 msgr2=0x7fa0700705d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:21.291 INFO:teuthology.orchestra.run.smithi132.stdout:55834574854 2024-04-16T15:52:21.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.290+0000 7fa0773bd640 1 -- 172.21.15.132:0/1382046762 shutdown_connections 2024-04-16T15:52:21.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.290+0000 7fa0773bd640 1 -- 172.21.15.132:0/1382046762 wait complete. 2024-04-16T15:52:21.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.292+0000 7f971359e640 1 -- 172.21.15.132:0/3548162096 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f96f406c8f0 msgr2=0x7f96f406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:21.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.292+0000 7f971359e640 1 --2- 172.21.15.132:0/3548162096 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f96f406c8f0 0x7f96f406edb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9704005070 tx=0x7f9704007ef0 comp rx=0 tx=0).stop 2024-04-16T15:52:21.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.292+0000 7f971359e640 1 -- 172.21.15.132:0/3548162096 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f970c0df220 msgr2=0x7f970c0477b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:21.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.292+0000 7f971359e640 1 --2- 172.21.15.132:0/3548162096 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f970c0df220 0x7f970c0477b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9714051000 tx=0x7f9714069580 comp rx=0 tx=0).stop 2024-04-16T15:52:21.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.292+0000 7f971359e640 1 -- 172.21.15.132:0/3548162096 shutdown_connections 2024-04-16T15:52:21.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.292+0000 7f971359e640 1 --2- 172.21.15.132:0/3548162096 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f96f406c8f0 0x7f96f406edb0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:21.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.292+0000 7f971359e640 1 --2- 172.21.15.132:0/3548162096 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f970c0df220 0x7f970c0477b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:21.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.292+0000 7f971359e640 1 --2- 172.21.15.132:0/3548162096 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f970c053c70 0x7f970c0cb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:21.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.292+0000 7f971359e640 1 --2- 172.21.15.132:0/3548162096 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f970c0501a0 0x7f970c0485f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:21.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.292+0000 7f971359e640 1 -- 172.21.15.132:0/3548162096 >> 172.21.15.132:0/3548162096 conn(0x7f970c009fb0 msgr2=0x7f970c034050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:21.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.292+0000 7f971359e640 1 -- 172.21.15.132:0/3548162096 shutdown_connections 2024-04-16T15:52:21.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.292+0000 7f971359e640 1 -- 172.21.15.132:0/3548162096 wait complete. 2024-04-16T15:52:21.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.293+0000 7fb270f0d640 1 -- 172.21.15.132:0/3302809239 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fb24c06c8f0 msgr2=0x7fb24c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:21.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.293+0000 7fb270f0d640 1 --2- 172.21.15.132:0/3302809239 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fb24c06c8f0 0x7fb24c06edb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb2600094a0 tx=0x7fb260009240 comp rx=0 tx=0).stop 2024-04-16T15:52:21.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.293+0000 7fb270f0d640 1 -- 172.21.15.132:0/3302809239 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2640dfae0 msgr2=0x7fb264005a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:21.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.293+0000 7fb270f0d640 1 --2- 172.21.15.132:0/3302809239 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2640dfae0 0x7fb264005a40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb26c06b060 tx=0x7fb26c069580 comp rx=0 tx=0).stop 2024-04-16T15:52:21.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.293+0000 7fb270f0d640 1 -- 172.21.15.132:0/3302809239 shutdown_connections 2024-04-16T15:52:21.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.293+0000 7fb270f0d640 1 --2- 172.21.15.132:0/3302809239 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fb24c06c8f0 0x7fb24c06edb0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:21.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.293+0000 7fb270f0d640 1 --2- 172.21.15.132:0/3302809239 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2640dfae0 0x7fb264005a40 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:21.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.293+0000 7fb270f0d640 1 --2- 172.21.15.132:0/3302809239 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2640df1c0 0x7fb26404e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:21.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.293+0000 7fb270f0d640 1 --2- 172.21.15.132:0/3302809239 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb264054690 0x7fb2641743b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:21.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.293+0000 7fb270f0d640 1 -- 172.21.15.132:0/3302809239 >> 172.21.15.132:0/3302809239 conn(0x7fb264009fe0 msgr2=0x7fb2640dac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:21.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.294+0000 7fb270f0d640 1 -- 172.21.15.132:0/3302809239 shutdown_connections 2024-04-16T15:52:21.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.294+0000 7fb270f0d640 1 -- 172.21.15.132:0/3302809239 wait complete. 2024-04-16T15:52:21.298 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.2 2024-04-16T15:52:21.299 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.300+0000 7f2f88463640 1 -- 172.21.15.132:0/70985013 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f2f80073c70 con 0x7f2f80157b10 2024-04-16T15:52:21.300 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.301+0000 7f2f76ffd640 1 -- 172.21.15.132:0/70985013 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2f70019030 con 0x7f2f80157b10 2024-04-16T15:52:21.303 INFO:teuthology.orchestra.run.smithi132.stdout:55834574854 2024-04-16T15:52:21.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.304+0000 7fb9dabe8640 1 -- 172.21.15.132:0/671815809 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fb9d404fe70 con 0x7fb9d406db50 2024-04-16T15:52:21.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.305+0000 7fb9d17fa640 1 -- 172.21.15.132:0/671815809 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb9c805dc80 con 0x7fb9d406db50 2024-04-16T15:52:21.304 INFO:teuthology.orchestra.run.smithi132.stdout:55834574853 2024-04-16T15:52:21.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.307+0000 7f2f88463640 1 -- 172.21.15.132:0/70985013 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f2f6406c8f0 msgr2=0x7f2f6406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:21.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.307+0000 7f2f88463640 1 --2- 172.21.15.132:0/70985013 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f2f6406c8f0 0x7f2f6406edb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2f800cc550 tx=0x7f2f7802f000 comp rx=0 tx=0).stop 2024-04-16T15:52:21.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.307+0000 7f2f88463640 1 -- 172.21.15.132:0/70985013 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f80157b10 msgr2=0x7f2f80164ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:21.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.307+0000 7f2f88463640 1 --2- 172.21.15.132:0/70985013 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f80157b10 0x7f2f80164ea0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2f70011540 tx=0x7f2f70011a00 comp rx=0 tx=0).stop 2024-04-16T15:52:21.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.307+0000 7f2f88463640 1 -- 172.21.15.132:0/70985013 shutdown_connections 2024-04-16T15:52:21.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.307+0000 7f2f88463640 1 --2- 172.21.15.132:0/70985013 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f2f6406c8f0 0x7f2f6406edb0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:21.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.307+0000 7f2f88463640 1 --2- 172.21.15.132:0/70985013 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f80157ef0 0x7f2f800b61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:21.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.307+0000 7f2f88463640 1 --2- 172.21.15.132:0/70985013 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f80165b50 0x7f2f801fa240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:21.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.307+0000 7f2f88463640 1 --2- 172.21.15.132:0/70985013 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f80157b10 0x7f2f80164ea0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:21.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.307+0000 7f2f88463640 1 -- 172.21.15.132:0/70985013 >> 172.21.15.132:0/70985013 conn(0x7f2f8009aa30 msgr2=0x7f2f800d1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:21.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.307+0000 7f2f88463640 1 -- 172.21.15.132:0/70985013 shutdown_connections 2024-04-16T15:52:21.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.307+0000 7f2f88463640 1 -- 172.21.15.132:0/70985013 wait complete. 2024-04-16T15:52:21.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.308+0000 7fb9dabe8640 1 -- 172.21.15.132:0/671815809 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fb9b806c8f0 msgr2=0x7fb9b806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:21.314 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2024-04-16T15:52:21.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.308+0000 7fb9dabe8640 1 --2- 172.21.15.132:0/671815809 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fb9b806c8f0 0x7fb9b806edb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb9d41fbfa0 tx=0x7fb9c0007f10 comp rx=0 tx=0).stop 2024-04-16T15:52:21.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.308+0000 7fb9dabe8640 1 -- 172.21.15.132:0/671815809 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9d406db50 msgr2=0x7fb9d41e7a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:21.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.308+0000 7fb9dabe8640 1 --2- 172.21.15.132:0/671815809 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9d406db50 0x7fb9d41e7a40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb9c800e840 tx=0x7fb9c800ed00 comp rx=0 tx=0).stop 2024-04-16T15:52:21.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.309+0000 7fb9dabe8640 1 -- 172.21.15.132:0/671815809 shutdown_connections 2024-04-16T15:52:21.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.309+0000 7fb9dabe8640 1 --2- 172.21.15.132:0/671815809 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fb9b806c8f0 0x7fb9b806edb0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:21.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.309+0000 7fb9dabe8640 1 --2- 172.21.15.132:0/671815809 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9d415ec10 0x7fb9d415d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:21.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.309+0000 7fb9dabe8640 1 --2- 172.21.15.132:0/671815809 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9d40d2c40 0x7fb9d40c7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:21.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.309+0000 7fb9dabe8640 1 --2- 172.21.15.132:0/671815809 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9d406db50 0x7fb9d41e7a40 secure :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb9c800e840 tx=0x7fb9c800ed00 comp rx=0 tx=0).stop 2024-04-16T15:52:21.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.309+0000 7fb9dabe8640 1 -- 172.21.15.132:0/671815809 >> 172.21.15.132:0/671815809 conn(0x7fb9d408bfc0 msgr2=0x7fb9d40d02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:21.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.309+0000 7fb9dabe8640 1 -- 172.21.15.132:0/671815809 shutdown_connections 2024-04-16T15:52:21.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:21.309+0000 7fb9dabe8640 1 -- 172.21.15.132:0/671815809 wait complete. 2024-04-16T15:52:21.316 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2024-04-16T15:52:21.316 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.7 2024-04-16T15:52:21.317 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2024-04-16T15:52:21.318 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.5 2024-04-16T15:52:21.321 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.0 2024-04-16T15:52:21.323 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2024-04-16T15:52:22.300 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-16T15:52:22.315 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-16T15:52:22.317 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-16T15:52:22.317 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-16T15:52:22.318 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-16T15:52:22.319 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-16T15:52:22.322 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-16T15:52:22.324 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-16T15:52:22.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.469+0000 7f1ed761b640 1 Processor -- start 2024-04-16T15:52:22.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.470+0000 7f1ed761b640 1 -- start start 2024-04-16T15:52:22.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.471+0000 7f1ed761b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ed006bce0 0x7f1ed00b52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:22.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.471+0000 7f1ed761b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1ed006df20 0x7f1ed006f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:22.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.471+0000 7f1ed761b640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ed006e3b0 con 0x7f1ed006c0c0 2024-04-16T15:52:22.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.471+0000 7f1ed761b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f1ed006e690 con 0x7f1ed006df20 2024-04-16T15:52:22.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.471+0000 7f1ed761b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1ed006e970 con 0x7f1ed006bce0 2024-04-16T15:52:22.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.471+0000 7f1ed5bb8640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f1ed006c0c0 0x7f1ed0071ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47252/0 (socket says 172.21.15.132:47252) 2024-04-16T15:52:22.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.471+0000 7f1ed5bb8640 1 -- 172.21.15.132:0/3120486536 learned_addr learned my addr 172.21.15.132:0/3120486536 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:22.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.472+0000 7f1ed4bb6640 1 --2- 172.21.15.132:0/3120486536 >> v2:172.21.15.132:3300/0 conn(0x7f1ed006df20 0x7f1ed006f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:22.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.472+0000 7f1ed4bb6640 1 -- 172.21.15.132:0/3120486536 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ed006bce0 msgr2=0x7f1ed00b52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:22.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.472+0000 7f1ed53b7640 1 --2- 172.21.15.132:0/3120486536 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ed006bce0 0x7f1ed00b52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:22.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.472+0000 7f1ed4bb6640 1 --2- 172.21.15.132:0/3120486536 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ed006bce0 0x7f1ed00b52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.472+0000 7f1ed4bb6640 1 -- 172.21.15.132:0/3120486536 >> v1:172.21.15.132:6789/0 conn(0x7f1ed006c0c0 legacy=0x7f1ed0071ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:22.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.472+0000 7f1ed4bb6640 1 -- 172.21.15.132:0/3120486536 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ed006ec50 con 0x7f1ed006df20 2024-04-16T15:52:22.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.473+0000 7f1ed53b7640 1 --2- 172.21.15.132:0/3120486536 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ed006bce0 0x7f1ed00b52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:52:22.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.474+0000 7f1ed4bb6640 1 --2- 172.21.15.132:0/3120486536 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ed006df20 0x7f1ed006f450 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1ec0008820 tx=0x7f1ec002bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3e5566ffb89a5ce server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:22.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.474+0000 7f1ec7fff640 1 -- 172.21.15.132:0/3120486536 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec002cb40 con 0x7f1ed006df20 2024-04-16T15:52:22.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.474+0000 7f1ec7fff640 1 -- 172.21.15.132:0/3120486536 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ec000ae50 con 0x7f1ed006df20 2024-04-16T15:52:22.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.474+0000 7f1ec7fff640 1 -- 172.21.15.132:0/3120486536 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec00343f0 con 0x7f1ed006df20 2024-04-16T15:52:22.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.475+0000 7f1ed761b640 1 -- 172.21.15.132:0/3120486536 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ed006df20 msgr2=0x7f1ed006f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:22.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.475+0000 7f1ed761b640 1 --2- 172.21.15.132:0/3120486536 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ed006df20 0x7f1ed006f450 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1ec0008820 tx=0x7f1ec002bd90 comp rx=0 tx=0).stop 2024-04-16T15:52:22.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.476+0000 7f1ed761b640 1 -- 172.21.15.132:0/3120486536 shutdown_connections 2024-04-16T15:52:22.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.476+0000 7f1ed761b640 1 --2- 172.21.15.132:0/3120486536 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ed006df20 0x7f1ed006f450 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.476+0000 7f1ed761b640 1 --2- 172.21.15.132:0/3120486536 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ed006bce0 0x7f1ed00b52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.476+0000 7f1ed761b640 1 -- 172.21.15.132:0/3120486536 >> 172.21.15.132:0/3120486536 conn(0x7f1ed00b23e0 msgr2=0x7f1ed00b27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:22.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.477+0000 7f1ed761b640 1 -- 172.21.15.132:0/3120486536 shutdown_connections 2024-04-16T15:52:22.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.477+0000 7f1ed761b640 1 -- 172.21.15.132:0/3120486536 wait complete. 2024-04-16T15:52:22.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.478+0000 7f1ed761b640 1 Processor -- start 2024-04-16T15:52:22.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.479+0000 7f1ed761b640 1 -- start start 2024-04-16T15:52:22.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.480+0000 7f1ed761b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ed006bce0 0x7f1ed0153df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:22.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.480+0000 7f1ed761b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ed006c0c0 0x7f1ed0154330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:22.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.480+0000 7f1ed761b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ed0151dd0 0x7f1ed0167570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:22.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.480+0000 7f1ed761b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed006c550 con 0x7f1ed0151dd0 2024-04-16T15:52:22.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.480+0000 7f1ed761b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed008ba20 con 0x7f1ed006bce0 2024-04-16T15:52:22.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.480+0000 7f1ed761b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1ed016b8d0 con 0x7f1ed006c0c0 2024-04-16T15:52:22.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.480+0000 7f1ed53b7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ed006bce0 0x7f1ed0153df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:22.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.480+0000 7f1ed53b7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ed006bce0 0x7f1ed0153df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.132:40756/0 (socket says 172.21.15.132:40756) 2024-04-16T15:52:22.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.480+0000 7f1ed53b7640 1 -- 172.21.15.132:0/322779455 learned_addr learned my addr 172.21.15.132:0/322779455 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:22.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.480+0000 7f1ed5bb8640 1 --2- 172.21.15.132:0/322779455 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ed0151dd0 0x7f1ed0167570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:22.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.480+0000 7f1ed4bb6640 1 --2- 172.21.15.132:0/322779455 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ed006c0c0 0x7f1ed0154330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:22.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.481+0000 7f1ed53b7640 1 -- 172.21.15.132:0/322779455 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ed006c0c0 msgr2=0x7f1ed0154330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:22.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.481+0000 7f1ed53b7640 1 --2- 172.21.15.132:0/322779455 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ed006c0c0 0x7f1ed0154330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.481+0000 7f1ed53b7640 1 -- 172.21.15.132:0/322779455 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ed0151dd0 msgr2=0x7f1ed0167570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:22.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.481+0000 7f1ed53b7640 1 --2- 172.21.15.132:0/322779455 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ed0151dd0 0x7f1ed0167570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.481+0000 7f1ed53b7640 1 -- 172.21.15.132:0/322779455 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ed016e6a0 con 0x7f1ed006bce0 2024-04-16T15:52:22.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.481+0000 7f1ed53b7640 1 --2- 172.21.15.132:0/322779455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ed006bce0 0x7f1ed0153df0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc010f60 tx=0x7f1ecc010f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:22.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.482+0000 7f1ec5ffb640 1 -- 172.21.15.132:0/322779455 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc005ba0 con 0x7f1ed006bce0 2024-04-16T15:52:22.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.482+0000 7f1ed761b640 1 -- 172.21.15.132:0/322779455 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ed01667b0 con 0x7f1ed006bce0 2024-04-16T15:52:22.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.483+0000 7f1ed761b640 1 -- 172.21.15.132:0/322779455 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ed0166d70 con 0x7f1ed006bce0 2024-04-16T15:52:22.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.483+0000 7f1ec5ffb640 1 -- 172.21.15.132:0/322779455 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ecc026020 con 0x7f1ed006bce0 2024-04-16T15:52:22.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.483+0000 7f1ec5ffb640 1 -- 172.21.15.132:0/322779455 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc00a260 con 0x7f1ed006bce0 2024-04-16T15:52:22.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.485+0000 7f1ec5ffb640 1 -- 172.21.15.132:0/322779455 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1ecc00a400 con 0x7f1ed006bce0 2024-04-16T15:52:22.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.485+0000 7f1ec5ffb640 1 --2- 172.21.15.132:0/322779455 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f1ebc06cb00 0x7f1ebc06efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:22.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.486+0000 7f1ec5ffb640 1 -- 172.21.15.132:0/322779455 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1ecc09d250 con 0x7f1ed006bce0 2024-04-16T15:52:22.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.486+0000 7f1ed4bb6640 1 --2- 172.21.15.132:0/322779455 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f1ebc06cb00 0x7f1ebc06efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:22.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.488+0000 7f1ed4bb6640 1 --2- 172.21.15.132:0/322779455 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f1ebc06cb00 0x7f1ebc06efc0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1ec0035000 tx=0x7f1ec0030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:22.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.488+0000 7f1ed761b640 1 -- 172.21.15.132:0/322779455 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1eb0005290 con 0x7f1ed006bce0 2024-04-16T15:52:22.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.494+0000 7f1ec5ffb640 1 -- 172.21.15.132:0/322779455 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1ecc030020 con 0x7f1ed006bce0 2024-04-16T15:52:22.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.522+0000 7f01b2cc2640 1 Processor -- start 2024-04-16T15:52:22.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.522+0000 7f01b2cc2640 1 -- start start 2024-04-16T15:52:22.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.524+0000 7f7a9c767640 1 Processor -- start 2024-04-16T15:52:22.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.524+0000 7f7a9c767640 1 -- start start 2024-04-16T15:52:22.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.524+0000 7f01b2cc2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01ac071dc0 0x7f01ac09aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:22.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.524+0000 7f01b1cc0640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f01ac15fdf0 0x7f01ac160650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.132:55480/0 (socket says 172.21.15.132:55480) 2024-04-16T15:52:22.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.524+0000 7f01b14bf640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f01ac1601d0 0x7f01ac160d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47268/0 (socket says 172.21.15.132:47268) 2024-04-16T15:52:22.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.524+0000 7f01b1cc0640 1 -- 172.21.15.132:0/1738467168 learned_addr learned my addr 172.21.15.132:0/1738467168 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:22.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.524+0000 7f01b24c1640 1 --2- 172.21.15.132:0/1738467168 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01ac071dc0 0x7f01ac09aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:22.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.525+0000 7f01b2cc2640 1 -- 172.21.15.132:0/1738467168 --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01ac0d0260 con 0x7f01ac1601d0 2024-04-16T15:52:22.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.525+0000 7f7a9c767640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a94070780 0x7f7a94070be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:22.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.525+0000 7f7a9c767640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7a9406f370 0x7f7a9406f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:22.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.525+0000 7f7a9c767640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a9415ef60 con 0x7f7a9415eb80 2024-04-16T15:52:22.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.525+0000 7f7a9c767640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f7a94071120 con 0x7f7a9406f370 2024-04-16T15:52:22.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.525+0000 7f7a9c767640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f7a9406c910 con 0x7f7a94070780 2024-04-16T15:52:22.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.525+0000 7f01b0cbe640 1 -- 172.21.15.132:0/1738467168 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3697933147 0 0) 0x7f01ac0d0260 con 0x7f01ac1601d0 2024-04-16T15:52:22.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.525+0000 7f01b2cc2640 1 -- 172.21.15.132:0/1738467168 --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01ac0d0540 con 0x7f01ac15fdf0 2024-04-16T15:52:22.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.525+0000 7f7a9ad04640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7a9406f370 0x7f7a9406f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:22.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.525+0000 7f7a99d02640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a94070780 0x7f7a94070be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:22.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.525+0000 7f7a99d02640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a94070780 0x7f7a94070be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.132:48010/0 (socket says 172.21.15.132:48010) 2024-04-16T15:52:22.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.525+0000 7f01b2cc2640 1 -- 172.21.15.132:0/1738467168 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f01ac161560 con 0x7f01ac071dc0 2024-04-16T15:52:22.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.525+0000 7f7a9ad04640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7a9406f370 0x7f7a9406f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.132:40762/0 (socket says 172.21.15.132:40762) 2024-04-16T15:52:22.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.525+0000 7f7a99d02640 1 -- 172.21.15.132:0/223555626 learned_addr learned my addr 172.21.15.132:0/223555626 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:22.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.526+0000 7f01b0cbe640 1 -- 172.21.15.132:0/1738467168 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0198003520 con 0x7f01ac1601d0 2024-04-16T15:52:22.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.526+0000 7f7a9ad04640 1 -- 172.21.15.132:0/223555626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a94070780 msgr2=0x7f7a94070be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:22.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.526+0000 7f7a9ad04640 1 --2- 172.21.15.132:0/223555626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a94070780 0x7f7a94070be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.526+0000 7f7a9ad04640 1 -- 172.21.15.132:0/223555626 >> v1:172.21.15.132:6789/0 conn(0x7f7a9415eb80 legacy=0x7f7a940b06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:22.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.526+0000 7f6a7ca38640 1 Processor -- start 2024-04-16T15:52:22.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.526+0000 7efcd7238640 1 Processor -- start 2024-04-16T15:52:22.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.526+0000 7efcd7238640 1 -- start start 2024-04-16T15:52:22.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.526+0000 7f01b0cbe640 1 -- 172.21.15.132:0/1738467168 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 454804916 0 0) 0x7f01ac0d0540 con 0x7f01ac15fdf0 2024-04-16T15:52:22.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.526+0000 7f01b24c1640 1 -- 172.21.15.132:0/1738467168 >> v1:172.21.15.179:6789/0 conn(0x7f01ac15fdf0 legacy=0x7f01ac160650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:22.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.526+0000 7f01b24c1640 1 -- 172.21.15.132:0/1738467168 >> v1:172.21.15.132:6789/0 conn(0x7f01ac1601d0 legacy=0x7f01ac160d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:22.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.526+0000 7f01b24c1640 1 -- 172.21.15.132:0/1738467168 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01ac0d0820 con 0x7f01ac071dc0 2024-04-16T15:52:22.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.526+0000 7f7a9ad04640 1 -- 172.21.15.132:0/223555626 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a940ae480 con 0x7f7a9406f370 2024-04-16T15:52:22.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.527+0000 7f7a9ad04640 1 --2- 172.21.15.132:0/223555626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a9406f370 0x7f7a9406f800 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c009d90 tx=0x7f7a8c02bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9f3402fba2be9ce server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:22.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.527+0000 7f3a52359640 1 Processor -- start 2024-04-16T15:52:22.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.527+0000 7f6a7ca38640 1 -- start start 2024-04-16T15:52:22.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.527+0000 7f3a52359640 1 -- start start 2024-04-16T15:52:22.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.527+0000 7efcd7238640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7efcc8036f90 0x7efcc8051980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:22.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.528+0000 7f6a7ca38640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6a7004b3c0 0x7f6a70034020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:22.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.528+0000 7f6a7ca38640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6a70006a50 0x7f6a70006e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:22.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.528+0000 7f6a7ca38640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a70054c10 con 0x7f6a7004f4d0 2024-04-16T15:52:22.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.528+0000 7f6a7ca38640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f6a700062e0 con 0x7f6a7004b3c0 2024-04-16T15:52:22.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.528+0000 7f6a7ca38640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f6a70053a50 con 0x7f6a70006a50 2024-04-16T15:52:22.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.528+0000 7f01b24c1640 1 --2- 172.21.15.132:0/1738467168 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01ac071dc0 0x7f01ac09aa30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f01a4009dc0 tx=0x7f01a402bbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=216bf9cbea0bc88 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:22.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.528+0000 7f6a77fff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6a70006a50 0x7f6a70006e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:22.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.528+0000 7f6a77fff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6a70006a50 0x7f6a70006e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.132:40768/0 (socket says 172.21.15.132:40768) 2024-04-16T15:52:22.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.528+0000 7f6a77fff640 1 -- 172.21.15.132:0/403922602 learned_addr learned my addr 172.21.15.132:0/403922602 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:22.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.528+0000 7f6a777fe640 1 --2- 172.21.15.132:0/403922602 >> v2:172.21.15.132:3300/0 conn(0x7f6a7004b3c0 0x7f6a70034020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:22.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.529+0000 7f6a77fff640 1 -- 172.21.15.132:0/403922602 >> v2:172.21.15.132:3300/0 conn(0x7f6a7004b3c0 msgr2=0x7f6a70034020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:22.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.529+0000 7f6a77fff640 1 --2- 172.21.15.132:0/403922602 >> v2:172.21.15.132:3300/0 conn(0x7f6a7004b3c0 0x7f6a70034020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.529+0000 7f6a77fff640 1 -- 172.21.15.132:0/403922602 >> v1:172.21.15.132:6789/0 conn(0x7f6a7004f4d0 legacy=0x7f6a7004f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:22.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.529+0000 7f6a77fff640 1 -- 172.21.15.132:0/403922602 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a70053d30 con 0x7f6a70006a50 2024-04-16T15:52:22.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.529+0000 7f6a777fe640 1 --2- 172.21.15.132:0/403922602 >> v2:172.21.15.132:3300/0 conn(0x7f6a7004b3c0 0x7f6a70034020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:22.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.529+0000 7f3a52359640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3a44050040 0x7f3a440542e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:22.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.529+0000 7f3a52359640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a44005ec0 con 0x7f3a44048100 2024-04-16T15:52:22.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.529+0000 7f3a52359640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a44053280 con 0x7f3a44053e50 2024-04-16T15:52:22.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.529+0000 7f3a52359640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f3a440e7b90 con 0x7f3a44050040 2024-04-16T15:52:22.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.529+0000 7f3a508f6640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3a44050040 0x7f3a440542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:22.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.529+0000 7f3a508f6640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3a44050040 0x7f3a440542e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35236/0 (socket says 172.21.15.132:35236) 2024-04-16T15:52:22.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.529+0000 7f3a508f6640 1 -- 172.21.15.132:0/3766064766 learned_addr learned my addr 172.21.15.132:0/3766064766 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:22.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.529+0000 7f3a4bfff640 1 --1- 172.21.15.132:0/3766064766 >> v1:172.21.15.132:6789/0 conn(0x7f3a44048100 0x7f3a44006f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47306/0 (socket says 172.21.15.132:47306) 2024-04-16T15:52:22.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.529+0000 7f01b0cbe640 1 -- 172.21.15.132:0/1738467168 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a4039070 con 0x7f01ac071dc0 2024-04-16T15:52:22.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.529+0000 7f01b0cbe640 1 -- 172.21.15.132:0/1738467168 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01a402c720 con 0x7f01ac071dc0 2024-04-16T15:52:22.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.529+0000 7f01b0cbe640 1 -- 172.21.15.132:0/1738467168 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f019c0015a0 con 0x7f01ac071dc0 2024-04-16T15:52:22.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.530+0000 7f01b2cc2640 1 -- 172.21.15.132:0/1738467168 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01ac071dc0 msgr2=0x7f01ac09aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:22.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.530+0000 7f01b2cc2640 1 --2- 172.21.15.132:0/1738467168 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01ac071dc0 0x7f01ac09aa30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f01a4009dc0 tx=0x7f01a402bbf0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.530+0000 7f01b2cc2640 1 -- 172.21.15.132:0/1738467168 shutdown_connections 2024-04-16T15:52:22.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.530+0000 7f01b2cc2640 1 --2- 172.21.15.132:0/1738467168 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01ac071dc0 0x7f01ac09aa30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.530+0000 7f01b2cc2640 1 -- 172.21.15.132:0/1738467168 >> 172.21.15.132:0/1738467168 conn(0x7f01ac0b4050 msgr2=0x7f01ac0b4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:22.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.530+0000 7f01b2cc2640 1 -- 172.21.15.132:0/1738467168 shutdown_connections 2024-04-16T15:52:22.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.530+0000 7f01b2cc2640 1 -- 172.21.15.132:0/1738467168 wait complete. 2024-04-16T15:52:22.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.527+0000 7efcd7238640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcc80090b0 con 0x7efcc8006b50 2024-04-16T15:52:22.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.527+0000 7efcd7238640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcc8009390 con 0x7efcc8052ce0 2024-04-16T15:52:22.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.527+0000 7efcd7238640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7efcc80503e0 con 0x7efcc8036f90 2024-04-16T15:52:22.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.528+0000 7efcd6a37640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7efcc8052ce0 0x7efcc8054b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.132:55482/0 (socket says 172.21.15.132:55482) 2024-04-16T15:52:22.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.528+0000 7efcd6a37640 1 -- 172.21.15.132:0/2777730412 learned_addr learned my addr 172.21.15.132:0/2777730412 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:22.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.528+0000 7efcd6236640 1 --2- 172.21.15.132:0/2777730412 >> v2:172.21.15.132:3300/0 conn(0x7efcc8036f90 0x7efcc8051980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:22.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.528+0000 7efcd5234640 1 -- 172.21.15.132:0/2777730412 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1000233795 0 0) 0x7efcc8009390 con 0x7efcc8052ce0 2024-04-16T15:52:22.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.528+0000 7efcd5234640 1 -- 172.21.15.132:0/2777730412 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efcbc003520 con 0x7efcc8052ce0 2024-04-16T15:52:22.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.528+0000 7efcd6236640 1 -- 172.21.15.132:0/2777730412 >> v1:172.21.15.179:6789/0 conn(0x7efcc8052ce0 legacy=0x7efcc8054b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:22.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.528+0000 7efcd6236640 1 -- 172.21.15.132:0/2777730412 >> v1:172.21.15.132:6789/0 conn(0x7efcc8006b50 legacy=0x7efcc80525d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:22.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.528+0000 7efcd6236640 1 -- 172.21.15.132:0/2777730412 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc8052090 con 0x7efcc8036f90 2024-04-16T15:52:22.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.530+0000 7efcd6236640 1 --2- 172.21.15.132:0/2777730412 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efcc8036f90 0x7efcc8051980 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efccc011fc0 tx=0x7efccc0340e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=679e1494d83ba2f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:22.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.530+0000 7efcd5234640 1 -- 172.21.15.132:0/2777730412 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efccc0110d0 con 0x7efcc8036f90 2024-04-16T15:52:22.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.530+0000 7efcd5234640 1 -- 172.21.15.132:0/2777730412 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efccc011270 con 0x7efcc8036f90 2024-04-16T15:52:22.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.530+0000 7efcd5234640 1 -- 172.21.15.132:0/2777730412 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efccc011640 con 0x7efcc8036f90 2024-04-16T15:52:22.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.529+0000 7f7a99501640 1 -- 172.21.15.132:0/223555626 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a8c039070 con 0x7f7a9406f370 2024-04-16T15:52:22.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.529+0000 7f7a99501640 1 -- 172.21.15.132:0/223555626 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a8c02cc50 con 0x7f7a9406f370 2024-04-16T15:52:22.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.530+0000 7f7a9c767640 1 -- 172.21.15.132:0/223555626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a9406f370 msgr2=0x7f7a9406f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:22.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.530+0000 7f7a9c767640 1 --2- 172.21.15.132:0/223555626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a9406f370 0x7f7a9406f800 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c009d90 tx=0x7f7a8c02bea0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.529+0000 7f3a508f6640 1 -- 172.21.15.132:0/3766064766 >> v1:172.21.15.179:6789/0 conn(0x7f3a44053e50 legacy=0x7f3a4404f930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-16T15:52:22.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.529+0000 7f3a508f6640 1 -- 172.21.15.132:0/3766064766 >> v1:172.21.15.132:6789/0 conn(0x7f3a44048100 legacy=0x7f3a44006f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:22.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.529+0000 7f3a508f6640 1 -- 172.21.15.132:0/3766064766 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a44006160 con 0x7f3a44050040 2024-04-16T15:52:22.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.530+0000 7f3a508f6640 1 --2- 172.21.15.132:0/3766064766 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3a44050040 0x7f3a440542e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c06b060 tx=0x7f3a4c06ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ca93c29e2b74e61 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:22.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.530+0000 7f6a77fff640 1 --2- 172.21.15.132:0/403922602 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a70006a50 0x7f6a70006e80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6a70006460 tx=0x7f6a7806ad40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d19c08cf6fc2c09 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:22.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.530+0000 7f6a767fc640 1 -- 172.21.15.132:0/403922602 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a780b3070 con 0x7f6a70006a50 2024-04-16T15:52:22.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.530+0000 7f6a767fc640 1 -- 172.21.15.132:0/403922602 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a780ac810 con 0x7f6a70006a50 2024-04-16T15:52:22.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.530+0000 7f6a767fc640 1 -- 172.21.15.132:0/403922602 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a780acca0 con 0x7f6a70006a50 2024-04-16T15:52:22.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.530+0000 7f7a9c767640 1 -- 172.21.15.132:0/223555626 shutdown_connections 2024-04-16T15:52:22.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.530+0000 7f7a9c767640 1 --2- 172.21.15.132:0/223555626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a9406f370 0x7f7a9406f800 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.530+0000 7f7a9c767640 1 --2- 172.21.15.132:0/223555626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a94070780 0x7f7a94070be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.530+0000 7f7a9c767640 1 -- 172.21.15.132:0/223555626 >> 172.21.15.132:0/223555626 conn(0x7f7a9409aa30 msgr2=0x7f7a940b31a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:22.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.531+0000 7f3a4affd640 1 -- 172.21.15.132:0/3766064766 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a4c0b3070 con 0x7f3a44050040 2024-04-16T15:52:22.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.530+0000 7fbb43035640 1 Processor -- start 2024-04-16T15:52:22.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.530+0000 7fbb43035640 1 -- start start 2024-04-16T15:52:22.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.531+0000 7f7a9c767640 1 -- 172.21.15.132:0/223555626 shutdown_connections 2024-04-16T15:52:22.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.531+0000 7f3a4affd640 1 -- 172.21.15.132:0/3766064766 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a4c0ac810 con 0x7f3a44050040 2024-04-16T15:52:22.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.531+0000 7f9ed959d640 1 Processor -- start 2024-04-16T15:52:22.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.531+0000 7f9ed959d640 1 -- start start 2024-04-16T15:52:22.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.531+0000 7f3a4affd640 1 -- 172.21.15.132:0/3766064766 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a4c0acca0 con 0x7f3a44050040 2024-04-16T15:52:22.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.531+0000 7f6a7ca38640 1 -- 172.21.15.132:0/403922602 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a70006a50 msgr2=0x7f6a70006e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:22.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.531+0000 7f6a7ca38640 1 --2- 172.21.15.132:0/403922602 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a70006a50 0x7f6a70006e80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6a70006460 tx=0x7f6a7806ad40 comp rx=0 tx=0).stop 2024-04-16T15:52:22.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.531+0000 7efcd7238640 1 -- 172.21.15.132:0/2777730412 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efcc8036f90 msgr2=0x7efcc8051980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:22.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.531+0000 7efcd7238640 1 --2- 172.21.15.132:0/2777730412 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efcc8036f90 0x7efcc8051980 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efccc011fc0 tx=0x7efccc0340e0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.531+0000 7f6a7ca38640 1 -- 172.21.15.132:0/403922602 shutdown_connections 2024-04-16T15:52:22.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.531+0000 7f6a7ca38640 1 --2- 172.21.15.132:0/403922602 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a70006a50 0x7f6a70006e80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.531+0000 7f6a7ca38640 1 --2- 172.21.15.132:0/403922602 >> v2:172.21.15.132:3300/0 conn(0x7f6a7004b3c0 0x7f6a70034020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.531+0000 7f6a7ca38640 1 -- 172.21.15.132:0/403922602 >> 172.21.15.132:0/403922602 conn(0x7f6a7000a400 msgr2=0x7f6a7000a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:22.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.532+0000 7efcd7238640 1 -- 172.21.15.132:0/2777730412 shutdown_connections 2024-04-16T15:52:22.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.532+0000 7f3a52359640 1 -- 172.21.15.132:0/3766064766 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3a44050040 msgr2=0x7f3a440542e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:22.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.532+0000 7f3a52359640 1 --2- 172.21.15.132:0/3766064766 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3a44050040 0x7f3a440542e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c06b060 tx=0x7f3a4c06ad40 comp rx=0 tx=0).stop 2024-04-16T15:52:22.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.532+0000 7fbb43035640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb3c0b3f30 0x7fbb3c06bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:22.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.532+0000 7f3a52359640 1 -- 172.21.15.132:0/3766064766 shutdown_connections 2024-04-16T15:52:22.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.532+0000 7f3a52359640 1 --2- 172.21.15.132:0/3766064766 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3a44050040 0x7f3a440542e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.532+0000 7f3a52359640 1 -- 172.21.15.132:0/3766064766 >> 172.21.15.132:0/3766064766 conn(0x7f3a44009fe0 msgr2=0x7f3a4400a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:22.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.532+0000 7f6a7ca38640 1 -- 172.21.15.132:0/403922602 shutdown_connections 2024-04-16T15:52:22.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.532+0000 7efcd7238640 1 --2- 172.21.15.132:0/2777730412 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efcc8036f90 0x7efcc8051980 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.532+0000 7efcd7238640 1 -- 172.21.15.132:0/2777730412 >> 172.21.15.132:0/2777730412 conn(0x7efcc801ef70 msgr2=0x7efcc8055c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:22.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.532+0000 7f6a7ca38640 1 -- 172.21.15.132:0/403922602 wait complete. 2024-04-16T15:52:22.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.532+0000 7f3a52359640 1 -- 172.21.15.132:0/3766064766 shutdown_connections 2024-04-16T15:52:22.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.532+0000 7f3a52359640 1 -- 172.21.15.132:0/3766064766 wait complete. 2024-04-16T15:52:22.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.532+0000 7f9ed959d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9ecc0e3260 0x7f9ecc04f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:22.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.532+0000 7f9ed959d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9ecc04fdb0 0x7f9ecc052c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:22.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.532+0000 7f9ed959d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ecc0531b0 0x7f9ecc005e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:22.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.532+0000 7f9ed959d640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f9ecc0e3640 con 0x7f9ecc04fdb0 2024-04-16T15:52:22.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.532+0000 7f9ed959d640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f9ecc053930 con 0x7f9ecc0e3260 2024-04-16T15:52:22.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.532+0000 7f9ed959d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9ecc053c10 con 0x7f9ecc0531b0 2024-04-16T15:52:22.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.532+0000 7f9ed37fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9ecc04fdb0 0x7f9ecc052c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:22.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.532+0000 7fbb43035640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbb3c06c220 0x7fbb3c0cd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:22.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.532+0000 7fbb40dd1640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fbb3c16b890 0x7fbb3c06ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.132:55498/0 (socket says 172.21.15.132:55498) 2024-04-16T15:52:22.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.532+0000 7f9ed8d9c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ecc0531b0 0x7f9ecc005e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:22.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.532+0000 7f01b2cc2640 1 Processor -- start 2024-04-16T15:52:22.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.532+0000 7f9ed3fff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9ecc0e3260 0x7f9ecc04f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:22.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.532+0000 7f9ed3fff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9ecc0e3260 0x7f9ecc04f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.132:40770/0 (socket says 172.21.15.132:40770) 2024-04-16T15:52:22.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.532+0000 7f9ed3fff640 1 -- 172.21.15.132:0/2305068843 learned_addr learned my addr 172.21.15.132:0/2305068843 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:22.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.532+0000 7f9ed8d9c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ecc0531b0 0x7f9ecc005e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.132:48022/0 (socket says 172.21.15.132:48022) 2024-04-16T15:52:22.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.533+0000 7f01b2cc2640 1 -- start start 2024-04-16T15:52:22.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.531+0000 7f7a9c767640 1 -- 172.21.15.132:0/223555626 wait complete. 2024-04-16T15:52:22.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.533+0000 7f7a9c767640 1 Processor -- start 2024-04-16T15:52:22.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.533+0000 7f7a9c767640 1 -- start start 2024-04-16T15:52:22.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.533+0000 7fbb43035640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb3c06f7c0 con 0x7fbb3c16b890 2024-04-16T15:52:22.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.533+0000 7fbb43035640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fbb3c0b5290 con 0x7fbb3c06c220 2024-04-16T15:52:22.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.533+0000 7fbb43035640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fbb3c0b4960 con 0x7fbb3c0b3f30 2024-04-16T15:52:22.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.533+0000 7fbb40dd1640 1 -- 172.21.15.132:0/3187023625 learned_addr learned my addr 172.21.15.132:0/3187023625 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:22.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.533+0000 7f9ed8d9c640 1 -- 172.21.15.132:0/2305068843 >> v2:172.21.15.179:3300/0 conn(0x7f9ecc0e3260 msgr2=0x7f9ecc04f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:22.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.533+0000 7f9ed8d9c640 1 --2- 172.21.15.132:0/2305068843 >> v2:172.21.15.179:3300/0 conn(0x7f9ecc0e3260 0x7f9ecc04f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.533+0000 7f9ed8d9c640 1 -- 172.21.15.132:0/2305068843 >> v2:172.21.15.132:3300/0 conn(0x7f9ecc04fdb0 msgr2=0x7f9ecc052c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:22.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.533+0000 7f9ed8d9c640 1 --2- 172.21.15.132:0/2305068843 >> v2:172.21.15.132:3300/0 conn(0x7f9ecc04fdb0 0x7f9ecc052c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.533+0000 7f9ed8d9c640 1 -- 172.21.15.132:0/2305068843 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ecc053ef0 con 0x7f9ecc0531b0 2024-04-16T15:52:22.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.533+0000 7fbb337fe640 1 -- 172.21.15.132:0/3187023625 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4015350676 0 0) 0x7fbb3c06f7c0 con 0x7fbb3c16b890 2024-04-16T15:52:22.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.533+0000 7fbb337fe640 1 -- 172.21.15.132:0/3187023625 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb24003520 con 0x7fbb3c16b890 2024-04-16T15:52:22.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.533+0000 7fbb337fe640 1 -- 172.21.15.132:0/3187023625 <== mon.1 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2291316598 0 0) 0x7fbb24003520 con 0x7fbb3c16b890 2024-04-16T15:52:22.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.533+0000 7fbb337fe640 1 -- 172.21.15.132:0/3187023625 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb3c0b3f30 msgr2=0x7fbb3c06bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:22.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.533+0000 7fbb33fff640 1 --2- 172.21.15.132:0/3187023625 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb3c0b3f30 0x7fbb3c06bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:22.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.533+0000 7f6a7ca38640 1 Processor -- start 2024-04-16T15:52:22.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.533+0000 7fbb337fe640 1 --2- 172.21.15.132:0/3187023625 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb3c0b3f30 0x7fbb3c06bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.533+0000 7fbb337fe640 1 -- 172.21.15.132:0/3187023625 >> v2:172.21.15.179:3300/0 conn(0x7fbb3c06c220 msgr2=0x7fbb3c0cd130 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-16T15:52:22.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.533+0000 7fbb337fe640 1 --2- 172.21.15.132:0/3187023625 >> v2:172.21.15.179:3300/0 conn(0x7fbb3c06c220 0x7fbb3c0cd130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.533+0000 7fbb337fe640 1 -- 172.21.15.132:0/3187023625 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb3c0b4c40 con 0x7fbb3c16b890 2024-04-16T15:52:22.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.533+0000 7fbb337fe640 1 -- 172.21.15.132:0/3187023625 <== mon.1 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2803668828 0 0) 0x7fbb38001670 con 0x7fbb3c16b890 2024-04-16T15:52:22.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.533+0000 7fbb337fe640 1 -- 172.21.15.132:0/3187023625 >> v1:172.21.15.179:6789/0 conn(0x7fbb3c16b890 legacy=0x7fbb3c06ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:22.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.533+0000 7fbb337fe640 1 --2- 172.21.15.132:0/3187023625 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb240039b0 0x7fbb24003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:22.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.534+0000 7f6a7ca38640 1 -- start start 2024-04-16T15:52:22.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.533+0000 7fbb337fe640 1 --2- 172.21.15.132:0/3187023625 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb24004800 0x7fbb24004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:22.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.534+0000 7f3a52359640 1 Processor -- start 2024-04-16T15:52:22.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.533+0000 7fbb337fe640 1 --2- 172.21.15.132:0/3187023625 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb240052e0 0x7fbb2400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:22.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.534+0000 7fbb337fe640 1 -- 172.21.15.132:0/3187023625 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fbb3c0b5290 con 0x7fbb24004800 2024-04-16T15:52:22.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.534+0000 7fbb337fe640 1 -- 172.21.15.132:0/3187023625 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fbb3c0b4960 con 0x7fbb240039b0 2024-04-16T15:52:22.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.534+0000 7fbb337fe640 1 -- 172.21.15.132:0/3187023625 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fbb2400c1a0 con 0x7fbb240052e0 2024-04-16T15:52:22.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.534+0000 7fbb40dd1640 1 --2- 172.21.15.132:0/3187023625 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb240039b0 0x7fbb24003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:22.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.534+0000 7f01b2cc2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01ac071dc0 0x7f01ac06d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:22.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.534+0000 7fbb33fff640 1 --2- 172.21.15.132:0/3187023625 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb24004800 0x7fbb24004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:22.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.534+0000 7f9ed8d9c640 1 --2- 172.21.15.132:0/2305068843 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ecc0531b0 0x7f9ecc005e90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4051740 tx=0x7f9ed4069820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63efc1c713788747 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:22.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.534+0000 7f7a9c767640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a94070780 0x7f7a941fb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:22.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.534+0000 7f7a9c767640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a9415eb80 0x7f7a940b6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:22.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.534+0000 7f7a9c767640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a940b6c90 0x7f7a940b4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:22.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.534+0000 7f7a9a503640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a94070780 0x7f7a941fb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:22.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.534+0000 7f7a9a503640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a94070780 0x7f7a941fb0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35274/0 (socket says 172.21.15.132:35274) 2024-04-16T15:52:22.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.534+0000 7efcd7238640 1 -- 172.21.15.132:0/2777730412 shutdown_connections 2024-04-16T15:52:22.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.534+0000 7fbb415d2640 1 --2- 172.21.15.132:0/3187023625 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb240052e0 0x7fbb2400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:22.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.534+0000 7efcd7238640 1 -- 172.21.15.132:0/2777730412 wait complete. 2024-04-16T15:52:22.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.535+0000 7f7a9ad04640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a940b6c90 0x7f7a940b4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:22.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.534+0000 7f3a52359640 1 -- start start 2024-04-16T15:52:22.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.535+0000 7f9ed2ffd640 1 -- 172.21.15.132:0/2305068843 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed40b3070 con 0x7f9ecc0531b0 2024-04-16T15:52:22.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.535+0000 7f7a9ad04640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a940b6c90 0x7f7a940b4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.132:40784/0 (socket says 172.21.15.132:40784) 2024-04-16T15:52:22.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.535+0000 7f9ed2ffd640 1 -- 172.21.15.132:0/2305068843 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ed40ac7d0 con 0x7f9ecc0531b0 2024-04-16T15:52:22.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.535+0000 7f9ed2ffd640 1 -- 172.21.15.132:0/2305068843 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed40acc40 con 0x7f9ecc0531b0 2024-04-16T15:52:22.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.535+0000 7f7a9c767640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f7a9406bfe0 con 0x7f7a94070780 2024-04-16T15:52:22.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.535+0000 7f7a9c767640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7a9406bd00 con 0x7f7a940b6c90 2024-04-16T15:52:22.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.535+0000 7f6a7ca38640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a70006a50 0x7f6a700e8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:22.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.535+0000 7f6a7ca38640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a7004b3c0 0x7f6a700d6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:22.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.535+0000 7f6a7ca38640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a7004f4d0 0x7f6a70049ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:22.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.535+0000 7f6a7ca38640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f6a70050060 con 0x7f6a70006a50 2024-04-16T15:52:22.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.535+0000 7f6a7ca38640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6a7004b7a0 con 0x7f6a7004f4d0 2024-04-16T15:52:22.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.535+0000 7f6a7ca38640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6a70054830 con 0x7f6a7004b3c0 2024-04-16T15:52:22.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.535+0000 7f01b2cc2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01ac15fdf0 0x7f01ac156040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:22.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.535+0000 7f01b2cc2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01ac1601d0 0x7f01ac153600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:22.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.535+0000 7f01b2cc2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f01ac071550 con 0x7f01ac071dc0 2024-04-16T15:52:22.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.535+0000 7f01b2cc2640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f01ac0713d0 con 0x7f01ac15fdf0 2024-04-16T15:52:22.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.535+0000 7f01b2cc2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f01ac0716d0 con 0x7f01ac1601d0 2024-04-16T15:52:22.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.535+0000 7f01b1cc0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01ac071dc0 0x7f01ac06d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:22.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.535+0000 7f7a9c767640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f7a9406c2c0 con 0x7f7a9415eb80 2024-04-16T15:52:22.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.535+0000 7f7a9a503640 1 -- 172.21.15.132:0/2220961388 learned_addr learned my addr 172.21.15.132:0/2220961388 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:22.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.535+0000 7f7a99d02640 1 --2- 172.21.15.132:0/2220961388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a9415eb80 0x7f7a940b6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:22.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.535+0000 7f6a76ffd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a7004b3c0 0x7f6a700d6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:22.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.535+0000 7f6a76ffd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a7004b3c0 0x7f6a700d6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.132:48042/0 (socket says 172.21.15.132:48042) 2024-04-16T15:52:22.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.535+0000 7f6a76ffd640 1 -- 172.21.15.132:0/2775481401 learned_addr learned my addr 172.21.15.132:0/2775481401 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:22.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.535+0000 7f3a52359640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a44048100 0x7f3a44188d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:22.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.535+0000 7fbb33fff640 1 -- 172.21.15.132:0/3187023625 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb240052e0 msgr2=0x7fbb2400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:22.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.535+0000 7fbb33fff640 1 --2- 172.21.15.132:0/3187023625 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb240052e0 0x7fbb2400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.535+0000 7fbb33fff640 1 -- 172.21.15.132:0/3187023625 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb240039b0 msgr2=0x7fbb24003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:22.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.535+0000 7f3a52359640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3a44050040 0x7f3a44037130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:22.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.535+0000 7f3a52359640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a44053e50 0x7f3a440e8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:22.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.536+0000 7f6a777fe640 1 --2- 172.21.15.132:0/2775481401 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a70006a50 0x7f6a700e8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:22.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.535+0000 7fbb33fff640 1 --2- 172.21.15.132:0/3187023625 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb240039b0 0x7fbb24003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.535+0000 7fbb33fff640 1 -- 172.21.15.132:0/3187023625 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb3c0b4c40 con 0x7fbb24004800 2024-04-16T15:52:22.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.535+0000 7f3a52359640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f3a44006720 con 0x7f3a44050040 2024-04-16T15:52:22.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.536+0000 7f7a9ad04640 1 -- 172.21.15.132:0/2220961388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a9415eb80 msgr2=0x7f7a940b6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:22.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.536+0000 7f7a9ad04640 1 --2- 172.21.15.132:0/2220961388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a9415eb80 0x7f7a940b6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.536+0000 7f7a9ad04640 1 -- 172.21.15.132:0/2220961388 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a94070780 msgr2=0x7f7a941fb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:22.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.536+0000 7f7a9ad04640 1 --2- 172.21.15.132:0/2220961388 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a94070780 0x7f7a941fb0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.536+0000 7f7a9ad04640 1 -- 172.21.15.132:0/2220961388 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a941fb620 con 0x7f7a940b6c90 2024-04-16T15:52:22.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.536+0000 7f7a99d02640 1 --2- 172.21.15.132:0/2220961388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a9415eb80 0x7f7a940b6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:52:22.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.536+0000 7f7a9a503640 1 --2- 172.21.15.132:0/2220961388 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a94070780 0x7f7a941fb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:22.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.536+0000 7f9ed959d640 1 -- 172.21.15.132:0/2305068843 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ecc0531b0 msgr2=0x7f9ecc005e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:22.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.536+0000 7f9ed959d640 1 --2- 172.21.15.132:0/2305068843 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ecc0531b0 0x7f9ecc005e90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4051740 tx=0x7f9ed4069820 comp rx=0 tx=0).stop 2024-04-16T15:52:22.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.536+0000 7f6a76ffd640 1 -- 172.21.15.132:0/2775481401 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a7004f4d0 msgr2=0x7f6a70049ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-16T15:52:22.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.536+0000 7f6a76ffd640 1 --2- 172.21.15.132:0/2775481401 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a7004f4d0 0x7f6a70049ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.536+0000 7f6a76ffd640 1 -- 172.21.15.132:0/2775481401 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a70006a50 msgr2=0x7f6a700e8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:22.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.536+0000 7f6a76ffd640 1 --2- 172.21.15.132:0/2775481401 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a70006a50 0x7f6a700e8ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.536+0000 7f3a52359640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3a44006a90 con 0x7f3a44048100 2024-04-16T15:52:22.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.536+0000 7f3a52359640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f3a44007630 con 0x7f3a44053e50 2024-04-16T15:52:22.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.536+0000 7f9ed959d640 1 -- 172.21.15.132:0/2305068843 shutdown_connections 2024-04-16T15:52:22.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.536+0000 7f6a76ffd640 1 -- 172.21.15.132:0/2775481401 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a700e7e90 con 0x7f6a7004b3c0 2024-04-16T15:52:22.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.536+0000 7f9ed959d640 1 --2- 172.21.15.132:0/2305068843 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ecc0531b0 0x7f9ecc005e90 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.536+0000 7f9ed959d640 1 --2- 172.21.15.132:0/2305068843 >> v2:172.21.15.132:3300/0 conn(0x7f9ecc04fdb0 0x7f9ecc052c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.536+0000 7f9ed959d640 1 --2- 172.21.15.132:0/2305068843 >> v2:172.21.15.179:3300/0 conn(0x7f9ecc0e3260 0x7f9ecc04f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.536+0000 7f9ed959d640 1 -- 172.21.15.132:0/2305068843 >> 172.21.15.132:0/2305068843 conn(0x7f9ecc009fb0 msgr2=0x7f9ecc00a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:22.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.536+0000 7f6a777fe640 1 --2- 172.21.15.132:0/2775481401 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a70006a50 0x7f6a700e8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:22.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.536+0000 7f3a508f6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a44053e50 0x7f3a440e8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:22.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.536+0000 7f3a508f6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a44053e50 0x7f3a440e8410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.132:48052/0 (socket says 172.21.15.132:48052) 2024-04-16T15:52:22.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.536+0000 7f3a508f6640 1 -- 172.21.15.132:0/3551887382 learned_addr learned my addr 172.21.15.132:0/3551887382 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:22.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.536+0000 7f01b1cc0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01ac071dc0 0x7f01ac06d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35262/0 (socket says 172.21.15.132:35262) 2024-04-16T15:52:22.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.536+0000 7f01b1cc0640 1 -- 172.21.15.132:0/50793253 learned_addr learned my addr 172.21.15.132:0/50793253 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:22.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.536+0000 7f01b24c1640 1 --2- 172.21.15.132:0/50793253 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01ac1601d0 0x7f01ac153600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:22.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.536+0000 7f01b24c1640 1 -- 172.21.15.132:0/50793253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01ac15fdf0 msgr2=0x7f01ac156040 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-16T15:52:22.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.536+0000 7f01b24c1640 1 --2- 172.21.15.132:0/50793253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01ac15fdf0 0x7f01ac156040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.536+0000 7f01b24c1640 1 -- 172.21.15.132:0/50793253 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01ac071dc0 msgr2=0x7f01ac06d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:22.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.536+0000 7f01b24c1640 1 --2- 172.21.15.132:0/50793253 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01ac071dc0 0x7f01ac06d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.536+0000 7f01b24c1640 1 -- 172.21.15.132:0/50793253 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01ac06e4b0 con 0x7f01ac1601d0 2024-04-16T15:52:22.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.536+0000 7f6a76ffd640 1 --2- 172.21.15.132:0/2775481401 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a7004b3c0 0x7f6a700d6750 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c00b3f0 tx=0x7f6a6c00b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:22.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.536+0000 7f01b1cc0640 1 --2- 172.21.15.132:0/50793253 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01ac071dc0 0x7f01ac06d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:22.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.536+0000 7f7a9ad04640 1 --2- 172.21.15.132:0/2220961388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a940b6c90 0x7f7a940b4220 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7a94071ad0 tx=0x7f7a8c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:22.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.536+0000 7f3a4b7fe640 1 --2- 172.21.15.132:0/3551887382 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3a44050040 0x7f3a44037130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:22.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.536+0000 7f3a508f6640 1 -- 172.21.15.132:0/3551887382 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a44048100 msgr2=0x7f3a44188d10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-16T15:52:22.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.536+0000 7f3a508f6640 1 --2- 172.21.15.132:0/3551887382 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a44048100 0x7f3a44188d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.536+0000 7f3a508f6640 1 -- 172.21.15.132:0/3551887382 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3a44050040 msgr2=0x7f3a44037130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:22.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.536+0000 7f6a63fff640 1 -- 172.21.15.132:0/2775481401 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c015020 con 0x7f6a7004b3c0 2024-04-16T15:52:22.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.537+0000 7f6a63fff640 1 -- 172.21.15.132:0/2775481401 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a6c011830 con 0x7f6a7004b3c0 2024-04-16T15:52:22.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.537+0000 7f6a63fff640 1 -- 172.21.15.132:0/2775481401 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c011c20 con 0x7f6a7004b3c0 2024-04-16T15:52:22.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.536+0000 7f3a508f6640 1 --2- 172.21.15.132:0/3551887382 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3a44050040 0x7f3a44037130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.537+0000 7f3a508f6640 1 -- 172.21.15.132:0/3551887382 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a440360c0 con 0x7f3a44053e50 2024-04-16T15:52:22.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.536+0000 7f01b24c1640 1 --2- 172.21.15.132:0/50793253 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01ac1601d0 0x7f01ac153600 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f01a4033000 tx=0x7f01a4004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:22.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.537+0000 7f6a7ca38640 1 -- 172.21.15.132:0/2775481401 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a700e8130 con 0x7f6a7004b3c0 2024-04-16T15:52:22.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.537+0000 7f3a4b7fe640 1 --2- 172.21.15.132:0/3551887382 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3a44050040 0x7f3a44037130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:52:22.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.537+0000 7f01a27fc640 1 -- 172.21.15.132:0/50793253 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a4044020 con 0x7f01ac1601d0 2024-04-16T15:52:22.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.537+0000 7efcd7238640 1 Processor -- start 2024-04-16T15:52:22.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.537+0000 7f9ed959d640 1 -- 172.21.15.132:0/2305068843 shutdown_connections 2024-04-16T15:52:22.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.537+0000 7f6a7ca38640 1 -- 172.21.15.132:0/2775481401 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a700e86f0 con 0x7f6a7004b3c0 2024-04-16T15:52:22.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.537+0000 7f9ed959d640 1 -- 172.21.15.132:0/2305068843 wait complete. 2024-04-16T15:52:22.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.537+0000 7f01a27fc640 1 -- 172.21.15.132:0/50793253 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01a403a040 con 0x7f01ac1601d0 2024-04-16T15:52:22.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.537+0000 7f01a27fc640 1 -- 172.21.15.132:0/50793253 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a4039070 con 0x7f01ac1601d0 2024-04-16T15:52:22.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.537+0000 7f01b2cc2640 1 -- 172.21.15.132:0/50793253 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01ac06e790 con 0x7f01ac1601d0 2024-04-16T15:52:22.574 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.537+0000 7efcd7238640 1 -- start start 2024-04-16T15:52:22.574 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.537+0000 7f3a508f6640 1 --2- 172.21.15.132:0/3551887382 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a44053e50 0x7f3a440e8410 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c02dbb0 tx=0x7f3a4c076d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:22.574 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.537+0000 7f01b2cc2640 1 -- 172.21.15.132:0/50793253 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f01ac0af350 con 0x7f01ac1601d0 2024-04-16T15:52:22.575 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.537+0000 7fbb33fff640 1 --2- 172.21.15.132:0/3187023625 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb24004800 0x7fbb24004c80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c16bc70 tx=0x7fbb24005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e0a0958f1b0f7d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:22.575 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.537+0000 7f7a8affd640 1 -- 172.21.15.132:0/2220961388 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a8c044020 con 0x7f7a940b6c90 2024-04-16T15:52:22.575 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.537+0000 7f3a48ff9640 1 -- 172.21.15.132:0/3551887382 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a4c0b3040 con 0x7f3a44053e50 2024-04-16T15:52:22.575 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.538+0000 7f3a52359640 1 -- 172.21.15.132:0/3551887382 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a440363a0 con 0x7f3a44053e50 2024-04-16T15:52:22.575 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.538+0000 7f3a52359640 1 -- 172.21.15.132:0/3551887382 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a44037670 con 0x7f3a44053e50 2024-04-16T15:52:22.576 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.538+0000 7efcd7238640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efcc8006b50 0x7efcc80de130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:22.576 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.539+0000 7efcd7238640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efcc8036f90 0x7efcc80e0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:22.576 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.537+0000 7fbb337fe640 1 -- 172.21.15.132:0/3187023625 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c00a4d0 con 0x7fbb24004800 2024-04-16T15:52:22.576 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.537+0000 7fbb337fe640 1 -- 172.21.15.132:0/3187023625 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb2c037070 con 0x7fbb24004800 2024-04-16T15:52:22.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.539+0000 7efcd6236640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efcc8006b50 0x7efcc80de130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:22.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.537+0000 7fbb337fe640 1 -- 172.21.15.132:0/3187023625 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c032900 con 0x7fbb24004800 2024-04-16T15:52:22.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.538+0000 7fbb43035640 1 -- 172.21.15.132:0/3187023625 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb24004800 msgr2=0x7fbb24004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:22.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.538+0000 7fbb43035640 1 --2- 172.21.15.132:0/3187023625 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb24004800 0x7fbb24004c80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c16bc70 tx=0x7fbb24005830 comp rx=0 tx=0).stop 2024-04-16T15:52:22.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.538+0000 7fbb415d2640 1 -- 172.21.15.132:0/3187023625 reap_dead start 2024-04-16T15:52:22.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.539+0000 7efcd6236640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efcc8006b50 0x7efcc80de130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.132:40820/0 (socket says 172.21.15.132:40820) 2024-04-16T15:52:22.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.539+0000 7efcd5a35640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efcc8036f90 0x7efcc80e0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:22.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.538+0000 7f3a48ff9640 1 -- 172.21.15.132:0/3551887382 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a4c0685f0 con 0x7f3a44053e50 2024-04-16T15:52:22.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.538+0000 7f3a48ff9640 1 -- 172.21.15.132:0/3551887382 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a4c067960 con 0x7f3a44053e50 2024-04-16T15:52:22.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.539+0000 7efcd5a35640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efcc8036f90 0x7efcc80e0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.132:48066/0 (socket says 172.21.15.132:48066) 2024-04-16T15:52:22.579 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.539+0000 7efcd6236640 1 -- 172.21.15.132:0/3572095154 learned_addr learned my addr 172.21.15.132:0/3572095154 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:22.579 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.539+0000 7f7a9c767640 1 -- 172.21.15.132:0/2220961388 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a940b4f90 con 0x7f7a940b6c90 2024-04-16T15:52:22.579 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.539+0000 7f9ed959d640 1 Processor -- start 2024-04-16T15:52:22.579 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.539+0000 7efcd7238640 1 --2- 172.21.15.132:0/3572095154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efcc8052ce0 0x7efcc80e4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:22.580 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.539+0000 7f7a9c767640 1 -- 172.21.15.132:0/2220961388 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a940b5550 con 0x7f7a940b6c90 2024-04-16T15:52:22.580 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.539+0000 7efcd6a37640 1 --2- 172.21.15.132:0/3572095154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efcc8052ce0 0x7efcc80e4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:22.580 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.539+0000 7efcd7238640 1 -- 172.21.15.132:0/3572095154 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7efcc803b450 con 0x7efcc8052ce0 2024-04-16T15:52:22.580 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.539+0000 7f9ed959d640 1 -- start start 2024-04-16T15:52:22.581 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.540+0000 7efcd7238640 1 -- 172.21.15.132:0/3572095154 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7efcc803b2d0 con 0x7efcc8006b50 2024-04-16T15:52:22.581 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.540+0000 7efcd7238640 1 -- 172.21.15.132:0/3572095154 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7efcc803b5d0 con 0x7efcc8036f90 2024-04-16T15:52:22.581 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.540+0000 7f6a7ca38640 1 -- 172.21.15.132:0/2775481401 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a700057e0 con 0x7f6a7004b3c0 2024-04-16T15:52:22.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.540+0000 7efcd6236640 1 -- 172.21.15.132:0/3572095154 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efcc8036f90 msgr2=0x7efcc80e0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:22.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.540+0000 7efcd6236640 1 --2- 172.21.15.132:0/3572095154 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efcc8036f90 0x7efcc80e0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.540+0000 7efcd6236640 1 -- 172.21.15.132:0/3572095154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efcc8052ce0 msgr2=0x7efcc80e4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:22.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.540+0000 7efcd6236640 1 --2- 172.21.15.132:0/3572095154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efcc8052ce0 0x7efcc80e4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.540+0000 7efcd6236640 1 -- 172.21.15.132:0/3572095154 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc804ce10 con 0x7efcc8006b50 2024-04-16T15:52:22.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.540+0000 7efcd5a35640 1 --2- 172.21.15.132:0/3572095154 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efcc8036f90 0x7efcc80e0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:52:22.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.540+0000 7efcd6a37640 1 --2- 172.21.15.132:0/3572095154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efcc8052ce0 0x7efcc80e4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:22.583 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.539+0000 7f7a8affd640 1 -- 172.21.15.132:0/2220961388 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a8c03a040 con 0x7f7a940b6c90 2024-04-16T15:52:22.583 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.539+0000 7f7a8affd640 1 -- 172.21.15.132:0/2220961388 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a8c039070 con 0x7f7a940b6c90 2024-04-16T15:52:22.583 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.540+0000 7f3a48ff9640 1 -- 172.21.15.132:0/3551887382 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3a4c0c2020 con 0x7f3a44053e50 2024-04-16T15:52:22.583 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.541+0000 7efcd6236640 1 --2- 172.21.15.132:0/3572095154 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efcc8006b50 0x7efcc80de130 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efccc0346f0 tx=0x7efccc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:22.583 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.541+0000 7f3a48ff9640 1 --2- 172.21.15.132:0/3551887382 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f3a3006c920 0x7f3a3006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:22.584 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.541+0000 7f7a88ff9640 1 -- 172.21.15.132:0/2220961388 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a94075510 con 0x7f7a940b6c90 2024-04-16T15:52:22.584 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.541+0000 7f3a48ff9640 1 -- 172.21.15.132:0/3551887382 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3a4c129390 con 0x7f3a44053e50 2024-04-16T15:52:22.584 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.540+0000 7f01a27fc640 1 -- 172.21.15.132:0/50793253 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f01a4047020 con 0x7f01ac1601d0 2024-04-16T15:52:22.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.541+0000 7f9ed959d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ecc04fdb0 0x7f9ecc0e5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:22.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.541+0000 7f01a27fc640 1 --2- 172.21.15.132:0/50793253 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f019006c9c0 0x7f019006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:22.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.541+0000 7f01a27fc640 1 -- 172.21.15.132:0/50793253 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f01a40adf60 con 0x7f01ac1601d0 2024-04-16T15:52:22.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.541+0000 7f3a4bfff640 1 --2- 172.21.15.132:0/3551887382 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f3a3006c920 0x7f3a3006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:22.586 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.541+0000 7f6a63fff640 1 -- 172.21.15.132:0/2775481401 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6a6c018020 con 0x7f6a7004b3c0 2024-04-16T15:52:22.586 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.541+0000 7f9ed959d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ecc0531b0 0x7f9ecc0ce610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:22.586 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.541+0000 7efcc6ffd640 1 -- 172.21.15.132:0/3572095154 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efccc04b070 con 0x7efcc8006b50 2024-04-16T15:52:22.586 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.541+0000 7efcc6ffd640 1 -- 172.21.15.132:0/3572095154 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efccc004030 con 0x7efcc8006b50 2024-04-16T15:52:22.587 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.541+0000 7f9ed959d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ecc0e3260 0x7f9ecc0ceeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:22.587 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.541+0000 7f9ed959d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f9ecc053640 con 0x7f9ecc0531b0 2024-04-16T15:52:22.587 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.541+0000 7efcc6ffd640 1 -- 172.21.15.132:0/3572095154 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efccc0110d0 con 0x7efcc8006b50 2024-04-16T15:52:22.587 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.541+0000 7efcd7238640 1 -- 172.21.15.132:0/3572095154 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcc804d0f0 con 0x7efcc8006b50 2024-04-16T15:52:22.587 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.541+0000 7efcd7238640 1 -- 172.21.15.132:0/3572095154 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcc804d6b0 con 0x7efcc8006b50 2024-04-16T15:52:22.587 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.541+0000 7f3a367fc640 1 -- 172.21.15.132:0/3551887382 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a440053c0 con 0x7f3a44053e50 2024-04-16T15:52:22.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.541+0000 7f6a63fff640 1 --2- 172.21.15.132:0/2775481401 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f6a5c06c9c0 0x7f6a5c06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:22.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.541+0000 7f9ed37fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ecc0531b0 0x7f9ecc0ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:22.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.541+0000 7f9ed8d9c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ecc0e3260 0x7f9ecc0ceeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:22.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.541+0000 7f9ed8d9c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ecc0e3260 0x7f9ecc0ceeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.132:40830/0 (socket says 172.21.15.132:40830) 2024-04-16T15:52:22.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.541+0000 7f9ed8d9c640 1 -- 172.21.15.132:0/715910480 learned_addr learned my addr 172.21.15.132:0/715910480 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:22.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.541+0000 7f9ed3fff640 1 --2- 172.21.15.132:0/715910480 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ecc04fdb0 0x7f9ecc0e5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:22.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.541+0000 7f9ed959d640 1 -- 172.21.15.132:0/715910480 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9ecc0544b0 con 0x7f9ecc0e3260 2024-04-16T15:52:22.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.541+0000 7f9ed959d640 1 -- 172.21.15.132:0/715910480 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9ecc0063d0 con 0x7f9ecc04fdb0 2024-04-16T15:52:22.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.541+0000 7f6a63fff640 1 -- 172.21.15.132:0/2775481401 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6a6c08b9f0 con 0x7f6a7004b3c0 2024-04-16T15:52:22.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.539+0000 7f01b2cc2640 1 -- 172.21.15.132:0/50793253 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01ac04fe70 con 0x7f01ac1601d0 2024-04-16T15:52:22.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.542+0000 7f01b1cc0640 1 --2- 172.21.15.132:0/50793253 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f019006c9c0 0x7f019006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:22.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.542+0000 7f01b1cc0640 1 --2- 172.21.15.132:0/50793253 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f019006c9c0 0x7f019006ee80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f01a80077e0 tx=0x7f01a8000f10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:22.590 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.542+0000 7f9ed37fe640 1 -- 172.21.15.132:0/715910480 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ecc04fdb0 msgr2=0x7f9ecc0e5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:22.590 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.542+0000 7f9ed37fe640 1 --2- 172.21.15.132:0/715910480 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ecc04fdb0 0x7f9ecc0e5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.590 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.542+0000 7f9ed37fe640 1 -- 172.21.15.132:0/715910480 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ecc0e3260 msgr2=0x7f9ecc0ceeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:22.590 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.542+0000 7f9ed37fe640 1 --2- 172.21.15.132:0/715910480 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ecc0e3260 0x7f9ecc0ceeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.590 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.542+0000 7f9ed37fe640 1 -- 172.21.15.132:0/715910480 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ecc048a40 con 0x7f9ecc0531b0 2024-04-16T15:52:22.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.542+0000 7f9ed8d9c640 1 --2- 172.21.15.132:0/715910480 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ecc0e3260 0x7f9ecc0ceeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:52:22.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.542+0000 7f6a777fe640 1 --2- 172.21.15.132:0/2775481401 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f6a5c06c9c0 0x7f6a5c06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:22.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.542+0000 7f3a4bfff640 1 --2- 172.21.15.132:0/3551887382 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f3a3006c920 0x7f3a3006ede0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3a38001570 tx=0x7f3a380079c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:22.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.542+0000 7fbb43035640 1 -- 172.21.15.132:0/3187023625 shutdown_connections 2024-04-16T15:52:22.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.542+0000 7fbb43035640 1 -- 172.21.15.132:0/3187023625 >> 172.21.15.132:0/3187023625 conn(0x7fbb3c0b23e0 msgr2=0x7fbb3c0b27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:22.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.543+0000 7fbb43035640 1 -- 172.21.15.132:0/3187023625 shutdown_connections 2024-04-16T15:52:22.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.543+0000 7fbb43035640 1 -- 172.21.15.132:0/3187023625 wait complete. 2024-04-16T15:52:22.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.543+0000 7f7a8affd640 1 -- 172.21.15.132:0/2220961388 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7a8c047020 con 0x7f7a940b6c90 2024-04-16T15:52:22.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.543+0000 7f9ed37fe640 1 --2- 172.21.15.132:0/715910480 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ecc0531b0 0x7f9ecc0ce610 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9ec800e850 tx=0x7f9ec800ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:22.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.543+0000 7f6a777fe640 1 --2- 172.21.15.132:0/2775481401 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f6a5c06c9c0 0x7f6a5c06ee80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6a700e0f10 tx=0x7f6a64008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:22.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.543+0000 7f9ed0ff9640 1 -- 172.21.15.132:0/715910480 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec8017070 con 0x7f9ecc0531b0 2024-04-16T15:52:22.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.543+0000 7f9ed0ff9640 1 -- 172.21.15.132:0/715910480 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ec800c940 con 0x7f9ecc0531b0 2024-04-16T15:52:22.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.543+0000 7f9ed0ff9640 1 -- 172.21.15.132:0/715910480 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec800cd10 con 0x7f9ecc0531b0 2024-04-16T15:52:22.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.543+0000 7f9ed959d640 1 -- 172.21.15.132:0/715910480 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ecc0e5320 con 0x7f9ecc0531b0 2024-04-16T15:52:22.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.543+0000 7efcd7238640 1 -- 172.21.15.132:0/3572095154 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcc8005390 con 0x7efcc8006b50 2024-04-16T15:52:22.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.543+0000 7f7a8affd640 1 --2- 172.21.15.132:0/2220961388 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f7a7806c940 0x7f7a7806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:22.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.543+0000 7efcc6ffd640 1 -- 172.21.15.132:0/3572095154 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efccc03c9b0 con 0x7efcc8006b50 2024-04-16T15:52:22.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.544+0000 7efcc6ffd640 1 --2- 172.21.15.132:0/3572095154 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7efcb406c9c0 0x7efcb406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:22.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.544+0000 7efcc6ffd640 1 -- 172.21.15.132:0/3572095154 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7efccc0b68d0 con 0x7efcc8006b50 2024-04-16T15:52:22.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.544+0000 7efcd5a35640 1 --2- 172.21.15.132:0/3572095154 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7efcb406c9c0 0x7efcb406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:22.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.543+0000 7f7a8affd640 1 -- 172.21.15.132:0/2220961388 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7a8c02ce00 con 0x7f7a940b6c90 2024-04-16T15:52:22.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.543+0000 7f7a9a503640 1 --2- 172.21.15.132:0/2220961388 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f7a7806c940 0x7f7a7806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:22.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.544+0000 7f7a9a503640 1 --2- 172.21.15.132:0/2220961388 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f7a7806c940 0x7f7a7806ee00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7a90009a40 tx=0x7f7a90008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:22.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.544+0000 7f9ed959d640 1 -- 172.21.15.132:0/715910480 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ecc0e58e0 con 0x7f9ecc0531b0 2024-04-16T15:52:22.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.544+0000 7efcd5a35640 1 --2- 172.21.15.132:0/3572095154 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7efcb406c9c0 0x7efcb406ee80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7efcc8054dd0 tx=0x7efcc0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:22.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.545+0000 7fbb43035640 1 Processor -- start 2024-04-16T15:52:22.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.545+0000 7fbb43035640 1 -- start start 2024-04-16T15:52:22.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.545+0000 7f9ed959d640 1 -- 172.21.15.132:0/715910480 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ecc005390 con 0x7f9ecc0531b0 2024-04-16T15:52:22.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.545+0000 7f9ed0ff9640 1 -- 172.21.15.132:0/715910480 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9ec801a070 con 0x7f9ecc0531b0 2024-04-16T15:52:22.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.545+0000 7f6a63fff640 1 -- 172.21.15.132:0/2775481401 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6a6c01f020 con 0x7f6a7004b3c0 2024-04-16T15:52:22.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.546+0000 7f9ed0ff9640 1 --2- 172.21.15.132:0/715910480 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f9eb806c8f0 0x7f9eb806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:22.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.546+0000 7f9ed3fff640 1 --2- 172.21.15.132:0/715910480 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f9eb806c8f0 0x7f9eb806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:22.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.546+0000 7f9ed0ff9640 1 -- 172.21.15.132:0/715910480 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9ec808be60 con 0x7f9ecc0531b0 2024-04-16T15:52:22.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.546+0000 7f9ed3fff640 1 --2- 172.21.15.132:0/715910480 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f9eb806c8f0 0x7f9eb806edb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9ec000ba10 tx=0x7f9ec0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:22.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.547+0000 7f7a8affd640 1 -- 172.21.15.132:0/2220961388 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7a8c04e030 con 0x7f7a940b6c90 2024-04-16T15:52:22.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.547+0000 7fbb43035640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb24004800 0x7fbb3c15add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:22.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.547+0000 7fbb43035640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb3c16a620 0x7fbb3c0ace20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:22.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.547+0000 7fbb43035640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb3c0ac040 0x7fbb3c0d0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:22.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.547+0000 7fbb40dd1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb24004800 0x7fbb3c15add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:22.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.547+0000 7fbb40dd1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb24004800 0x7fbb3c15add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.132:48092/0 (socket says 172.21.15.132:48092) 2024-04-16T15:52:22.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.547+0000 7fbb33fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb3c16a620 0x7fbb3c0ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:22.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.547+0000 7fbb33fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb3c16a620 0x7fbb3c0ace20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.132:40838/0 (socket says 172.21.15.132:40838) 2024-04-16T15:52:22.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.547+0000 7fbb415d2640 1 --2- 172.21.15.132:0/3565392931 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb3c0ac040 0x7fbb3c0d0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:22.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.547+0000 7fbb40dd1640 1 -- 172.21.15.132:0/3565392931 learned_addr learned my addr 172.21.15.132:0/3565392931 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:22.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.547+0000 7fbb43035640 1 -- 172.21.15.132:0/3565392931 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fbb3c06f4d0 con 0x7fbb3c0ac040 2024-04-16T15:52:22.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.547+0000 7fbb43035640 1 -- 172.21.15.132:0/3565392931 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fbb3c06f350 con 0x7fbb3c16a620 2024-04-16T15:52:22.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.547+0000 7fbb43035640 1 -- 172.21.15.132:0/3565392931 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fbb3c06bce0 con 0x7fbb24004800 2024-04-16T15:52:22.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.548+0000 7fbb415d2640 1 -- 172.21.15.132:0/3565392931 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb24004800 msgr2=0x7fbb3c15add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:22.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.548+0000 7fbb415d2640 1 --2- 172.21.15.132:0/3565392931 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb24004800 0x7fbb3c15add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.548+0000 7fbb415d2640 1 -- 172.21.15.132:0/3565392931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb3c16a620 msgr2=0x7fbb3c0ace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:22.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.548+0000 7fbb415d2640 1 --2- 172.21.15.132:0/3565392931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb3c16a620 0x7fbb3c0ace20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.548+0000 7fbb415d2640 1 -- 172.21.15.132:0/3565392931 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb3c15b670 con 0x7fbb3c0ac040 2024-04-16T15:52:22.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.548+0000 7fbb40dd1640 1 --2- 172.21.15.132:0/3565392931 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb24004800 0x7fbb3c15add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:52:22.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.548+0000 7fbb33fff640 1 --2- 172.21.15.132:0/3565392931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb3c16a620 0x7fbb3c0ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:52:22.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.548+0000 7fbb415d2640 1 --2- 172.21.15.132:0/3565392931 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb3c0ac040 0x7fbb3c0d0630 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c06c8c0 tx=0x7fbb3400ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:22.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.550+0000 7f3a48ff9640 1 -- 172.21.15.132:0/3551887382 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3a4c0f7690 con 0x7f3a44053e50 2024-04-16T15:52:22.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.551+0000 7efcc6ffd640 1 -- 172.21.15.132:0/3572095154 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7efccc084720 con 0x7efcc8006b50 2024-04-16T15:52:22.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.554+0000 7f01a27fc640 1 -- 172.21.15.132:0/50793253 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f01a40dcb80 con 0x7f01ac1601d0 2024-04-16T15:52:22.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.556+0000 7f9ed0ff9640 1 -- 172.21.15.132:0/715910480 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9ec8059ba0 con 0x7f9ecc0531b0 2024-04-16T15:52:22.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.555+0000 7fbb317fa640 1 -- 172.21.15.132:0/3565392931 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb3401b070 con 0x7fbb3c0ac040 2024-04-16T15:52:22.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.555+0000 7fbb317fa640 1 -- 172.21.15.132:0/3565392931 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb3400cb80 con 0x7fbb3c0ac040 2024-04-16T15:52:22.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.555+0000 7fbb43035640 1 -- 172.21.15.132:0/3565392931 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb3c15b950 con 0x7fbb3c0ac040 2024-04-16T15:52:22.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.556+0000 7fbb317fa640 1 -- 172.21.15.132:0/3565392931 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb34016410 con 0x7fbb3c0ac040 2024-04-16T15:52:22.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.556+0000 7fbb43035640 1 -- 172.21.15.132:0/3565392931 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb3c15bf10 con 0x7fbb3c0ac040 2024-04-16T15:52:22.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.557+0000 7fbb43035640 1 -- 172.21.15.132:0/3565392931 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb3c075510 con 0x7fbb3c0ac040 2024-04-16T15:52:22.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.559+0000 7fbb317fa640 1 -- 172.21.15.132:0/3565392931 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbb34005d10 con 0x7fbb3c0ac040 2024-04-16T15:52:22.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.559+0000 7fbb317fa640 1 --2- 172.21.15.132:0/3565392931 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fbb2806c9f0 0x7fbb2806eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:22.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.560+0000 7fbb317fa640 1 -- 172.21.15.132:0/3565392931 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fbb3408bb40 con 0x7fbb3c0ac040 2024-04-16T15:52:22.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.566+0000 7fbb40dd1640 1 --2- 172.21.15.132:0/3565392931 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fbb2806c9f0 0x7fbb2806eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:22.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.567+0000 7fbb40dd1640 1 --2- 172.21.15.132:0/3565392931 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fbb2806c9f0 0x7fbb2806eeb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbb38000ff0 tx=0x7fbb38009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:22.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.571+0000 7fbb317fa640 1 -- 172.21.15.132:0/3565392931 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbb34059f50 con 0x7fbb3c0ac040 2024-04-16T15:52:22.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.901+0000 7f1ed761b640 1 -- 172.21.15.132:0/322779455 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f1eb0005580 con 0x7f1ed006bce0 2024-04-16T15:52:22.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.902+0000 7f1ec5ffb640 1 -- 172.21.15.132:0/322779455 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1ecc06b0a0 con 0x7f1ed006bce0 2024-04-16T15:52:22.901 INFO:teuthology.orchestra.run.smithi132.stdout:55834574853 2024-04-16T15:52:22.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.905+0000 7f1ebb7fe640 1 -- 172.21.15.132:0/322779455 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f1ebc06cb00 msgr2=0x7f1ebc06efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:22.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.905+0000 7f1ebb7fe640 1 --2- 172.21.15.132:0/322779455 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f1ebc06cb00 0x7f1ebc06efc0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1ec0035000 tx=0x7f1ec0030000 comp rx=0 tx=0).stop 2024-04-16T15:52:22.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.905+0000 7f1ebb7fe640 1 -- 172.21.15.132:0/322779455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ed006bce0 msgr2=0x7f1ed0153df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:22.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.905+0000 7f1ebb7fe640 1 --2- 172.21.15.132:0/322779455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ed006bce0 0x7f1ed0153df0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc010f60 tx=0x7f1ecc010f90 comp rx=0 tx=0).stop 2024-04-16T15:52:22.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.906+0000 7f1ebb7fe640 1 -- 172.21.15.132:0/322779455 shutdown_connections 2024-04-16T15:52:22.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.906+0000 7f1ebb7fe640 1 --2- 172.21.15.132:0/322779455 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f1ebc06cb00 0x7f1ebc06efc0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.906+0000 7f1ebb7fe640 1 --2- 172.21.15.132:0/322779455 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ed0151dd0 0x7f1ed0167570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.906+0000 7f1ebb7fe640 1 --2- 172.21.15.132:0/322779455 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ed006c0c0 0x7f1ed0154330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.906+0000 7f1ebb7fe640 1 --2- 172.21.15.132:0/322779455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ed006bce0 0x7f1ed0153df0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.906+0000 7f1ebb7fe640 1 -- 172.21.15.132:0/322779455 >> 172.21.15.132:0/322779455 conn(0x7f1ed00b23e0 msgr2=0x7f1ed008b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:22.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.906+0000 7f1ebb7fe640 1 -- 172.21.15.132:0/322779455 shutdown_connections 2024-04-16T15:52:22.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.906+0000 7f1ebb7fe640 1 -- 172.21.15.132:0/322779455 wait complete. 2024-04-16T15:52:22.923 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.2 2024-04-16T15:52:22.923 DEBUG:teuthology.parallel:result is None 2024-04-16T15:52:22.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.942+0000 7f01b2cc2640 1 -- 172.21.15.132:0/50793253 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f01ac0b4dd0 con 0x7f01ac1601d0 2024-04-16T15:52:22.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.942+0000 7f01a27fc640 1 -- 172.21.15.132:0/50793253 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f01a4082070 con 0x7f01ac1601d0 2024-04-16T15:52:22.942 INFO:teuthology.orchestra.run.smithi132.stdout:55834574854 2024-04-16T15:52:22.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.945+0000 7f01b2cc2640 1 -- 172.21.15.132:0/50793253 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f019006c9c0 msgr2=0x7f019006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:22.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.945+0000 7f01b2cc2640 1 --2- 172.21.15.132:0/50793253 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f019006c9c0 0x7f019006ee80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f01a80077e0 tx=0x7f01a8000f10 comp rx=0 tx=0).stop 2024-04-16T15:52:22.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.945+0000 7f01b2cc2640 1 -- 172.21.15.132:0/50793253 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01ac1601d0 msgr2=0x7f01ac153600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:22.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.945+0000 7f01b2cc2640 1 --2- 172.21.15.132:0/50793253 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01ac1601d0 0x7f01ac153600 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f01a4033000 tx=0x7f01a4004a40 comp rx=0 tx=0).stop 2024-04-16T15:52:22.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.945+0000 7f01b2cc2640 1 -- 172.21.15.132:0/50793253 shutdown_connections 2024-04-16T15:52:22.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.945+0000 7f01b2cc2640 1 --2- 172.21.15.132:0/50793253 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f019006c9c0 0x7f019006ee80 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.945+0000 7f01b2cc2640 1 --2- 172.21.15.132:0/50793253 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01ac1601d0 0x7f01ac153600 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.945+0000 7f01b2cc2640 1 --2- 172.21.15.132:0/50793253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01ac15fdf0 0x7f01ac156040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.945+0000 7f01b2cc2640 1 --2- 172.21.15.132:0/50793253 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01ac071dc0 0x7f01ac06d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.945+0000 7f01b2cc2640 1 -- 172.21.15.132:0/50793253 >> 172.21.15.132:0/50793253 conn(0x7f01ac0b4050 msgr2=0x7f01ac0cf980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:22.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.945+0000 7f01b2cc2640 1 -- 172.21.15.132:0/50793253 shutdown_connections 2024-04-16T15:52:22.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.946+0000 7f01b2cc2640 1 -- 172.21.15.132:0/50793253 wait complete. 2024-04-16T15:52:22.957 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2024-04-16T15:52:22.958 DEBUG:teuthology.parallel:result is None 2024-04-16T15:52:22.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.967+0000 7f6a7ca38640 1 -- 172.21.15.132:0/2775481401 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f6a70054010 con 0x7f6a7004b3c0 2024-04-16T15:52:22.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.969+0000 7f6a63fff640 1 -- 172.21.15.132:0/2775481401 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6a6c0172c0 con 0x7f6a7004b3c0 2024-04-16T15:52:22.968 INFO:teuthology.orchestra.run.smithi132.stdout:55834574855 2024-04-16T15:52:22.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.971+0000 7f7a88ff9640 1 -- 172.21.15.132:0/2220961388 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f7a9415f820 con 0x7f7a940b6c90 2024-04-16T15:52:22.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.971+0000 7f3a367fc640 1 -- 172.21.15.132:0/3551887382 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f3a44007410 con 0x7f3a44053e50 2024-04-16T15:52:22.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.972+0000 7f6a7ca38640 1 -- 172.21.15.132:0/2775481401 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f6a5c06c9c0 msgr2=0x7f6a5c06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:22.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.972+0000 7f6a7ca38640 1 --2- 172.21.15.132:0/2775481401 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f6a5c06c9c0 0x7f6a5c06ee80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6a700e0f10 tx=0x7f6a64008040 comp rx=0 tx=0).stop 2024-04-16T15:52:22.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.972+0000 7f6a7ca38640 1 -- 172.21.15.132:0/2775481401 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a7004b3c0 msgr2=0x7f6a700d6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:22.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.972+0000 7f6a7ca38640 1 --2- 172.21.15.132:0/2775481401 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a7004b3c0 0x7f6a700d6750 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c00b3f0 tx=0x7f6a6c00b8b0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.972+0000 7f6a7ca38640 1 -- 172.21.15.132:0/2775481401 shutdown_connections 2024-04-16T15:52:22.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.972+0000 7f7a8affd640 1 -- 172.21.15.132:0/2220961388 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7a8c07c7d0 con 0x7f7a940b6c90 2024-04-16T15:52:22.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.972+0000 7f3a48ff9640 1 -- 172.21.15.132:0/3551887382 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3a4c0f6f90 con 0x7f3a44053e50 2024-04-16T15:52:22.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.972+0000 7f6a7ca38640 1 --2- 172.21.15.132:0/2775481401 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f6a5c06c9c0 0x7f6a5c06ee80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.972+0000 7f6a7ca38640 1 --2- 172.21.15.132:0/2775481401 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a7004f4d0 0x7f6a70049ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.972+0000 7f6a7ca38640 1 --2- 172.21.15.132:0/2775481401 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a7004b3c0 0x7f6a700d6750 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.972+0000 7f6a7ca38640 1 --2- 172.21.15.132:0/2775481401 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a70006a50 0x7f6a700e8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.972+0000 7f6a7ca38640 1 -- 172.21.15.132:0/2775481401 >> 172.21.15.132:0/2775481401 conn(0x7f6a7000a400 msgr2=0x7f6a7004f950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:22.973 INFO:teuthology.orchestra.run.smithi132.stdout:55834574854 2024-04-16T15:52:22.974 INFO:teuthology.orchestra.run.smithi132.stdout:55834574855 2024-04-16T15:52:22.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.972+0000 7f6a7ca38640 1 -- 172.21.15.132:0/2775481401 shutdown_connections 2024-04-16T15:52:22.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.972+0000 7f6a7ca38640 1 -- 172.21.15.132:0/2775481401 wait complete. 2024-04-16T15:52:22.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.973+0000 7efcd7238640 1 -- 172.21.15.132:0/3572095154 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7efcc801f450 con 0x7efcc8006b50 2024-04-16T15:52:22.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.974+0000 7efcc6ffd640 1 -- 172.21.15.132:0/3572095154 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efccc088a20 con 0x7efcc8006b50 2024-04-16T15:52:22.975 INFO:teuthology.orchestra.run.smithi132.stdout:55834574855 2024-04-16T15:52:22.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.975+0000 7f3a367fc640 1 -- 172.21.15.132:0/3551887382 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f3a3006c920 msgr2=0x7f3a3006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:22.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.975+0000 7f3a367fc640 1 --2- 172.21.15.132:0/3551887382 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f3a3006c920 0x7f3a3006ede0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3a38001570 tx=0x7f3a380079c0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.975+0000 7f3a367fc640 1 -- 172.21.15.132:0/3551887382 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a44053e50 msgr2=0x7f3a440e8410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:22.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.975+0000 7f3a367fc640 1 --2- 172.21.15.132:0/3551887382 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a44053e50 0x7f3a440e8410 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c02dbb0 tx=0x7f3a4c076d10 comp rx=0 tx=0).stop 2024-04-16T15:52:22.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.975+0000 7f7a88ff9640 1 -- 172.21.15.132:0/2220961388 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f7a7806c940 msgr2=0x7f7a7806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:22.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.975+0000 7f7a88ff9640 1 --2- 172.21.15.132:0/2220961388 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f7a7806c940 0x7f7a7806ee00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7a90009a40 tx=0x7f7a90008040 comp rx=0 tx=0).stop 2024-04-16T15:52:22.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.975+0000 7f7a88ff9640 1 -- 172.21.15.132:0/2220961388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a940b6c90 msgr2=0x7f7a940b4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:22.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.975+0000 7f7a88ff9640 1 --2- 172.21.15.132:0/2220961388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a940b6c90 0x7f7a940b4220 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7a94071ad0 tx=0x7f7a8c004a40 comp rx=0 tx=0).stop 2024-04-16T15:52:22.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.976+0000 7f3a367fc640 1 -- 172.21.15.132:0/3551887382 shutdown_connections 2024-04-16T15:52:22.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.976+0000 7f3a367fc640 1 --2- 172.21.15.132:0/3551887382 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f3a3006c920 0x7f3a3006ede0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.976+0000 7f3a367fc640 1 --2- 172.21.15.132:0/3551887382 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a44053e50 0x7f3a440e8410 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.976+0000 7f3a367fc640 1 --2- 172.21.15.132:0/3551887382 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3a44050040 0x7f3a44037130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.976+0000 7f3a367fc640 1 --2- 172.21.15.132:0/3551887382 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a44048100 0x7f3a44188d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.976+0000 7f3a367fc640 1 -- 172.21.15.132:0/3551887382 >> 172.21.15.132:0/3551887382 conn(0x7f3a44009fe0 msgr2=0x7f3a4404df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:22.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.976+0000 7f7a88ff9640 1 -- 172.21.15.132:0/2220961388 shutdown_connections 2024-04-16T15:52:22.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.976+0000 7f7a88ff9640 1 --2- 172.21.15.132:0/2220961388 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f7a7806c940 0x7f7a7806ee00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.976+0000 7f7a88ff9640 1 --2- 172.21.15.132:0/2220961388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a940b6c90 0x7f7a940b4220 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.976+0000 7f7a88ff9640 1 --2- 172.21.15.132:0/2220961388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a9415eb80 0x7f7a940b6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.976+0000 7f7a88ff9640 1 --2- 172.21.15.132:0/2220961388 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a94070780 0x7f7a941fb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.976+0000 7f7a88ff9640 1 -- 172.21.15.132:0/2220961388 >> 172.21.15.132:0/2220961388 conn(0x7f7a9409aa30 msgr2=0x7f7a940b3490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:22.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.976+0000 7f3a367fc640 1 -- 172.21.15.132:0/3551887382 shutdown_connections 2024-04-16T15:52:22.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.976+0000 7f3a367fc640 1 -- 172.21.15.132:0/3551887382 wait complete. 2024-04-16T15:52:22.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.976+0000 7f7a88ff9640 1 -- 172.21.15.132:0/2220961388 shutdown_connections 2024-04-16T15:52:22.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.976+0000 7f7a88ff9640 1 -- 172.21.15.132:0/2220961388 wait complete. 2024-04-16T15:52:22.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.977+0000 7efcd7238640 1 -- 172.21.15.132:0/3572095154 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7efcb406c9c0 msgr2=0x7efcb406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:22.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.977+0000 7efcd7238640 1 --2- 172.21.15.132:0/3572095154 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7efcb406c9c0 0x7efcb406ee80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7efcc8054dd0 tx=0x7efcc0009040 comp rx=0 tx=0).stop 2024-04-16T15:52:22.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.977+0000 7efcd7238640 1 -- 172.21.15.132:0/3572095154 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efcc8006b50 msgr2=0x7efcc80de130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:22.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.977+0000 7efcd7238640 1 --2- 172.21.15.132:0/3572095154 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efcc8006b50 0x7efcc80de130 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efccc0346f0 tx=0x7efccc0046c0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.977+0000 7efcd7238640 1 -- 172.21.15.132:0/3572095154 shutdown_connections 2024-04-16T15:52:22.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.977+0000 7efcd7238640 1 --2- 172.21.15.132:0/3572095154 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7efcb406c9c0 0x7efcb406ee80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.977+0000 7efcd7238640 1 --2- 172.21.15.132:0/3572095154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efcc8052ce0 0x7efcc80e4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.977+0000 7efcd7238640 1 --2- 172.21.15.132:0/3572095154 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efcc8036f90 0x7efcc80e0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.977+0000 7efcd7238640 1 --2- 172.21.15.132:0/3572095154 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efcc8006b50 0x7efcc80de130 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.977+0000 7efcd7238640 1 -- 172.21.15.132:0/3572095154 >> 172.21.15.132:0/3572095154 conn(0x7efcc801ef70 msgr2=0x7efcc8055300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:22.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.978+0000 7efcd7238640 1 -- 172.21.15.132:0/3572095154 shutdown_connections 2024-04-16T15:52:22.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.978+0000 7efcd7238640 1 -- 172.21.15.132:0/3572095154 wait complete. 2024-04-16T15:52:22.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.979+0000 7f9ed959d640 1 -- 172.21.15.132:0/715910480 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f9ecc04f8c0 con 0x7f9ecc0531b0 2024-04-16T15:52:22.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.981+0000 7f9ed0ff9640 1 -- 172.21.15.132:0/715910480 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9ec805dea0 con 0x7f9ecc0531b0 2024-04-16T15:52:22.981 INFO:teuthology.orchestra.run.smithi132.stdout:55834574855 2024-04-16T15:52:22.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.985+0000 7f9ed959d640 1 -- 172.21.15.132:0/715910480 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f9eb806c8f0 msgr2=0x7f9eb806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:22.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.985+0000 7f9ed959d640 1 --2- 172.21.15.132:0/715910480 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f9eb806c8f0 0x7f9eb806edb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9ec000ba10 tx=0x7f9ec0008040 comp rx=0 tx=0).stop 2024-04-16T15:52:22.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.985+0000 7f9ed959d640 1 -- 172.21.15.132:0/715910480 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ecc0531b0 msgr2=0x7f9ecc0ce610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:22.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.985+0000 7f9ed959d640 1 --2- 172.21.15.132:0/715910480 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ecc0531b0 0x7f9ecc0ce610 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9ec800e850 tx=0x7f9ec800ed10 comp rx=0 tx=0).stop 2024-04-16T15:52:22.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.985+0000 7f9ed959d640 1 -- 172.21.15.132:0/715910480 shutdown_connections 2024-04-16T15:52:22.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.985+0000 7f9ed959d640 1 --2- 172.21.15.132:0/715910480 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f9eb806c8f0 0x7f9eb806edb0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.985+0000 7f9ed959d640 1 --2- 172.21.15.132:0/715910480 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ecc0e3260 0x7f9ecc0ceeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.985+0000 7f9ed959d640 1 --2- 172.21.15.132:0/715910480 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ecc0531b0 0x7f9ecc0ce610 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.985+0000 7f9ed959d640 1 --2- 172.21.15.132:0/715910480 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ecc04fdb0 0x7f9ecc0e5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.985+0000 7f9ed959d640 1 -- 172.21.15.132:0/715910480 >> 172.21.15.132:0/715910480 conn(0x7f9ecc009fb0 msgr2=0x7f9ecc035360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:22.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.985+0000 7f9ed959d640 1 -- 172.21.15.132:0/715910480 shutdown_connections 2024-04-16T15:52:22.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.985+0000 7f9ed959d640 1 -- 172.21.15.132:0/715910480 wait complete. 2024-04-16T15:52:22.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.989+0000 7fbb43035640 1 -- 172.21.15.132:0/3565392931 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fbb3c16eb90 con 0x7fbb3c0ac040 2024-04-16T15:52:22.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.989+0000 7fbb317fa640 1 -- 172.21.15.132:0/3565392931 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbb34059850 con 0x7fbb3c0ac040 2024-04-16T15:52:22.988 INFO:teuthology.orchestra.run.smithi132.stdout:55834574854 2024-04-16T15:52:22.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.992+0000 7fbb43035640 1 -- 172.21.15.132:0/3565392931 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fbb2806c9f0 msgr2=0x7fbb2806eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:22.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.992+0000 7fbb43035640 1 --2- 172.21.15.132:0/3565392931 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fbb2806c9f0 0x7fbb2806eeb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbb38000ff0 tx=0x7fbb38009040 comp rx=0 tx=0).stop 2024-04-16T15:52:22.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.992+0000 7fbb43035640 1 -- 172.21.15.132:0/3565392931 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb3c0ac040 msgr2=0x7fbb3c0d0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:22.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.992+0000 7fbb43035640 1 --2- 172.21.15.132:0/3565392931 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb3c0ac040 0x7fbb3c0d0630 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c06c8c0 tx=0x7fbb3400ef10 comp rx=0 tx=0).stop 2024-04-16T15:52:22.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.992+0000 7fbb43035640 1 -- 172.21.15.132:0/3565392931 shutdown_connections 2024-04-16T15:52:22.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.992+0000 7fbb43035640 1 --2- 172.21.15.132:0/3565392931 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fbb2806c9f0 0x7fbb2806eeb0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.992+0000 7fbb43035640 1 --2- 172.21.15.132:0/3565392931 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb3c0ac040 0x7fbb3c0d0630 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.992+0000 7fbb43035640 1 --2- 172.21.15.132:0/3565392931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb3c16a620 0x7fbb3c0ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.992+0000 7fbb43035640 1 --2- 172.21.15.132:0/3565392931 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb24004800 0x7fbb3c15add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:22.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.992+0000 7fbb43035640 1 -- 172.21.15.132:0/3565392931 >> 172.21.15.132:0/3565392931 conn(0x7fbb3c0b23e0 msgr2=0x7fbb3c06ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:22.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.992+0000 7fbb43035640 1 -- 172.21.15.132:0/3565392931 shutdown_connections 2024-04-16T15:52:22.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:22.992+0000 7fbb43035640 1 -- 172.21.15.132:0/3565392931 wait complete. 2024-04-16T15:52:22.992 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.0 2024-04-16T15:52:22.993 DEBUG:teuthology.parallel:result is None 2024-04-16T15:52:22.998 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2024-04-16T15:52:22.998 DEBUG:teuthology.parallel:result is None 2024-04-16T15:52:22.999 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2024-04-16T15:52:22.999 DEBUG:teuthology.parallel:result is None 2024-04-16T15:52:23.000 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2024-04-16T15:52:23.000 DEBUG:teuthology.parallel:result is None 2024-04-16T15:52:23.001 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2024-04-16T15:52:23.001 DEBUG:teuthology.parallel:result is None 2024-04-16T15:52:23.004 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2024-04-16T15:52:23.004 DEBUG:teuthology.parallel:result is None 2024-04-16T15:52:23.004 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-16T15:52:23.004 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T15:52:23.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.148+0000 7f0817a31640 1 Processor -- start 2024-04-16T15:52:23.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.148+0000 7f0817a31640 1 -- start start 2024-04-16T15:52:23.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.149+0000 7f0817a31640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f081009aa30 0x7f081006cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:23.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.149+0000 7f0817a31640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f081015ede0 0x7f081009ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:23.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.149+0000 7f0817a31640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f081009b350 con 0x7f081006df50 2024-04-16T15:52:23.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.149+0000 7f0817a31640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f08100b1c00 con 0x7f081009aa30 2024-04-16T15:52:23.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.149+0000 7f0817a31640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f08100cd530 con 0x7f081015ede0 2024-04-16T15:52:23.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.149+0000 7f08157cd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f081009aa30 0x7f081006cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:23.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.149+0000 7f08157cd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f081009aa30 0x7f081006cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35326/0 (socket says 172.21.15.132:35326) 2024-04-16T15:52:23.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.149+0000 7f08157cd640 1 -- 172.21.15.132:0/4243246295 learned_addr learned my addr 172.21.15.132:0/4243246295 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:23.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.149+0000 7f0814fcc640 1 --2- 172.21.15.132:0/4243246295 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f081015ede0 0x7f081009ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:23.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.149+0000 7f08157cd640 1 -- 172.21.15.132:0/4243246295 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f081015ede0 msgr2=0x7f081009ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:23.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.149+0000 7f08157cd640 1 --2- 172.21.15.132:0/4243246295 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f081015ede0 0x7f081009ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:23.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.149+0000 7f08157cd640 1 -- 172.21.15.132:0/4243246295 >> v1:172.21.15.179:6789/0 conn(0x7f081006df50 legacy=0x7f08100cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:23.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.149+0000 7f08157cd640 1 -- 172.21.15.132:0/4243246295 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08100d1fe0 con 0x7f081009aa30 2024-04-16T15:52:23.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.149+0000 7f0814fcc640 1 --2- 172.21.15.132:0/4243246295 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f081015ede0 0x7f081009ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:52:23.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.150+0000 7f08157cd640 1 --2- 172.21.15.132:0/4243246295 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f081009aa30 0x7f081006cd40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f080c009e50 tx=0x7f080c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1c418a61b4ec51b server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:23.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.150+0000 7f0807fff640 1 -- 172.21.15.132:0/4243246295 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f080c02ca70 con 0x7f081009aa30 2024-04-16T15:52:23.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.150+0000 7f0807fff640 1 -- 172.21.15.132:0/4243246295 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f080c02cc10 con 0x7f081009aa30 2024-04-16T15:52:23.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.150+0000 7f0807fff640 1 -- 172.21.15.132:0/4243246295 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f080c0343f0 con 0x7f081009aa30 2024-04-16T15:52:23.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.151+0000 7f0817a31640 1 -- 172.21.15.132:0/4243246295 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f081009aa30 msgr2=0x7f081006cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:23.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.151+0000 7f0817a31640 1 --2- 172.21.15.132:0/4243246295 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f081009aa30 0x7f081006cd40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f080c009e50 tx=0x7f080c02bed0 comp rx=0 tx=0).stop 2024-04-16T15:52:23.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.151+0000 7f0817a31640 1 -- 172.21.15.132:0/4243246295 shutdown_connections 2024-04-16T15:52:23.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.151+0000 7f0817a31640 1 --2- 172.21.15.132:0/4243246295 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f081015ede0 0x7f081009ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:23.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.151+0000 7f0817a31640 1 --2- 172.21.15.132:0/4243246295 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f081009aa30 0x7f081006cd40 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:23.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.151+0000 7f0817a31640 1 -- 172.21.15.132:0/4243246295 >> 172.21.15.132:0/4243246295 conn(0x7f08100b41e0 msgr2=0x7f08100b45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:23.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.151+0000 7f0817a31640 1 -- 172.21.15.132:0/4243246295 shutdown_connections 2024-04-16T15:52:23.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.151+0000 7f0817a31640 1 -- 172.21.15.132:0/4243246295 wait complete. 2024-04-16T15:52:23.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.152+0000 7f0817a31640 1 Processor -- start 2024-04-16T15:52:23.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.152+0000 7f0817a31640 1 -- start start 2024-04-16T15:52:23.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.153+0000 7f0817a31640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f081006df50 0x7f0810158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:23.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.153+0000 7f0817a31640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f081009aa30 0x7f08101616c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:23.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.153+0000 7f0817a31640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0810161c00 0x7f08100b6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:23.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.153+0000 7f0817a31640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f08100d1b00 con 0x7f081006df50 2024-04-16T15:52:23.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.153+0000 7f0817a31640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f08100cd1c0 con 0x7f081009aa30 2024-04-16T15:52:23.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.153+0000 7f0817a31640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f08100d1c80 con 0x7f0810161c00 2024-04-16T15:52:23.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.153+0000 7f08157cd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f081006df50 0x7f0810158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:23.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.153+0000 7f08157cd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f081006df50 0x7f0810158ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35338/0 (socket says 172.21.15.132:35338) 2024-04-16T15:52:23.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.153+0000 7f08157cd640 1 -- 172.21.15.132:0/3906470640 learned_addr learned my addr 172.21.15.132:0/3906470640 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:23.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.153+0000 7f0814fcc640 1 --2- 172.21.15.132:0/3906470640 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f081009aa30 0x7f08101616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:23.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.153+0000 7f0815fce640 1 --2- 172.21.15.132:0/3906470640 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0810161c00 0x7f08100b6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:23.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.153+0000 7f08157cd640 1 -- 172.21.15.132:0/3906470640 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0810161c00 msgr2=0x7f08100b6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:23.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.153+0000 7f08157cd640 1 --2- 172.21.15.132:0/3906470640 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0810161c00 0x7f08100b6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:23.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.153+0000 7f08157cd640 1 -- 172.21.15.132:0/3906470640 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f081009aa30 msgr2=0x7f08101616c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:23.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.153+0000 7f08157cd640 1 --2- 172.21.15.132:0/3906470640 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f081009aa30 0x7f08101616c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:23.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.153+0000 7f08157cd640 1 -- 172.21.15.132:0/3906470640 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08100b70c0 con 0x7f081006df50 2024-04-16T15:52:23.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.153+0000 7f0814fcc640 1 --2- 172.21.15.132:0/3906470640 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f081009aa30 0x7f08101616c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:23.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.153+0000 7f08157cd640 1 --2- 172.21.15.132:0/3906470640 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f081006df50 0x7f0810158ff0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f080c009e50 tx=0x7f080c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:23.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.154+0000 7f0805ffb640 1 -- 172.21.15.132:0/3906470640 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f080c043020 con 0x7f081006df50 2024-04-16T15:52:23.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.154+0000 7f0805ffb640 1 -- 172.21.15.132:0/3906470640 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f080c03e450 con 0x7f081006df50 2024-04-16T15:52:23.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.154+0000 7f0817a31640 1 -- 172.21.15.132:0/3906470640 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08100b73a0 con 0x7f081006df50 2024-04-16T15:52:23.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.154+0000 7f0805ffb640 1 -- 172.21.15.132:0/3906470640 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f080c03e840 con 0x7f081006df50 2024-04-16T15:52:23.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.154+0000 7f0817a31640 1 -- 172.21.15.132:0/3906470640 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08100b7960 con 0x7f081006df50 2024-04-16T15:52:23.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.155+0000 7f0817a31640 1 -- 172.21.15.132:0/3906470640 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0810071470 con 0x7f081006df50 2024-04-16T15:52:23.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.155+0000 7f0805ffb640 1 -- 172.21.15.132:0/3906470640 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f080c046020 con 0x7f081006df50 2024-04-16T15:52:23.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.155+0000 7f0805ffb640 1 --2- 172.21.15.132:0/3906470640 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f07f406c8f0 0x7f07f406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:23.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.156+0000 7f0814fcc640 1 --2- 172.21.15.132:0/3906470640 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f07f406c8f0 0x7f07f406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:23.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.156+0000 7f0805ffb640 1 -- 172.21.15.132:0/3906470640 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f080c0ae440 con 0x7f081006df50 2024-04-16T15:52:23.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.156+0000 7f0814fcc640 1 --2- 172.21.15.132:0/3906470640 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f07f406c8f0 0x7f07f406edb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f08101f80f0 tx=0x7f0800008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:23.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.160+0000 7f0805ffb640 1 -- 172.21.15.132:0/3906470640 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0810071470 con 0x7f081006df50 2024-04-16T15:52:23.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.334+0000 7f0817a31640 1 -- 172.21.15.132:0/3906470640 --> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f08100c9480 con 0x7f07f406c8f0 2024-04-16T15:52:23.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.340+0000 7f0805ffb640 1 -- 172.21.15.132:0/3906470640 <== mgr.4101 v2:172.21.15.132:6832/3896387465 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251835 (secure 0 0 0) 0x7f08100c9480 con 0x7f07f406c8f0 2024-04-16T15:52:23.342 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:52:23.344 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2024-04-16T15:52:23.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.343+0000 7f0817a31640 1 -- 172.21.15.132:0/3906470640 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f07f406c8f0 msgr2=0x7f07f406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:23.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.343+0000 7f0817a31640 1 --2- 172.21.15.132:0/3906470640 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f07f406c8f0 0x7f07f406edb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f08101f80f0 tx=0x7f0800008040 comp rx=0 tx=0).stop 2024-04-16T15:52:23.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.343+0000 7f0817a31640 1 -- 172.21.15.132:0/3906470640 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f081006df50 msgr2=0x7f0810158ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:23.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.343+0000 7f0817a31640 1 --2- 172.21.15.132:0/3906470640 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f081006df50 0x7f0810158ff0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f080c009e50 tx=0x7f080c004a40 comp rx=0 tx=0).stop 2024-04-16T15:52:23.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.343+0000 7f0817a31640 1 -- 172.21.15.132:0/3906470640 shutdown_connections 2024-04-16T15:52:23.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.343+0000 7f0817a31640 1 --2- 172.21.15.132:0/3906470640 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f07f406c8f0 0x7f07f406edb0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:23.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.343+0000 7f0817a31640 1 --2- 172.21.15.132:0/3906470640 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0810161c00 0x7f08100b6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:23.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.343+0000 7f0817a31640 1 --2- 172.21.15.132:0/3906470640 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f081009aa30 0x7f08101616c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:23.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.343+0000 7f0817a31640 1 --2- 172.21.15.132:0/3906470640 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f081006df50 0x7f0810158ff0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:23.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.343+0000 7f0817a31640 1 -- 172.21.15.132:0/3906470640 >> 172.21.15.132:0/3906470640 conn(0x7f08100b41e0 msgr2=0x7f08100716b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:23.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.343+0000 7f0817a31640 1 -- 172.21.15.132:0/3906470640 shutdown_connections 2024-04-16T15:52:23.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.343+0000 7f0817a31640 1 -- 172.21.15.132:0/3906470640 wait complete. 2024-04-16T15:52:23.353 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-04-16T15:52:23.271351+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":178,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219008,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755712,"statfs":{"total":773094113280,"available":772869849088,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001519"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.863951+0000","last_change":"2024-04-16T15:52:15.966421+0000","last_active":"2024-04-16T15:52:17.863951+0000","last_peered":"2024-04-16T15:52:17.863951+0000","last_clean":"2024-04-16T15:52:17.863951+0000","last_became_active":"2024-04-16T15:52:15.966130+0000","last_became_peered":"2024-04-16T15:52:15.966130+0000","last_unstale":"2024-04-16T15:52:17.863951+0000","last_undegraded":"2024-04-16T15:52:17.863951+0000","last_fullsized":"2024-04-16T15:52:17.863951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:55:42.881235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.953509+0000","last_change":"2024-04-16T15:52:15.960231+0000","last_active":"2024-04-16T15:52:16.953509+0000","last_peered":"2024-04-16T15:52:16.953509+0000","last_clean":"2024-04-16T15:52:16.953509+0000","last_became_active":"2024-04-16T15:52:15.959916+0000","last_became_peered":"2024-04-16T15:52:15.959916+0000","last_unstale":"2024-04-16T15:52:16.953509+0000","last_undegraded":"2024-04-16T15:52:16.953509+0000","last_fullsized":"2024-04-16T15:52:16.953509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:12:51.264278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:18.870909+0000","last_change":"2024-04-16T15:52:15.958351+0000","last_active":"2024-04-16T15:52:18.870909+0000","last_peered":"2024-04-16T15:52:18.870909+0000","last_clean":"2024-04-16T15:52:18.870909+0000","last_became_active":"2024-04-16T15:52:15.956927+0000","last_became_peered":"2024-04-16T15:52:15.956927+0000","last_unstale":"2024-04-16T15:52:18.870909+0000","last_undegraded":"2024-04-16T15:52:18.870909+0000","last_fullsized":"2024-04-16T15:52:18.870909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:26:03.155698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.958233+0000","last_change":"2024-04-16T15:52:15.961429+0000","last_active":"2024-04-16T15:52:16.958233+0000","last_peered":"2024-04-16T15:52:16.958233+0000","last_clean":"2024-04-16T15:52:16.958233+0000","last_became_active":"2024-04-16T15:52:15.961162+0000","last_became_peered":"2024-04-16T15:52:15.961162+0000","last_unstale":"2024-04-16T15:52:16.958233+0000","last_undegraded":"2024-04-16T15:52:16.958233+0000","last_fullsized":"2024-04-16T15:52:16.958233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:43:19.355250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.863627+0000","last_change":"2024-04-16T15:52:15.960864+0000","last_active":"2024-04-16T15:52:17.863627+0000","last_peered":"2024-04-16T15:52:17.863627+0000","last_clean":"2024-04-16T15:52:17.863627+0000","last_became_active":"2024-04-16T15:52:15.960590+0000","last_became_peered":"2024-04-16T15:52:15.960590+0000","last_unstale":"2024-04-16T15:52:17.863627+0000","last_undegraded":"2024-04-16T15:52:17.863627+0000","last_fullsized":"2024-04-16T15:52:17.863627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:49:00.138512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.957714+0000","last_change":"2024-04-16T15:52:15.960295+0000","last_active":"2024-04-16T15:52:16.957714+0000","last_peered":"2024-04-16T15:52:16.957714+0000","last_clean":"2024-04-16T15:52:16.957714+0000","last_became_active":"2024-04-16T15:52:15.959540+0000","last_became_peered":"2024-04-16T15:52:15.959540+0000","last_unstale":"2024-04-16T15:52:16.957714+0000","last_undegraded":"2024-04-16T15:52:16.957714+0000","last_fullsized":"2024-04-16T15:52:16.957714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:31:45.732213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.863425+0000","last_change":"2024-04-16T15:52:15.960729+0000","last_active":"2024-04-16T15:52:17.863425+0000","last_peered":"2024-04-16T15:52:17.863425+0000","last_clean":"2024-04-16T15:52:17.863425+0000","last_became_active":"2024-04-16T15:52:15.960436+0000","last_became_peered":"2024-04-16T15:52:15.960436+0000","last_unstale":"2024-04-16T15:52:17.863425+0000","last_undegraded":"2024-04-16T15:52:17.863425+0000","last_fullsized":"2024-04-16T15:52:17.863425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:31:45.732213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:18.255738+0000","last_change":"2024-04-16T15:52:15.966326+0000","last_active":"2024-04-16T15:52:18.255738+0000","last_peered":"2024-04-16T15:52:18.255738+0000","last_clean":"2024-04-16T15:52:18.255738+0000","last_became_active":"2024-04-16T15:52:15.966012+0000","last_became_peered":"2024-04-16T15:52:15.966012+0000","last_unstale":"2024-04-16T15:52:18.255738+0000","last_undegraded":"2024-04-16T15:52:18.255738+0000","last_fullsized":"2024-04-16T15:52:18.255738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:26:03.155698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.864038+0000","last_change":"2024-04-16T15:52:15.969843+0000","last_active":"2024-04-16T15:52:17.864038+0000","last_peered":"2024-04-16T15:52:17.864038+0000","last_clean":"2024-04-16T15:52:17.864038+0000","last_became_active":"2024-04-16T15:52:15.969569+0000","last_became_peered":"2024-04-16T15:52:15.969569+0000","last_unstale":"2024-04-16T15:52:17.864038+0000","last_undegraded":"2024-04-16T15:52:17.864038+0000","last_fullsized":"2024-04-16T15:52:17.864038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:18.357867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.959521+0000","last_change":"2024-04-16T15:52:15.964277+0000","last_active":"2024-04-16T15:52:17.959521+0000","last_peered":"2024-04-16T15:52:17.959521+0000","last_clean":"2024-04-16T15:52:17.959521+0000","last_became_active":"2024-04-16T15:52:15.963999+0000","last_became_peered":"2024-04-16T15:52:15.963999+0000","last_unstale":"2024-04-16T15:52:17.959521+0000","last_undegraded":"2024-04-16T15:52:17.959521+0000","last_fullsized":"2024-04-16T15:52:17.959521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:06:46.464243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.959461+0000","last_change":"2024-04-16T15:52:15.962038+0000","last_active":"2024-04-16T15:52:17.959461+0000","last_peered":"2024-04-16T15:52:17.959461+0000","last_clean":"2024-04-16T15:52:17.959461+0000","last_became_active":"2024-04-16T15:52:15.961769+0000","last_became_peered":"2024-04-16T15:52:15.961769+0000","last_unstale":"2024-04-16T15:52:17.959461+0000","last_undegraded":"2024-04-16T15:52:17.959461+0000","last_fullsized":"2024-04-16T15:52:17.959461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:32:03.549437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.957704+0000","last_change":"2024-04-16T15:52:15.955262+0000","last_active":"2024-04-16T15:52:16.957704+0000","last_peered":"2024-04-16T15:52:16.957704+0000","last_clean":"2024-04-16T15:52:16.957704+0000","last_became_active":"2024-04-16T15:52:15.955026+0000","last_became_peered":"2024-04-16T15:52:15.955026+0000","last_unstale":"2024-04-16T15:52:16.957704+0000","last_undegraded":"2024-04-16T15:52:16.957704+0000","last_fullsized":"2024-04-16T15:52:16.957704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:25:37.505791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:18.255970+0000","last_change":"2024-04-16T15:52:15.957719+0000","last_active":"2024-04-16T15:52:18.255970+0000","last_peered":"2024-04-16T15:52:18.255970+0000","last_clean":"2024-04-16T15:52:18.255970+0000","last_became_active":"2024-04-16T15:52:15.957420+0000","last_became_peered":"2024-04-16T15:52:15.957420+0000","last_unstale":"2024-04-16T15:52:18.255970+0000","last_undegraded":"2024-04-16T15:52:18.255970+0000","last_fullsized":"2024-04-16T15:52:18.255970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:12:51.264278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:18.870707+0000","last_change":"2024-04-16T15:52:15.954658+0000","last_active":"2024-04-16T15:52:18.870707+0000","last_peered":"2024-04-16T15:52:18.870707+0000","last_clean":"2024-04-16T15:52:18.870707+0000","last_became_active":"2024-04-16T15:52:15.954415+0000","last_became_peered":"2024-04-16T15:52:15.954415+0000","last_unstale":"2024-04-16T15:52:18.870707+0000","last_undegraded":"2024-04-16T15:52:18.870707+0000","last_fullsized":"2024-04-16T15:52:18.870707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:55:11.299922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.953491+0000","last_change":"2024-04-16T15:52:15.963146+0000","last_active":"2024-04-16T15:52:16.953491+0000","last_peered":"2024-04-16T15:52:16.953491+0000","last_clean":"2024-04-16T15:52:16.953491+0000","last_became_active":"2024-04-16T15:52:15.962757+0000","last_became_peered":"2024-04-16T15:52:15.962757+0000","last_unstale":"2024-04-16T15:52:16.953491+0000","last_undegraded":"2024-04-16T15:52:16.953491+0000","last_fullsized":"2024-04-16T15:52:16.953491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:06:46.464243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.957014+0000","last_change":"2024-04-16T15:52:15.964964+0000","last_active":"2024-04-16T15:52:16.957014+0000","last_peered":"2024-04-16T15:52:16.957014+0000","last_clean":"2024-04-16T15:52:16.957014+0000","last_became_active":"2024-04-16T15:52:15.964719+0000","last_became_peered":"2024-04-16T15:52:15.964719+0000","last_unstale":"2024-04-16T15:52:16.957014+0000","last_undegraded":"2024-04-16T15:52:16.957014+0000","last_fullsized":"2024-04-16T15:52:16.957014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:06:46.464243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.958319+0000","last_change":"2024-04-16T15:52:15.964462+0000","last_active":"2024-04-16T15:52:16.958319+0000","last_peered":"2024-04-16T15:52:16.958319+0000","last_clean":"2024-04-16T15:52:16.958319+0000","last_became_active":"2024-04-16T15:52:15.962472+0000","last_became_peered":"2024-04-16T15:52:15.962472+0000","last_unstale":"2024-04-16T15:52:16.958319+0000","last_undegraded":"2024-04-16T15:52:16.958319+0000","last_fullsized":"2024-04-16T15:52:16.958319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:19:17.423858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.166342+0000","last_change":"2024-04-16T15:52:15.957070+0000","last_active":"2024-04-16T15:52:17.166342+0000","last_peered":"2024-04-16T15:52:17.166342+0000","last_clean":"2024-04-16T15:52:17.166342+0000","last_became_active":"2024-04-16T15:52:15.956709+0000","last_became_peered":"2024-04-16T15:52:15.956709+0000","last_unstale":"2024-04-16T15:52:17.166342+0000","last_undegraded":"2024-04-16T15:52:17.166342+0000","last_fullsized":"2024-04-16T15:52:17.166342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:09:22.888070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.863939+0000","last_change":"2024-04-16T15:52:15.962038+0000","last_active":"2024-04-16T15:52:17.863939+0000","last_peered":"2024-04-16T15:52:17.863939+0000","last_clean":"2024-04-16T15:52:17.863939+0000","last_became_active":"2024-04-16T15:52:15.961798+0000","last_became_peered":"2024-04-16T15:52:15.961798+0000","last_unstale":"2024-04-16T15:52:17.863939+0000","last_undegraded":"2024-04-16T15:52:17.863939+0000","last_fullsized":"2024-04-16T15:52:17.863939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:19:17.423858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.959273+0000","last_change":"2024-04-16T15:52:15.957366+0000","last_active":"2024-04-16T15:52:17.959273+0000","last_peered":"2024-04-16T15:52:17.959273+0000","last_clean":"2024-04-16T15:52:17.959273+0000","last_became_active":"2024-04-16T15:52:15.956820+0000","last_became_peered":"2024-04-16T15:52:15.956820+0000","last_unstale":"2024-04-16T15:52:17.959273+0000","last_undegraded":"2024-04-16T15:52:17.959273+0000","last_fullsized":"2024-04-16T15:52:17.959273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:38:40.918721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:18.870869+0000","last_change":"2024-04-16T15:52:15.960508+0000","last_active":"2024-04-16T15:52:18.870869+0000","last_peered":"2024-04-16T15:52:18.870869+0000","last_clean":"2024-04-16T15:52:18.870869+0000","last_became_active":"2024-04-16T15:52:15.960254+0000","last_became_peered":"2024-04-16T15:52:15.960254+0000","last_unstale":"2024-04-16T15:52:18.870869+0000","last_undegraded":"2024-04-16T15:52:18.870869+0000","last_fullsized":"2024-04-16T15:52:18.870869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:47:47.685958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.957878+0000","last_change":"2024-04-16T15:52:15.954611+0000","last_active":"2024-04-16T15:52:16.957878+0000","last_peered":"2024-04-16T15:52:16.957878+0000","last_clean":"2024-04-16T15:52:16.957878+0000","last_became_active":"2024-04-16T15:52:15.954303+0000","last_became_peered":"2024-04-16T15:52:15.954303+0000","last_unstale":"2024-04-16T15:52:16.957878+0000","last_undegraded":"2024-04-16T15:52:16.957878+0000","last_fullsized":"2024-04-16T15:52:16.957878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:12:23.633108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:18.255824+0000","last_change":"2024-04-16T15:52:15.971774+0000","last_active":"2024-04-16T15:52:18.255824+0000","last_peered":"2024-04-16T15:52:18.255824+0000","last_clean":"2024-04-16T15:52:18.255824+0000","last_became_active":"2024-04-16T15:52:15.971186+0000","last_became_peered":"2024-04-16T15:52:15.971186+0000","last_unstale":"2024-04-16T15:52:18.255824+0000","last_undegraded":"2024-04-16T15:52:18.255824+0000","last_fullsized":"2024-04-16T15:52:18.255824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:32:03.549437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.957191+0000","last_change":"2024-04-16T15:52:15.960952+0000","last_active":"2024-04-16T15:52:16.957191+0000","last_peered":"2024-04-16T15:52:16.957191+0000","last_clean":"2024-04-16T15:52:16.957191+0000","last_became_active":"2024-04-16T15:52:15.960676+0000","last_became_peered":"2024-04-16T15:52:15.960676+0000","last_unstale":"2024-04-16T15:52:16.957191+0000","last_undegraded":"2024-04-16T15:52:16.957191+0000","last_fullsized":"2024-04-16T15:52:16.957191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:12.609412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:18.256211+0000","last_change":"2024-04-16T15:52:15.968822+0000","last_active":"2024-04-16T15:52:18.256211+0000","last_peered":"2024-04-16T15:52:18.256211+0000","last_clean":"2024-04-16T15:52:18.256211+0000","last_became_active":"2024-04-16T15:52:15.968422+0000","last_became_peered":"2024-04-16T15:52:15.968422+0000","last_unstale":"2024-04-16T15:52:18.256211+0000","last_undegraded":"2024-04-16T15:52:18.256211+0000","last_fullsized":"2024-04-16T15:52:18.256211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:20:01.452180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.959596+0000","last_change":"2024-04-16T15:52:15.961136+0000","last_active":"2024-04-16T15:52:17.959596+0000","last_peered":"2024-04-16T15:52:17.959596+0000","last_clean":"2024-04-16T15:52:17.959596+0000","last_became_active":"2024-04-16T15:52:15.960894+0000","last_became_peered":"2024-04-16T15:52:15.960894+0000","last_unstale":"2024-04-16T15:52:17.959596+0000","last_undegraded":"2024-04-16T15:52:17.959596+0000","last_fullsized":"2024-04-16T15:52:17.959596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:12:51.264278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.953334+0000","last_change":"2024-04-16T15:52:15.955537+0000","last_active":"2024-04-16T15:52:16.953334+0000","last_peered":"2024-04-16T15:52:16.953334+0000","last_clean":"2024-04-16T15:52:16.953334+0000","last_became_active":"2024-04-16T15:52:15.955225+0000","last_became_peered":"2024-04-16T15:52:15.955225+0000","last_unstale":"2024-04-16T15:52:16.953334+0000","last_undegraded":"2024-04-16T15:52:16.953334+0000","last_fullsized":"2024-04-16T15:52:16.953334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:38:40.918721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:18.256197+0000","last_change":"2024-04-16T15:52:15.962164+0000","last_active":"2024-04-16T15:52:18.256197+0000","last_peered":"2024-04-16T15:52:18.256197+0000","last_clean":"2024-04-16T15:52:18.256197+0000","last_became_active":"2024-04-16T15:52:15.961616+0000","last_became_peered":"2024-04-16T15:52:15.961616+0000","last_unstale":"2024-04-16T15:52:18.256197+0000","last_undegraded":"2024-04-16T15:52:18.256197+0000","last_fullsized":"2024-04-16T15:52:18.256197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:49:00.138512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:18.870921+0000","last_change":"2024-04-16T15:52:15.960482+0000","last_active":"2024-04-16T15:52:18.870921+0000","last_peered":"2024-04-16T15:52:18.870921+0000","last_clean":"2024-04-16T15:52:18.870921+0000","last_became_active":"2024-04-16T15:52:15.960230+0000","last_became_peered":"2024-04-16T15:52:15.960230+0000","last_unstale":"2024-04-16T15:52:18.870921+0000","last_undegraded":"2024-04-16T15:52:18.870921+0000","last_fullsized":"2024-04-16T15:52:18.870921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:37:47.713734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.958035+0000","last_change":"2024-04-16T15:52:15.959288+0000","last_active":"2024-04-16T15:52:16.958035+0000","last_peered":"2024-04-16T15:52:16.958035+0000","last_clean":"2024-04-16T15:52:16.958035+0000","last_became_active":"2024-04-16T15:52:15.958870+0000","last_became_peered":"2024-04-16T15:52:15.958870+0000","last_unstale":"2024-04-16T15:52:16.958035+0000","last_undegraded":"2024-04-16T15:52:16.958035+0000","last_fullsized":"2024-04-16T15:52:16.958035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:20:01.452180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.166079+0000","last_change":"2024-04-16T15:52:15.962345+0000","last_active":"2024-04-16T15:52:17.166079+0000","last_peered":"2024-04-16T15:52:17.166079+0000","last_clean":"2024-04-16T15:52:17.166079+0000","last_became_active":"2024-04-16T15:52:15.962070+0000","last_became_peered":"2024-04-16T15:52:15.962070+0000","last_unstale":"2024-04-16T15:52:17.166079+0000","last_undegraded":"2024-04-16T15:52:17.166079+0000","last_fullsized":"2024-04-16T15:52:17.166079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:43:14.139014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.959184+0000","last_change":"2024-04-16T15:52:15.964986+0000","last_active":"2024-04-16T15:52:17.959184+0000","last_peered":"2024-04-16T15:52:17.959184+0000","last_clean":"2024-04-16T15:52:17.959184+0000","last_became_active":"2024-04-16T15:52:15.964652+0000","last_became_peered":"2024-04-16T15:52:15.964652+0000","last_unstale":"2024-04-16T15:52:17.959184+0000","last_undegraded":"2024-04-16T15:52:17.959184+0000","last_fullsized":"2024-04-16T15:52:17.959184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:26:03.155698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.956966+0000","last_change":"2024-04-16T15:52:15.951020+0000","last_active":"2024-04-16T15:52:16.956966+0000","last_peered":"2024-04-16T15:52:16.956966+0000","last_clean":"2024-04-16T15:52:16.956966+0000","last_became_active":"2024-04-16T15:52:15.950740+0000","last_became_peered":"2024-04-16T15:52:15.950740+0000","last_unstale":"2024-04-16T15:52:16.956966+0000","last_undegraded":"2024-04-16T15:52:16.956966+0000","last_fullsized":"2024-04-16T15:52:16.956966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:56:17.065473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:18.256123+0000","last_change":"2024-04-16T15:52:14.949066+0000","last_active":"2024-04-16T15:52:18.256123+0000","last_peered":"2024-04-16T15:52:18.256123+0000","last_clean":"2024-04-16T15:52:18.256123+0000","last_became_active":"2024-04-16T15:52:14.948796+0000","last_became_peered":"2024-04-16T15:52:14.948796+0000","last_unstale":"2024-04-16T15:52:18.256123+0000","last_undegraded":"2024-04-16T15:52:18.256123+0000","last_fullsized":"2024-04-16T15:52:18.256123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:54:14.854467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:18.871021+0000","last_change":"2024-04-16T15:52:15.954656+0000","last_active":"2024-04-16T15:52:18.871021+0000","last_peered":"2024-04-16T15:52:18.871021+0000","last_clean":"2024-04-16T15:52:18.871021+0000","last_became_active":"2024-04-16T15:52:15.954391+0000","last_became_peered":"2024-04-16T15:52:15.954391+0000","last_unstale":"2024-04-16T15:52:18.871021+0000","last_undegraded":"2024-04-16T15:52:18.871021+0000","last_fullsized":"2024-04-16T15:52:18.871021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:38:40.918721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.959028+0000","last_change":"2024-04-16T15:52:14.942908+0000","last_active":"2024-04-16T15:52:17.959028+0000","last_peered":"2024-04-16T15:52:17.959028+0000","last_clean":"2024-04-16T15:52:17.959028+0000","last_became_active":"2024-04-16T15:52:14.942553+0000","last_became_peered":"2024-04-16T15:52:14.942553+0000","last_unstale":"2024-04-16T15:52:17.959028+0000","last_undegraded":"2024-04-16T15:52:17.959028+0000","last_fullsized":"2024-04-16T15:52:17.959028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:50:25.315001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:18.255900+0000","last_change":"2024-04-16T15:52:14.947686+0000","last_active":"2024-04-16T15:52:18.255900+0000","last_peered":"2024-04-16T15:52:18.255900+0000","last_clean":"2024-04-16T15:52:18.255900+0000","last_became_active":"2024-04-16T15:52:14.947418+0000","last_became_peered":"2024-04-16T15:52:14.947418+0000","last_unstale":"2024-04-16T15:52:18.255900+0000","last_undegraded":"2024-04-16T15:52:18.255900+0000","last_fullsized":"2024-04-16T15:52:18.255900+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:57:52.293174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:18.255751+0000","last_change":"2024-04-16T15:52:15.968647+0000","last_active":"2024-04-16T15:52:18.255751+0000","last_peered":"2024-04-16T15:52:18.255751+0000","last_clean":"2024-04-16T15:52:18.255751+0000","last_became_active":"2024-04-16T15:52:15.968291+0000","last_became_peered":"2024-04-16T15:52:15.968291+0000","last_unstale":"2024-04-16T15:52:18.255751+0000","last_undegraded":"2024-04-16T15:52:18.255751+0000","last_fullsized":"2024-04-16T15:52:18.255751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:38:40.918721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.957300+0000","last_change":"2024-04-16T15:52:14.937235+0000","last_active":"2024-04-16T15:52:16.957300+0000","last_peered":"2024-04-16T15:52:16.957300+0000","last_clean":"2024-04-16T15:52:16.957300+0000","last_became_active":"2024-04-16T15:52:14.936933+0000","last_became_peered":"2024-04-16T15:52:14.936933+0000","last_unstale":"2024-04-16T15:52:16.957300+0000","last_undegraded":"2024-04-16T15:52:16.957300+0000","last_fullsized":"2024-04-16T15:52:16.957300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:56:16.060919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.953284+0000","last_change":"2024-04-16T15:52:15.956171+0000","last_active":"2024-04-16T15:52:16.953284+0000","last_peered":"2024-04-16T15:52:16.953284+0000","last_clean":"2024-04-16T15:52:16.953284+0000","last_became_active":"2024-04-16T15:52:15.955891+0000","last_became_peered":"2024-04-16T15:52:15.955891+0000","last_unstale":"2024-04-16T15:52:16.953284+0000","last_undegraded":"2024-04-16T15:52:16.953284+0000","last_fullsized":"2024-04-16T15:52:16.953284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:26:03.155698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.959498+0000","last_change":"2024-04-16T15:52:14.949780+0000","last_active":"2024-04-16T15:52:17.959498+0000","last_peered":"2024-04-16T15:52:17.959498+0000","last_clean":"2024-04-16T15:52:17.959498+0000","last_became_active":"2024-04-16T15:52:14.949488+0000","last_became_peered":"2024-04-16T15:52:14.949488+0000","last_unstale":"2024-04-16T15:52:17.959498+0000","last_undegraded":"2024-04-16T15:52:17.959498+0000","last_fullsized":"2024-04-16T15:52:17.959498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:57:52.293174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.957085+0000","last_change":"2024-04-16T15:52:15.963253+0000","last_active":"2024-04-16T15:52:16.957085+0000","last_peered":"2024-04-16T15:52:16.957085+0000","last_clean":"2024-04-16T15:52:16.957085+0000","last_became_active":"2024-04-16T15:52:15.962755+0000","last_became_peered":"2024-04-16T15:52:15.962755+0000","last_unstale":"2024-04-16T15:52:16.957085+0000","last_undegraded":"2024-04-16T15:52:16.957085+0000","last_fullsized":"2024-04-16T15:52:16.957085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:12:51.264278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.957206+0000","last_change":"2024-04-16T15:52:14.948736+0000","last_active":"2024-04-16T15:52:16.957206+0000","last_peered":"2024-04-16T15:52:16.957206+0000","last_clean":"2024-04-16T15:52:16.957206+0000","last_became_active":"2024-04-16T15:52:14.948413+0000","last_became_peered":"2024-04-16T15:52:14.948413+0000","last_unstale":"2024-04-16T15:52:16.957206+0000","last_undegraded":"2024-04-16T15:52:16.957206+0000","last_fullsized":"2024-04-16T15:52:16.957206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:05:32.659988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:18.871039+0000","last_change":"2024-04-16T15:52:15.962582+0000","last_active":"2024-04-16T15:52:18.871039+0000","last_peered":"2024-04-16T15:52:18.871039+0000","last_clean":"2024-04-16T15:52:18.871039+0000","last_became_active":"2024-04-16T15:52:15.962290+0000","last_became_peered":"2024-04-16T15:52:15.962290+0000","last_unstale":"2024-04-16T15:52:18.871039+0000","last_undegraded":"2024-04-16T15:52:18.871039+0000","last_fullsized":"2024-04-16T15:52:18.871039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:32:03.549437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.953451+0000","last_change":"2024-04-16T15:52:14.942420+0000","last_active":"2024-04-16T15:52:16.953451+0000","last_peered":"2024-04-16T15:52:16.953451+0000","last_clean":"2024-04-16T15:52:16.953451+0000","last_became_active":"2024-04-16T15:52:14.942185+0000","last_became_peered":"2024-04-16T15:52:14.942185+0000","last_unstale":"2024-04-16T15:52:16.953451+0000","last_undegraded":"2024-04-16T15:52:16.953451+0000","last_fullsized":"2024-04-16T15:52:16.953451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:25:36.501237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.957745+0000","last_change":"2024-04-16T15:52:15.968661+0000","last_active":"2024-04-16T15:52:16.957745+0000","last_peered":"2024-04-16T15:52:16.957745+0000","last_clean":"2024-04-16T15:52:16.957745+0000","last_became_active":"2024-04-16T15:52:15.968372+0000","last_became_peered":"2024-04-16T15:52:15.968372+0000","last_unstale":"2024-04-16T15:52:16.957745+0000","last_undegraded":"2024-04-16T15:52:16.957745+0000","last_fullsized":"2024-04-16T15:52:16.957745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:52:38.940563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.959249+0000","last_change":"2024-04-16T15:52:14.947183+0000","last_active":"2024-04-16T15:52:17.959249+0000","last_peered":"2024-04-16T15:52:17.959249+0000","last_clean":"2024-04-16T15:52:17.959249+0000","last_became_active":"2024-04-16T15:52:14.946917+0000","last_became_peered":"2024-04-16T15:52:14.946917+0000","last_unstale":"2024-04-16T15:52:17.959249+0000","last_undegraded":"2024-04-16T15:52:17.959249+0000","last_fullsized":"2024-04-16T15:52:17.959249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:25:36.501237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.863691+0000","last_change":"2024-04-16T15:52:15.960326+0000","last_active":"2024-04-16T15:52:17.863691+0000","last_peered":"2024-04-16T15:52:17.863691+0000","last_clean":"2024-04-16T15:52:17.863691+0000","last_became_active":"2024-04-16T15:52:15.960019+0000","last_became_peered":"2024-04-16T15:52:15.960019+0000","last_unstale":"2024-04-16T15:52:17.863691+0000","last_undegraded":"2024-04-16T15:52:17.863691+0000","last_fullsized":"2024-04-16T15:52:17.863691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:20:01.452180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:18.871011+0000","last_change":"2024-04-16T15:52:14.943977+0000","last_active":"2024-04-16T15:52:18.871011+0000","last_peered":"2024-04-16T15:52:18.871011+0000","last_clean":"2024-04-16T15:52:18.871011+0000","last_became_active":"2024-04-16T15:52:14.942113+0000","last_became_peered":"2024-04-16T15:52:14.942113+0000","last_unstale":"2024-04-16T15:52:18.871011+0000","last_undegraded":"2024-04-16T15:52:18.871011+0000","last_fullsized":"2024-04-16T15:52:18.871011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:54:14.854467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:18.870810+0000","last_change":"2024-04-16T15:52:15.963253+0000","last_active":"2024-04-16T15:52:18.870810+0000","last_peered":"2024-04-16T15:52:18.870810+0000","last_clean":"2024-04-16T15:52:18.870810+0000","last_became_active":"2024-04-16T15:52:15.963021+0000","last_became_peered":"2024-04-16T15:52:15.963021+0000","last_unstale":"2024-04-16T15:52:18.870810+0000","last_undegraded":"2024-04-16T15:52:18.870810+0000","last_fullsized":"2024-04-16T15:52:18.870810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:30:06.435878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.958161+0000","last_change":"2024-04-16T15:52:14.947713+0000","last_active":"2024-04-16T15:52:16.958161+0000","last_peered":"2024-04-16T15:52:16.958161+0000","last_clean":"2024-04-16T15:52:16.958161+0000","last_became_active":"2024-04-16T15:52:14.947256+0000","last_became_peered":"2024-04-16T15:52:14.947256+0000","last_unstale":"2024-04-16T15:52:16.958161+0000","last_undegraded":"2024-04-16T15:52:16.958161+0000","last_fullsized":"2024-04-16T15:52:16.958161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:50:25.315001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.863700+0000","last_change":"2024-04-16T15:52:15.971167+0000","last_active":"2024-04-16T15:52:17.863700+0000","last_peered":"2024-04-16T15:52:17.863700+0000","last_clean":"2024-04-16T15:52:17.863700+0000","last_became_active":"2024-04-16T15:52:15.970297+0000","last_became_peered":"2024-04-16T15:52:15.970297+0000","last_unstale":"2024-04-16T15:52:17.863700+0000","last_undegraded":"2024-04-16T15:52:17.863700+0000","last_fullsized":"2024-04-16T15:52:17.863700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:43:19.355250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.959001+0000","last_change":"2024-04-16T15:52:14.944001+0000","last_active":"2024-04-16T15:52:17.959001+0000","last_peered":"2024-04-16T15:52:17.959001+0000","last_clean":"2024-04-16T15:52:17.959001+0000","last_became_active":"2024-04-16T15:52:14.943399+0000","last_became_peered":"2024-04-16T15:52:14.943399+0000","last_unstale":"2024-04-16T15:52:17.959001+0000","last_undegraded":"2024-04-16T15:52:17.959001+0000","last_fullsized":"2024-04-16T15:52:17.959001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:56:16.060919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.959076+0000","last_change":"2024-04-16T15:52:15.966108+0000","last_active":"2024-04-16T15:52:17.959076+0000","last_peered":"2024-04-16T15:52:17.959076+0000","last_clean":"2024-04-16T15:52:17.959076+0000","last_became_active":"2024-04-16T15:52:15.965453+0000","last_became_peered":"2024-04-16T15:52:15.965453+0000","last_unstale":"2024-04-16T15:52:17.959076+0000","last_undegraded":"2024-04-16T15:52:17.959076+0000","last_fullsized":"2024-04-16T15:52:17.959076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:47:47.685958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.166026+0000","last_change":"2024-04-16T15:52:14.942830+0000","last_active":"2024-04-16T15:52:17.166026+0000","last_peered":"2024-04-16T15:52:17.166026+0000","last_clean":"2024-04-16T15:52:17.166026+0000","last_became_active":"2024-04-16T15:52:14.942553+0000","last_became_peered":"2024-04-16T15:52:14.942553+0000","last_unstale":"2024-04-16T15:52:17.166026+0000","last_undegraded":"2024-04-16T15:52:17.166026+0000","last_fullsized":"2024-04-16T15:52:17.166026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:56:16.060919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.863469+0000","last_change":"2024-04-16T15:52:15.970722+0000","last_active":"2024-04-16T15:52:17.863469+0000","last_peered":"2024-04-16T15:52:17.863469+0000","last_clean":"2024-04-16T15:52:17.863469+0000","last_became_active":"2024-04-16T15:52:15.970463+0000","last_became_peered":"2024-04-16T15:52:15.970463+0000","last_unstale":"2024-04-16T15:52:17.863469+0000","last_undegraded":"2024-04-16T15:52:17.863469+0000","last_fullsized":"2024-04-16T15:52:17.863469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:12:23.633108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.958010+0000","last_change":"2024-04-16T15:52:14.945683+0000","last_active":"2024-04-16T15:52:16.958010+0000","last_peered":"2024-04-16T15:52:16.958010+0000","last_clean":"2024-04-16T15:52:16.958010+0000","last_became_active":"2024-04-16T15:52:14.945282+0000","last_became_peered":"2024-04-16T15:52:14.945282+0000","last_unstale":"2024-04-16T15:52:16.958010+0000","last_undegraded":"2024-04-16T15:52:16.958010+0000","last_fullsized":"2024-04-16T15:52:16.958010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:32:02.360792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.863944+0000","last_change":"2024-04-16T15:52:15.967350+0000","last_active":"2024-04-16T15:52:17.863944+0000","last_peered":"2024-04-16T15:52:17.863944+0000","last_clean":"2024-04-16T15:52:17.863944+0000","last_became_active":"2024-04-16T15:52:15.967083+0000","last_became_peered":"2024-04-16T15:52:15.967083+0000","last_unstale":"2024-04-16T15:52:17.863944+0000","last_undegraded":"2024-04-16T15:52:17.863944+0000","last_fullsized":"2024-04-16T15:52:17.863944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:32:53.550133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.166349+0000","last_change":"2024-04-16T15:52:14.946978+0000","last_active":"2024-04-16T15:52:17.166349+0000","last_peered":"2024-04-16T15:52:17.166349+0000","last_clean":"2024-04-16T15:52:17.166349+0000","last_became_active":"2024-04-16T15:52:14.946652+0000","last_became_peered":"2024-04-16T15:52:14.946652+0000","last_unstale":"2024-04-16T15:52:17.166349+0000","last_undegraded":"2024-04-16T15:52:17.166349+0000","last_fullsized":"2024-04-16T15:52:17.166349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:57:52.293174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.864076+0000","last_change":"2024-04-16T15:52:15.970506+0000","last_active":"2024-04-16T15:52:17.864076+0000","last_peered":"2024-04-16T15:52:17.864076+0000","last_clean":"2024-04-16T15:52:17.864076+0000","last_became_active":"2024-04-16T15:52:15.970199+0000","last_became_peered":"2024-04-16T15:52:15.970199+0000","last_unstale":"2024-04-16T15:52:17.864076+0000","last_undegraded":"2024-04-16T15:52:17.864076+0000","last_fullsized":"2024-04-16T15:52:17.864076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:55:34.371253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.953459+0000","last_change":"2024-04-16T15:52:14.941968+0000","last_active":"2024-04-16T15:52:16.953459+0000","last_peered":"2024-04-16T15:52:16.953459+0000","last_clean":"2024-04-16T15:52:16.953459+0000","last_became_active":"2024-04-16T15:52:14.941684+0000","last_became_peered":"2024-04-16T15:52:14.941684+0000","last_unstale":"2024-04-16T15:52:16.953459+0000","last_undegraded":"2024-04-16T15:52:16.953459+0000","last_fullsized":"2024-04-16T15:52:16.953459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:52:37.936009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.958409+0000","last_change":"2024-04-16T15:52:15.959098+0000","last_active":"2024-04-16T15:52:16.958409+0000","last_peered":"2024-04-16T15:52:16.958409+0000","last_clean":"2024-04-16T15:52:16.958409+0000","last_became_active":"2024-04-16T15:52:15.958816+0000","last_became_peered":"2024-04-16T15:52:15.958816+0000","last_unstale":"2024-04-16T15:52:16.958409+0000","last_undegraded":"2024-04-16T15:52:16.958409+0000","last_fullsized":"2024-04-16T15:52:16.958409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:32:53.550133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.166208+0000","last_change":"2024-04-16T15:52:14.941162+0000","last_active":"2024-04-16T15:52:17.166208+0000","last_peered":"2024-04-16T15:52:17.166208+0000","last_clean":"2024-04-16T15:52:17.166208+0000","last_became_active":"2024-04-16T15:52:14.940893+0000","last_became_peered":"2024-04-16T15:52:14.940893+0000","last_unstale":"2024-04-16T15:52:17.166208+0000","last_undegraded":"2024-04-16T15:52:17.166208+0000","last_fullsized":"2024-04-16T15:52:17.166208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:52:05.410477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.863706+0000","last_change":"2024-04-16T15:52:15.971577+0000","last_active":"2024-04-16T15:52:17.863706+0000","last_peered":"2024-04-16T15:52:17.863706+0000","last_clean":"2024-04-16T15:52:17.863706+0000","last_became_active":"2024-04-16T15:52:15.971055+0000","last_became_peered":"2024-04-16T15:52:15.971055+0000","last_unstale":"2024-04-16T15:52:17.863706+0000","last_undegraded":"2024-04-16T15:52:17.863706+0000","last_fullsized":"2024-04-16T15:52:17.863706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:15:54.440902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.863473+0000","last_change":"2024-04-16T15:52:04.356095+0000","last_active":"2024-04-16T15:52:17.863473+0000","last_peered":"2024-04-16T15:52:17.863473+0000","last_clean":"2024-04-16T15:52:17.863473+0000","last_became_active":"2024-04-16T15:52:04.355126+0000","last_became_peered":"2024-04-16T15:52:04.355126+0000","last_unstale":"2024-04-16T15:52:17.863473+0000","last_undegraded":"2024-04-16T15:52:17.863473+0000","last_fullsized":"2024-04-16T15:52:17.863473+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:03.285037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:03.285037+0000","last_clean_scrub_stamp":"2024-04-16T15:52:03.285037+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:19.005024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.957635+0000","last_change":"2024-04-16T15:52:14.939932+0000","last_active":"2024-04-16T15:52:16.957635+0000","last_peered":"2024-04-16T15:52:16.957635+0000","last_clean":"2024-04-16T15:52:16.957635+0000","last_became_active":"2024-04-16T15:52:14.939347+0000","last_became_peered":"2024-04-16T15:52:14.939347+0000","last_unstale":"2024-04-16T15:52:16.957635+0000","last_undegraded":"2024-04-16T15:52:16.957635+0000","last_fullsized":"2024-04-16T15:52:16.957635+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:57:52.293174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:18.256242+0000","last_change":"2024-04-16T15:52:15.966920+0000","last_active":"2024-04-16T15:52:18.256242+0000","last_peered":"2024-04-16T15:52:18.256242+0000","last_clean":"2024-04-16T15:52:18.256242+0000","last_became_active":"2024-04-16T15:52:15.966702+0000","last_became_peered":"2024-04-16T15:52:15.966702+0000","last_unstale":"2024-04-16T15:52:18.256242+0000","last_undegraded":"2024-04-16T15:52:18.256242+0000","last_fullsized":"2024-04-16T15:52:18.256242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:15:54.440902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.863328+0000","last_change":"2024-04-16T15:52:14.949823+0000","last_active":"2024-04-16T15:52:17.863328+0000","last_peered":"2024-04-16T15:52:17.863328+0000","last_clean":"2024-04-16T15:52:17.863328+0000","last_became_active":"2024-04-16T15:52:14.949402+0000","last_became_peered":"2024-04-16T15:52:14.949402+0000","last_unstale":"2024-04-16T15:52:17.863328+0000","last_undegraded":"2024-04-16T15:52:17.863328+0000","last_fullsized":"2024-04-16T15:52:17.863328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:09:21.883516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:18.870846+0000","last_change":"2024-04-16T15:52:15.965283+0000","last_active":"2024-04-16T15:52:18.870846+0000","last_peered":"2024-04-16T15:52:18.870846+0000","last_clean":"2024-04-16T15:52:18.870846+0000","last_became_active":"2024-04-16T15:52:15.964965+0000","last_became_peered":"2024-04-16T15:52:15.964965+0000","last_unstale":"2024-04-16T15:52:18.870846+0000","last_undegraded":"2024-04-16T15:52:18.870846+0000","last_fullsized":"2024-04-16T15:52:18.870846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:29:56.924883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.166130+0000","last_change":"2024-04-16T15:52:14.948651+0000","last_active":"2024-04-16T15:52:17.166130+0000","last_peered":"2024-04-16T15:52:17.166130+0000","last_clean":"2024-04-16T15:52:17.166130+0000","last_became_active":"2024-04-16T15:52:14.948371+0000","last_became_peered":"2024-04-16T15:52:14.948371+0000","last_unstale":"2024-04-16T15:52:17.166130+0000","last_undegraded":"2024-04-16T15:52:17.166130+0000","last_fullsized":"2024-04-16T15:52:17.166130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:05:32.659988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.953291+0000","last_change":"2024-04-16T15:52:15.955167+0000","last_active":"2024-04-16T15:52:16.953291+0000","last_peered":"2024-04-16T15:52:16.953291+0000","last_clean":"2024-04-16T15:52:16.953291+0000","last_became_active":"2024-04-16T15:52:15.954877+0000","last_became_peered":"2024-04-16T15:52:15.954877+0000","last_unstale":"2024-04-16T15:52:16.953291+0000","last_undegraded":"2024-04-16T15:52:16.953291+0000","last_fullsized":"2024-04-16T15:52:16.953291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:37:47.713734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.958193+0000","last_change":"2024-04-16T15:52:14.943461+0000","last_active":"2024-04-16T15:52:16.958193+0000","last_peered":"2024-04-16T15:52:16.958193+0000","last_clean":"2024-04-16T15:52:16.958193+0000","last_became_active":"2024-04-16T15:52:14.943188+0000","last_became_peered":"2024-04-16T15:52:14.943188+0000","last_unstale":"2024-04-16T15:52:16.958193+0000","last_undegraded":"2024-04-16T15:52:16.958193+0000","last_fullsized":"2024-04-16T15:52:16.958193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:25:36.501237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.957431+0000","last_change":"2024-04-16T15:52:15.955147+0000","last_active":"2024-04-16T15:52:16.957431+0000","last_peered":"2024-04-16T15:52:16.957431+0000","last_clean":"2024-04-16T15:52:16.957431+0000","last_became_active":"2024-04-16T15:52:15.954234+0000","last_became_peered":"2024-04-16T15:52:15.954234+0000","last_unstale":"2024-04-16T15:52:16.957431+0000","last_undegraded":"2024-04-16T15:52:16.957431+0000","last_fullsized":"2024-04-16T15:52:16.957431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:50:26.319554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.953318+0000","last_change":"2024-04-16T15:52:14.943962+0000","last_active":"2024-04-16T15:52:16.953318+0000","last_peered":"2024-04-16T15:52:16.953318+0000","last_clean":"2024-04-16T15:52:16.953318+0000","last_became_active":"2024-04-16T15:52:14.943709+0000","last_became_peered":"2024-04-16T15:52:14.943709+0000","last_unstale":"2024-04-16T15:52:16.953318+0000","last_undegraded":"2024-04-16T15:52:16.953318+0000","last_fullsized":"2024-04-16T15:52:16.953318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:43:13.134461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.958129+0000","last_change":"2024-04-16T15:52:15.953840+0000","last_active":"2024-04-16T15:52:16.958129+0000","last_peered":"2024-04-16T15:52:16.958129+0000","last_clean":"2024-04-16T15:52:16.958129+0000","last_became_active":"2024-04-16T15:52:15.953574+0000","last_became_peered":"2024-04-16T15:52:15.953574+0000","last_unstale":"2024-04-16T15:52:16.958129+0000","last_undegraded":"2024-04-16T15:52:16.958129+0000","last_fullsized":"2024-04-16T15:52:16.958129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:15:54.440902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.864016+0000","last_change":"2024-04-16T15:52:14.950797+0000","last_active":"2024-04-16T15:52:17.864016+0000","last_peered":"2024-04-16T15:52:17.864016+0000","last_clean":"2024-04-16T15:52:17.864016+0000","last_became_active":"2024-04-16T15:52:14.950474+0000","last_became_peered":"2024-04-16T15:52:14.950474+0000","last_unstale":"2024-04-16T15:52:17.864016+0000","last_undegraded":"2024-04-16T15:52:17.864016+0000","last_fullsized":"2024-04-16T15:52:17.864016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:52:37.936009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.953360+0000","last_change":"2024-04-16T15:52:15.954764+0000","last_active":"2024-04-16T15:52:16.953360+0000","last_peered":"2024-04-16T15:52:16.953360+0000","last_clean":"2024-04-16T15:52:16.953360+0000","last_became_active":"2024-04-16T15:52:15.954454+0000","last_became_peered":"2024-04-16T15:52:15.954454+0000","last_unstale":"2024-04-16T15:52:16.953360+0000","last_undegraded":"2024-04-16T15:52:16.953360+0000","last_fullsized":"2024-04-16T15:52:16.953360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:32:03.549437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.290499+0000","last_change":"2024-04-16T15:52:14.945505+0000","last_active":"2024-04-16T15:52:17.290499+0000","last_peered":"2024-04-16T15:52:17.290499+0000","last_clean":"2024-04-16T15:52:17.290499+0000","last_became_active":"2024-04-16T15:52:14.945275+0000","last_became_peered":"2024-04-16T15:52:14.945275+0000","last_unstale":"2024-04-16T15:52:17.290499+0000","last_undegraded":"2024-04-16T15:52:17.290499+0000","last_fullsized":"2024-04-16T15:52:17.290499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:50:25.315001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:18.256182+0000","last_change":"2024-04-16T15:52:15.962328+0000","last_active":"2024-04-16T15:52:18.256182+0000","last_peered":"2024-04-16T15:52:18.256182+0000","last_clean":"2024-04-16T15:52:18.256182+0000","last_became_active":"2024-04-16T15:52:15.961856+0000","last_became_peered":"2024-04-16T15:52:15.961856+0000","last_unstale":"2024-04-16T15:52:18.256182+0000","last_undegraded":"2024-04-16T15:52:18.256182+0000","last_fullsized":"2024-04-16T15:52:18.256182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:12:23.633108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.959506+0000","last_change":"2024-04-16T15:52:14.948103+0000","last_active":"2024-04-16T15:52:17.959506+0000","last_peered":"2024-04-16T15:52:17.959506+0000","last_clean":"2024-04-16T15:52:17.959506+0000","last_became_active":"2024-04-16T15:52:14.947827+0000","last_became_peered":"2024-04-16T15:52:14.947827+0000","last_unstale":"2024-04-16T15:52:17.959506+0000","last_undegraded":"2024-04-16T15:52:17.959506+0000","last_fullsized":"2024-04-16T15:52:17.959506+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:05:32.659988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:18.871072+0000","last_change":"2024-04-16T15:52:15.954129+0000","last_active":"2024-04-16T15:52:18.871072+0000","last_peered":"2024-04-16T15:52:18.871072+0000","last_clean":"2024-04-16T15:52:18.871072+0000","last_became_active":"2024-04-16T15:52:15.953833+0000","last_became_peered":"2024-04-16T15:52:15.953833+0000","last_unstale":"2024-04-16T15:52:18.871072+0000","last_undegraded":"2024-04-16T15:52:18.871072+0000","last_fullsized":"2024-04-16T15:52:18.871072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:12:51.264278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.863328+0000","last_change":"2024-04-16T15:52:14.951279+0000","last_active":"2024-04-16T15:52:17.863328+0000","last_peered":"2024-04-16T15:52:17.863328+0000","last_clean":"2024-04-16T15:52:17.863328+0000","last_became_active":"2024-04-16T15:52:14.950928+0000","last_became_peered":"2024-04-16T15:52:14.950928+0000","last_unstale":"2024-04-16T15:52:17.863328+0000","last_undegraded":"2024-04-16T15:52:17.863328+0000","last_fullsized":"2024-04-16T15:52:17.863328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:50:25.315001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.958003+0000","last_change":"2024-04-16T15:52:15.959257+0000","last_active":"2024-04-16T15:52:16.958003+0000","last_peered":"2024-04-16T15:52:16.958003+0000","last_clean":"2024-04-16T15:52:16.958003+0000","last_became_active":"2024-04-16T15:52:15.957931+0000","last_became_peered":"2024-04-16T15:52:15.957931+0000","last_unstale":"2024-04-16T15:52:16.958003+0000","last_undegraded":"2024-04-16T15:52:16.958003+0000","last_fullsized":"2024-04-16T15:52:16.958003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:43:14.139014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.953380+0000","last_change":"2024-04-16T15:52:14.947381+0000","last_active":"2024-04-16T15:52:16.953380+0000","last_peered":"2024-04-16T15:52:16.953380+0000","last_clean":"2024-04-16T15:52:16.953380+0000","last_became_active":"2024-04-16T15:52:14.947124+0000","last_became_peered":"2024-04-16T15:52:14.947124+0000","last_unstale":"2024-04-16T15:52:16.953380+0000","last_undegraded":"2024-04-16T15:52:16.953380+0000","last_fullsized":"2024-04-16T15:52:16.953380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:05:32.659988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:18.255899+0000","last_change":"2024-04-16T15:52:15.962034+0000","last_active":"2024-04-16T15:52:18.255899+0000","last_peered":"2024-04-16T15:52:18.255899+0000","last_clean":"2024-04-16T15:52:18.255899+0000","last_became_active":"2024-04-16T15:52:15.954240+0000","last_became_peered":"2024-04-16T15:52:15.954240+0000","last_unstale":"2024-04-16T15:52:18.255899+0000","last_undegraded":"2024-04-16T15:52:18.255899+0000","last_fullsized":"2024-04-16T15:52:18.255899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:06:46.464243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.953436+0000","last_change":"2024-04-16T15:52:14.946919+0000","last_active":"2024-04-16T15:52:16.953436+0000","last_peered":"2024-04-16T15:52:16.953436+0000","last_clean":"2024-04-16T15:52:16.953436+0000","last_became_active":"2024-04-16T15:52:14.946666+0000","last_became_peered":"2024-04-16T15:52:14.946666+0000","last_unstale":"2024-04-16T15:52:16.953436+0000","last_undegraded":"2024-04-16T15:52:16.953436+0000","last_fullsized":"2024-04-16T15:52:16.953436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:56:16.060919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:18.256025+0000","last_change":"2024-04-16T15:52:15.961288+0000","last_active":"2024-04-16T15:52:18.256025+0000","last_peered":"2024-04-16T15:52:18.256025+0000","last_clean":"2024-04-16T15:52:18.256025+0000","last_became_active":"2024-04-16T15:52:15.961033+0000","last_became_peered":"2024-04-16T15:52:15.961033+0000","last_unstale":"2024-04-16T15:52:18.256025+0000","last_undegraded":"2024-04-16T15:52:18.256025+0000","last_fullsized":"2024-04-16T15:52:18.256025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:12.609412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.863749+0000","last_change":"2024-04-16T15:52:14.951317+0000","last_active":"2024-04-16T15:52:17.863749+0000","last_peered":"2024-04-16T15:52:17.863749+0000","last_clean":"2024-04-16T15:52:17.863749+0000","last_became_active":"2024-04-16T15:52:14.950992+0000","last_became_peered":"2024-04-16T15:52:14.950992+0000","last_unstale":"2024-04-16T15:52:17.863749+0000","last_undegraded":"2024-04-16T15:52:17.863749+0000","last_fullsized":"2024-04-16T15:52:17.863749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:25:36.501237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.959215+0000","last_change":"2024-04-16T15:52:15.958425+0000","last_active":"2024-04-16T15:52:17.959215+0000","last_peered":"2024-04-16T15:52:17.959215+0000","last_clean":"2024-04-16T15:52:17.959215+0000","last_became_active":"2024-04-16T15:52:15.957473+0000","last_became_peered":"2024-04-16T15:52:15.957473+0000","last_unstale":"2024-04-16T15:52:17.959215+0000","last_undegraded":"2024-04-16T15:52:17.959215+0000","last_fullsized":"2024-04-16T15:52:17.959215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:37:47.713734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.957965+0000","last_change":"2024-04-16T15:52:15.960621+0000","last_active":"2024-04-16T15:52:16.957965+0000","last_peered":"2024-04-16T15:52:16.957965+0000","last_clean":"2024-04-16T15:52:16.957965+0000","last_became_active":"2024-04-16T15:52:15.959965+0000","last_became_peered":"2024-04-16T15:52:15.959965+0000","last_unstale":"2024-04-16T15:52:16.957965+0000","last_undegraded":"2024-04-16T15:52:16.957965+0000","last_fullsized":"2024-04-16T15:52:16.957965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:49:00.138512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.863692+0000","last_change":"2024-04-16T15:52:14.951351+0000","last_active":"2024-04-16T15:52:17.863692+0000","last_peered":"2024-04-16T15:52:17.863692+0000","last_clean":"2024-04-16T15:52:17.863692+0000","last_became_active":"2024-04-16T15:52:14.950926+0000","last_became_peered":"2024-04-16T15:52:14.950926+0000","last_unstale":"2024-04-16T15:52:17.863692+0000","last_undegraded":"2024-04-16T15:52:17.863692+0000","last_fullsized":"2024-04-16T15:52:17.863692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:56:16.060919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.958390+0000","last_change":"2024-04-16T15:52:15.959396+0000","last_active":"2024-04-16T15:52:16.958390+0000","last_peered":"2024-04-16T15:52:16.958390+0000","last_clean":"2024-04-16T15:52:16.958390+0000","last_became_active":"2024-04-16T15:52:15.959074+0000","last_became_peered":"2024-04-16T15:52:15.959074+0000","last_unstale":"2024-04-16T15:52:16.958390+0000","last_undegraded":"2024-04-16T15:52:16.958390+0000","last_fullsized":"2024-04-16T15:52:16.958390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:55:42.881235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.863861+0000","last_change":"2024-04-16T15:52:14.951186+0000","last_active":"2024-04-16T15:52:17.863861+0000","last_peered":"2024-04-16T15:52:17.863861+0000","last_clean":"2024-04-16T15:52:17.863861+0000","last_became_active":"2024-04-16T15:52:14.950881+0000","last_became_peered":"2024-04-16T15:52:14.950881+0000","last_unstale":"2024-04-16T15:52:17.863861+0000","last_undegraded":"2024-04-16T15:52:17.863861+0000","last_fullsized":"2024-04-16T15:52:17.863861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:43:13.134461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:18.871071+0000","last_change":"2024-04-16T15:52:15.954875+0000","last_active":"2024-04-16T15:52:18.871071+0000","last_peered":"2024-04-16T15:52:18.871071+0000","last_clean":"2024-04-16T15:52:18.871071+0000","last_became_active":"2024-04-16T15:52:15.953628+0000","last_became_peered":"2024-04-16T15:52:15.953628+0000","last_unstale":"2024-04-16T15:52:18.871071+0000","last_undegraded":"2024-04-16T15:52:18.871071+0000","last_fullsized":"2024-04-16T15:52:18.871071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:06:46.464243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:18.256113+0000","last_change":"2024-04-16T15:52:14.948410+0000","last_active":"2024-04-16T15:52:18.256113+0000","last_peered":"2024-04-16T15:52:18.256113+0000","last_clean":"2024-04-16T15:52:18.256113+0000","last_became_active":"2024-04-16T15:52:14.947833+0000","last_became_peered":"2024-04-16T15:52:14.947833+0000","last_unstale":"2024-04-16T15:52:18.256113+0000","last_undegraded":"2024-04-16T15:52:18.256113+0000","last_fullsized":"2024-04-16T15:52:18.256113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:52:05.410477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:18.256051+0000","last_change":"2024-04-16T15:52:15.958174+0000","last_active":"2024-04-16T15:52:18.256051+0000","last_peered":"2024-04-16T15:52:18.256051+0000","last_clean":"2024-04-16T15:52:18.256051+0000","last_became_active":"2024-04-16T15:52:15.957886+0000","last_became_peered":"2024-04-16T15:52:15.957886+0000","last_unstale":"2024-04-16T15:52:18.256051+0000","last_undegraded":"2024-04-16T15:52:18.256051+0000","last_fullsized":"2024-04-16T15:52:18.256051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:31:45.732213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:18.871111+0000","last_change":"2024-04-16T15:52:14.948721+0000","last_active":"2024-04-16T15:52:18.871111+0000","last_peered":"2024-04-16T15:52:18.871111+0000","last_clean":"2024-04-16T15:52:18.871111+0000","last_became_active":"2024-04-16T15:52:14.948417+0000","last_became_peered":"2024-04-16T15:52:14.948417+0000","last_unstale":"2024-04-16T15:52:18.871111+0000","last_undegraded":"2024-04-16T15:52:18.871111+0000","last_fullsized":"2024-04-16T15:52:18.871111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:41:48.115342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T15:52:23.357 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T15:52:23.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.497+0000 7f3600d32640 1 Processor -- start 2024-04-16T15:52:23.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.497+0000 7f3600d32640 1 -- start start 2024-04-16T15:52:23.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.498+0000 7f3600d32640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f35fc15ead0 0x7f35fc0b7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:23.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.498+0000 7f3600d32640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35fc06d060 con 0x7f35fc0cfdc0 2024-04-16T15:52:23.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.498+0000 7f3600d32640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35fc06d340 con 0x7f35fc0b63f0 2024-04-16T15:52:23.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.498+0000 7f3600d32640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f35fc0d01d0 con 0x7f35fc15ead0 2024-04-16T15:52:23.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.498+0000 7f35fa59c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f35fc15ead0 0x7f35fc0b7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:23.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.498+0000 7f35fad9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f35fc0cfdc0 0x7f35fc1627e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47310/0 (socket says 172.21.15.132:47310) 2024-04-16T15:52:23.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.498+0000 7f35fad9d640 1 -- 172.21.15.132:0/700890386 learned_addr learned my addr 172.21.15.132:0/700890386 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:23.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.498+0000 7f35fa59c640 1 -- 172.21.15.132:0/700890386 >> v1:172.21.15.179:6789/0 conn(0x7f35fc0b63f0 legacy=0x7f35fc0cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:23.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.498+0000 7f35fa59c640 1 -- 172.21.15.132:0/700890386 >> v1:172.21.15.132:6789/0 conn(0x7f35fc0cfdc0 legacy=0x7f35fc1627e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:23.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.498+0000 7f35f9d9b640 1 -- 172.21.15.132:0/700890386 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3518867129 0 0) 0x7f35fc06d060 con 0x7f35fc0cfdc0 2024-04-16T15:52:23.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.498+0000 7f35fa59c640 1 -- 172.21.15.132:0/700890386 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35fc06d620 con 0x7f35fc15ead0 2024-04-16T15:52:23.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.499+0000 7f35fa59c640 1 --2- 172.21.15.132:0/700890386 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35fc15ead0 0x7f35fc0b7ba0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f35ec0097a0 tx=0x7f35ec02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c99ba2ea6b5e7693 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:23.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.499+0000 7f35f9d9b640 1 -- 172.21.15.132:0/700890386 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35ec035020 con 0x7f35fc15ead0 2024-04-16T15:52:23.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.499+0000 7f35f9d9b640 1 -- 172.21.15.132:0/700890386 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35ec031830 con 0x7f35fc15ead0 2024-04-16T15:52:23.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.499+0000 7f35f9d9b640 1 -- 172.21.15.132:0/700890386 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35ec031c00 con 0x7f35fc15ead0 2024-04-16T15:52:23.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.500+0000 7f3600d32640 1 -- 172.21.15.132:0/700890386 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35fc15ead0 msgr2=0x7f35fc0b7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:23.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.500+0000 7f3600d32640 1 --2- 172.21.15.132:0/700890386 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35fc15ead0 0x7f35fc0b7ba0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f35ec0097a0 tx=0x7f35ec02b8d0 comp rx=0 tx=0).stop 2024-04-16T15:52:23.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.500+0000 7f3600d32640 1 -- 172.21.15.132:0/700890386 shutdown_connections 2024-04-16T15:52:23.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.500+0000 7f3600d32640 1 --2- 172.21.15.132:0/700890386 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35fc15ead0 0x7f35fc0b7ba0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:23.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.500+0000 7f3600d32640 1 -- 172.21.15.132:0/700890386 >> 172.21.15.132:0/700890386 conn(0x7f35fc0d13f0 msgr2=0x7f35fc0d1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:23.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.500+0000 7f3600d32640 1 -- 172.21.15.132:0/700890386 shutdown_connections 2024-04-16T15:52:23.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.500+0000 7f3600d32640 1 -- 172.21.15.132:0/700890386 wait complete. 2024-04-16T15:52:23.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.501+0000 7f3600d32640 1 Processor -- start 2024-04-16T15:52:23.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.501+0000 7f3600d32640 1 -- start start 2024-04-16T15:52:23.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.502+0000 7f3600d32640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35fc0b63f0 0x7f35fc14aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:23.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.502+0000 7f3600d32640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35fc0cfdc0 0x7f35fc15d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:23.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.502+0000 7f3600d32640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35fc15ead0 0x7f35fc14dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:23.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.502+0000 7f3600d32640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f35fc15eeb0 con 0x7f35fc15ead0 2024-04-16T15:52:23.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.502+0000 7f3600d32640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f35fc06dbe0 con 0x7f35fc0b63f0 2024-04-16T15:52:23.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.502+0000 7f3600d32640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f35fc15f030 con 0x7f35fc0cfdc0 2024-04-16T15:52:23.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.502+0000 7f35fad9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35fc15ead0 0x7f35fc14dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:23.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.502+0000 7f35fad9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35fc15ead0 0x7f35fc14dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35358/0 (socket says 172.21.15.132:35358) 2024-04-16T15:52:23.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.502+0000 7f35fad9d640 1 -- 172.21.15.132:0/3061711598 learned_addr learned my addr 172.21.15.132:0/3061711598 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:23.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.502+0000 7f35fa59c640 1 --2- 172.21.15.132:0/3061711598 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35fc0b63f0 0x7f35fc14aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:23.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.502+0000 7f35f3fff640 1 --2- 172.21.15.132:0/3061711598 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35fc0cfdc0 0x7f35fc15d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:23.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.502+0000 7f35fad9d640 1 -- 172.21.15.132:0/3061711598 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35fc0cfdc0 msgr2=0x7f35fc15d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:23.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.502+0000 7f35fad9d640 1 --2- 172.21.15.132:0/3061711598 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35fc0cfdc0 0x7f35fc15d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:23.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.502+0000 7f35fad9d640 1 -- 172.21.15.132:0/3061711598 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35fc0b63f0 msgr2=0x7f35fc14aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:23.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.502+0000 7f35fad9d640 1 --2- 172.21.15.132:0/3061711598 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35fc0b63f0 0x7f35fc14aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:23.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.502+0000 7f35fad9d640 1 -- 172.21.15.132:0/3061711598 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35fc0caa90 con 0x7f35fc15ead0 2024-04-16T15:52:23.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.502+0000 7f35fad9d640 1 --2- 172.21.15.132:0/3061711598 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35fc15ead0 0x7f35fc14dcd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f35f400c7d0 tx=0x7f35f400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:23.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.502+0000 7f35f2ffd640 1 -- 172.21.15.132:0/3061711598 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f4018070 con 0x7f35fc15ead0 2024-04-16T15:52:23.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.502+0000 7f35f2ffd640 1 -- 172.21.15.132:0/3061711598 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35f400a640 con 0x7f35fc15ead0 2024-04-16T15:52:23.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.502+0000 7f3600d32640 1 -- 172.21.15.132:0/3061711598 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35fc0cad70 con 0x7f35fc15ead0 2024-04-16T15:52:23.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.502+0000 7f35f2ffd640 1 -- 172.21.15.132:0/3061711598 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f400aa70 con 0x7f35fc15ead0 2024-04-16T15:52:23.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.502+0000 7f3600d32640 1 -- 172.21.15.132:0/3061711598 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35fc1617c0 con 0x7f35fc15ead0 2024-04-16T15:52:23.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.503+0000 7f3600d32640 1 -- 172.21.15.132:0/3061711598 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35fc075510 con 0x7f35fc15ead0 2024-04-16T15:52:23.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.504+0000 7f35f2ffd640 1 -- 172.21.15.132:0/3061711598 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f35f401b070 con 0x7f35fc15ead0 2024-04-16T15:52:23.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.504+0000 7f35f2ffd640 1 --2- 172.21.15.132:0/3061711598 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f35dc06c8f0 0x7f35dc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:23.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.504+0000 7f35fa59c640 1 --2- 172.21.15.132:0/3061711598 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f35dc06c8f0 0x7f35dc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:23.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.504+0000 7f35f2ffd640 1 -- 172.21.15.132:0/3061711598 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f35f408b1b0 con 0x7f35fc15ead0 2024-04-16T15:52:23.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.505+0000 7f35fa59c640 1 --2- 172.21.15.132:0/3061711598 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f35dc06c8f0 0x7f35dc06edb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f35ec036000 tx=0x7f35ec03c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:23.516 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.509+0000 7f35f2ffd640 1 -- 172.21.15.132:0/3061711598 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f35f40595e0 con 0x7f35fc15ead0 2024-04-16T15:52:23.681 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.682+0000 7f3600d32640 1 -- 172.21.15.132:0/3061711598 --> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f35fc0b6d00 con 0x7f35dc06c8f0 2024-04-16T15:52:23.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.688+0000 7f35f2ffd640 1 -- 172.21.15.132:0/3061711598 <== mgr.4101 v2:172.21.15.132:6832/3896387465 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251835 (secure 0 0 0) 0x7f35fc0b6d00 con 0x7f35dc06c8f0 2024-04-16T15:52:23.690 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:52:23.691 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2024-04-16T15:52:23.693 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.691+0000 7f3600d32640 1 -- 172.21.15.132:0/3061711598 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f35dc06c8f0 msgr2=0x7f35dc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:23.693 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.691+0000 7f3600d32640 1 --2- 172.21.15.132:0/3061711598 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f35dc06c8f0 0x7f35dc06edb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f35ec036000 tx=0x7f35ec03c040 comp rx=0 tx=0).stop 2024-04-16T15:52:23.693 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.691+0000 7f3600d32640 1 -- 172.21.15.132:0/3061711598 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35fc15ead0 msgr2=0x7f35fc14dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:23.693 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.691+0000 7f3600d32640 1 --2- 172.21.15.132:0/3061711598 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35fc15ead0 0x7f35fc14dcd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f35f400c7d0 tx=0x7f35f400cc90 comp rx=0 tx=0).stop 2024-04-16T15:52:23.693 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.691+0000 7f3600d32640 1 -- 172.21.15.132:0/3061711598 shutdown_connections 2024-04-16T15:52:23.693 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.691+0000 7f3600d32640 1 --2- 172.21.15.132:0/3061711598 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f35dc06c8f0 0x7f35dc06edb0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:23.693 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.691+0000 7f3600d32640 1 --2- 172.21.15.132:0/3061711598 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35fc15ead0 0x7f35fc14dcd0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:23.693 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.691+0000 7f3600d32640 1 --2- 172.21.15.132:0/3061711598 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35fc0cfdc0 0x7f35fc15d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:23.693 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.691+0000 7f3600d32640 1 --2- 172.21.15.132:0/3061711598 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35fc0b63f0 0x7f35fc14aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:23.693 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.691+0000 7f3600d32640 1 -- 172.21.15.132:0/3061711598 >> 172.21.15.132:0/3061711598 conn(0x7f35fc0d13f0 msgr2=0x7f35fc0ce2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:23.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.691+0000 7f3600d32640 1 -- 172.21.15.132:0/3061711598 shutdown_connections 2024-04-16T15:52:23.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.691+0000 7f3600d32640 1 -- 172.21.15.132:0/3061711598 wait complete. 2024-04-16T15:52:23.701 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-04-16T15:52:23.271351+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":178,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219008,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755712,"statfs":{"total":773094113280,"available":772869849088,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001519"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.863951+0000","last_change":"2024-04-16T15:52:15.966421+0000","last_active":"2024-04-16T15:52:17.863951+0000","last_peered":"2024-04-16T15:52:17.863951+0000","last_clean":"2024-04-16T15:52:17.863951+0000","last_became_active":"2024-04-16T15:52:15.966130+0000","last_became_peered":"2024-04-16T15:52:15.966130+0000","last_unstale":"2024-04-16T15:52:17.863951+0000","last_undegraded":"2024-04-16T15:52:17.863951+0000","last_fullsized":"2024-04-16T15:52:17.863951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:55:42.881235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.953509+0000","last_change":"2024-04-16T15:52:15.960231+0000","last_active":"2024-04-16T15:52:16.953509+0000","last_peered":"2024-04-16T15:52:16.953509+0000","last_clean":"2024-04-16T15:52:16.953509+0000","last_became_active":"2024-04-16T15:52:15.959916+0000","last_became_peered":"2024-04-16T15:52:15.959916+0000","last_unstale":"2024-04-16T15:52:16.953509+0000","last_undegraded":"2024-04-16T15:52:16.953509+0000","last_fullsized":"2024-04-16T15:52:16.953509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:12:51.264278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:18.870909+0000","last_change":"2024-04-16T15:52:15.958351+0000","last_active":"2024-04-16T15:52:18.870909+0000","last_peered":"2024-04-16T15:52:18.870909+0000","last_clean":"2024-04-16T15:52:18.870909+0000","last_became_active":"2024-04-16T15:52:15.956927+0000","last_became_peered":"2024-04-16T15:52:15.956927+0000","last_unstale":"2024-04-16T15:52:18.870909+0000","last_undegraded":"2024-04-16T15:52:18.870909+0000","last_fullsized":"2024-04-16T15:52:18.870909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:26:03.155698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.958233+0000","last_change":"2024-04-16T15:52:15.961429+0000","last_active":"2024-04-16T15:52:16.958233+0000","last_peered":"2024-04-16T15:52:16.958233+0000","last_clean":"2024-04-16T15:52:16.958233+0000","last_became_active":"2024-04-16T15:52:15.961162+0000","last_became_peered":"2024-04-16T15:52:15.961162+0000","last_unstale":"2024-04-16T15:52:16.958233+0000","last_undegraded":"2024-04-16T15:52:16.958233+0000","last_fullsized":"2024-04-16T15:52:16.958233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:43:19.355250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.863627+0000","last_change":"2024-04-16T15:52:15.960864+0000","last_active":"2024-04-16T15:52:17.863627+0000","last_peered":"2024-04-16T15:52:17.863627+0000","last_clean":"2024-04-16T15:52:17.863627+0000","last_became_active":"2024-04-16T15:52:15.960590+0000","last_became_peered":"2024-04-16T15:52:15.960590+0000","last_unstale":"2024-04-16T15:52:17.863627+0000","last_undegraded":"2024-04-16T15:52:17.863627+0000","last_fullsized":"2024-04-16T15:52:17.863627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:49:00.138512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.957714+0000","last_change":"2024-04-16T15:52:15.960295+0000","last_active":"2024-04-16T15:52:16.957714+0000","last_peered":"2024-04-16T15:52:16.957714+0000","last_clean":"2024-04-16T15:52:16.957714+0000","last_became_active":"2024-04-16T15:52:15.959540+0000","last_became_peered":"2024-04-16T15:52:15.959540+0000","last_unstale":"2024-04-16T15:52:16.957714+0000","last_undegraded":"2024-04-16T15:52:16.957714+0000","last_fullsized":"2024-04-16T15:52:16.957714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:31:45.732213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.863425+0000","last_change":"2024-04-16T15:52:15.960729+0000","last_active":"2024-04-16T15:52:17.863425+0000","last_peered":"2024-04-16T15:52:17.863425+0000","last_clean":"2024-04-16T15:52:17.863425+0000","last_became_active":"2024-04-16T15:52:15.960436+0000","last_became_peered":"2024-04-16T15:52:15.960436+0000","last_unstale":"2024-04-16T15:52:17.863425+0000","last_undegraded":"2024-04-16T15:52:17.863425+0000","last_fullsized":"2024-04-16T15:52:17.863425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:31:45.732213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:18.255738+0000","last_change":"2024-04-16T15:52:15.966326+0000","last_active":"2024-04-16T15:52:18.255738+0000","last_peered":"2024-04-16T15:52:18.255738+0000","last_clean":"2024-04-16T15:52:18.255738+0000","last_became_active":"2024-04-16T15:52:15.966012+0000","last_became_peered":"2024-04-16T15:52:15.966012+0000","last_unstale":"2024-04-16T15:52:18.255738+0000","last_undegraded":"2024-04-16T15:52:18.255738+0000","last_fullsized":"2024-04-16T15:52:18.255738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:26:03.155698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.864038+0000","last_change":"2024-04-16T15:52:15.969843+0000","last_active":"2024-04-16T15:52:17.864038+0000","last_peered":"2024-04-16T15:52:17.864038+0000","last_clean":"2024-04-16T15:52:17.864038+0000","last_became_active":"2024-04-16T15:52:15.969569+0000","last_became_peered":"2024-04-16T15:52:15.969569+0000","last_unstale":"2024-04-16T15:52:17.864038+0000","last_undegraded":"2024-04-16T15:52:17.864038+0000","last_fullsized":"2024-04-16T15:52:17.864038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:18.357867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.959521+0000","last_change":"2024-04-16T15:52:15.964277+0000","last_active":"2024-04-16T15:52:17.959521+0000","last_peered":"2024-04-16T15:52:17.959521+0000","last_clean":"2024-04-16T15:52:17.959521+0000","last_became_active":"2024-04-16T15:52:15.963999+0000","last_became_peered":"2024-04-16T15:52:15.963999+0000","last_unstale":"2024-04-16T15:52:17.959521+0000","last_undegraded":"2024-04-16T15:52:17.959521+0000","last_fullsized":"2024-04-16T15:52:17.959521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:06:46.464243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.959461+0000","last_change":"2024-04-16T15:52:15.962038+0000","last_active":"2024-04-16T15:52:17.959461+0000","last_peered":"2024-04-16T15:52:17.959461+0000","last_clean":"2024-04-16T15:52:17.959461+0000","last_became_active":"2024-04-16T15:52:15.961769+0000","last_became_peered":"2024-04-16T15:52:15.961769+0000","last_unstale":"2024-04-16T15:52:17.959461+0000","last_undegraded":"2024-04-16T15:52:17.959461+0000","last_fullsized":"2024-04-16T15:52:17.959461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:32:03.549437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.957704+0000","last_change":"2024-04-16T15:52:15.955262+0000","last_active":"2024-04-16T15:52:16.957704+0000","last_peered":"2024-04-16T15:52:16.957704+0000","last_clean":"2024-04-16T15:52:16.957704+0000","last_became_active":"2024-04-16T15:52:15.955026+0000","last_became_peered":"2024-04-16T15:52:15.955026+0000","last_unstale":"2024-04-16T15:52:16.957704+0000","last_undegraded":"2024-04-16T15:52:16.957704+0000","last_fullsized":"2024-04-16T15:52:16.957704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:25:37.505791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:18.255970+0000","last_change":"2024-04-16T15:52:15.957719+0000","last_active":"2024-04-16T15:52:18.255970+0000","last_peered":"2024-04-16T15:52:18.255970+0000","last_clean":"2024-04-16T15:52:18.255970+0000","last_became_active":"2024-04-16T15:52:15.957420+0000","last_became_peered":"2024-04-16T15:52:15.957420+0000","last_unstale":"2024-04-16T15:52:18.255970+0000","last_undegraded":"2024-04-16T15:52:18.255970+0000","last_fullsized":"2024-04-16T15:52:18.255970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:12:51.264278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:18.870707+0000","last_change":"2024-04-16T15:52:15.954658+0000","last_active":"2024-04-16T15:52:18.870707+0000","last_peered":"2024-04-16T15:52:18.870707+0000","last_clean":"2024-04-16T15:52:18.870707+0000","last_became_active":"2024-04-16T15:52:15.954415+0000","last_became_peered":"2024-04-16T15:52:15.954415+0000","last_unstale":"2024-04-16T15:52:18.870707+0000","last_undegraded":"2024-04-16T15:52:18.870707+0000","last_fullsized":"2024-04-16T15:52:18.870707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:55:11.299922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.953491+0000","last_change":"2024-04-16T15:52:15.963146+0000","last_active":"2024-04-16T15:52:16.953491+0000","last_peered":"2024-04-16T15:52:16.953491+0000","last_clean":"2024-04-16T15:52:16.953491+0000","last_became_active":"2024-04-16T15:52:15.962757+0000","last_became_peered":"2024-04-16T15:52:15.962757+0000","last_unstale":"2024-04-16T15:52:16.953491+0000","last_undegraded":"2024-04-16T15:52:16.953491+0000","last_fullsized":"2024-04-16T15:52:16.953491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:06:46.464243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.957014+0000","last_change":"2024-04-16T15:52:15.964964+0000","last_active":"2024-04-16T15:52:16.957014+0000","last_peered":"2024-04-16T15:52:16.957014+0000","last_clean":"2024-04-16T15:52:16.957014+0000","last_became_active":"2024-04-16T15:52:15.964719+0000","last_became_peered":"2024-04-16T15:52:15.964719+0000","last_unstale":"2024-04-16T15:52:16.957014+0000","last_undegraded":"2024-04-16T15:52:16.957014+0000","last_fullsized":"2024-04-16T15:52:16.957014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:06:46.464243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.958319+0000","last_change":"2024-04-16T15:52:15.964462+0000","last_active":"2024-04-16T15:52:16.958319+0000","last_peered":"2024-04-16T15:52:16.958319+0000","last_clean":"2024-04-16T15:52:16.958319+0000","last_became_active":"2024-04-16T15:52:15.962472+0000","last_became_peered":"2024-04-16T15:52:15.962472+0000","last_unstale":"2024-04-16T15:52:16.958319+0000","last_undegraded":"2024-04-16T15:52:16.958319+0000","last_fullsized":"2024-04-16T15:52:16.958319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:19:17.423858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.166342+0000","last_change":"2024-04-16T15:52:15.957070+0000","last_active":"2024-04-16T15:52:17.166342+0000","last_peered":"2024-04-16T15:52:17.166342+0000","last_clean":"2024-04-16T15:52:17.166342+0000","last_became_active":"2024-04-16T15:52:15.956709+0000","last_became_peered":"2024-04-16T15:52:15.956709+0000","last_unstale":"2024-04-16T15:52:17.166342+0000","last_undegraded":"2024-04-16T15:52:17.166342+0000","last_fullsized":"2024-04-16T15:52:17.166342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:09:22.888070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.863939+0000","last_change":"2024-04-16T15:52:15.962038+0000","last_active":"2024-04-16T15:52:17.863939+0000","last_peered":"2024-04-16T15:52:17.863939+0000","last_clean":"2024-04-16T15:52:17.863939+0000","last_became_active":"2024-04-16T15:52:15.961798+0000","last_became_peered":"2024-04-16T15:52:15.961798+0000","last_unstale":"2024-04-16T15:52:17.863939+0000","last_undegraded":"2024-04-16T15:52:17.863939+0000","last_fullsized":"2024-04-16T15:52:17.863939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:19:17.423858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.959273+0000","last_change":"2024-04-16T15:52:15.957366+0000","last_active":"2024-04-16T15:52:17.959273+0000","last_peered":"2024-04-16T15:52:17.959273+0000","last_clean":"2024-04-16T15:52:17.959273+0000","last_became_active":"2024-04-16T15:52:15.956820+0000","last_became_peered":"2024-04-16T15:52:15.956820+0000","last_unstale":"2024-04-16T15:52:17.959273+0000","last_undegraded":"2024-04-16T15:52:17.959273+0000","last_fullsized":"2024-04-16T15:52:17.959273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:38:40.918721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:18.870869+0000","last_change":"2024-04-16T15:52:15.960508+0000","last_active":"2024-04-16T15:52:18.870869+0000","last_peered":"2024-04-16T15:52:18.870869+0000","last_clean":"2024-04-16T15:52:18.870869+0000","last_became_active":"2024-04-16T15:52:15.960254+0000","last_became_peered":"2024-04-16T15:52:15.960254+0000","last_unstale":"2024-04-16T15:52:18.870869+0000","last_undegraded":"2024-04-16T15:52:18.870869+0000","last_fullsized":"2024-04-16T15:52:18.870869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:47:47.685958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.957878+0000","last_change":"2024-04-16T15:52:15.954611+0000","last_active":"2024-04-16T15:52:16.957878+0000","last_peered":"2024-04-16T15:52:16.957878+0000","last_clean":"2024-04-16T15:52:16.957878+0000","last_became_active":"2024-04-16T15:52:15.954303+0000","last_became_peered":"2024-04-16T15:52:15.954303+0000","last_unstale":"2024-04-16T15:52:16.957878+0000","last_undegraded":"2024-04-16T15:52:16.957878+0000","last_fullsized":"2024-04-16T15:52:16.957878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:12:23.633108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:18.255824+0000","last_change":"2024-04-16T15:52:15.971774+0000","last_active":"2024-04-16T15:52:18.255824+0000","last_peered":"2024-04-16T15:52:18.255824+0000","last_clean":"2024-04-16T15:52:18.255824+0000","last_became_active":"2024-04-16T15:52:15.971186+0000","last_became_peered":"2024-04-16T15:52:15.971186+0000","last_unstale":"2024-04-16T15:52:18.255824+0000","last_undegraded":"2024-04-16T15:52:18.255824+0000","last_fullsized":"2024-04-16T15:52:18.255824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:32:03.549437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.957191+0000","last_change":"2024-04-16T15:52:15.960952+0000","last_active":"2024-04-16T15:52:16.957191+0000","last_peered":"2024-04-16T15:52:16.957191+0000","last_clean":"2024-04-16T15:52:16.957191+0000","last_became_active":"2024-04-16T15:52:15.960676+0000","last_became_peered":"2024-04-16T15:52:15.960676+0000","last_unstale":"2024-04-16T15:52:16.957191+0000","last_undegraded":"2024-04-16T15:52:16.957191+0000","last_fullsized":"2024-04-16T15:52:16.957191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:12.609412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:18.256211+0000","last_change":"2024-04-16T15:52:15.968822+0000","last_active":"2024-04-16T15:52:18.256211+0000","last_peered":"2024-04-16T15:52:18.256211+0000","last_clean":"2024-04-16T15:52:18.256211+0000","last_became_active":"2024-04-16T15:52:15.968422+0000","last_became_peered":"2024-04-16T15:52:15.968422+0000","last_unstale":"2024-04-16T15:52:18.256211+0000","last_undegraded":"2024-04-16T15:52:18.256211+0000","last_fullsized":"2024-04-16T15:52:18.256211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:20:01.452180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.959596+0000","last_change":"2024-04-16T15:52:15.961136+0000","last_active":"2024-04-16T15:52:17.959596+0000","last_peered":"2024-04-16T15:52:17.959596+0000","last_clean":"2024-04-16T15:52:17.959596+0000","last_became_active":"2024-04-16T15:52:15.960894+0000","last_became_peered":"2024-04-16T15:52:15.960894+0000","last_unstale":"2024-04-16T15:52:17.959596+0000","last_undegraded":"2024-04-16T15:52:17.959596+0000","last_fullsized":"2024-04-16T15:52:17.959596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:12:51.264278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.953334+0000","last_change":"2024-04-16T15:52:15.955537+0000","last_active":"2024-04-16T15:52:16.953334+0000","last_peered":"2024-04-16T15:52:16.953334+0000","last_clean":"2024-04-16T15:52:16.953334+0000","last_became_active":"2024-04-16T15:52:15.955225+0000","last_became_peered":"2024-04-16T15:52:15.955225+0000","last_unstale":"2024-04-16T15:52:16.953334+0000","last_undegraded":"2024-04-16T15:52:16.953334+0000","last_fullsized":"2024-04-16T15:52:16.953334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:38:40.918721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:18.256197+0000","last_change":"2024-04-16T15:52:15.962164+0000","last_active":"2024-04-16T15:52:18.256197+0000","last_peered":"2024-04-16T15:52:18.256197+0000","last_clean":"2024-04-16T15:52:18.256197+0000","last_became_active":"2024-04-16T15:52:15.961616+0000","last_became_peered":"2024-04-16T15:52:15.961616+0000","last_unstale":"2024-04-16T15:52:18.256197+0000","last_undegraded":"2024-04-16T15:52:18.256197+0000","last_fullsized":"2024-04-16T15:52:18.256197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:49:00.138512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:18.870921+0000","last_change":"2024-04-16T15:52:15.960482+0000","last_active":"2024-04-16T15:52:18.870921+0000","last_peered":"2024-04-16T15:52:18.870921+0000","last_clean":"2024-04-16T15:52:18.870921+0000","last_became_active":"2024-04-16T15:52:15.960230+0000","last_became_peered":"2024-04-16T15:52:15.960230+0000","last_unstale":"2024-04-16T15:52:18.870921+0000","last_undegraded":"2024-04-16T15:52:18.870921+0000","last_fullsized":"2024-04-16T15:52:18.870921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:37:47.713734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.958035+0000","last_change":"2024-04-16T15:52:15.959288+0000","last_active":"2024-04-16T15:52:16.958035+0000","last_peered":"2024-04-16T15:52:16.958035+0000","last_clean":"2024-04-16T15:52:16.958035+0000","last_became_active":"2024-04-16T15:52:15.958870+0000","last_became_peered":"2024-04-16T15:52:15.958870+0000","last_unstale":"2024-04-16T15:52:16.958035+0000","last_undegraded":"2024-04-16T15:52:16.958035+0000","last_fullsized":"2024-04-16T15:52:16.958035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:20:01.452180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.166079+0000","last_change":"2024-04-16T15:52:15.962345+0000","last_active":"2024-04-16T15:52:17.166079+0000","last_peered":"2024-04-16T15:52:17.166079+0000","last_clean":"2024-04-16T15:52:17.166079+0000","last_became_active":"2024-04-16T15:52:15.962070+0000","last_became_peered":"2024-04-16T15:52:15.962070+0000","last_unstale":"2024-04-16T15:52:17.166079+0000","last_undegraded":"2024-04-16T15:52:17.166079+0000","last_fullsized":"2024-04-16T15:52:17.166079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:43:14.139014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.959184+0000","last_change":"2024-04-16T15:52:15.964986+0000","last_active":"2024-04-16T15:52:17.959184+0000","last_peered":"2024-04-16T15:52:17.959184+0000","last_clean":"2024-04-16T15:52:17.959184+0000","last_became_active":"2024-04-16T15:52:15.964652+0000","last_became_peered":"2024-04-16T15:52:15.964652+0000","last_unstale":"2024-04-16T15:52:17.959184+0000","last_undegraded":"2024-04-16T15:52:17.959184+0000","last_fullsized":"2024-04-16T15:52:17.959184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:26:03.155698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.956966+0000","last_change":"2024-04-16T15:52:15.951020+0000","last_active":"2024-04-16T15:52:16.956966+0000","last_peered":"2024-04-16T15:52:16.956966+0000","last_clean":"2024-04-16T15:52:16.956966+0000","last_became_active":"2024-04-16T15:52:15.950740+0000","last_became_peered":"2024-04-16T15:52:15.950740+0000","last_unstale":"2024-04-16T15:52:16.956966+0000","last_undegraded":"2024-04-16T15:52:16.956966+0000","last_fullsized":"2024-04-16T15:52:16.956966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:56:17.065473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:18.256123+0000","last_change":"2024-04-16T15:52:14.949066+0000","last_active":"2024-04-16T15:52:18.256123+0000","last_peered":"2024-04-16T15:52:18.256123+0000","last_clean":"2024-04-16T15:52:18.256123+0000","last_became_active":"2024-04-16T15:52:14.948796+0000","last_became_peered":"2024-04-16T15:52:14.948796+0000","last_unstale":"2024-04-16T15:52:18.256123+0000","last_undegraded":"2024-04-16T15:52:18.256123+0000","last_fullsized":"2024-04-16T15:52:18.256123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:54:14.854467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:18.871021+0000","last_change":"2024-04-16T15:52:15.954656+0000","last_active":"2024-04-16T15:52:18.871021+0000","last_peered":"2024-04-16T15:52:18.871021+0000","last_clean":"2024-04-16T15:52:18.871021+0000","last_became_active":"2024-04-16T15:52:15.954391+0000","last_became_peered":"2024-04-16T15:52:15.954391+0000","last_unstale":"2024-04-16T15:52:18.871021+0000","last_undegraded":"2024-04-16T15:52:18.871021+0000","last_fullsized":"2024-04-16T15:52:18.871021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:38:40.918721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.959028+0000","last_change":"2024-04-16T15:52:14.942908+0000","last_active":"2024-04-16T15:52:17.959028+0000","last_peered":"2024-04-16T15:52:17.959028+0000","last_clean":"2024-04-16T15:52:17.959028+0000","last_became_active":"2024-04-16T15:52:14.942553+0000","last_became_peered":"2024-04-16T15:52:14.942553+0000","last_unstale":"2024-04-16T15:52:17.959028+0000","last_undegraded":"2024-04-16T15:52:17.959028+0000","last_fullsized":"2024-04-16T15:52:17.959028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:50:25.315001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:18.255900+0000","last_change":"2024-04-16T15:52:14.947686+0000","last_active":"2024-04-16T15:52:18.255900+0000","last_peered":"2024-04-16T15:52:18.255900+0000","last_clean":"2024-04-16T15:52:18.255900+0000","last_became_active":"2024-04-16T15:52:14.947418+0000","last_became_peered":"2024-04-16T15:52:14.947418+0000","last_unstale":"2024-04-16T15:52:18.255900+0000","last_undegraded":"2024-04-16T15:52:18.255900+0000","last_fullsized":"2024-04-16T15:52:18.255900+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:57:52.293174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:18.255751+0000","last_change":"2024-04-16T15:52:15.968647+0000","last_active":"2024-04-16T15:52:18.255751+0000","last_peered":"2024-04-16T15:52:18.255751+0000","last_clean":"2024-04-16T15:52:18.255751+0000","last_became_active":"2024-04-16T15:52:15.968291+0000","last_became_peered":"2024-04-16T15:52:15.968291+0000","last_unstale":"2024-04-16T15:52:18.255751+0000","last_undegraded":"2024-04-16T15:52:18.255751+0000","last_fullsized":"2024-04-16T15:52:18.255751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:38:40.918721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.957300+0000","last_change":"2024-04-16T15:52:14.937235+0000","last_active":"2024-04-16T15:52:16.957300+0000","last_peered":"2024-04-16T15:52:16.957300+0000","last_clean":"2024-04-16T15:52:16.957300+0000","last_became_active":"2024-04-16T15:52:14.936933+0000","last_became_peered":"2024-04-16T15:52:14.936933+0000","last_unstale":"2024-04-16T15:52:16.957300+0000","last_undegraded":"2024-04-16T15:52:16.957300+0000","last_fullsized":"2024-04-16T15:52:16.957300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:56:16.060919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.953284+0000","last_change":"2024-04-16T15:52:15.956171+0000","last_active":"2024-04-16T15:52:16.953284+0000","last_peered":"2024-04-16T15:52:16.953284+0000","last_clean":"2024-04-16T15:52:16.953284+0000","last_became_active":"2024-04-16T15:52:15.955891+0000","last_became_peered":"2024-04-16T15:52:15.955891+0000","last_unstale":"2024-04-16T15:52:16.953284+0000","last_undegraded":"2024-04-16T15:52:16.953284+0000","last_fullsized":"2024-04-16T15:52:16.953284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:26:03.155698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.959498+0000","last_change":"2024-04-16T15:52:14.949780+0000","last_active":"2024-04-16T15:52:17.959498+0000","last_peered":"2024-04-16T15:52:17.959498+0000","last_clean":"2024-04-16T15:52:17.959498+0000","last_became_active":"2024-04-16T15:52:14.949488+0000","last_became_peered":"2024-04-16T15:52:14.949488+0000","last_unstale":"2024-04-16T15:52:17.959498+0000","last_undegraded":"2024-04-16T15:52:17.959498+0000","last_fullsized":"2024-04-16T15:52:17.959498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:57:52.293174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.957085+0000","last_change":"2024-04-16T15:52:15.963253+0000","last_active":"2024-04-16T15:52:16.957085+0000","last_peered":"2024-04-16T15:52:16.957085+0000","last_clean":"2024-04-16T15:52:16.957085+0000","last_became_active":"2024-04-16T15:52:15.962755+0000","last_became_peered":"2024-04-16T15:52:15.962755+0000","last_unstale":"2024-04-16T15:52:16.957085+0000","last_undegraded":"2024-04-16T15:52:16.957085+0000","last_fullsized":"2024-04-16T15:52:16.957085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:12:51.264278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.957206+0000","last_change":"2024-04-16T15:52:14.948736+0000","last_active":"2024-04-16T15:52:16.957206+0000","last_peered":"2024-04-16T15:52:16.957206+0000","last_clean":"2024-04-16T15:52:16.957206+0000","last_became_active":"2024-04-16T15:52:14.948413+0000","last_became_peered":"2024-04-16T15:52:14.948413+0000","last_unstale":"2024-04-16T15:52:16.957206+0000","last_undegraded":"2024-04-16T15:52:16.957206+0000","last_fullsized":"2024-04-16T15:52:16.957206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:05:32.659988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:18.871039+0000","last_change":"2024-04-16T15:52:15.962582+0000","last_active":"2024-04-16T15:52:18.871039+0000","last_peered":"2024-04-16T15:52:18.871039+0000","last_clean":"2024-04-16T15:52:18.871039+0000","last_became_active":"2024-04-16T15:52:15.962290+0000","last_became_peered":"2024-04-16T15:52:15.962290+0000","last_unstale":"2024-04-16T15:52:18.871039+0000","last_undegraded":"2024-04-16T15:52:18.871039+0000","last_fullsized":"2024-04-16T15:52:18.871039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:32:03.549437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.953451+0000","last_change":"2024-04-16T15:52:14.942420+0000","last_active":"2024-04-16T15:52:16.953451+0000","last_peered":"2024-04-16T15:52:16.953451+0000","last_clean":"2024-04-16T15:52:16.953451+0000","last_became_active":"2024-04-16T15:52:14.942185+0000","last_became_peered":"2024-04-16T15:52:14.942185+0000","last_unstale":"2024-04-16T15:52:16.953451+0000","last_undegraded":"2024-04-16T15:52:16.953451+0000","last_fullsized":"2024-04-16T15:52:16.953451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:25:36.501237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.957745+0000","last_change":"2024-04-16T15:52:15.968661+0000","last_active":"2024-04-16T15:52:16.957745+0000","last_peered":"2024-04-16T15:52:16.957745+0000","last_clean":"2024-04-16T15:52:16.957745+0000","last_became_active":"2024-04-16T15:52:15.968372+0000","last_became_peered":"2024-04-16T15:52:15.968372+0000","last_unstale":"2024-04-16T15:52:16.957745+0000","last_undegraded":"2024-04-16T15:52:16.957745+0000","last_fullsized":"2024-04-16T15:52:16.957745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:52:38.940563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.959249+0000","last_change":"2024-04-16T15:52:14.947183+0000","last_active":"2024-04-16T15:52:17.959249+0000","last_peered":"2024-04-16T15:52:17.959249+0000","last_clean":"2024-04-16T15:52:17.959249+0000","last_became_active":"2024-04-16T15:52:14.946917+0000","last_became_peered":"2024-04-16T15:52:14.946917+0000","last_unstale":"2024-04-16T15:52:17.959249+0000","last_undegraded":"2024-04-16T15:52:17.959249+0000","last_fullsized":"2024-04-16T15:52:17.959249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:25:36.501237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.863691+0000","last_change":"2024-04-16T15:52:15.960326+0000","last_active":"2024-04-16T15:52:17.863691+0000","last_peered":"2024-04-16T15:52:17.863691+0000","last_clean":"2024-04-16T15:52:17.863691+0000","last_became_active":"2024-04-16T15:52:15.960019+0000","last_became_peered":"2024-04-16T15:52:15.960019+0000","last_unstale":"2024-04-16T15:52:17.863691+0000","last_undegraded":"2024-04-16T15:52:17.863691+0000","last_fullsized":"2024-04-16T15:52:17.863691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:20:01.452180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:18.871011+0000","last_change":"2024-04-16T15:52:14.943977+0000","last_active":"2024-04-16T15:52:18.871011+0000","last_peered":"2024-04-16T15:52:18.871011+0000","last_clean":"2024-04-16T15:52:18.871011+0000","last_became_active":"2024-04-16T15:52:14.942113+0000","last_became_peered":"2024-04-16T15:52:14.942113+0000","last_unstale":"2024-04-16T15:52:18.871011+0000","last_undegraded":"2024-04-16T15:52:18.871011+0000","last_fullsized":"2024-04-16T15:52:18.871011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:54:14.854467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:18.870810+0000","last_change":"2024-04-16T15:52:15.963253+0000","last_active":"2024-04-16T15:52:18.870810+0000","last_peered":"2024-04-16T15:52:18.870810+0000","last_clean":"2024-04-16T15:52:18.870810+0000","last_became_active":"2024-04-16T15:52:15.963021+0000","last_became_peered":"2024-04-16T15:52:15.963021+0000","last_unstale":"2024-04-16T15:52:18.870810+0000","last_undegraded":"2024-04-16T15:52:18.870810+0000","last_fullsized":"2024-04-16T15:52:18.870810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:30:06.435878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.958161+0000","last_change":"2024-04-16T15:52:14.947713+0000","last_active":"2024-04-16T15:52:16.958161+0000","last_peered":"2024-04-16T15:52:16.958161+0000","last_clean":"2024-04-16T15:52:16.958161+0000","last_became_active":"2024-04-16T15:52:14.947256+0000","last_became_peered":"2024-04-16T15:52:14.947256+0000","last_unstale":"2024-04-16T15:52:16.958161+0000","last_undegraded":"2024-04-16T15:52:16.958161+0000","last_fullsized":"2024-04-16T15:52:16.958161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:50:25.315001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.863700+0000","last_change":"2024-04-16T15:52:15.971167+0000","last_active":"2024-04-16T15:52:17.863700+0000","last_peered":"2024-04-16T15:52:17.863700+0000","last_clean":"2024-04-16T15:52:17.863700+0000","last_became_active":"2024-04-16T15:52:15.970297+0000","last_became_peered":"2024-04-16T15:52:15.970297+0000","last_unstale":"2024-04-16T15:52:17.863700+0000","last_undegraded":"2024-04-16T15:52:17.863700+0000","last_fullsized":"2024-04-16T15:52:17.863700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:43:19.355250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.959001+0000","last_change":"2024-04-16T15:52:14.944001+0000","last_active":"2024-04-16T15:52:17.959001+0000","last_peered":"2024-04-16T15:52:17.959001+0000","last_clean":"2024-04-16T15:52:17.959001+0000","last_became_active":"2024-04-16T15:52:14.943399+0000","last_became_peered":"2024-04-16T15:52:14.943399+0000","last_unstale":"2024-04-16T15:52:17.959001+0000","last_undegraded":"2024-04-16T15:52:17.959001+0000","last_fullsized":"2024-04-16T15:52:17.959001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:56:16.060919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.959076+0000","last_change":"2024-04-16T15:52:15.966108+0000","last_active":"2024-04-16T15:52:17.959076+0000","last_peered":"2024-04-16T15:52:17.959076+0000","last_clean":"2024-04-16T15:52:17.959076+0000","last_became_active":"2024-04-16T15:52:15.965453+0000","last_became_peered":"2024-04-16T15:52:15.965453+0000","last_unstale":"2024-04-16T15:52:17.959076+0000","last_undegraded":"2024-04-16T15:52:17.959076+0000","last_fullsized":"2024-04-16T15:52:17.959076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:47:47.685958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.166026+0000","last_change":"2024-04-16T15:52:14.942830+0000","last_active":"2024-04-16T15:52:17.166026+0000","last_peered":"2024-04-16T15:52:17.166026+0000","last_clean":"2024-04-16T15:52:17.166026+0000","last_became_active":"2024-04-16T15:52:14.942553+0000","last_became_peered":"2024-04-16T15:52:14.942553+0000","last_unstale":"2024-04-16T15:52:17.166026+0000","last_undegraded":"2024-04-16T15:52:17.166026+0000","last_fullsized":"2024-04-16T15:52:17.166026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:56:16.060919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.863469+0000","last_change":"2024-04-16T15:52:15.970722+0000","last_active":"2024-04-16T15:52:17.863469+0000","last_peered":"2024-04-16T15:52:17.863469+0000","last_clean":"2024-04-16T15:52:17.863469+0000","last_became_active":"2024-04-16T15:52:15.970463+0000","last_became_peered":"2024-04-16T15:52:15.970463+0000","last_unstale":"2024-04-16T15:52:17.863469+0000","last_undegraded":"2024-04-16T15:52:17.863469+0000","last_fullsized":"2024-04-16T15:52:17.863469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:12:23.633108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.958010+0000","last_change":"2024-04-16T15:52:14.945683+0000","last_active":"2024-04-16T15:52:16.958010+0000","last_peered":"2024-04-16T15:52:16.958010+0000","last_clean":"2024-04-16T15:52:16.958010+0000","last_became_active":"2024-04-16T15:52:14.945282+0000","last_became_peered":"2024-04-16T15:52:14.945282+0000","last_unstale":"2024-04-16T15:52:16.958010+0000","last_undegraded":"2024-04-16T15:52:16.958010+0000","last_fullsized":"2024-04-16T15:52:16.958010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:32:02.360792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.863944+0000","last_change":"2024-04-16T15:52:15.967350+0000","last_active":"2024-04-16T15:52:17.863944+0000","last_peered":"2024-04-16T15:52:17.863944+0000","last_clean":"2024-04-16T15:52:17.863944+0000","last_became_active":"2024-04-16T15:52:15.967083+0000","last_became_peered":"2024-04-16T15:52:15.967083+0000","last_unstale":"2024-04-16T15:52:17.863944+0000","last_undegraded":"2024-04-16T15:52:17.863944+0000","last_fullsized":"2024-04-16T15:52:17.863944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:32:53.550133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.166349+0000","last_change":"2024-04-16T15:52:14.946978+0000","last_active":"2024-04-16T15:52:17.166349+0000","last_peered":"2024-04-16T15:52:17.166349+0000","last_clean":"2024-04-16T15:52:17.166349+0000","last_became_active":"2024-04-16T15:52:14.946652+0000","last_became_peered":"2024-04-16T15:52:14.946652+0000","last_unstale":"2024-04-16T15:52:17.166349+0000","last_undegraded":"2024-04-16T15:52:17.166349+0000","last_fullsized":"2024-04-16T15:52:17.166349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:57:52.293174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.864076+0000","last_change":"2024-04-16T15:52:15.970506+0000","last_active":"2024-04-16T15:52:17.864076+0000","last_peered":"2024-04-16T15:52:17.864076+0000","last_clean":"2024-04-16T15:52:17.864076+0000","last_became_active":"2024-04-16T15:52:15.970199+0000","last_became_peered":"2024-04-16T15:52:15.970199+0000","last_unstale":"2024-04-16T15:52:17.864076+0000","last_undegraded":"2024-04-16T15:52:17.864076+0000","last_fullsized":"2024-04-16T15:52:17.864076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:55:34.371253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.953459+0000","last_change":"2024-04-16T15:52:14.941968+0000","last_active":"2024-04-16T15:52:16.953459+0000","last_peered":"2024-04-16T15:52:16.953459+0000","last_clean":"2024-04-16T15:52:16.953459+0000","last_became_active":"2024-04-16T15:52:14.941684+0000","last_became_peered":"2024-04-16T15:52:14.941684+0000","last_unstale":"2024-04-16T15:52:16.953459+0000","last_undegraded":"2024-04-16T15:52:16.953459+0000","last_fullsized":"2024-04-16T15:52:16.953459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:52:37.936009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.958409+0000","last_change":"2024-04-16T15:52:15.959098+0000","last_active":"2024-04-16T15:52:16.958409+0000","last_peered":"2024-04-16T15:52:16.958409+0000","last_clean":"2024-04-16T15:52:16.958409+0000","last_became_active":"2024-04-16T15:52:15.958816+0000","last_became_peered":"2024-04-16T15:52:15.958816+0000","last_unstale":"2024-04-16T15:52:16.958409+0000","last_undegraded":"2024-04-16T15:52:16.958409+0000","last_fullsized":"2024-04-16T15:52:16.958409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:32:53.550133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.166208+0000","last_change":"2024-04-16T15:52:14.941162+0000","last_active":"2024-04-16T15:52:17.166208+0000","last_peered":"2024-04-16T15:52:17.166208+0000","last_clean":"2024-04-16T15:52:17.166208+0000","last_became_active":"2024-04-16T15:52:14.940893+0000","last_became_peered":"2024-04-16T15:52:14.940893+0000","last_unstale":"2024-04-16T15:52:17.166208+0000","last_undegraded":"2024-04-16T15:52:17.166208+0000","last_fullsized":"2024-04-16T15:52:17.166208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:52:05.410477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.863706+0000","last_change":"2024-04-16T15:52:15.971577+0000","last_active":"2024-04-16T15:52:17.863706+0000","last_peered":"2024-04-16T15:52:17.863706+0000","last_clean":"2024-04-16T15:52:17.863706+0000","last_became_active":"2024-04-16T15:52:15.971055+0000","last_became_peered":"2024-04-16T15:52:15.971055+0000","last_unstale":"2024-04-16T15:52:17.863706+0000","last_undegraded":"2024-04-16T15:52:17.863706+0000","last_fullsized":"2024-04-16T15:52:17.863706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:15:54.440902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.863473+0000","last_change":"2024-04-16T15:52:04.356095+0000","last_active":"2024-04-16T15:52:17.863473+0000","last_peered":"2024-04-16T15:52:17.863473+0000","last_clean":"2024-04-16T15:52:17.863473+0000","last_became_active":"2024-04-16T15:52:04.355126+0000","last_became_peered":"2024-04-16T15:52:04.355126+0000","last_unstale":"2024-04-16T15:52:17.863473+0000","last_undegraded":"2024-04-16T15:52:17.863473+0000","last_fullsized":"2024-04-16T15:52:17.863473+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:03.285037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:03.285037+0000","last_clean_scrub_stamp":"2024-04-16T15:52:03.285037+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:19.005024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.957635+0000","last_change":"2024-04-16T15:52:14.939932+0000","last_active":"2024-04-16T15:52:16.957635+0000","last_peered":"2024-04-16T15:52:16.957635+0000","last_clean":"2024-04-16T15:52:16.957635+0000","last_became_active":"2024-04-16T15:52:14.939347+0000","last_became_peered":"2024-04-16T15:52:14.939347+0000","last_unstale":"2024-04-16T15:52:16.957635+0000","last_undegraded":"2024-04-16T15:52:16.957635+0000","last_fullsized":"2024-04-16T15:52:16.957635+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:57:52.293174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:18.256242+0000","last_change":"2024-04-16T15:52:15.966920+0000","last_active":"2024-04-16T15:52:18.256242+0000","last_peered":"2024-04-16T15:52:18.256242+0000","last_clean":"2024-04-16T15:52:18.256242+0000","last_became_active":"2024-04-16T15:52:15.966702+0000","last_became_peered":"2024-04-16T15:52:15.966702+0000","last_unstale":"2024-04-16T15:52:18.256242+0000","last_undegraded":"2024-04-16T15:52:18.256242+0000","last_fullsized":"2024-04-16T15:52:18.256242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:15:54.440902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.863328+0000","last_change":"2024-04-16T15:52:14.949823+0000","last_active":"2024-04-16T15:52:17.863328+0000","last_peered":"2024-04-16T15:52:17.863328+0000","last_clean":"2024-04-16T15:52:17.863328+0000","last_became_active":"2024-04-16T15:52:14.949402+0000","last_became_peered":"2024-04-16T15:52:14.949402+0000","last_unstale":"2024-04-16T15:52:17.863328+0000","last_undegraded":"2024-04-16T15:52:17.863328+0000","last_fullsized":"2024-04-16T15:52:17.863328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:09:21.883516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:18.870846+0000","last_change":"2024-04-16T15:52:15.965283+0000","last_active":"2024-04-16T15:52:18.870846+0000","last_peered":"2024-04-16T15:52:18.870846+0000","last_clean":"2024-04-16T15:52:18.870846+0000","last_became_active":"2024-04-16T15:52:15.964965+0000","last_became_peered":"2024-04-16T15:52:15.964965+0000","last_unstale":"2024-04-16T15:52:18.870846+0000","last_undegraded":"2024-04-16T15:52:18.870846+0000","last_fullsized":"2024-04-16T15:52:18.870846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:29:56.924883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.166130+0000","last_change":"2024-04-16T15:52:14.948651+0000","last_active":"2024-04-16T15:52:17.166130+0000","last_peered":"2024-04-16T15:52:17.166130+0000","last_clean":"2024-04-16T15:52:17.166130+0000","last_became_active":"2024-04-16T15:52:14.948371+0000","last_became_peered":"2024-04-16T15:52:14.948371+0000","last_unstale":"2024-04-16T15:52:17.166130+0000","last_undegraded":"2024-04-16T15:52:17.166130+0000","last_fullsized":"2024-04-16T15:52:17.166130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:05:32.659988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.953291+0000","last_change":"2024-04-16T15:52:15.955167+0000","last_active":"2024-04-16T15:52:16.953291+0000","last_peered":"2024-04-16T15:52:16.953291+0000","last_clean":"2024-04-16T15:52:16.953291+0000","last_became_active":"2024-04-16T15:52:15.954877+0000","last_became_peered":"2024-04-16T15:52:15.954877+0000","last_unstale":"2024-04-16T15:52:16.953291+0000","last_undegraded":"2024-04-16T15:52:16.953291+0000","last_fullsized":"2024-04-16T15:52:16.953291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:37:47.713734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.958193+0000","last_change":"2024-04-16T15:52:14.943461+0000","last_active":"2024-04-16T15:52:16.958193+0000","last_peered":"2024-04-16T15:52:16.958193+0000","last_clean":"2024-04-16T15:52:16.958193+0000","last_became_active":"2024-04-16T15:52:14.943188+0000","last_became_peered":"2024-04-16T15:52:14.943188+0000","last_unstale":"2024-04-16T15:52:16.958193+0000","last_undegraded":"2024-04-16T15:52:16.958193+0000","last_fullsized":"2024-04-16T15:52:16.958193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:25:36.501237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.957431+0000","last_change":"2024-04-16T15:52:15.955147+0000","last_active":"2024-04-16T15:52:16.957431+0000","last_peered":"2024-04-16T15:52:16.957431+0000","last_clean":"2024-04-16T15:52:16.957431+0000","last_became_active":"2024-04-16T15:52:15.954234+0000","last_became_peered":"2024-04-16T15:52:15.954234+0000","last_unstale":"2024-04-16T15:52:16.957431+0000","last_undegraded":"2024-04-16T15:52:16.957431+0000","last_fullsized":"2024-04-16T15:52:16.957431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:50:26.319554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.953318+0000","last_change":"2024-04-16T15:52:14.943962+0000","last_active":"2024-04-16T15:52:16.953318+0000","last_peered":"2024-04-16T15:52:16.953318+0000","last_clean":"2024-04-16T15:52:16.953318+0000","last_became_active":"2024-04-16T15:52:14.943709+0000","last_became_peered":"2024-04-16T15:52:14.943709+0000","last_unstale":"2024-04-16T15:52:16.953318+0000","last_undegraded":"2024-04-16T15:52:16.953318+0000","last_fullsized":"2024-04-16T15:52:16.953318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:43:13.134461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.958129+0000","last_change":"2024-04-16T15:52:15.953840+0000","last_active":"2024-04-16T15:52:16.958129+0000","last_peered":"2024-04-16T15:52:16.958129+0000","last_clean":"2024-04-16T15:52:16.958129+0000","last_became_active":"2024-04-16T15:52:15.953574+0000","last_became_peered":"2024-04-16T15:52:15.953574+0000","last_unstale":"2024-04-16T15:52:16.958129+0000","last_undegraded":"2024-04-16T15:52:16.958129+0000","last_fullsized":"2024-04-16T15:52:16.958129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:15:54.440902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.864016+0000","last_change":"2024-04-16T15:52:14.950797+0000","last_active":"2024-04-16T15:52:17.864016+0000","last_peered":"2024-04-16T15:52:17.864016+0000","last_clean":"2024-04-16T15:52:17.864016+0000","last_became_active":"2024-04-16T15:52:14.950474+0000","last_became_peered":"2024-04-16T15:52:14.950474+0000","last_unstale":"2024-04-16T15:52:17.864016+0000","last_undegraded":"2024-04-16T15:52:17.864016+0000","last_fullsized":"2024-04-16T15:52:17.864016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:52:37.936009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.953360+0000","last_change":"2024-04-16T15:52:15.954764+0000","last_active":"2024-04-16T15:52:16.953360+0000","last_peered":"2024-04-16T15:52:16.953360+0000","last_clean":"2024-04-16T15:52:16.953360+0000","last_became_active":"2024-04-16T15:52:15.954454+0000","last_became_peered":"2024-04-16T15:52:15.954454+0000","last_unstale":"2024-04-16T15:52:16.953360+0000","last_undegraded":"2024-04-16T15:52:16.953360+0000","last_fullsized":"2024-04-16T15:52:16.953360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:32:03.549437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.290499+0000","last_change":"2024-04-16T15:52:14.945505+0000","last_active":"2024-04-16T15:52:17.290499+0000","last_peered":"2024-04-16T15:52:17.290499+0000","last_clean":"2024-04-16T15:52:17.290499+0000","last_became_active":"2024-04-16T15:52:14.945275+0000","last_became_peered":"2024-04-16T15:52:14.945275+0000","last_unstale":"2024-04-16T15:52:17.290499+0000","last_undegraded":"2024-04-16T15:52:17.290499+0000","last_fullsized":"2024-04-16T15:52:17.290499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:50:25.315001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:18.256182+0000","last_change":"2024-04-16T15:52:15.962328+0000","last_active":"2024-04-16T15:52:18.256182+0000","last_peered":"2024-04-16T15:52:18.256182+0000","last_clean":"2024-04-16T15:52:18.256182+0000","last_became_active":"2024-04-16T15:52:15.961856+0000","last_became_peered":"2024-04-16T15:52:15.961856+0000","last_unstale":"2024-04-16T15:52:18.256182+0000","last_undegraded":"2024-04-16T15:52:18.256182+0000","last_fullsized":"2024-04-16T15:52:18.256182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:12:23.633108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.959506+0000","last_change":"2024-04-16T15:52:14.948103+0000","last_active":"2024-04-16T15:52:17.959506+0000","last_peered":"2024-04-16T15:52:17.959506+0000","last_clean":"2024-04-16T15:52:17.959506+0000","last_became_active":"2024-04-16T15:52:14.947827+0000","last_became_peered":"2024-04-16T15:52:14.947827+0000","last_unstale":"2024-04-16T15:52:17.959506+0000","last_undegraded":"2024-04-16T15:52:17.959506+0000","last_fullsized":"2024-04-16T15:52:17.959506+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:05:32.659988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:18.871072+0000","last_change":"2024-04-16T15:52:15.954129+0000","last_active":"2024-04-16T15:52:18.871072+0000","last_peered":"2024-04-16T15:52:18.871072+0000","last_clean":"2024-04-16T15:52:18.871072+0000","last_became_active":"2024-04-16T15:52:15.953833+0000","last_became_peered":"2024-04-16T15:52:15.953833+0000","last_unstale":"2024-04-16T15:52:18.871072+0000","last_undegraded":"2024-04-16T15:52:18.871072+0000","last_fullsized":"2024-04-16T15:52:18.871072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:12:51.264278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.863328+0000","last_change":"2024-04-16T15:52:14.951279+0000","last_active":"2024-04-16T15:52:17.863328+0000","last_peered":"2024-04-16T15:52:17.863328+0000","last_clean":"2024-04-16T15:52:17.863328+0000","last_became_active":"2024-04-16T15:52:14.950928+0000","last_became_peered":"2024-04-16T15:52:14.950928+0000","last_unstale":"2024-04-16T15:52:17.863328+0000","last_undegraded":"2024-04-16T15:52:17.863328+0000","last_fullsized":"2024-04-16T15:52:17.863328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:50:25.315001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.958003+0000","last_change":"2024-04-16T15:52:15.959257+0000","last_active":"2024-04-16T15:52:16.958003+0000","last_peered":"2024-04-16T15:52:16.958003+0000","last_clean":"2024-04-16T15:52:16.958003+0000","last_became_active":"2024-04-16T15:52:15.957931+0000","last_became_peered":"2024-04-16T15:52:15.957931+0000","last_unstale":"2024-04-16T15:52:16.958003+0000","last_undegraded":"2024-04-16T15:52:16.958003+0000","last_fullsized":"2024-04-16T15:52:16.958003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:43:14.139014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.953380+0000","last_change":"2024-04-16T15:52:14.947381+0000","last_active":"2024-04-16T15:52:16.953380+0000","last_peered":"2024-04-16T15:52:16.953380+0000","last_clean":"2024-04-16T15:52:16.953380+0000","last_became_active":"2024-04-16T15:52:14.947124+0000","last_became_peered":"2024-04-16T15:52:14.947124+0000","last_unstale":"2024-04-16T15:52:16.953380+0000","last_undegraded":"2024-04-16T15:52:16.953380+0000","last_fullsized":"2024-04-16T15:52:16.953380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:05:32.659988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:18.255899+0000","last_change":"2024-04-16T15:52:15.962034+0000","last_active":"2024-04-16T15:52:18.255899+0000","last_peered":"2024-04-16T15:52:18.255899+0000","last_clean":"2024-04-16T15:52:18.255899+0000","last_became_active":"2024-04-16T15:52:15.954240+0000","last_became_peered":"2024-04-16T15:52:15.954240+0000","last_unstale":"2024-04-16T15:52:18.255899+0000","last_undegraded":"2024-04-16T15:52:18.255899+0000","last_fullsized":"2024-04-16T15:52:18.255899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:06:46.464243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.953436+0000","last_change":"2024-04-16T15:52:14.946919+0000","last_active":"2024-04-16T15:52:16.953436+0000","last_peered":"2024-04-16T15:52:16.953436+0000","last_clean":"2024-04-16T15:52:16.953436+0000","last_became_active":"2024-04-16T15:52:14.946666+0000","last_became_peered":"2024-04-16T15:52:14.946666+0000","last_unstale":"2024-04-16T15:52:16.953436+0000","last_undegraded":"2024-04-16T15:52:16.953436+0000","last_fullsized":"2024-04-16T15:52:16.953436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:56:16.060919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:18.256025+0000","last_change":"2024-04-16T15:52:15.961288+0000","last_active":"2024-04-16T15:52:18.256025+0000","last_peered":"2024-04-16T15:52:18.256025+0000","last_clean":"2024-04-16T15:52:18.256025+0000","last_became_active":"2024-04-16T15:52:15.961033+0000","last_became_peered":"2024-04-16T15:52:15.961033+0000","last_unstale":"2024-04-16T15:52:18.256025+0000","last_undegraded":"2024-04-16T15:52:18.256025+0000","last_fullsized":"2024-04-16T15:52:18.256025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:12.609412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.863749+0000","last_change":"2024-04-16T15:52:14.951317+0000","last_active":"2024-04-16T15:52:17.863749+0000","last_peered":"2024-04-16T15:52:17.863749+0000","last_clean":"2024-04-16T15:52:17.863749+0000","last_became_active":"2024-04-16T15:52:14.950992+0000","last_became_peered":"2024-04-16T15:52:14.950992+0000","last_unstale":"2024-04-16T15:52:17.863749+0000","last_undegraded":"2024-04-16T15:52:17.863749+0000","last_fullsized":"2024-04-16T15:52:17.863749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:25:36.501237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.959215+0000","last_change":"2024-04-16T15:52:15.958425+0000","last_active":"2024-04-16T15:52:17.959215+0000","last_peered":"2024-04-16T15:52:17.959215+0000","last_clean":"2024-04-16T15:52:17.959215+0000","last_became_active":"2024-04-16T15:52:15.957473+0000","last_became_peered":"2024-04-16T15:52:15.957473+0000","last_unstale":"2024-04-16T15:52:17.959215+0000","last_undegraded":"2024-04-16T15:52:17.959215+0000","last_fullsized":"2024-04-16T15:52:17.959215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:37:47.713734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.957965+0000","last_change":"2024-04-16T15:52:15.960621+0000","last_active":"2024-04-16T15:52:16.957965+0000","last_peered":"2024-04-16T15:52:16.957965+0000","last_clean":"2024-04-16T15:52:16.957965+0000","last_became_active":"2024-04-16T15:52:15.959965+0000","last_became_peered":"2024-04-16T15:52:15.959965+0000","last_unstale":"2024-04-16T15:52:16.957965+0000","last_undegraded":"2024-04-16T15:52:16.957965+0000","last_fullsized":"2024-04-16T15:52:16.957965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:49:00.138512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.863692+0000","last_change":"2024-04-16T15:52:14.951351+0000","last_active":"2024-04-16T15:52:17.863692+0000","last_peered":"2024-04-16T15:52:17.863692+0000","last_clean":"2024-04-16T15:52:17.863692+0000","last_became_active":"2024-04-16T15:52:14.950926+0000","last_became_peered":"2024-04-16T15:52:14.950926+0000","last_unstale":"2024-04-16T15:52:17.863692+0000","last_undegraded":"2024-04-16T15:52:17.863692+0000","last_fullsized":"2024-04-16T15:52:17.863692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:56:16.060919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:16.958390+0000","last_change":"2024-04-16T15:52:15.959396+0000","last_active":"2024-04-16T15:52:16.958390+0000","last_peered":"2024-04-16T15:52:16.958390+0000","last_clean":"2024-04-16T15:52:16.958390+0000","last_became_active":"2024-04-16T15:52:15.959074+0000","last_became_peered":"2024-04-16T15:52:15.959074+0000","last_unstale":"2024-04-16T15:52:16.958390+0000","last_undegraded":"2024-04-16T15:52:16.958390+0000","last_fullsized":"2024-04-16T15:52:16.958390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:55:42.881235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:17.863861+0000","last_change":"2024-04-16T15:52:14.951186+0000","last_active":"2024-04-16T15:52:17.863861+0000","last_peered":"2024-04-16T15:52:17.863861+0000","last_clean":"2024-04-16T15:52:17.863861+0000","last_became_active":"2024-04-16T15:52:14.950881+0000","last_became_peered":"2024-04-16T15:52:14.950881+0000","last_unstale":"2024-04-16T15:52:17.863861+0000","last_undegraded":"2024-04-16T15:52:17.863861+0000","last_fullsized":"2024-04-16T15:52:17.863861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:43:13.134461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:18.871071+0000","last_change":"2024-04-16T15:52:15.954875+0000","last_active":"2024-04-16T15:52:18.871071+0000","last_peered":"2024-04-16T15:52:18.871071+0000","last_clean":"2024-04-16T15:52:18.871071+0000","last_became_active":"2024-04-16T15:52:15.953628+0000","last_became_peered":"2024-04-16T15:52:15.953628+0000","last_unstale":"2024-04-16T15:52:18.871071+0000","last_undegraded":"2024-04-16T15:52:18.871071+0000","last_fullsized":"2024-04-16T15:52:18.871071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:06:46.464243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:18.256113+0000","last_change":"2024-04-16T15:52:14.948410+0000","last_active":"2024-04-16T15:52:18.256113+0000","last_peered":"2024-04-16T15:52:18.256113+0000","last_clean":"2024-04-16T15:52:18.256113+0000","last_became_active":"2024-04-16T15:52:14.947833+0000","last_became_peered":"2024-04-16T15:52:14.947833+0000","last_unstale":"2024-04-16T15:52:18.256113+0000","last_undegraded":"2024-04-16T15:52:18.256113+0000","last_fullsized":"2024-04-16T15:52:18.256113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:52:05.410477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:18.256051+0000","last_change":"2024-04-16T15:52:15.958174+0000","last_active":"2024-04-16T15:52:18.256051+0000","last_peered":"2024-04-16T15:52:18.256051+0000","last_clean":"2024-04-16T15:52:18.256051+0000","last_became_active":"2024-04-16T15:52:15.957886+0000","last_became_peered":"2024-04-16T15:52:15.957886+0000","last_unstale":"2024-04-16T15:52:18.256051+0000","last_undegraded":"2024-04-16T15:52:18.256051+0000","last_fullsized":"2024-04-16T15:52:18.256051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:14.924992+0000","last_clean_scrub_stamp":"2024-04-16T15:52:14.924992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:31:45.732213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-16T15:52:18.871111+0000","last_change":"2024-04-16T15:52:14.948721+0000","last_active":"2024-04-16T15:52:18.871111+0000","last_peered":"2024-04-16T15:52:18.871111+0000","last_clean":"2024-04-16T15:52:18.871111+0000","last_became_active":"2024-04-16T15:52:14.948417+0000","last_became_peered":"2024-04-16T15:52:14.948417+0000","last_unstale":"2024-04-16T15:52:18.871111+0000","last_undegraded":"2024-04-16T15:52:18.871111+0000","last_fullsized":"2024-04-16T15:52:18.871111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:13.920439+0000","last_clean_scrub_stamp":"2024-04-16T15:52:13.920439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:41:48.115342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T15:52:23.705 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-16T15:52:23.705 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-16T15:52:23.705 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-16T15:52:23.705 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-16T15:52:23.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.845+0000 7f4a4e7db640 1 Processor -- start 2024-04-16T15:52:23.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.845+0000 7f4a4e7db640 1 -- start start 2024-04-16T15:52:23.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.846+0000 7f4a4e7db640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4a48163420 0x7f4a480b3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:23.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.846+0000 7f4a4e7db640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4a480b37c0 0x7f4a48073050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:23.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.846+0000 7f4a4e7db640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a480b3bd0 con 0x7f4a4815eb10 2024-04-16T15:52:23.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.846+0000 7f4a4e7db640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f4a480b55a0 con 0x7f4a48163420 2024-04-16T15:52:23.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.846+0000 7f4a4e7db640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f4a480b4790 con 0x7f4a480b37c0 2024-04-16T15:52:23.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.846+0000 7f4a3ffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4a48163420 0x7f4a480b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:23.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.846+0000 7f4a3ffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4a48163420 0x7f4a480b3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35364/0 (socket says 172.21.15.132:35364) 2024-04-16T15:52:23.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.846+0000 7f4a3ffff640 1 -- 172.21.15.132:0/2438879815 learned_addr learned my addr 172.21.15.132:0/2438879815 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:23.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.846+0000 7f4a3ffff640 1 -- 172.21.15.132:0/2438879815 >> v2:172.21.15.179:3300/0 conn(0x7f4a480b37c0 msgr2=0x7f4a48073050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:23.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.846+0000 7f4a3ffff640 1 --2- 172.21.15.132:0/2438879815 >> v2:172.21.15.179:3300/0 conn(0x7f4a480b37c0 0x7f4a48073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:23.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.846+0000 7f4a3ffff640 1 -- 172.21.15.132:0/2438879815 >> v1:172.21.15.179:6789/0 conn(0x7f4a4815eb10 legacy=0x7f4a480d1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:23.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.846+0000 7f4a3ffff640 1 -- 172.21.15.132:0/2438879815 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a480b4d10 con 0x7f4a48163420 2024-04-16T15:52:23.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.847+0000 7f4a3ffff640 1 --2- 172.21.15.132:0/2438879815 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a48163420 0x7f4a480b3280 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4a480b5510 tx=0x7f4a3002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b9bf8c92b68eb7 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:23.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.847+0000 7f4a477fe640 1 -- 172.21.15.132:0/2438879815 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a3002e070 con 0x7f4a48163420 2024-04-16T15:52:23.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.847+0000 7f4a477fe640 1 -- 172.21.15.132:0/2438879815 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a30037070 con 0x7f4a48163420 2024-04-16T15:52:23.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.847+0000 7f4a477fe640 1 -- 172.21.15.132:0/2438879815 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a30031a00 con 0x7f4a48163420 2024-04-16T15:52:23.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.847+0000 7f4a4e7db640 1 -- 172.21.15.132:0/2438879815 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a48163420 msgr2=0x7f4a480b3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:23.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.847+0000 7f4a4e7db640 1 --2- 172.21.15.132:0/2438879815 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a48163420 0x7f4a480b3280 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4a480b5510 tx=0x7f4a3002b880 comp rx=0 tx=0).stop 2024-04-16T15:52:23.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.847+0000 7f4a4e7db640 1 -- 172.21.15.132:0/2438879815 shutdown_connections 2024-04-16T15:52:23.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.847+0000 7f4a4e7db640 1 --2- 172.21.15.132:0/2438879815 >> v2:172.21.15.179:3300/0 conn(0x7f4a480b37c0 0x7f4a48073050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:23.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.847+0000 7f4a4e7db640 1 --2- 172.21.15.132:0/2438879815 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a48163420 0x7f4a480b3280 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:23.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.847+0000 7f4a4e7db640 1 -- 172.21.15.132:0/2438879815 >> 172.21.15.132:0/2438879815 conn(0x7f4a4806cb30 msgr2=0x7f4a4806cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:23.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.847+0000 7f4a4e7db640 1 -- 172.21.15.132:0/2438879815 shutdown_connections 2024-04-16T15:52:23.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.848+0000 7f4a4e7db640 1 -- 172.21.15.132:0/2438879815 wait complete. 2024-04-16T15:52:23.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.849+0000 7f4a4e7db640 1 Processor -- start 2024-04-16T15:52:23.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.849+0000 7f4a4e7db640 1 -- start start 2024-04-16T15:52:23.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.849+0000 7f4a4e7db640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a480b37c0 0x7f4a48149090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:23.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.849+0000 7f4a4e7db640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a4815eb10 0x7f4a48155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:23.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.849+0000 7f4a4e7db640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a48163420 0x7f4a481561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:23.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.849+0000 7f4a4e7db640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f4a480ce300 con 0x7f4a48163420 2024-04-16T15:52:23.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.849+0000 7f4a4e7db640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4a480b5230 con 0x7f4a4815eb10 2024-04-16T15:52:23.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.849+0000 7f4a4e7db640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f4a480ce480 con 0x7f4a480b37c0 2024-04-16T15:52:23.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.849+0000 7f4a4cd78640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a48163420 0x7f4a481561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:23.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.849+0000 7f4a4cd78640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a48163420 0x7f4a481561a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35376/0 (socket says 172.21.15.132:35376) 2024-04-16T15:52:23.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.849+0000 7f4a4cd78640 1 -- 172.21.15.132:0/1304948990 learned_addr learned my addr 172.21.15.132:0/1304948990 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:23.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.850+0000 7f4a3ffff640 1 --2- 172.21.15.132:0/1304948990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a4815eb10 0x7f4a48155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:23.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.850+0000 7f4a47fff640 1 --2- 172.21.15.132:0/1304948990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a480b37c0 0x7f4a48149090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:23.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.850+0000 7f4a4cd78640 1 -- 172.21.15.132:0/1304948990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a480b37c0 msgr2=0x7f4a48149090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:23.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.850+0000 7f4a4cd78640 1 --2- 172.21.15.132:0/1304948990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a480b37c0 0x7f4a48149090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:23.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.850+0000 7f4a4cd78640 1 -- 172.21.15.132:0/1304948990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a4815eb10 msgr2=0x7f4a48155c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:23.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.850+0000 7f4a4cd78640 1 --2- 172.21.15.132:0/1304948990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a4815eb10 0x7f4a48155c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:23.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.850+0000 7f4a4cd78640 1 -- 172.21.15.132:0/1304948990 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a481548a0 con 0x7f4a48163420 2024-04-16T15:52:23.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.850+0000 7f4a4cd78640 1 --2- 172.21.15.132:0/1304948990 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a48163420 0x7f4a481561a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4a4000b970 tx=0x7f4a4000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:23.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.850+0000 7f4a457fa640 1 -- 172.21.15.132:0/1304948990 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a40019070 con 0x7f4a48163420 2024-04-16T15:52:23.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.850+0000 7f4a457fa640 1 -- 172.21.15.132:0/1304948990 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a4000cb60 con 0x7f4a48163420 2024-04-16T15:52:23.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.850+0000 7f4a4e7db640 1 -- 172.21.15.132:0/1304948990 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a48154b80 con 0x7f4a48163420 2024-04-16T15:52:23.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.850+0000 7f4a457fa640 1 -- 172.21.15.132:0/1304948990 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a40014440 con 0x7f4a48163420 2024-04-16T15:52:23.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.850+0000 7f4a4e7db640 1 -- 172.21.15.132:0/1304948990 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a48155140 con 0x7f4a48163420 2024-04-16T15:52:23.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.851+0000 7f4a4e7db640 1 -- 172.21.15.132:0/1304948990 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a48075510 con 0x7f4a48163420 2024-04-16T15:52:23.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.851+0000 7f4a457fa640 1 -- 172.21.15.132:0/1304948990 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4a4001c070 con 0x7f4a48163420 2024-04-16T15:52:23.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.852+0000 7f4a457fa640 1 --2- 172.21.15.132:0/1304948990 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f4a2806c8f0 0x7f4a2806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:23.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.852+0000 7f4a457fa640 1 -- 172.21.15.132:0/1304948990 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4a4008b8a0 con 0x7f4a48163420 2024-04-16T15:52:23.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.852+0000 7f4a47fff640 1 --2- 172.21.15.132:0/1304948990 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f4a2806c8f0 0x7f4a2806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:23.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.852+0000 7f4a47fff640 1 --2- 172.21.15.132:0/1304948990 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f4a2806c8f0 0x7f4a2806edb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4a38007fd0 tx=0x7f4a38009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:23.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:23.856+0000 7f4a457fa640 1 -- 172.21.15.132:0/1304948990 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4a40059cd0 con 0x7f4a48163420 2024-04-16T15:52:24.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.078+0000 7f4a4e7db640 1 -- 172.21.15.132:0/1304948990 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f4a480b4290 con 0x7f4a48163420 2024-04-16T15:52:24.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.078+0000 7f4a457fa640 1 -- 172.21.15.132:0/1304948990 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f4a400595d0 con 0x7f4a48163420 2024-04-16T15:52:24.079 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:52:24.079 INFO:teuthology.orchestra.run.smithi132.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-16T15:52:24.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.080+0000 7f4a4e7db640 1 -- 172.21.15.132:0/1304948990 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f4a2806c8f0 msgr2=0x7f4a2806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:24.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.080+0000 7f4a4e7db640 1 --2- 172.21.15.132:0/1304948990 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f4a2806c8f0 0x7f4a2806edb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4a38007fd0 tx=0x7f4a38009040 comp rx=0 tx=0).stop 2024-04-16T15:52:24.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.080+0000 7f4a4e7db640 1 -- 172.21.15.132:0/1304948990 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a48163420 msgr2=0x7f4a481561a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:24.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.080+0000 7f4a4e7db640 1 --2- 172.21.15.132:0/1304948990 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a48163420 0x7f4a481561a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4a4000b970 tx=0x7f4a4000be30 comp rx=0 tx=0).stop 2024-04-16T15:52:24.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.080+0000 7f4a4e7db640 1 -- 172.21.15.132:0/1304948990 shutdown_connections 2024-04-16T15:52:24.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.080+0000 7f4a4e7db640 1 --2- 172.21.15.132:0/1304948990 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f4a2806c8f0 0x7f4a2806edb0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:24.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.080+0000 7f4a4e7db640 1 --2- 172.21.15.132:0/1304948990 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a48163420 0x7f4a481561a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:24.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.080+0000 7f4a4e7db640 1 --2- 172.21.15.132:0/1304948990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a4815eb10 0x7f4a48155c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:24.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.080+0000 7f4a4e7db640 1 --2- 172.21.15.132:0/1304948990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a480b37c0 0x7f4a48149090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:24.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.080+0000 7f4a4e7db640 1 -- 172.21.15.132:0/1304948990 >> 172.21.15.132:0/1304948990 conn(0x7f4a4806cb30 msgr2=0x7f4a480ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:24.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.080+0000 7f4a4e7db640 1 -- 172.21.15.132:0/1304948990 shutdown_connections 2024-04-16T15:52:24.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.080+0000 7f4a4e7db640 1 -- 172.21.15.132:0/1304948990 wait complete. 2024-04-16T15:52:24.096 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-16T15:52:24.097 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:52:24.211 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.211+0000 7f243ca50640 1 Processor -- start 2024-04-16T15:52:24.211 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.211+0000 7f243ca50640 1 -- start start 2024-04-16T15:52:24.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.212+0000 7f243ca50640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f243815e9d0 0x7f2438070cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:24.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.212+0000 7f243ca50640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24380b0460 0x7f24380ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:24.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.212+0000 7f243ca50640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f243806ba20 0x7f243806beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:24.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.212+0000 7f243ca50640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f24380b08c0 con 0x7f243815e9d0 2024-04-16T15:52:24.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.212+0000 7f243ca50640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f24380b4840 con 0x7f243806ba20 2024-04-16T15:52:24.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.212+0000 7f243ca50640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f24380b66e0 con 0x7f24380b0460 2024-04-16T15:52:24.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.212+0000 7f243659c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f243815e9d0 0x7f2438070cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:24.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.212+0000 7f243659c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f243815e9d0 0x7f2438070cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35386/0 (socket says 172.21.15.132:35386) 2024-04-16T15:52:24.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.212+0000 7f243659c640 1 -- 172.21.15.132:0/607686337 learned_addr learned my addr 172.21.15.132:0/607686337 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:24.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.212+0000 7f2435d9b640 1 --2- 172.21.15.132:0/607686337 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24380b0460 0x7f24380ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:24.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.212+0000 7f243659c640 1 -- 172.21.15.132:0/607686337 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24380b0460 msgr2=0x7f24380ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:24.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.212+0000 7f243659c640 1 --2- 172.21.15.132:0/607686337 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24380b0460 0x7f24380ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:24.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.212+0000 7f2436d9d640 1 --2- 172.21.15.132:0/607686337 >> v2:172.21.15.179:3300/0 conn(0x7f243806ba20 0x7f243806beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:24.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.212+0000 7f243659c640 1 -- 172.21.15.132:0/607686337 >> v2:172.21.15.179:3300/0 conn(0x7f243806ba20 msgr2=0x7f243806beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:24.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.212+0000 7f243659c640 1 --2- 172.21.15.132:0/607686337 >> v2:172.21.15.179:3300/0 conn(0x7f243806ba20 0x7f243806beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:24.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.212+0000 7f243659c640 1 -- 172.21.15.132:0/607686337 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24380b6400 con 0x7f243815e9d0 2024-04-16T15:52:24.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.213+0000 7f243659c640 1 --2- 172.21.15.132:0/607686337 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f243815e9d0 0x7f2438070cf0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f24380d2590 tx=0x7f242802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32e3ad62378a3d79 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:24.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.213+0000 7f243559a640 1 -- 172.21.15.132:0/607686337 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f242802c9e0 con 0x7f243815e9d0 2024-04-16T15:52:24.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.213+0000 7f243559a640 1 -- 172.21.15.132:0/607686337 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f242802cb80 con 0x7f243815e9d0 2024-04-16T15:52:24.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.213+0000 7f243559a640 1 -- 172.21.15.132:0/607686337 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24280343f0 con 0x7f243815e9d0 2024-04-16T15:52:24.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.214+0000 7f243ca50640 1 -- 172.21.15.132:0/607686337 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f243815e9d0 msgr2=0x7f2438070cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:24.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.214+0000 7f243ca50640 1 --2- 172.21.15.132:0/607686337 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f243815e9d0 0x7f2438070cf0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f24380d2590 tx=0x7f242802be40 comp rx=0 tx=0).stop 2024-04-16T15:52:24.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.214+0000 7f243ca50640 1 -- 172.21.15.132:0/607686337 shutdown_connections 2024-04-16T15:52:24.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.214+0000 7f243ca50640 1 --2- 172.21.15.132:0/607686337 >> v2:172.21.15.179:3300/0 conn(0x7f243806ba20 0x7f243806beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:24.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.214+0000 7f243ca50640 1 --2- 172.21.15.132:0/607686337 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24380b0460 0x7f24380ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:24.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.214+0000 7f243ca50640 1 --2- 172.21.15.132:0/607686337 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f243815e9d0 0x7f2438070cf0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:24.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.214+0000 7f243ca50640 1 -- 172.21.15.132:0/607686337 >> 172.21.15.132:0/607686337 conn(0x7f243809aa30 msgr2=0x7f24380b6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:24.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.214+0000 7f243ca50640 1 -- 172.21.15.132:0/607686337 shutdown_connections 2024-04-16T15:52:24.218 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.214+0000 7f243ca50640 1 -- 172.21.15.132:0/607686337 wait complete. 2024-04-16T15:52:24.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.215+0000 7f243ca50640 1 Processor -- start 2024-04-16T15:52:24.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.215+0000 7f243ca50640 1 -- start start 2024-04-16T15:52:24.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.216+0000 7f243ca50640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f243806ba20 0x7f243814b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:24.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.216+0000 7f243ca50640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24380b0460 0x7f243815cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:24.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.216+0000 7f243ca50640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f243815e9d0 0x7f243815d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:24.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.216+0000 7f243ca50640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f24380b6020 con 0x7f24380b0460 2024-04-16T15:52:24.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.216+0000 7f243ca50640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f243815edb0 con 0x7f243806ba20 2024-04-16T15:52:24.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.216+0000 7f243ca50640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f24380b61a0 con 0x7f243815e9d0 2024-04-16T15:52:24.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.216+0000 7f2435d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24380b0460 0x7f243815cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:24.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.216+0000 7f2435d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24380b0460 0x7f243815cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35392/0 (socket says 172.21.15.132:35392) 2024-04-16T15:52:24.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.216+0000 7f2435d9b640 1 -- 172.21.15.132:0/3126537057 learned_addr learned my addr 172.21.15.132:0/3126537057 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:24.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.216+0000 7f2436d9d640 1 --2- 172.21.15.132:0/3126537057 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f243815e9d0 0x7f243815d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:24.586 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.216+0000 7f243659c640 1 --2- 172.21.15.132:0/3126537057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f243806ba20 0x7f243814b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:24.586 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.216+0000 7f2435d9b640 1 -- 172.21.15.132:0/3126537057 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f243815e9d0 msgr2=0x7f243815d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:24.586 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.216+0000 7f2435d9b640 1 --2- 172.21.15.132:0/3126537057 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f243815e9d0 0x7f243815d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:24.586 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.216+0000 7f2435d9b640 1 -- 172.21.15.132:0/3126537057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f243806ba20 msgr2=0x7f243814b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:24.586 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.216+0000 7f2435d9b640 1 --2- 172.21.15.132:0/3126537057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f243806ba20 0x7f243814b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:24.586 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.216+0000 7f2435d9b640 1 -- 172.21.15.132:0/3126537057 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2438148d80 con 0x7f24380b0460 2024-04-16T15:52:24.586 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.216+0000 7f2436d9d640 1 --2- 172.21.15.132:0/3126537057 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f243815e9d0 0x7f243815d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:24.586 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.216+0000 7f243659c640 1 --2- 172.21.15.132:0/3126537057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f243806ba20 0x7f243814b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:24.586 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.217+0000 7f2435d9b640 1 --2- 172.21.15.132:0/3126537057 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24380b0460 0x7f243815cc20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f242c00c7f0 tx=0x7f242c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:24.586 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.217+0000 7f2426ffd640 1 -- 172.21.15.132:0/3126537057 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f242c015070 con 0x7f24380b0460 2024-04-16T15:52:24.586 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.217+0000 7f2426ffd640 1 -- 172.21.15.132:0/3126537057 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f242c004240 con 0x7f24380b0460 2024-04-16T15:52:24.586 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.217+0000 7f243ca50640 1 -- 172.21.15.132:0/3126537057 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2438156220 con 0x7f24380b0460 2024-04-16T15:52:24.587 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.217+0000 7f2426ffd640 1 -- 172.21.15.132:0/3126537057 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f242c007620 con 0x7f24380b0460 2024-04-16T15:52:24.587 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.217+0000 7f243ca50640 1 -- 172.21.15.132:0/3126537057 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f243815afc0 con 0x7f24380b0460 2024-04-16T15:52:24.587 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.218+0000 7f243ca50640 1 -- 172.21.15.132:0/3126537057 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2438075510 con 0x7f24380b0460 2024-04-16T15:52:24.587 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.218+0000 7f2426ffd640 1 -- 172.21.15.132:0/3126537057 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f242c0079d0 con 0x7f24380b0460 2024-04-16T15:52:24.587 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.219+0000 7f2426ffd640 1 --2- 172.21.15.132:0/3126537057 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f241806c8f0 0x7f241806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:24.587 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.219+0000 7f243659c640 1 --2- 172.21.15.132:0/3126537057 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f241806c8f0 0x7f241806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:24.587 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.219+0000 7f2426ffd640 1 -- 172.21.15.132:0/3126537057 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f242c08bed0 con 0x7f24380b0460 2024-04-16T15:52:24.587 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.219+0000 7f243659c640 1 --2- 172.21.15.132:0/3126537057 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f241806c8f0 0x7f241806edb0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2428035000 tx=0x7f2428030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:24.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.223+0000 7f2426ffd640 1 -- 172.21.15.132:0/3126537057 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2438148d80 con 0x7f24380b0460 2024-04-16T15:52:24.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.401+0000 7f243ca50640 1 -- 172.21.15.132:0/3126537057 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f243806c620 con 0x7f24380b0460 2024-04-16T15:52:24.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.402+0000 7f2426ffd640 1 -- 172.21.15.132:0/3126537057 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7f242c05a390 con 0x7f24380b0460 2024-04-16T15:52:24.589 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:52:24.589 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"6bdec5d9-f406-43ad-8584-0503b32f6f0d","created":"2024-04-16T15:51:51.073040+0000","modified":"2024-04-16T15:52:16.950186+0000","last_up_change":"2024-04-16T15:52:02.280496+0000","last_in_change":"2024-04-16T15:51:53.376468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:52:03.284927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:52:13.363758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T15:52:14.246647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d45908b-6e22-4619-b190-897af594b712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6801","nonce":1170594668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6803","nonce":1170594668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6807","nonce":1170594668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6805","nonce":1170594668}]},"public_addr":"172.21.15.132:6801/1170594668","cluster_addr":"172.21.15.132:6803/1170594668","heartbeat_back_addr":"172.21.15.132:6807/1170594668","heartbeat_front_addr":"172.21.15.132:6805/1170594668","state":["exists","up"]},{"osd":1,"uuid":"c88bf082-e51f-4ee6-815a-025f6ce0d67b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6809","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6811","nonce":2494780358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6815","nonce":2494780358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6823","nonce":2494780358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6819","nonce":2494780358}]},"public_addr":"172.21.15.132:6811/2494780358","cluster_addr":"172.21.15.132:6815/2494780358","heartbeat_back_addr":"172.21.15.132:6823/2494780358","heartbeat_front_addr":"172.21.15.132:6819/2494780358","state":["exists","up"]},{"osd":2,"uuid":"e5dbd6b4-4e7b-47e4-ad4e-35b4b81696c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6825","nonce":27655483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6827","nonce":27655483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6831","nonce":27655483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6829","nonce":27655483}]},"public_addr":"172.21.15.132:6825/27655483","cluster_addr":"172.21.15.132:6827/27655483","heartbeat_back_addr":"172.21.15.132:6831/27655483","heartbeat_front_addr":"172.21.15.132:6829/27655483","state":["exists","up"]},{"osd":3,"uuid":"9d75cd67-3b8a-4424-8884-5f3660e1f5f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6810","nonce":3100919191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6814","nonce":3100919191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6821","nonce":3100919191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6818","nonce":3100919191}]},"public_addr":"172.21.15.132:6810/3100919191","cluster_addr":"172.21.15.132:6814/3100919191","heartbeat_back_addr":"172.21.15.132:6821/3100919191","heartbeat_front_addr":"172.21.15.132:6818/3100919191","state":["exists","up"]},{"osd":4,"uuid":"83aea46a-8642-4777-912b-c130e5890da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6825","nonce":123637799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6827","nonce":123637799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6831","nonce":123637799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6829","nonce":123637799}]},"public_addr":"172.21.15.179:6825/123637799","cluster_addr":"172.21.15.179:6827/123637799","heartbeat_back_addr":"172.21.15.179:6831/123637799","heartbeat_front_addr":"172.21.15.179:6829/123637799","state":["exists","up"]},{"osd":5,"uuid":"534117c8-3317-48d6-b436-afd5709f71e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6801","nonce":2224750370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6803","nonce":2224750370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6807","nonce":2224750370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6805","nonce":2224750370}]},"public_addr":"172.21.15.179:6801/2224750370","cluster_addr":"172.21.15.179:6803/2224750370","heartbeat_back_addr":"172.21.15.179:6807/2224750370","heartbeat_front_addr":"172.21.15.179:6805/2224750370","state":["exists","up"]},{"osd":6,"uuid":"0ba363e7-fa9d-42b1-ae09-a6a0f57d41f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6809","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6811","nonce":101498164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6813","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6815","nonce":101498164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6823","nonce":101498164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6819","nonce":101498164}]},"public_addr":"172.21.15.179:6811/101498164","cluster_addr":"172.21.15.179:6815/101498164","heartbeat_back_addr":"172.21.15.179:6823/101498164","heartbeat_front_addr":"172.21.15.179:6819/101498164","state":["exists","up"]},{"osd":7,"uuid":"e6830c77-2f2d-4067-9866-ee7625afc1a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6810","nonce":872148365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6814","nonce":872148365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6822","nonce":872148365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6818","nonce":872148365}]},"public_addr":"172.21.15.179:6810/872148365","cluster_addr":"172.21.15.179:6814/872148365","heartbeat_back_addr":"172.21.15.179:6822/872148365","heartbeat_front_addr":"172.21.15.179:6818/872148365","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.535221+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.563769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.520765+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.526264+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.517058+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.500842+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.534332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.512486+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:52:24.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.404+0000 7f243ca50640 1 -- 172.21.15.132:0/3126537057 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f241806c8f0 msgr2=0x7f241806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:24.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.404+0000 7f243ca50640 1 --2- 172.21.15.132:0/3126537057 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f241806c8f0 0x7f241806edb0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2428035000 tx=0x7f2428030000 comp rx=0 tx=0).stop 2024-04-16T15:52:24.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.404+0000 7f243ca50640 1 -- 172.21.15.132:0/3126537057 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24380b0460 msgr2=0x7f243815cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:24.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.404+0000 7f243ca50640 1 --2- 172.21.15.132:0/3126537057 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24380b0460 0x7f243815cc20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f242c00c7f0 tx=0x7f242c00ccb0 comp rx=0 tx=0).stop 2024-04-16T15:52:24.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.404+0000 7f243ca50640 1 -- 172.21.15.132:0/3126537057 shutdown_connections 2024-04-16T15:52:24.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.404+0000 7f243ca50640 1 --2- 172.21.15.132:0/3126537057 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f241806c8f0 0x7f241806edb0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:24.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.404+0000 7f243ca50640 1 --2- 172.21.15.132:0/3126537057 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f243815e9d0 0x7f243815d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:24.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.404+0000 7f243ca50640 1 --2- 172.21.15.132:0/3126537057 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24380b0460 0x7f243815cc20 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:24.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.404+0000 7f243ca50640 1 --2- 172.21.15.132:0/3126537057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f243806ba20 0x7f243814b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:24.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.404+0000 7f243ca50640 1 -- 172.21.15.132:0/3126537057 >> 172.21.15.132:0/3126537057 conn(0x7f243809aa30 msgr2=0x7f243806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:24.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.404+0000 7f243ca50640 1 -- 172.21.15.132:0/3126537057 shutdown_connections 2024-04-16T15:52:24.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.404+0000 7f243ca50640 1 -- 172.21.15.132:0/3126537057 wait complete. 2024-04-16T15:52:24.593 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T15:52:03.284927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T15:52:13.363758+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T15:52:14.246647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T15:52:24.594 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T15:52:24.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.702+0000 7f5fca435640 1 Processor -- start 2024-04-16T15:52:24.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.703+0000 7f5fca435640 1 -- start start 2024-04-16T15:52:24.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.703+0000 7f5fca435640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5fc415c950 0x7f5fc4071530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:24.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.703+0000 7f5fca435640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5fc415cd30 0x7f5fc40cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:24.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.703+0000 7f5fca435640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fc4071a70 con 0x7f5fc406fcb0 2024-04-16T15:52:24.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.703+0000 7f5fca435640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f5fc40d0990 con 0x7f5fc415cd30 2024-04-16T15:52:24.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.703+0000 7f5fca435640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f5fc40d0c70 con 0x7f5fc415c950 2024-04-16T15:52:24.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.704+0000 7f5fc37fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5fc415cd30 0x7f5fc40cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:24.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.704+0000 7f5fc89d2640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f5fc406fcb0 0x7f5fc406ba20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47314/0 (socket says 172.21.15.132:47314) 2024-04-16T15:52:24.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.704+0000 7f5fc89d2640 1 -- 172.21.15.132:0/2269926676 learned_addr learned my addr 172.21.15.132:0/2269926676 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:24.706 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.704+0000 7f5fc3fff640 1 --2- 172.21.15.132:0/2269926676 >> v2:172.21.15.179:3300/0 conn(0x7f5fc415c950 0x7f5fc4071530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:24.706 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.704+0000 7f5fc37fe640 1 -- 172.21.15.132:0/2269926676 >> v2:172.21.15.179:3300/0 conn(0x7f5fc415c950 msgr2=0x7f5fc4071530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:24.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.704+0000 7f5fc37fe640 1 --2- 172.21.15.132:0/2269926676 >> v2:172.21.15.179:3300/0 conn(0x7f5fc415c950 0x7f5fc4071530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:24.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.704+0000 7f5fc37fe640 1 -- 172.21.15.132:0/2269926676 >> v1:172.21.15.132:6789/0 conn(0x7f5fc406fcb0 legacy=0x7f5fc406ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:24.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.704+0000 7f5fc2ffd640 1 -- 172.21.15.132:0/2269926676 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 346079019 0 0) 0x7f5fc4071a70 con 0x7f5fc406fcb0 2024-04-16T15:52:24.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.704+0000 7f5fc37fe640 1 -- 172.21.15.132:0/2269926676 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fc40d0f50 con 0x7f5fc415cd30 2024-04-16T15:52:24.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.705+0000 7f5fc37fe640 1 --2- 172.21.15.132:0/2269926676 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5fc415cd30 0x7f5fc40cdeb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5fc40504d0 tx=0x7f5fb802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b18a4dec17dd0d85 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:24.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.705+0000 7f5fc2ffd640 1 -- 172.21.15.132:0/2269926676 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb8035020 con 0x7f5fc415cd30 2024-04-16T15:52:24.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.705+0000 7f5fc2ffd640 1 -- 172.21.15.132:0/2269926676 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fb8031830 con 0x7f5fc415cd30 2024-04-16T15:52:24.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.705+0000 7f5fc2ffd640 1 -- 172.21.15.132:0/2269926676 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb8031c00 con 0x7f5fc415cd30 2024-04-16T15:52:24.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.705+0000 7f5fca435640 1 -- 172.21.15.132:0/2269926676 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5fc415cd30 msgr2=0x7f5fc40cdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:24.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.705+0000 7f5fca435640 1 --2- 172.21.15.132:0/2269926676 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5fc415cd30 0x7f5fc40cdeb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5fc40504d0 tx=0x7f5fb802b8d0 comp rx=0 tx=0).stop 2024-04-16T15:52:24.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.705+0000 7f5fca435640 1 -- 172.21.15.132:0/2269926676 shutdown_connections 2024-04-16T15:52:24.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.705+0000 7f5fca435640 1 --2- 172.21.15.132:0/2269926676 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5fc415cd30 0x7f5fc40cdeb0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:24.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.705+0000 7f5fca435640 1 --2- 172.21.15.132:0/2269926676 >> v2:172.21.15.179:3300/0 conn(0x7f5fc415c950 0x7f5fc4071530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:24.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.705+0000 7f5fca435640 1 -- 172.21.15.132:0/2269926676 >> 172.21.15.132:0/2269926676 conn(0x7f5fc406f120 msgr2=0x7f5fc406f530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:24.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.705+0000 7f5fca435640 1 -- 172.21.15.132:0/2269926676 shutdown_connections 2024-04-16T15:52:24.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.705+0000 7f5fca435640 1 -- 172.21.15.132:0/2269926676 wait complete. 2024-04-16T15:52:24.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.706+0000 7f5fca435640 1 Processor -- start 2024-04-16T15:52:24.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.707+0000 7f5fca435640 1 -- start start 2024-04-16T15:52:24.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.707+0000 7f5fca435640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5fc406fcb0 0x7f5fc41f26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:24.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.707+0000 7f5fca435640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fc415c950 0x7f5fc40ac7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:24.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.707+0000 7f5fca435640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fc415cd30 0x7f5fc40acce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:24.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.707+0000 7f5fca435640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc40ce3f0 con 0x7f5fc406fcb0 2024-04-16T15:52:24.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.707+0000 7f5fca435640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc40d0680 con 0x7f5fc415cd30 2024-04-16T15:52:24.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.707+0000 7f5fca435640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f5fc40ce570 con 0x7f5fc415c950 2024-04-16T15:52:24.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.707+0000 7f5fc3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5fc406fcb0 0x7f5fc41f26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:24.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.707+0000 7f5fc3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5fc406fcb0 0x7f5fc41f26a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35416/0 (socket says 172.21.15.132:35416) 2024-04-16T15:52:24.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.708+0000 7f5fc3fff640 1 -- 172.21.15.132:0/2386423058 learned_addr learned my addr 172.21.15.132:0/2386423058 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:24.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.708+0000 7f5fc3fff640 1 -- 172.21.15.132:0/2386423058 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fc415c950 msgr2=0x7f5fc40ac7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:24.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.708+0000 7f5fc3fff640 1 --2- 172.21.15.132:0/2386423058 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fc415c950 0x7f5fc40ac7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:24.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.708+0000 7f5fc3fff640 1 -- 172.21.15.132:0/2386423058 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fc415cd30 msgr2=0x7f5fc40acce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:24.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.708+0000 7f5fc3fff640 1 --2- 172.21.15.132:0/2386423058 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fc415cd30 0x7f5fc40acce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:24.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.708+0000 7f5fc3fff640 1 -- 172.21.15.132:0/2386423058 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fc41f3640 con 0x7f5fc406fcb0 2024-04-16T15:52:24.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.708+0000 7f5fc3fff640 1 --2- 172.21.15.132:0/2386423058 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5fc406fcb0 0x7f5fc41f26a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5fb400c7f0 tx=0x7f5fb400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:24.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.708+0000 7f5fc0ff9640 1 -- 172.21.15.132:0/2386423058 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb4015070 con 0x7f5fc406fcb0 2024-04-16T15:52:24.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.708+0000 7f5fc0ff9640 1 -- 172.21.15.132:0/2386423058 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fb4004240 con 0x7f5fc406fcb0 2024-04-16T15:52:24.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.708+0000 7f5fca435640 1 -- 172.21.15.132:0/2386423058 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fc41f3080 con 0x7f5fc406fcb0 2024-04-16T15:52:24.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.708+0000 7f5fc0ff9640 1 -- 172.21.15.132:0/2386423058 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb4007620 con 0x7f5fc406fcb0 2024-04-16T15:52:24.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.708+0000 7f5fca435640 1 -- 172.21.15.132:0/2386423058 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fc41e21f0 con 0x7f5fc406fcb0 2024-04-16T15:52:24.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.709+0000 7f5fca435640 1 -- 172.21.15.132:0/2386423058 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fc40cff60 con 0x7f5fc406fcb0 2024-04-16T15:52:24.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.710+0000 7f5fc0ff9640 1 -- 172.21.15.132:0/2386423058 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5fb40079d0 con 0x7f5fc406fcb0 2024-04-16T15:52:24.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.710+0000 7f5fc0ff9640 1 --2- 172.21.15.132:0/2386423058 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f5fb006c8f0 0x7f5fb006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:24.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.710+0000 7f5fc0ff9640 1 -- 172.21.15.132:0/2386423058 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5fb408bed0 con 0x7f5fc406fcb0 2024-04-16T15:52:24.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.710+0000 7f5fc37fe640 1 --2- 172.21.15.132:0/2386423058 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f5fb006c8f0 0x7f5fb006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:24.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.711+0000 7f5fc37fe640 1 --2- 172.21.15.132:0/2386423058 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f5fb006c8f0 0x7f5fb006edb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8036000 tx=0x7f5fb8030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:24.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.714+0000 7f5fc0ff9640 1 -- 172.21.15.132:0/2386423058 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5fc40cff60 con 0x7f5fc406fcb0 2024-04-16T15:52:24.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.889+0000 7f5fca435640 1 -- 172.21.15.132:0/2386423058 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5fc4075510 con 0x7f5fc406fcb0 2024-04-16T15:52:24.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.889+0000 7f5fc0ff9640 1 -- 172.21.15.132:0/2386423058 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f5fb405a390 con 0x7f5fc406fcb0 2024-04-16T15:52:24.889 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2024-04-16T15:52:24.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.891+0000 7f5fca435640 1 -- 172.21.15.132:0/2386423058 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f5fb006c8f0 msgr2=0x7f5fb006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:24.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.891+0000 7f5fca435640 1 --2- 172.21.15.132:0/2386423058 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f5fb006c8f0 0x7f5fb006edb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8036000 tx=0x7f5fb8030000 comp rx=0 tx=0).stop 2024-04-16T15:52:24.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.891+0000 7f5fca435640 1 -- 172.21.15.132:0/2386423058 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5fc406fcb0 msgr2=0x7f5fc41f26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:24.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.891+0000 7f5fca435640 1 --2- 172.21.15.132:0/2386423058 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5fc406fcb0 0x7f5fc41f26a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5fb400c7f0 tx=0x7f5fb400ccb0 comp rx=0 tx=0).stop 2024-04-16T15:52:24.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.891+0000 7f5fca435640 1 -- 172.21.15.132:0/2386423058 shutdown_connections 2024-04-16T15:52:24.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.891+0000 7f5fca435640 1 --2- 172.21.15.132:0/2386423058 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f5fb006c8f0 0x7f5fb006edb0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:24.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.891+0000 7f5fca435640 1 --2- 172.21.15.132:0/2386423058 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fc415cd30 0x7f5fc40acce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:24.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.891+0000 7f5fca435640 1 --2- 172.21.15.132:0/2386423058 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fc415c950 0x7f5fc40ac7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:24.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.891+0000 7f5fca435640 1 --2- 172.21.15.132:0/2386423058 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5fc406fcb0 0x7f5fc41f26a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:24.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.891+0000 7f5fca435640 1 -- 172.21.15.132:0/2386423058 >> 172.21.15.132:0/2386423058 conn(0x7f5fc406f120 msgr2=0x7f5fc415afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:24.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.892+0000 7f5fca435640 1 -- 172.21.15.132:0/2386423058 shutdown_connections 2024-04-16T15:52:24.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:24.892+0000 7f5fca435640 1 -- 172.21.15.132:0/2386423058 wait complete. 2024-04-16T15:52:24.903 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T15:52:25.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.011+0000 7f6c7fd40640 1 Processor -- start 2024-04-16T15:52:25.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.011+0000 7f6c7fd40640 1 -- start start 2024-04-16T15:52:25.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.012+0000 7f6c7fd40640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6c7809ae60 0x7f6c7815fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:25.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.012+0000 7f6c7fd40640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c780d04a0 0x7f6c78160180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:25.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.012+0000 7f6c7fd40640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6c7809b240 0x7f6c780cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:25.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.012+0000 7f6c7fd40640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f6c7809bc40 con 0x7f6c7809ae60 2024-04-16T15:52:25.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.012+0000 7f6c7fd40640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f6c7809bf20 con 0x7f6c7809b240 2024-04-16T15:52:25.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.012+0000 7f6c7fd40640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6c780b3ab0 con 0x7f6c780d04a0 2024-04-16T15:52:25.014 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.012+0000 7f6c7dadc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6c7809ae60 0x7f6c7815fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:25.014 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.012+0000 7f6c7dadc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6c7809ae60 0x7f6c7815fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35428/0 (socket says 172.21.15.132:35428) 2024-04-16T15:52:25.014 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.012+0000 7f6c7dadc640 1 -- 172.21.15.132:0/3308628061 learned_addr learned my addr 172.21.15.132:0/3308628061 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:25.014 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.013+0000 7f6c7d2db640 1 --2- 172.21.15.132:0/3308628061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c780d04a0 0x7f6c78160180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:25.014 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.013+0000 7f6c7e2dd640 1 --2- 172.21.15.132:0/3308628061 >> v2:172.21.15.179:3300/0 conn(0x7f6c7809b240 0x7f6c780cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:25.014 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.013+0000 7f6c7dadc640 1 -- 172.21.15.132:0/3308628061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c780d04a0 msgr2=0x7f6c78160180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:25.014 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.013+0000 7f6c7dadc640 1 --2- 172.21.15.132:0/3308628061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c780d04a0 0x7f6c78160180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:25.014 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.013+0000 7f6c7dadc640 1 -- 172.21.15.132:0/3308628061 >> v2:172.21.15.179:3300/0 conn(0x7f6c7809b240 msgr2=0x7f6c780cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:25.014 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.013+0000 7f6c7dadc640 1 --2- 172.21.15.132:0/3308628061 >> v2:172.21.15.179:3300/0 conn(0x7f6c7809b240 0x7f6c780cd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:25.014 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.013+0000 7f6c7dadc640 1 -- 172.21.15.132:0/3308628061 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c780b3d90 con 0x7f6c7809ae60 2024-04-16T15:52:25.014 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.013+0000 7f6c7e2dd640 1 --2- 172.21.15.132:0/3308628061 >> v2:172.21.15.179:3300/0 conn(0x7f6c7809b240 0x7f6c780cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:52:25.014 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.013+0000 7f6c7dadc640 1 --2- 172.21.15.132:0/3308628061 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c7809ae60 0x7f6c7815fc40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6c780b8950 tx=0x7f6c7402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37c2495089b174c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:25.014 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.014+0000 7f6c7cada640 1 -- 172.21.15.132:0/3308628061 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c7402c9e0 con 0x7f6c7809ae60 2024-04-16T15:52:25.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.014+0000 7f6c7cada640 1 -- 172.21.15.132:0/3308628061 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c7402cb80 con 0x7f6c7809ae60 2024-04-16T15:52:25.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.014+0000 7f6c7cada640 1 -- 172.21.15.132:0/3308628061 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c740343f0 con 0x7f6c7809ae60 2024-04-16T15:52:25.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.014+0000 7f6c7fd40640 1 -- 172.21.15.132:0/3308628061 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c7809ae60 msgr2=0x7f6c7815fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:25.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.014+0000 7f6c7fd40640 1 --2- 172.21.15.132:0/3308628061 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c7809ae60 0x7f6c7815fc40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6c780b8950 tx=0x7f6c7402be40 comp rx=0 tx=0).stop 2024-04-16T15:52:25.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.014+0000 7f6c7fd40640 1 -- 172.21.15.132:0/3308628061 shutdown_connections 2024-04-16T15:52:25.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.014+0000 7f6c7fd40640 1 --2- 172.21.15.132:0/3308628061 >> v2:172.21.15.179:3300/0 conn(0x7f6c7809b240 0x7f6c780cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:25.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.014+0000 7f6c7fd40640 1 --2- 172.21.15.132:0/3308628061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c780d04a0 0x7f6c78160180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:25.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.014+0000 7f6c7fd40640 1 --2- 172.21.15.132:0/3308628061 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c7809ae60 0x7f6c7815fc40 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:25.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.014+0000 7f6c7fd40640 1 -- 172.21.15.132:0/3308628061 >> 172.21.15.132:0/3308628061 conn(0x7f6c780b43c0 msgr2=0x7f6c780b47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:25.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.014+0000 7f6c7fd40640 1 -- 172.21.15.132:0/3308628061 shutdown_connections 2024-04-16T15:52:25.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.014+0000 7f6c7fd40640 1 -- 172.21.15.132:0/3308628061 wait complete. 2024-04-16T15:52:25.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.015+0000 7f6c7fd40640 1 Processor -- start 2024-04-16T15:52:25.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.015+0000 7f6c7fd40640 1 -- start start 2024-04-16T15:52:25.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.016+0000 7f6c7fd40640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c7809ae60 0x7f6c781559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:25.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.016+0000 7f6c7fd40640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c7809b240 0x7f6c780c8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:25.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.016+0000 7f6c7fd40640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c780d04a0 0x7f6c780c8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:25.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.016+0000 7f6c7fd40640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f6c780cdaa0 con 0x7f6c7809b240 2024-04-16T15:52:25.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.016+0000 7f6c7fd40640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6c780cd920 con 0x7f6c7809ae60 2024-04-16T15:52:25.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.016+0000 7f6c7fd40640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6c780cdc20 con 0x7f6c780d04a0 2024-04-16T15:52:25.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.016+0000 7f6c7d2db640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c7809b240 0x7f6c780c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:25.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.016+0000 7f6c7d2db640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c7809b240 0x7f6c780c8410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35434/0 (socket says 172.21.15.132:35434) 2024-04-16T15:52:25.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.016+0000 7f6c7d2db640 1 -- 172.21.15.132:0/4269560817 learned_addr learned my addr 172.21.15.132:0/4269560817 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:25.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.016+0000 7f6c7e2dd640 1 --2- 172.21.15.132:0/4269560817 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c780d04a0 0x7f6c780c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:25.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.016+0000 7f6c7dadc640 1 --2- 172.21.15.132:0/4269560817 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c7809ae60 0x7f6c781559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:25.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.016+0000 7f6c7d2db640 1 -- 172.21.15.132:0/4269560817 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c780d04a0 msgr2=0x7f6c780c8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:25.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.016+0000 7f6c7d2db640 1 --2- 172.21.15.132:0/4269560817 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c780d04a0 0x7f6c780c8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:25.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.016+0000 7f6c7d2db640 1 -- 172.21.15.132:0/4269560817 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c7809ae60 msgr2=0x7f6c781559e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:25.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.016+0000 7f6c7d2db640 1 --2- 172.21.15.132:0/4269560817 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c7809ae60 0x7f6c781559e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:25.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.016+0000 7f6c7d2db640 1 -- 172.21.15.132:0/4269560817 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c78156220 con 0x7f6c7809b240 2024-04-16T15:52:25.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.016+0000 7f6c7e2dd640 1 --2- 172.21.15.132:0/4269560817 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c780d04a0 0x7f6c780c8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:52:25.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.016+0000 7f6c7dadc640 1 --2- 172.21.15.132:0/4269560817 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c7809ae60 0x7f6c781559e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:52:25.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.017+0000 7f6c7d2db640 1 --2- 172.21.15.132:0/4269560817 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c7809b240 0x7f6c780c8410 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6c6800c7f0 tx=0x7f6c6800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:25.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.017+0000 7f6c6e7fc640 1 -- 172.21.15.132:0/4269560817 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c68015070 con 0x7f6c7809b240 2024-04-16T15:52:25.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.017+0000 7f6c6e7fc640 1 -- 172.21.15.132:0/4269560817 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c68004220 con 0x7f6c7809b240 2024-04-16T15:52:25.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.017+0000 7f6c7fd40640 1 -- 172.21.15.132:0/4269560817 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c780b53e0 con 0x7f6c7809b240 2024-04-16T15:52:25.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.017+0000 7f6c6e7fc640 1 -- 172.21.15.132:0/4269560817 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c68007620 con 0x7f6c7809b240 2024-04-16T15:52:25.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.017+0000 7f6c7fd40640 1 -- 172.21.15.132:0/4269560817 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c780b59a0 con 0x7f6c7809b240 2024-04-16T15:52:25.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.018+0000 7f6c7fd40640 1 -- 172.21.15.132:0/4269560817 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c78075510 con 0x7f6c7809b240 2024-04-16T15:52:25.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.018+0000 7f6c6e7fc640 1 -- 172.21.15.132:0/4269560817 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6c680079d0 con 0x7f6c7809b240 2024-04-16T15:52:25.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.018+0000 7f6c6e7fc640 1 --2- 172.21.15.132:0/4269560817 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f6c5c06c8f0 0x7f6c5c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:25.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.019+0000 7f6c6e7fc640 1 -- 172.21.15.132:0/4269560817 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6c6808bd60 con 0x7f6c7809b240 2024-04-16T15:52:25.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.019+0000 7f6c7dadc640 1 --2- 172.21.15.132:0/4269560817 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f6c5c06c8f0 0x7f6c5c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:25.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.019+0000 7f6c7dadc640 1 --2- 172.21.15.132:0/4269560817 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f6c5c06c8f0 0x7f6c5c06edb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6c74035000 tx=0x7f6c74030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:25.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.023+0000 7f6c6e7fc640 1 -- 172.21.15.132:0/4269560817 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6c6805a220 con 0x7f6c7809b240 2024-04-16T15:52:25.196 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.196+0000 7f6c7fd40640 1 -- 172.21.15.132:0/4269560817 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f6c781564a0 con 0x7f6c7809b240 2024-04-16T15:52:25.196 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.197+0000 7f6c6e7fc640 1 -- 172.21.15.132:0/4269560817 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f6c68059b20 con 0x7f6c7809b240 2024-04-16T15:52:25.197 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2024-04-16T15:52:25.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.199+0000 7f6c7fd40640 1 -- 172.21.15.132:0/4269560817 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f6c5c06c8f0 msgr2=0x7f6c5c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:25.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.199+0000 7f6c7fd40640 1 --2- 172.21.15.132:0/4269560817 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f6c5c06c8f0 0x7f6c5c06edb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6c74035000 tx=0x7f6c74030000 comp rx=0 tx=0).stop 2024-04-16T15:52:25.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.199+0000 7f6c7fd40640 1 -- 172.21.15.132:0/4269560817 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c7809b240 msgr2=0x7f6c780c8410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:25.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.199+0000 7f6c7fd40640 1 --2- 172.21.15.132:0/4269560817 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c7809b240 0x7f6c780c8410 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6c6800c7f0 tx=0x7f6c6800ccb0 comp rx=0 tx=0).stop 2024-04-16T15:52:25.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.199+0000 7f6c7fd40640 1 -- 172.21.15.132:0/4269560817 shutdown_connections 2024-04-16T15:52:25.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.199+0000 7f6c7fd40640 1 --2- 172.21.15.132:0/4269560817 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f6c5c06c8f0 0x7f6c5c06edb0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:25.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.199+0000 7f6c7fd40640 1 --2- 172.21.15.132:0/4269560817 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c780d04a0 0x7f6c780c8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:25.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.199+0000 7f6c7fd40640 1 --2- 172.21.15.132:0/4269560817 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c7809b240 0x7f6c780c8410 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:25.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.199+0000 7f6c7fd40640 1 --2- 172.21.15.132:0/4269560817 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c7809ae60 0x7f6c781559e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:25.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.199+0000 7f6c7fd40640 1 -- 172.21.15.132:0/4269560817 >> 172.21.15.132:0/4269560817 conn(0x7f6c780b43c0 msgr2=0x7f6c780cba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:25.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.199+0000 7f6c7fd40640 1 -- 172.21.15.132:0/4269560817 shutdown_connections 2024-04-16T15:52:25.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.199+0000 7f6c7fd40640 1 -- 172.21.15.132:0/4269560817 wait complete. 2024-04-16T15:52:25.210 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T15:52:25.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.317+0000 7f065990e640 1 Processor -- start 2024-04-16T15:52:25.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.317+0000 7f065990e640 1 -- start start 2024-04-16T15:52:25.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.318+0000 7f065990e640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f06540b71f0 0x7f06540d0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:25.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.318+0000 7f065990e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f065415ff90 0x7f06540d1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:25.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.318+0000 7f065990e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06540b75d0 con 0x7f06540d0a50 2024-04-16T15:52:25.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.318+0000 7f065990e640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f06540b6840 con 0x7f06540b71f0 2024-04-16T15:52:25.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.318+0000 7f065990e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f065415f260 con 0x7f065415ff90 2024-04-16T15:52:25.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.318+0000 7f06537fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f06540d0a50 0x7f06540cf150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47316/0 (socket says 172.21.15.132:47316) 2024-04-16T15:52:25.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.318+0000 7f06537fe640 1 -- 172.21.15.132:0/2373532656 learned_addr learned my addr 172.21.15.132:0/2373532656 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:25.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.318+0000 7f0652ffd640 1 --2- 172.21.15.132:0/2373532656 >> v2:172.21.15.179:3300/0 conn(0x7f06540b71f0 0x7f06540d0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:25.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.318+0000 7f06527fc640 1 --2- 172.21.15.132:0/2373532656 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f065415ff90 0x7f06540d1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:25.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.318+0000 7f0651ffb640 1 -- 172.21.15.132:0/2373532656 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3481697922 0 0) 0x7f06540b75d0 con 0x7f06540d0a50 2024-04-16T15:52:25.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.319+0000 7f0651ffb640 1 -- 172.21.15.132:0/2373532656 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0640003520 con 0x7f06540d0a50 2024-04-16T15:52:25.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.319+0000 7f0651ffb640 1 -- 172.21.15.132:0/2373532656 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1085473823 0 0) 0x7f0640003520 con 0x7f06540d0a50 2024-04-16T15:52:25.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.319+0000 7f0651ffb640 1 -- 172.21.15.132:0/2373532656 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f065415ff90 msgr2=0x7f06540d1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:25.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.319+0000 7f0651ffb640 1 --2- 172.21.15.132:0/2373532656 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f065415ff90 0x7f06540d1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:25.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.319+0000 7f0651ffb640 1 -- 172.21.15.132:0/2373532656 >> v2:172.21.15.179:3300/0 conn(0x7f06540b71f0 msgr2=0x7f06540d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:25.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.319+0000 7f0651ffb640 1 --2- 172.21.15.132:0/2373532656 >> v2:172.21.15.179:3300/0 conn(0x7f06540b71f0 0x7f06540d0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:25.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.319+0000 7f0651ffb640 1 -- 172.21.15.132:0/2373532656 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06540d0fd0 con 0x7f06540d0a50 2024-04-16T15:52:25.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.319+0000 7f0651ffb640 1 -- 172.21.15.132:0/2373532656 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2803668828 0 0) 0x7f0644001670 con 0x7f06540d0a50 2024-04-16T15:52:25.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.319+0000 7f0651ffb640 1 -- 172.21.15.132:0/2373532656 >> v1:172.21.15.132:6789/0 conn(0x7f06540d0a50 legacy=0x7f06540cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:25.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.319+0000 7f0651ffb640 1 --2- 172.21.15.132:0/2373532656 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06400039b0 0x7f0640003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:25.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.319+0000 7f0651ffb640 1 --2- 172.21.15.132:0/2373532656 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f065415ff90 0x7f0640004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:25.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.319+0000 7f0651ffb640 1 --2- 172.21.15.132:0/2373532656 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0640004d40 0x7f06400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:25.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.319+0000 7f0651ffb640 1 -- 172.21.15.132:0/2373532656 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f06540b6840 con 0x7f06400039b0 2024-04-16T15:52:25.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.319+0000 7f0651ffb640 1 -- 172.21.15.132:0/2373532656 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f065415f260 con 0x7f0640004d40 2024-04-16T15:52:25.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.319+0000 7f0651ffb640 1 -- 172.21.15.132:0/2373532656 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f064000b9c0 con 0x7f065415ff90 2024-04-16T15:52:25.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.319+0000 7f0652ffd640 1 --2- 172.21.15.132:0/2373532656 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06400039b0 0x7f0640003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:25.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.319+0000 7f06527fc640 1 --2- 172.21.15.132:0/2373532656 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f065415ff90 0x7f0640004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:25.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.319+0000 7f06537fe640 1 --2- 172.21.15.132:0/2373532656 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0640004d40 0x7f06400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:25.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.319+0000 7f0652ffd640 1 -- 172.21.15.132:0/2373532656 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f065415ff90 msgr2=0x7f0640004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:25.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.319+0000 7f0652ffd640 1 --2- 172.21.15.132:0/2373532656 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f065415ff90 0x7f0640004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:25.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.319+0000 7f0652ffd640 1 -- 172.21.15.132:0/2373532656 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0640004d40 msgr2=0x7f06400051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:25.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.319+0000 7f0652ffd640 1 --2- 172.21.15.132:0/2373532656 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0640004d40 0x7f06400051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:25.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.319+0000 7f0652ffd640 1 -- 172.21.15.132:0/2373532656 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0640003520 con 0x7f06400039b0 2024-04-16T15:52:25.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.320+0000 7f0652ffd640 1 --2- 172.21.15.132:0/2373532656 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06400039b0 0x7f0640003dd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f064c009fc0 tx=0x7f0640005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=885f50a631d49969 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:25.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.320+0000 7f0651ffb640 1 -- 172.21.15.132:0/2373532656 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f064c039070 con 0x7f06400039b0 2024-04-16T15:52:25.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.320+0000 7f0651ffb640 1 -- 172.21.15.132:0/2373532656 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f064c02cc60 con 0x7f06400039b0 2024-04-16T15:52:25.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.320+0000 7f0651ffb640 1 -- 172.21.15.132:0/2373532656 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f064c009c10 con 0x7f06400039b0 2024-04-16T15:52:25.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.321+0000 7f065990e640 1 -- 172.21.15.132:0/2373532656 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06400039b0 msgr2=0x7f0640003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:25.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.321+0000 7f065990e640 1 --2- 172.21.15.132:0/2373532656 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06400039b0 0x7f0640003dd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f064c009fc0 tx=0x7f0640005830 comp rx=0 tx=0).stop 2024-04-16T15:52:25.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.321+0000 7f06537fe640 1 -- 172.21.15.132:0/2373532656 reap_dead start 2024-04-16T15:52:25.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.321+0000 7f065990e640 1 -- 172.21.15.132:0/2373532656 shutdown_connections 2024-04-16T15:52:25.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.321+0000 7f065990e640 1 -- 172.21.15.132:0/2373532656 >> 172.21.15.132:0/2373532656 conn(0x7f06540ce0b0 msgr2=0x7f06540ce4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:25.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.321+0000 7f065990e640 1 -- 172.21.15.132:0/2373532656 shutdown_connections 2024-04-16T15:52:25.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.321+0000 7f065990e640 1 -- 172.21.15.132:0/2373532656 wait complete. 2024-04-16T15:52:25.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.322+0000 7f065990e640 1 Processor -- start 2024-04-16T15:52:25.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.322+0000 7f065990e640 1 -- start start 2024-04-16T15:52:25.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.323+0000 7f065990e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06400039b0 0x7f06541366a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:25.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.323+0000 7f065990e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f065414e240 0x7f065414e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:25.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.323+0000 7f065990e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0654139200 0x7f0654139680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:25.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.323+0000 7f065990e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f065415f790 con 0x7f065414e240 2024-04-16T15:52:25.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.323+0000 7f065990e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f065415fb00 con 0x7f06400039b0 2024-04-16T15:52:25.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.323+0000 7f065990e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f06540b4090 con 0x7f0654139200 2024-04-16T15:52:25.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.323+0000 7f06527fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f065414e240 0x7f065414e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:25.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.323+0000 7f06527fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f065414e240 0x7f065414e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35458/0 (socket says 172.21.15.132:35458) 2024-04-16T15:52:25.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.323+0000 7f06527fc640 1 -- 172.21.15.132:0/2025577742 learned_addr learned my addr 172.21.15.132:0/2025577742 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:25.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.323+0000 7f0652ffd640 1 --2- 172.21.15.132:0/2025577742 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06400039b0 0x7f06541366a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:25.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.323+0000 7f06537fe640 1 --2- 172.21.15.132:0/2025577742 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0654139200 0x7f0654139680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:25.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.323+0000 7f06527fc640 1 -- 172.21.15.132:0/2025577742 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0654139200 msgr2=0x7f0654139680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:25.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.323+0000 7f06527fc640 1 --2- 172.21.15.132:0/2025577742 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0654139200 0x7f0654139680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:25.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.323+0000 7f06527fc640 1 -- 172.21.15.132:0/2025577742 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06400039b0 msgr2=0x7f06541366a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:25.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.323+0000 7f06527fc640 1 --2- 172.21.15.132:0/2025577742 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06400039b0 0x7f06541366a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:25.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.323+0000 7f06527fc640 1 -- 172.21.15.132:0/2025577742 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0654139f30 con 0x7f065414e240 2024-04-16T15:52:25.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.323+0000 7f06537fe640 1 --2- 172.21.15.132:0/2025577742 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0654139200 0x7f0654139680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:25.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.323+0000 7f06527fc640 1 --2- 172.21.15.132:0/2025577742 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f065414e240 0x7f065414e6a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f063c0119d0 tx=0x7f063c011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:25.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.323+0000 7f064bfff640 1 -- 172.21.15.132:0/2025577742 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f063c00fb50 con 0x7f065414e240 2024-04-16T15:52:25.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.323+0000 7f064bfff640 1 -- 172.21.15.132:0/2025577742 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f063c00fcf0 con 0x7f065414e240 2024-04-16T15:52:25.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.323+0000 7f065990e640 1 -- 172.21.15.132:0/2025577742 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f065415c900 con 0x7f065414e240 2024-04-16T15:52:25.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.323+0000 7f064bfff640 1 -- 172.21.15.132:0/2025577742 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f063c00fea0 con 0x7f065414e240 2024-04-16T15:52:25.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.323+0000 7f065990e640 1 -- 172.21.15.132:0/2025577742 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f065415cec0 con 0x7f065414e240 2024-04-16T15:52:25.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.324+0000 7f065990e640 1 -- 172.21.15.132:0/2025577742 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f065415d300 con 0x7f065414e240 2024-04-16T15:52:25.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.325+0000 7f064bfff640 1 -- 172.21.15.132:0/2025577742 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f063c012040 con 0x7f065414e240 2024-04-16T15:52:25.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.325+0000 7f064bfff640 1 --2- 172.21.15.132:0/2025577742 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f063406c890 0x7f063406ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:25.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.325+0000 7f064bfff640 1 -- 172.21.15.132:0/2025577742 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f063c08c170 con 0x7f065414e240 2024-04-16T15:52:25.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.325+0000 7f0652ffd640 1 --2- 172.21.15.132:0/2025577742 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f063406c890 0x7f063406ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:25.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.326+0000 7f0652ffd640 1 --2- 172.21.15.132:0/2025577742 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f063406c890 0x7f063406ed50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f064c036000 tx=0x7f064c02e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:25.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.330+0000 7f064bfff640 1 -- 172.21.15.132:0/2025577742 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f063c019030 con 0x7f065414e240 2024-04-16T15:52:25.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.506+0000 7f065990e640 1 -- 172.21.15.132:0/2025577742 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f0654075510 con 0x7f065414e240 2024-04-16T15:52:25.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.507+0000 7f064bfff640 1 -- 172.21.15.132:0/2025577742 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f063c05a630 con 0x7f065414e240 2024-04-16T15:52:25.506 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2024-04-16T15:52:25.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.509+0000 7f065990e640 1 -- 172.21.15.132:0/2025577742 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f063406c890 msgr2=0x7f063406ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:25.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.509+0000 7f065990e640 1 --2- 172.21.15.132:0/2025577742 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f063406c890 0x7f063406ed50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f064c036000 tx=0x7f064c02e000 comp rx=0 tx=0).stop 2024-04-16T15:52:25.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.509+0000 7f065990e640 1 -- 172.21.15.132:0/2025577742 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f065414e240 msgr2=0x7f065414e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:25.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.509+0000 7f065990e640 1 --2- 172.21.15.132:0/2025577742 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f065414e240 0x7f065414e6a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f063c0119d0 tx=0x7f063c011e90 comp rx=0 tx=0).stop 2024-04-16T15:52:25.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.509+0000 7f065990e640 1 -- 172.21.15.132:0/2025577742 shutdown_connections 2024-04-16T15:52:25.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.509+0000 7f065990e640 1 --2- 172.21.15.132:0/2025577742 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f063406c890 0x7f063406ed50 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:25.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.509+0000 7f065990e640 1 --2- 172.21.15.132:0/2025577742 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0654139200 0x7f0654139680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:25.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.509+0000 7f065990e640 1 --2- 172.21.15.132:0/2025577742 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f065414e240 0x7f065414e6a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:25.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.509+0000 7f065990e640 1 --2- 172.21.15.132:0/2025577742 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06400039b0 0x7f06541366a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:25.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.509+0000 7f065990e640 1 -- 172.21.15.132:0/2025577742 >> 172.21.15.132:0/2025577742 conn(0x7f06540ce0b0 msgr2=0x7f065415bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:25.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.509+0000 7f065990e640 1 -- 172.21.15.132:0/2025577742 shutdown_connections 2024-04-16T15:52:25.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.509+0000 7f065990e640 1 -- 172.21.15.132:0/2025577742 wait complete. 2024-04-16T15:52:25.520 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T15:52:25.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.624+0000 7f7462635640 1 Processor -- start 2024-04-16T15:52:25.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.625+0000 7f7462635640 1 -- start start 2024-04-16T15:52:25.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.625+0000 7f7462635640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f745c09aa30 0x7f745c06cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:25.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.625+0000 7f7462635640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f745c0d1fe0 con 0x7f745c06df50 2024-04-16T15:52:25.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.625+0000 7f7462635640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f745c0ccee0 con 0x7f745c15ede0 2024-04-16T15:52:25.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.625+0000 7f7462635640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f745c0b1c00 con 0x7f745c09aa30 2024-04-16T15:52:25.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.625+0000 7f7460bd2640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f745c06df50 0x7f745c0d0af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47318/0 (socket says 172.21.15.132:47318) 2024-04-16T15:52:25.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.625+0000 7f7460bd2640 1 -- 172.21.15.132:0/3509861199 learned_addr learned my addr 172.21.15.132:0/3509861199 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:25.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.626+0000 7f745b7fe640 1 -- 172.21.15.132:0/3509861199 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3484706569 0 0) 0x7f745c0d1fe0 con 0x7f745c06df50 2024-04-16T15:52:25.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.626+0000 7f745b7fe640 1 -- 172.21.15.132:0/3509861199 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7448003520 con 0x7f745c06df50 2024-04-16T15:52:25.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.626+0000 7f745bfff640 1 --2- 172.21.15.132:0/3509861199 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f745c09aa30 0x7f745c06cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:25.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.626+0000 7f745b7fe640 1 -- 172.21.15.132:0/3509861199 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 935872895 0 0) 0x7f7448003520 con 0x7f745c06df50 2024-04-16T15:52:25.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.626+0000 7f745b7fe640 1 -- 172.21.15.132:0/3509861199 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f745c09aa30 msgr2=0x7f745c06cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:25.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.626+0000 7f745b7fe640 1 --2- 172.21.15.132:0/3509861199 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f745c09aa30 0x7f745c06cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:25.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.626+0000 7f745b7fe640 1 -- 172.21.15.132:0/3509861199 >> v1:172.21.15.179:6789/0 conn(0x7f745c15ede0 legacy=0x7f745c09ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:25.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.626+0000 7f745b7fe640 1 -- 172.21.15.132:0/3509861199 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f745c0cd1c0 con 0x7f745c06df50 2024-04-16T15:52:25.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.626+0000 7f745b7fe640 1 -- 172.21.15.132:0/3509861199 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2803668828 0 0) 0x7f74540019f0 con 0x7f745c06df50 2024-04-16T15:52:25.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.626+0000 7f745b7fe640 1 -- 172.21.15.132:0/3509861199 >> v1:172.21.15.132:6789/0 conn(0x7f745c06df50 legacy=0x7f745c0d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:25.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.626+0000 7f745b7fe640 1 --2- 172.21.15.132:0/3509861199 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74480039e0 0x7f7448003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:25.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.626+0000 7f745b7fe640 1 --2- 172.21.15.132:0/3509861199 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7448004800 0x7f7448004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:25.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.626+0000 7f745b7fe640 1 --2- 172.21.15.132:0/3509861199 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f745c09aa30 0x7f7448005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:25.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.626+0000 7f745b7fe640 1 -- 172.21.15.132:0/3509861199 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f744800bac0 con 0x7f74480039e0 2024-04-16T15:52:25.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.626+0000 7f745b7fe640 1 -- 172.21.15.132:0/3509861199 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f744800bc70 con 0x7f7448004800 2024-04-16T15:52:25.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.626+0000 7f745b7fe640 1 -- 172.21.15.132:0/3509861199 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f744800be70 con 0x7f745c09aa30 2024-04-16T15:52:25.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.626+0000 7f745bfff640 1 --2- 172.21.15.132:0/3509861199 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74480039e0 0x7f7448003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:25.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.626+0000 7f7460bd2640 1 --2- 172.21.15.132:0/3509861199 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f745c09aa30 0x7f7448005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:25.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.626+0000 7f7453fff640 1 --2- 172.21.15.132:0/3509861199 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7448004800 0x7f7448004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:25.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.626+0000 7f745bfff640 1 -- 172.21.15.132:0/3509861199 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f745c09aa30 msgr2=0x7f7448005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:25.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.626+0000 7f745bfff640 1 --2- 172.21.15.132:0/3509861199 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f745c09aa30 0x7f7448005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:25.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.626+0000 7f745bfff640 1 -- 172.21.15.132:0/3509861199 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7448004800 msgr2=0x7f7448004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:25.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.626+0000 7f745bfff640 1 --2- 172.21.15.132:0/3509861199 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7448004800 0x7f7448004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:25.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.626+0000 7f745bfff640 1 -- 172.21.15.132:0/3509861199 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7448003520 con 0x7f74480039e0 2024-04-16T15:52:25.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.626+0000 7f7460bd2640 1 --2- 172.21.15.132:0/3509861199 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f745c09aa30 0x7f7448005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:25.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.627+0000 7f745bfff640 1 --2- 172.21.15.132:0/3509861199 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74480039e0 0x7f7448003e00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f744c00ba30 tx=0x7f7448005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d33f5b757c20f9a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:25.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.627+0000 7f745b7fe640 1 -- 172.21.15.132:0/3509861199 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f744c036020 con 0x7f74480039e0 2024-04-16T15:52:25.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.627+0000 7f745b7fe640 1 -- 172.21.15.132:0/3509861199 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f744c032640 con 0x7f74480039e0 2024-04-16T15:52:25.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.627+0000 7f745b7fe640 1 -- 172.21.15.132:0/3509861199 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f744c00b600 con 0x7f74480039e0 2024-04-16T15:52:25.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.628+0000 7f7462635640 1 -- 172.21.15.132:0/3509861199 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74480039e0 msgr2=0x7f7448003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:25.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.628+0000 7f7462635640 1 --2- 172.21.15.132:0/3509861199 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74480039e0 0x7f7448003e00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f744c00ba30 tx=0x7f7448005830 comp rx=0 tx=0).stop 2024-04-16T15:52:25.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.628+0000 7f7460bd2640 1 -- 172.21.15.132:0/3509861199 reap_dead start 2024-04-16T15:52:25.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.628+0000 7f7462635640 1 -- 172.21.15.132:0/3509861199 shutdown_connections 2024-04-16T15:52:25.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.628+0000 7f7462635640 1 -- 172.21.15.132:0/3509861199 >> 172.21.15.132:0/3509861199 conn(0x7f745c0b41e0 msgr2=0x7f745c0b45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:25.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.628+0000 7f7462635640 1 -- 172.21.15.132:0/3509861199 shutdown_connections 2024-04-16T15:52:25.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.628+0000 7f7462635640 1 -- 172.21.15.132:0/3509861199 wait complete. 2024-04-16T15:52:25.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.629+0000 7f7462635640 1 Processor -- start 2024-04-16T15:52:25.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.629+0000 7f7462635640 1 -- start start 2024-04-16T15:52:25.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.630+0000 7f7462635640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74480039e0 0x7f745c14c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:25.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.630+0000 7f7462635640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f745c0b5dd0 0x7f745c0b6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:25.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.630+0000 7f7462635640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f745c0c97c0 0x7f745c0c9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:25.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.630+0000 7f7462635640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f745c06cd40 con 0x7f74480039e0 2024-04-16T15:52:25.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.630+0000 7f7462635640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f745c0cd530 con 0x7f745c0b5dd0 2024-04-16T15:52:25.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.630+0000 7f7462635640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f745c06cec0 con 0x7f745c0c97c0 2024-04-16T15:52:25.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.630+0000 7f745bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74480039e0 0x7f745c14c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:25.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.630+0000 7f745bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74480039e0 0x7f745c14c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35478/0 (socket says 172.21.15.132:35478) 2024-04-16T15:52:25.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.630+0000 7f745bfff640 1 -- 172.21.15.132:0/2282725242 learned_addr learned my addr 172.21.15.132:0/2282725242 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:25.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.630+0000 7f7460bd2640 1 --2- 172.21.15.132:0/2282725242 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f745c0c97c0 0x7f745c0c9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:25.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.630+0000 7f7453fff640 1 --2- 172.21.15.132:0/2282725242 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f745c0b5dd0 0x7f745c0b6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:25.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.630+0000 7f745bfff640 1 -- 172.21.15.132:0/2282725242 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f745c0c97c0 msgr2=0x7f745c0c9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:25.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.630+0000 7f745bfff640 1 --2- 172.21.15.132:0/2282725242 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f745c0c97c0 0x7f745c0c9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:25.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.630+0000 7f745bfff640 1 -- 172.21.15.132:0/2282725242 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f745c0b5dd0 msgr2=0x7f745c0b6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:25.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.630+0000 7f745bfff640 1 --2- 172.21.15.132:0/2282725242 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f745c0b5dd0 0x7f745c0b6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:25.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.630+0000 7f745bfff640 1 -- 172.21.15.132:0/2282725242 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f745c14cc20 con 0x7f74480039e0 2024-04-16T15:52:25.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.630+0000 7f7453fff640 1 --2- 172.21.15.132:0/2282725242 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f745c0b5dd0 0x7f745c0b6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:52:25.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.630+0000 7f7460bd2640 1 --2- 172.21.15.132:0/2282725242 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f745c0c97c0 0x7f745c0c9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:52:25.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.631+0000 7f745bfff640 1 --2- 172.21.15.132:0/2282725242 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74480039e0 0x7f745c14c6e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f744c00bb20 tx=0x7f744c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:25.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.631+0000 7f74597fa640 1 -- 172.21.15.132:0/2282725242 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f744c036040 con 0x7f74480039e0 2024-04-16T15:52:25.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.631+0000 7f74597fa640 1 -- 172.21.15.132:0/2282725242 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f744c030a80 con 0x7f74480039e0 2024-04-16T15:52:25.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.631+0000 7f7462635640 1 -- 172.21.15.132:0/2282725242 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f745c0b6890 con 0x7f74480039e0 2024-04-16T15:52:25.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.631+0000 7f74597fa640 1 -- 172.21.15.132:0/2282725242 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f744c00b600 con 0x7f74480039e0 2024-04-16T15:52:25.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.631+0000 7f7462635640 1 -- 172.21.15.132:0/2282725242 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f745c0b6e50 con 0x7f74480039e0 2024-04-16T15:52:25.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.632+0000 7f7462635640 1 -- 172.21.15.132:0/2282725242 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f745c075510 con 0x7f74480039e0 2024-04-16T15:52:25.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.632+0000 7f74597fa640 1 -- 172.21.15.132:0/2282725242 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f744c039020 con 0x7f74480039e0 2024-04-16T15:52:25.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.633+0000 7f74597fa640 1 --2- 172.21.15.132:0/2282725242 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f743c06c920 0x7f743c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:25.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.633+0000 7f74597fa640 1 -- 172.21.15.132:0/2282725242 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f744c0ae600 con 0x7f74480039e0 2024-04-16T15:52:25.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.633+0000 7f7453fff640 1 --2- 172.21.15.132:0/2282725242 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f743c06c920 0x7f743c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:25.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.633+0000 7f7453fff640 1 --2- 172.21.15.132:0/2282725242 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f743c06c920 0x7f743c06ede0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f745c0711c0 tx=0x7f7444009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:25.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.637+0000 7f74597fa640 1 -- 172.21.15.132:0/2282725242 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f744c030e70 con 0x7f74480039e0 2024-04-16T15:52:25.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.850+0000 7f7462635640 1 -- 172.21.15.132:0/2282725242 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f745c15e5e0 con 0x7f74480039e0 2024-04-16T15:52:25.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.850+0000 7f74597fa640 1 -- 172.21.15.132:0/2282725242 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5175 (secure 0 0 0) 0x7f744c07c9a0 con 0x7f74480039e0 2024-04-16T15:52:25.851 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:52:25.851 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/659108212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":659108212},{"type":"v1","addr":"172.21.15.132:6835","nonce":659108212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/811468074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":811468074},{"type":"v1","addr":"172.21.15.132:6837","nonce":811468074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/493922944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":493922944},{"type":"v1","addr":"172.21.15.179:6834","nonce":493922944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T15:52:15.286161+0000","modified":"2024-04-16T15:52:17.305756+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/202618568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":202618568},{"type":"v1","addr":"172.21.15.179:6835","nonce":202618568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1}]} 2024-04-16T15:52:25.852 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 6 2024-04-16T15:52:25.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.852+0000 7f7462635640 1 -- 172.21.15.132:0/2282725242 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f743c06c920 msgr2=0x7f743c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:25.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.852+0000 7f7462635640 1 --2- 172.21.15.132:0/2282725242 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f743c06c920 0x7f743c06ede0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f745c0711c0 tx=0x7f7444009040 comp rx=0 tx=0).stop 2024-04-16T15:52:25.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.852+0000 7f7462635640 1 -- 172.21.15.132:0/2282725242 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74480039e0 msgr2=0x7f745c14c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:25.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.852+0000 7f7462635640 1 --2- 172.21.15.132:0/2282725242 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74480039e0 0x7f745c14c6e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f744c00bb20 tx=0x7f744c004730 comp rx=0 tx=0).stop 2024-04-16T15:52:25.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.852+0000 7f7462635640 1 -- 172.21.15.132:0/2282725242 shutdown_connections 2024-04-16T15:52:25.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.852+0000 7f7462635640 1 --2- 172.21.15.132:0/2282725242 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f743c06c920 0x7f743c06ede0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:25.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.852+0000 7f7462635640 1 --2- 172.21.15.132:0/2282725242 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f745c0c97c0 0x7f745c0c9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:25.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.852+0000 7f7462635640 1 --2- 172.21.15.132:0/2282725242 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f745c0b5dd0 0x7f745c0b6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:25.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.852+0000 7f7462635640 1 --2- 172.21.15.132:0/2282725242 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74480039e0 0x7f745c14c6e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:25.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.852+0000 7f7462635640 1 -- 172.21.15.132:0/2282725242 >> 172.21.15.132:0/2282725242 conn(0x7f745c0b41e0 msgr2=0x7f745c070220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:25.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.852+0000 7f7462635640 1 -- 172.21.15.132:0/2282725242 shutdown_connections 2024-04-16T15:52:25.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.852+0000 7f7462635640 1 -- 172.21.15.132:0/2282725242 wait complete. 2024-04-16T15:52:25.863 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:52:25.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.968+0000 7fe02ebbd640 1 Processor -- start 2024-04-16T15:52:25.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.968+0000 7fe02ebbd640 1 -- start start 2024-04-16T15:52:25.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.968+0000 7fe02ebbd640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe02815eed0 0x7fe0280b63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:25.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.968+0000 7fe02ebbd640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe028162cc0 con 0x7fe0281627e0 2024-04-16T15:52:25.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.968+0000 7fe02ebbd640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe028162fa0 con 0x7fe02815eaf0 2024-04-16T15:52:25.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.968+0000 7fe02ebbd640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fe0280d2af0 con 0x7fe02815eed0 2024-04-16T15:52:25.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.969+0000 7fe02d15a640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fe0281627e0 0x7fe0280d2f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47324/0 (socket says 172.21.15.132:47324) 2024-04-16T15:52:25.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.969+0000 7fe02d15a640 1 -- 172.21.15.132:0/2951694856 learned_addr learned my addr 172.21.15.132:0/2951694856 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:25.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.969+0000 7fe0277fe640 1 -- 172.21.15.132:0/2951694856 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2430431 0 0) 0x7fe028162cc0 con 0x7fe0281627e0 2024-04-16T15:52:25.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.969+0000 7fe0277fe640 1 -- 172.21.15.132:0/2951694856 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe018003520 con 0x7fe0281627e0 2024-04-16T15:52:25.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.969+0000 7fe027fff640 1 --2- 172.21.15.132:0/2951694856 >> v2:172.21.15.179:3300/0 conn(0x7fe02815eed0 0x7fe0280b63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:25.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.969+0000 7fe0277fe640 1 -- 172.21.15.132:0/2951694856 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 747193619 0 0) 0x7fe018003520 con 0x7fe0281627e0 2024-04-16T15:52:25.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.969+0000 7fe0277fe640 1 -- 172.21.15.132:0/2951694856 >> v2:172.21.15.179:3300/0 conn(0x7fe02815eed0 msgr2=0x7fe0280b63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:25.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.969+0000 7fe0277fe640 1 --2- 172.21.15.132:0/2951694856 >> v2:172.21.15.179:3300/0 conn(0x7fe02815eed0 0x7fe0280b63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:25.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.969+0000 7fe0277fe640 1 -- 172.21.15.132:0/2951694856 >> v1:172.21.15.179:6789/0 conn(0x7fe02815eaf0 legacy=0x7fe0280ba300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:25.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.969+0000 7fe0277fe640 1 -- 172.21.15.132:0/2951694856 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe028163280 con 0x7fe0281627e0 2024-04-16T15:52:25.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.969+0000 7fe0277fe640 1 -- 172.21.15.132:0/2951694856 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2803668828 0 0) 0x7fe0200019f0 con 0x7fe0281627e0 2024-04-16T15:52:25.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.969+0000 7fe0277fe640 1 -- 172.21.15.132:0/2951694856 >> v1:172.21.15.132:6789/0 conn(0x7fe0281627e0 legacy=0x7fe0280d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:25.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.969+0000 7fe0277fe640 1 --2- 172.21.15.132:0/2951694856 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0180039b0 0x7fe018003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:25.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.969+0000 7fe0277fe640 1 --2- 172.21.15.132:0/2951694856 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe018004800 0x7fe018004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:25.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.969+0000 7fe0277fe640 1 --2- 172.21.15.132:0/2951694856 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0180051c0 0x7fe01800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:25.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.969+0000 7fe0277fe640 1 -- 172.21.15.132:0/2951694856 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe0280d2af0 con 0x7fe0180051c0 2024-04-16T15:52:25.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.969+0000 7fe0277fe640 1 -- 172.21.15.132:0/2951694856 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe01800c110 con 0x7fe018004800 2024-04-16T15:52:25.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.969+0000 7fe0277fe640 1 -- 172.21.15.132:0/2951694856 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe01800c310 con 0x7fe0180039b0 2024-04-16T15:52:25.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.969+0000 7fe02d15a640 1 --2- 172.21.15.132:0/2951694856 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0180051c0 0x7fe01800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:25.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.969+0000 7fe02c959640 1 --2- 172.21.15.132:0/2951694856 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0180039b0 0x7fe018003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:25.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.969+0000 7fe027fff640 1 --2- 172.21.15.132:0/2951694856 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe018004800 0x7fe018004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:25.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.969+0000 7fe02d15a640 1 -- 172.21.15.132:0/2951694856 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0180039b0 msgr2=0x7fe018003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:25.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.969+0000 7fe02d15a640 1 --2- 172.21.15.132:0/2951694856 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0180039b0 0x7fe018003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:25.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.969+0000 7fe02d15a640 1 -- 172.21.15.132:0/2951694856 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe018004800 msgr2=0x7fe018004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:25.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.969+0000 7fe02d15a640 1 --2- 172.21.15.132:0/2951694856 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe018004800 0x7fe018004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:25.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.969+0000 7fe02d15a640 1 -- 172.21.15.132:0/2951694856 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe018003520 con 0x7fe0180051c0 2024-04-16T15:52:25.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.970+0000 7fe02d15a640 1 -- 172.21.15.132:0/2951694856 reap_dead start 2024-04-16T15:52:25.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.970+0000 7fe02d15a640 1 --2- 172.21.15.132:0/2951694856 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0180051c0 0x7fe01800b9c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe0280d4850 tx=0x7fe018005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47fab40f189d09c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:25.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.970+0000 7fe0277fe640 1 -- 172.21.15.132:0/2951694856 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe02000a460 con 0x7fe0180051c0 2024-04-16T15:52:25.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.970+0000 7fe0277fe640 1 -- 172.21.15.132:0/2951694856 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe020034650 con 0x7fe0180051c0 2024-04-16T15:52:25.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.970+0000 7fe0277fe640 1 -- 172.21.15.132:0/2951694856 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe020034a40 con 0x7fe0180051c0 2024-04-16T15:52:25.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.971+0000 7fe02ebbd640 1 -- 172.21.15.132:0/2951694856 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0180051c0 msgr2=0x7fe01800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:25.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.971+0000 7fe02ebbd640 1 --2- 172.21.15.132:0/2951694856 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0180051c0 0x7fe01800b9c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe0280d4850 tx=0x7fe018005830 comp rx=0 tx=0).stop 2024-04-16T15:52:25.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.971+0000 7fe02ebbd640 1 -- 172.21.15.132:0/2951694856 shutdown_connections 2024-04-16T15:52:25.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.971+0000 7fe02ebbd640 1 --2- 172.21.15.132:0/2951694856 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0180051c0 0x7fe01800b9c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:25.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.971+0000 7fe02ebbd640 1 -- 172.21.15.132:0/2951694856 >> 172.21.15.132:0/2951694856 conn(0x7fe0280d13f0 msgr2=0x7fe0280d1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:25.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.971+0000 7fe02ebbd640 1 -- 172.21.15.132:0/2951694856 shutdown_connections 2024-04-16T15:52:25.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.971+0000 7fe02ebbd640 1 -- 172.21.15.132:0/2951694856 wait complete. 2024-04-16T15:52:25.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.972+0000 7fe02ebbd640 1 Processor -- start 2024-04-16T15:52:25.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.972+0000 7fe02ebbd640 1 -- start start 2024-04-16T15:52:25.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.973+0000 7fe02ebbd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0180051c0 0x7fe028155530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:25.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.973+0000 7fe02ebbd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0280c84a0 0x7fe0280b8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:25.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.973+0000 7fe02ebbd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0280c8920 0x7fe0280b91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:25.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.973+0000 7fe02ebbd640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe0280ba480 con 0x7fe0280c8920 2024-04-16T15:52:25.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.973+0000 7fe02ebbd640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe0280ba300 con 0x7fe0280c84a0 2024-04-16T15:52:25.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.973+0000 7fe02ebbd640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe0280ba600 con 0x7fe0180051c0 2024-04-16T15:52:25.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.973+0000 7fe02d15a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0280c8920 0x7fe0280b91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:25.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.973+0000 7fe02d15a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0280c8920 0x7fe0280b91a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35502/0 (socket says 172.21.15.132:35502) 2024-04-16T15:52:25.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.973+0000 7fe02d15a640 1 -- 172.21.15.132:0/827769006 learned_addr learned my addr 172.21.15.132:0/827769006 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:25.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.973+0000 7fe02c959640 1 --2- 172.21.15.132:0/827769006 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0180051c0 0x7fe028155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:25.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.973+0000 7fe027fff640 1 --2- 172.21.15.132:0/827769006 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0280c84a0 0x7fe0280b8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:25.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.973+0000 7fe02d15a640 1 -- 172.21.15.132:0/827769006 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0180051c0 msgr2=0x7fe028155530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:25.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.973+0000 7fe02d15a640 1 --2- 172.21.15.132:0/827769006 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0180051c0 0x7fe028155530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:25.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.973+0000 7fe02d15a640 1 -- 172.21.15.132:0/827769006 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0280c84a0 msgr2=0x7fe0280b8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:25.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.973+0000 7fe02d15a640 1 --2- 172.21.15.132:0/827769006 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0280c84a0 0x7fe0280b8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:25.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.973+0000 7fe02d15a640 1 -- 172.21.15.132:0/827769006 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe028162000 con 0x7fe0280c8920 2024-04-16T15:52:25.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.973+0000 7fe02c959640 1 --2- 172.21.15.132:0/827769006 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0180051c0 0x7fe028155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:52:25.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.973+0000 7fe027fff640 1 --2- 172.21.15.132:0/827769006 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0280c84a0 0x7fe0280b8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:52:25.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.974+0000 7fe02d15a640 1 --2- 172.21.15.132:0/827769006 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0280c8920 0x7fe0280b91a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe02002cc00 tx=0x7fe028163450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:25.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.974+0000 7fe0257fa640 1 -- 172.21.15.132:0/827769006 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe020039040 con 0x7fe0280c8920 2024-04-16T15:52:25.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.974+0000 7fe0257fa640 1 -- 172.21.15.132:0/827769006 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe020004de0 con 0x7fe0280c8920 2024-04-16T15:52:25.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.974+0000 7fe02ebbd640 1 -- 172.21.15.132:0/827769006 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0280cbc50 con 0x7fe0280c8920 2024-04-16T15:52:25.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.974+0000 7fe0257fa640 1 -- 172.21.15.132:0/827769006 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0200019d0 con 0x7fe0280c8920 2024-04-16T15:52:25.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.974+0000 7fe02ebbd640 1 -- 172.21.15.132:0/827769006 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0280cc210 con 0x7fe0280c8920 2024-04-16T15:52:25.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.975+0000 7fe02ebbd640 1 -- 172.21.15.132:0/827769006 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe028075510 con 0x7fe0280c8920 2024-04-16T15:52:25.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.975+0000 7fe0257fa640 1 -- 172.21.15.132:0/827769006 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe020034650 con 0x7fe0280c8920 2024-04-16T15:52:25.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.976+0000 7fe0257fa640 1 --2- 172.21.15.132:0/827769006 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fe00c06c8f0 0x7fe00c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:25.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.976+0000 7fe02c959640 1 --2- 172.21.15.132:0/827769006 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fe00c06c8f0 0x7fe00c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:25.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.976+0000 7fe0257fa640 1 -- 172.21.15.132:0/827769006 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe0200ad550 con 0x7fe0280c8920 2024-04-16T15:52:25.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.976+0000 7fe02c959640 1 --2- 172.21.15.132:0/827769006 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fe00c06c8f0 0x7fe00c06edb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe01c005580 tx=0x7fe01c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:25.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:25.980+0000 7fe0257fa640 1 -- 172.21.15.132:0/827769006 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe02007b980 con 0x7fe0280c8920 2024-04-16T15:52:26.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.158+0000 7fe02ebbd640 1 -- 172.21.15.132:0/827769006 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe0280d2610 con 0x7fe0280c8920 2024-04-16T15:52:26.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.159+0000 7fe0257fa640 1 -- 172.21.15.132:0/827769006 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7fe02007b280 con 0x7fe0280c8920 2024-04-16T15:52:26.159 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:52:26.159 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"6bdec5d9-f406-43ad-8584-0503b32f6f0d","created":"2024-04-16T15:51:51.073040+0000","modified":"2024-04-16T15:52:16.950186+0000","last_up_change":"2024-04-16T15:52:02.280496+0000","last_in_change":"2024-04-16T15:51:53.376468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:52:03.284927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:52:13.363758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T15:52:14.246647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d45908b-6e22-4619-b190-897af594b712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6801","nonce":1170594668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6803","nonce":1170594668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6807","nonce":1170594668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6805","nonce":1170594668}]},"public_addr":"172.21.15.132:6801/1170594668","cluster_addr":"172.21.15.132:6803/1170594668","heartbeat_back_addr":"172.21.15.132:6807/1170594668","heartbeat_front_addr":"172.21.15.132:6805/1170594668","state":["exists","up"]},{"osd":1,"uuid":"c88bf082-e51f-4ee6-815a-025f6ce0d67b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6809","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6811","nonce":2494780358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6815","nonce":2494780358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6823","nonce":2494780358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6819","nonce":2494780358}]},"public_addr":"172.21.15.132:6811/2494780358","cluster_addr":"172.21.15.132:6815/2494780358","heartbeat_back_addr":"172.21.15.132:6823/2494780358","heartbeat_front_addr":"172.21.15.132:6819/2494780358","state":["exists","up"]},{"osd":2,"uuid":"e5dbd6b4-4e7b-47e4-ad4e-35b4b81696c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6825","nonce":27655483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6827","nonce":27655483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6831","nonce":27655483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6829","nonce":27655483}]},"public_addr":"172.21.15.132:6825/27655483","cluster_addr":"172.21.15.132:6827/27655483","heartbeat_back_addr":"172.21.15.132:6831/27655483","heartbeat_front_addr":"172.21.15.132:6829/27655483","state":["exists","up"]},{"osd":3,"uuid":"9d75cd67-3b8a-4424-8884-5f3660e1f5f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6810","nonce":3100919191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6814","nonce":3100919191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6821","nonce":3100919191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6818","nonce":3100919191}]},"public_addr":"172.21.15.132:6810/3100919191","cluster_addr":"172.21.15.132:6814/3100919191","heartbeat_back_addr":"172.21.15.132:6821/3100919191","heartbeat_front_addr":"172.21.15.132:6818/3100919191","state":["exists","up"]},{"osd":4,"uuid":"83aea46a-8642-4777-912b-c130e5890da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6825","nonce":123637799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6827","nonce":123637799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6831","nonce":123637799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6829","nonce":123637799}]},"public_addr":"172.21.15.179:6825/123637799","cluster_addr":"172.21.15.179:6827/123637799","heartbeat_back_addr":"172.21.15.179:6831/123637799","heartbeat_front_addr":"172.21.15.179:6829/123637799","state":["exists","up"]},{"osd":5,"uuid":"534117c8-3317-48d6-b436-afd5709f71e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6801","nonce":2224750370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6803","nonce":2224750370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6807","nonce":2224750370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6805","nonce":2224750370}]},"public_addr":"172.21.15.179:6801/2224750370","cluster_addr":"172.21.15.179:6803/2224750370","heartbeat_back_addr":"172.21.15.179:6807/2224750370","heartbeat_front_addr":"172.21.15.179:6805/2224750370","state":["exists","up"]},{"osd":6,"uuid":"0ba363e7-fa9d-42b1-ae09-a6a0f57d41f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6809","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6811","nonce":101498164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6813","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6815","nonce":101498164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6823","nonce":101498164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6819","nonce":101498164}]},"public_addr":"172.21.15.179:6811/101498164","cluster_addr":"172.21.15.179:6815/101498164","heartbeat_back_addr":"172.21.15.179:6823/101498164","heartbeat_front_addr":"172.21.15.179:6819/101498164","state":["exists","up"]},{"osd":7,"uuid":"e6830c77-2f2d-4067-9866-ee7625afc1a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6810","nonce":872148365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6814","nonce":872148365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6822","nonce":872148365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6818","nonce":872148365}]},"public_addr":"172.21.15.179:6810/872148365","cluster_addr":"172.21.15.179:6814/872148365","heartbeat_back_addr":"172.21.15.179:6822/872148365","heartbeat_front_addr":"172.21.15.179:6818/872148365","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.535221+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.563769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.520765+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.526264+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.517058+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.500842+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.534332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.512486+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:52:26.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.161+0000 7fe02ebbd640 1 -- 172.21.15.132:0/827769006 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fe00c06c8f0 msgr2=0x7fe00c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:26.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.161+0000 7fe02ebbd640 1 --2- 172.21.15.132:0/827769006 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fe00c06c8f0 0x7fe00c06edb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe01c005580 tx=0x7fe01c009040 comp rx=0 tx=0).stop 2024-04-16T15:52:26.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.161+0000 7fe02ebbd640 1 -- 172.21.15.132:0/827769006 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0280c8920 msgr2=0x7fe0280b91a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:26.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.161+0000 7fe02ebbd640 1 --2- 172.21.15.132:0/827769006 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0280c8920 0x7fe0280b91a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe02002cc00 tx=0x7fe028163450 comp rx=0 tx=0).stop 2024-04-16T15:52:26.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.161+0000 7fe02ebbd640 1 -- 172.21.15.132:0/827769006 shutdown_connections 2024-04-16T15:52:26.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.161+0000 7fe02ebbd640 1 --2- 172.21.15.132:0/827769006 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fe00c06c8f0 0x7fe00c06edb0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:26.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.161+0000 7fe02ebbd640 1 --2- 172.21.15.132:0/827769006 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0280c8920 0x7fe0280b91a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:26.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.161+0000 7fe02ebbd640 1 --2- 172.21.15.132:0/827769006 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0280c84a0 0x7fe0280b8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:26.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.161+0000 7fe02ebbd640 1 --2- 172.21.15.132:0/827769006 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0180051c0 0x7fe028155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:26.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.161+0000 7fe02ebbd640 1 -- 172.21.15.132:0/827769006 >> 172.21.15.132:0/827769006 conn(0x7fe0280d13f0 msgr2=0x7fe0280ced10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:26.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.161+0000 7fe02ebbd640 1 -- 172.21.15.132:0/827769006 shutdown_connections 2024-04-16T15:52:26.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.161+0000 7fe02ebbd640 1 -- 172.21.15.132:0/827769006 wait complete. 2024-04-16T15:52:26.172 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T15:52:03.284927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T15:52:13.363758+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T15:52:14.246647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T15:52:26.172 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T15:52:26.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.280+0000 7fad39e88640 1 Processor -- start 2024-04-16T15:52:26.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.281+0000 7fad39e88640 1 -- start start 2024-04-16T15:52:26.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.281+0000 7fad39e88640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fad34162380 0x7fad340d2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:26.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.281+0000 7fad39e88640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fad340b1830 0x7fad340ccf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:26.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.281+0000 7fad39e88640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad3406d6c0 con 0x7fad3409ab80 2024-04-16T15:52:26.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.281+0000 7fad39e88640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fad340d09a0 con 0x7fad34162380 2024-04-16T15:52:26.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.281+0000 7fad39e88640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fad340d0f40 con 0x7fad340b1830 2024-04-16T15:52:26.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.281+0000 7fad337fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fad34162380 0x7fad340d2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:26.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.281+0000 7fad33fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fad3409ab80 0x7fad340d13d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47334/0 (socket says 172.21.15.132:47334) 2024-04-16T15:52:26.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.282+0000 7fad33fff640 1 -- 172.21.15.132:0/1668186179 learned_addr learned my addr 172.21.15.132:0/1668186179 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:26.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.282+0000 7fad2affd640 1 --2- 172.21.15.132:0/1668186179 >> v2:172.21.15.179:3300/0 conn(0x7fad340b1830 0x7fad340ccf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:26.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.282+0000 7fad337fe640 1 -- 172.21.15.132:0/1668186179 >> v2:172.21.15.179:3300/0 conn(0x7fad340b1830 msgr2=0x7fad340ccf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:26.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.282+0000 7fad337fe640 1 --2- 172.21.15.132:0/1668186179 >> v2:172.21.15.179:3300/0 conn(0x7fad340b1830 0x7fad340ccf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:26.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.282+0000 7fad337fe640 1 -- 172.21.15.132:0/1668186179 >> v1:172.21.15.132:6789/0 conn(0x7fad3409ab80 legacy=0x7fad340d13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:26.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.282+0000 7fad337fe640 1 -- 172.21.15.132:0/1668186179 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad3406d9a0 con 0x7fad34162380 2024-04-16T15:52:26.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.282+0000 7fad32ffd640 1 -- 172.21.15.132:0/1668186179 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4202882922 0 0) 0x7fad3406d6c0 con 0x7fad3409ab80 2024-04-16T15:52:26.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.282+0000 7fad2affd640 1 --2- 172.21.15.132:0/1668186179 >> v2:172.21.15.179:3300/0 conn(0x7fad340b1830 0x7fad340ccf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:52:26.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.282+0000 7fad337fe640 1 --2- 172.21.15.132:0/1668186179 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad34162380 0x7fad340d2310 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fad340c6410 tx=0x7fad2402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e4a2ab0d54aa38a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:26.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.283+0000 7fad32ffd640 1 -- 172.21.15.132:0/1668186179 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad24035020 con 0x7fad34162380 2024-04-16T15:52:26.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.283+0000 7fad32ffd640 1 -- 172.21.15.132:0/1668186179 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad24031830 con 0x7fad34162380 2024-04-16T15:52:26.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.283+0000 7fad32ffd640 1 -- 172.21.15.132:0/1668186179 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad24031c00 con 0x7fad34162380 2024-04-16T15:52:26.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.283+0000 7fad39e88640 1 -- 172.21.15.132:0/1668186179 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad34162380 msgr2=0x7fad340d2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:26.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.283+0000 7fad39e88640 1 --2- 172.21.15.132:0/1668186179 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad34162380 0x7fad340d2310 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fad340c6410 tx=0x7fad2402b8d0 comp rx=0 tx=0).stop 2024-04-16T15:52:26.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.283+0000 7fad39e88640 1 -- 172.21.15.132:0/1668186179 shutdown_connections 2024-04-16T15:52:26.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.283+0000 7fad39e88640 1 --2- 172.21.15.132:0/1668186179 >> v2:172.21.15.179:3300/0 conn(0x7fad340b1830 0x7fad340ccf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:26.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.283+0000 7fad39e88640 1 --2- 172.21.15.132:0/1668186179 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad34162380 0x7fad340d2310 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:26.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.283+0000 7fad39e88640 1 -- 172.21.15.132:0/1668186179 >> 172.21.15.132:0/1668186179 conn(0x7fad340b4400 msgr2=0x7fad340b4810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:26.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.283+0000 7fad39e88640 1 -- 172.21.15.132:0/1668186179 shutdown_connections 2024-04-16T15:52:26.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.283+0000 7fad39e88640 1 -- 172.21.15.132:0/1668186179 wait complete. 2024-04-16T15:52:26.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.284+0000 7fad39e88640 1 Processor -- start 2024-04-16T15:52:26.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.285+0000 7fad39e88640 1 -- start start 2024-04-16T15:52:26.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.285+0000 7fad39e88640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad3409ab80 0x7fad3415f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:26.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.285+0000 7fad39e88640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad340b1830 0x7fad3415f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:26.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.285+0000 7fad39e88640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad34162380 0x7fad341f44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:26.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.285+0000 7fad39e88640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fad3406dc80 con 0x7fad3409ab80 2024-04-16T15:52:26.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.285+0000 7fad39e88640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fad34162760 con 0x7fad340b1830 2024-04-16T15:52:26.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.285+0000 7fad39e88640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fad340cd4a0 con 0x7fad34162380 2024-04-16T15:52:26.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.285+0000 7fad337fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad3409ab80 0x7fad3415f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:26.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.285+0000 7fad337fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad3409ab80 0x7fad3415f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35508/0 (socket says 172.21.15.132:35508) 2024-04-16T15:52:26.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.285+0000 7fad337fe640 1 -- 172.21.15.132:0/2351320432 learned_addr learned my addr 172.21.15.132:0/2351320432 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:26.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.286+0000 7fad337fe640 1 -- 172.21.15.132:0/2351320432 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad34162380 msgr2=0x7fad341f44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:26.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.286+0000 7fad337fe640 1 --2- 172.21.15.132:0/2351320432 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad34162380 0x7fad341f44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:26.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.286+0000 7fad337fe640 1 -- 172.21.15.132:0/2351320432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad340b1830 msgr2=0x7fad3415f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:26.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.286+0000 7fad337fe640 1 --2- 172.21.15.132:0/2351320432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad340b1830 0x7fad3415f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:26.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.286+0000 7fad337fe640 1 -- 172.21.15.132:0/2351320432 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad3415fba0 con 0x7fad3409ab80 2024-04-16T15:52:26.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.286+0000 7fad337fe640 1 --2- 172.21.15.132:0/2351320432 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad3409ab80 0x7fad3415f120 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fad2402bee0 tx=0x7fad240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:26.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.286+0000 7fad30ff9640 1 -- 172.21.15.132:0/2351320432 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad24041070 con 0x7fad3409ab80 2024-04-16T15:52:26.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.286+0000 7fad30ff9640 1 -- 172.21.15.132:0/2351320432 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad2403aa30 con 0x7fad3409ab80 2024-04-16T15:52:26.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.286+0000 7fad39e88640 1 -- 172.21.15.132:0/2351320432 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad3415fe50 con 0x7fad3409ab80 2024-04-16T15:52:26.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.286+0000 7fad30ff9640 1 -- 172.21.15.132:0/2351320432 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad24035040 con 0x7fad3409ab80 2024-04-16T15:52:26.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.286+0000 7fad39e88640 1 -- 172.21.15.132:0/2351320432 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad341f5ac0 con 0x7fad3409ab80 2024-04-16T15:52:26.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.287+0000 7fad39e88640 1 -- 172.21.15.132:0/2351320432 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad34075510 con 0x7fad3409ab80 2024-04-16T15:52:26.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.287+0000 7fad30ff9640 1 -- 172.21.15.132:0/2351320432 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fad24038020 con 0x7fad3409ab80 2024-04-16T15:52:26.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.288+0000 7fad30ff9640 1 --2- 172.21.15.132:0/2351320432 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fad1406c8f0 0x7fad1406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:26.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.288+0000 7fad2affd640 1 --2- 172.21.15.132:0/2351320432 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fad1406c8f0 0x7fad1406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:26.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.288+0000 7fad30ff9640 1 -- 172.21.15.132:0/2351320432 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fad240ad2f0 con 0x7fad3409ab80 2024-04-16T15:52:26.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.288+0000 7fad2affd640 1 --2- 172.21.15.132:0/2351320432 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fad1406c8f0 0x7fad1406edb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fad1c006fd0 tx=0x7fad1c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:26.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.292+0000 7fad30ff9640 1 -- 172.21.15.132:0/2351320432 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fad2407b720 con 0x7fad3409ab80 2024-04-16T15:52:26.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.468+0000 7fad39e88640 1 -- 172.21.15.132:0/2351320432 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fad340b5060 con 0x7fad3409ab80 2024-04-16T15:52:26.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.468+0000 7fad30ff9640 1 -- 172.21.15.132:0/2351320432 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fad2407b020 con 0x7fad3409ab80 2024-04-16T15:52:26.469 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2024-04-16T15:52:26.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.470+0000 7fad39e88640 1 -- 172.21.15.132:0/2351320432 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fad1406c8f0 msgr2=0x7fad1406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:26.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.470+0000 7fad39e88640 1 --2- 172.21.15.132:0/2351320432 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fad1406c8f0 0x7fad1406edb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fad1c006fd0 tx=0x7fad1c008040 comp rx=0 tx=0).stop 2024-04-16T15:52:26.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.470+0000 7fad39e88640 1 -- 172.21.15.132:0/2351320432 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad3409ab80 msgr2=0x7fad3415f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:26.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.470+0000 7fad39e88640 1 --2- 172.21.15.132:0/2351320432 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad3409ab80 0x7fad3415f120 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fad2402bee0 tx=0x7fad240046c0 comp rx=0 tx=0).stop 2024-04-16T15:52:26.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.470+0000 7fad39e88640 1 -- 172.21.15.132:0/2351320432 shutdown_connections 2024-04-16T15:52:26.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.470+0000 7fad39e88640 1 --2- 172.21.15.132:0/2351320432 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fad1406c8f0 0x7fad1406edb0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:26.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.470+0000 7fad39e88640 1 --2- 172.21.15.132:0/2351320432 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad34162380 0x7fad341f44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:26.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.470+0000 7fad39e88640 1 --2- 172.21.15.132:0/2351320432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad340b1830 0x7fad3415f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:26.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.470+0000 7fad39e88640 1 --2- 172.21.15.132:0/2351320432 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad3409ab80 0x7fad3415f120 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:26.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.470+0000 7fad39e88640 1 -- 172.21.15.132:0/2351320432 >> 172.21.15.132:0/2351320432 conn(0x7fad340b4400 msgr2=0x7fad340cd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:26.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.470+0000 7fad39e88640 1 -- 172.21.15.132:0/2351320432 shutdown_connections 2024-04-16T15:52:26.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.470+0000 7fad39e88640 1 -- 172.21.15.132:0/2351320432 wait complete. 2024-04-16T15:52:26.480 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T15:52:26.587 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.588+0000 7fe7f493d640 1 Processor -- start 2024-04-16T15:52:26.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.588+0000 7fe7f493d640 1 -- start start 2024-04-16T15:52:26.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.589+0000 7fe7f493d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe7f015eae0 0x7fe7f00ae480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:26.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.589+0000 7fe7f493d640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7f00b67c0 con 0x7fe7f0070eb0 2024-04-16T15:52:26.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.589+0000 7fe7f493d640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7f00b4b90 con 0x7fe7f00b6020 2024-04-16T15:52:26.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.589+0000 7fe7f493d640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fe7f00b64e0 con 0x7fe7f015eae0 2024-04-16T15:52:26.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.589+0000 7fe7eed9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fe7f0070eb0 0x7fe7f006ba20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47344/0 (socket says 172.21.15.132:47344) 2024-04-16T15:52:26.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.589+0000 7fe7eed9d640 1 -- 172.21.15.132:0/3928767910 learned_addr learned my addr 172.21.15.132:0/3928767910 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:26.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.590+0000 7fe7ee59c640 1 --2- 172.21.15.132:0/3928767910 >> v2:172.21.15.179:3300/0 conn(0x7fe7f015eae0 0x7fe7f00ae480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:26.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.590+0000 7fe7ed59a640 1 -- 172.21.15.132:0/3928767910 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3459365547 0 0) 0x7fe7e0001110 con 0x7fe7f0070eb0 2024-04-16T15:52:26.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.590+0000 7fe7ed59a640 1 -- 172.21.15.132:0/3928767910 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7dc003520 con 0x7fe7f0070eb0 2024-04-16T15:52:26.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.590+0000 7fe7ed59a640 1 -- 172.21.15.132:0/3928767910 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1026268129 0 0) 0x7fe7f00b4b90 con 0x7fe7f00b6020 2024-04-16T15:52:26.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.590+0000 7fe7ed59a640 1 -- 172.21.15.132:0/3928767910 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7e0001110 con 0x7fe7f00b6020 2024-04-16T15:52:26.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.590+0000 7fe7ed59a640 1 -- 172.21.15.132:0/3928767910 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3039647600 0 0) 0x7fe7dc003520 con 0x7fe7f0070eb0 2024-04-16T15:52:26.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.590+0000 7fe7ed59a640 1 -- 172.21.15.132:0/3928767910 >> v2:172.21.15.179:3300/0 conn(0x7fe7f015eae0 msgr2=0x7fe7f00ae480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:26.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.590+0000 7fe7ed59a640 1 --2- 172.21.15.132:0/3928767910 >> v2:172.21.15.179:3300/0 conn(0x7fe7f015eae0 0x7fe7f00ae480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:26.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.590+0000 7fe7ed59a640 1 -- 172.21.15.132:0/3928767910 >> v1:172.21.15.179:6789/0 conn(0x7fe7f00b6020 legacy=0x7fe7f006fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:26.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.590+0000 7fe7ed59a640 1 -- 172.21.15.132:0/3928767910 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7f00b45d0 con 0x7fe7f0070eb0 2024-04-16T15:52:26.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.590+0000 7fe7ed59a640 1 -- 172.21.15.132:0/3928767910 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2803668828 0 0) 0x7fe7e0001840 con 0x7fe7f0070eb0 2024-04-16T15:52:26.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.590+0000 7fe7ed59a640 1 -- 172.21.15.132:0/3928767910 >> v1:172.21.15.132:6789/0 conn(0x7fe7f0070eb0 legacy=0x7fe7f006ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:26.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.590+0000 7fe7ed59a640 1 --2- 172.21.15.132:0/3928767910 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7dc003b90 0x7fe7dc003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:26.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.590+0000 7fe7ed59a640 1 --2- 172.21.15.132:0/3928767910 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7dc004800 0x7fe7dc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:26.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.590+0000 7fe7ed59a640 1 --2- 172.21.15.132:0/3928767910 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7dc005210 0x7fe7dc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:26.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.590+0000 7fe7ed59a640 1 -- 172.21.15.132:0/3928767910 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe7f00b64e0 con 0x7fe7dc005210 2024-04-16T15:52:26.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.590+0000 7fe7ed59a640 1 -- 172.21.15.132:0/3928767910 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe7dc00c140 con 0x7fe7dc003b90 2024-04-16T15:52:26.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.590+0000 7fe7ed59a640 1 -- 172.21.15.132:0/3928767910 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe7dc00c340 con 0x7fe7dc004800 2024-04-16T15:52:26.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.590+0000 7fe7eed9d640 1 --2- 172.21.15.132:0/3928767910 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7dc005210 0x7fe7dc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:26.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.590+0000 7fe7ee59c640 1 --2- 172.21.15.132:0/3928767910 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7dc003b90 0x7fe7dc003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:26.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.590+0000 7fe7edd9b640 1 --2- 172.21.15.132:0/3928767910 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7dc004800 0x7fe7dc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:26.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.590+0000 7fe7eed9d640 1 -- 172.21.15.132:0/3928767910 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7dc004800 msgr2=0x7fe7dc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:26.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.590+0000 7fe7eed9d640 1 --2- 172.21.15.132:0/3928767910 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7dc004800 0x7fe7dc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:26.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.590+0000 7fe7eed9d640 1 -- 172.21.15.132:0/3928767910 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7dc003b90 msgr2=0x7fe7dc003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:26.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.590+0000 7fe7eed9d640 1 --2- 172.21.15.132:0/3928767910 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7dc003b90 0x7fe7dc003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:26.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.590+0000 7fe7eed9d640 1 -- 172.21.15.132:0/3928767910 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7dc003520 con 0x7fe7dc005210 2024-04-16T15:52:26.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.591+0000 7fe7eed9d640 1 -- 172.21.15.132:0/3928767910 reap_dead start 2024-04-16T15:52:26.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.591+0000 7fe7eed9d640 1 --2- 172.21.15.132:0/3928767910 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7dc005210 0x7fe7dc00b9c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe7e000c320 tx=0x7fe7dc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cd284252e79d2f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:26.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.591+0000 7fe7ed59a640 1 -- 172.21.15.132:0/3928767910 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e0007d90 con 0x7fe7dc005210 2024-04-16T15:52:26.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.591+0000 7fe7ed59a640 1 -- 172.21.15.132:0/3928767910 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7e0030070 con 0x7fe7dc005210 2024-04-16T15:52:26.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.591+0000 7fe7ed59a640 1 -- 172.21.15.132:0/3928767910 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e002cdc0 con 0x7fe7dc005210 2024-04-16T15:52:26.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.592+0000 7fe7f493d640 1 -- 172.21.15.132:0/3928767910 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7dc005210 msgr2=0x7fe7dc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:26.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.592+0000 7fe7f493d640 1 --2- 172.21.15.132:0/3928767910 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7dc005210 0x7fe7dc00b9c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe7e000c320 tx=0x7fe7dc005830 comp rx=0 tx=0).stop 2024-04-16T15:52:26.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.592+0000 7fe7f493d640 1 -- 172.21.15.132:0/3928767910 shutdown_connections 2024-04-16T15:52:26.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.592+0000 7fe7f493d640 1 --2- 172.21.15.132:0/3928767910 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7dc005210 0x7fe7dc00b9c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:26.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.592+0000 7fe7f493d640 1 -- 172.21.15.132:0/3928767910 >> 172.21.15.132:0/3928767910 conn(0x7fe7f009aa30 msgr2=0x7fe7f00b69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:26.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.592+0000 7fe7f493d640 1 -- 172.21.15.132:0/3928767910 shutdown_connections 2024-04-16T15:52:26.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.592+0000 7fe7f493d640 1 -- 172.21.15.132:0/3928767910 wait complete. 2024-04-16T15:52:26.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.593+0000 7fe7f493d640 1 Processor -- start 2024-04-16T15:52:26.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.593+0000 7fe7f493d640 1 -- start start 2024-04-16T15:52:26.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.594+0000 7fe7f493d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7dc005210 0x7fe7f01f5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:26.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.594+0000 7fe7f493d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7f01f7d40 0x7fe7f014beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:26.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.594+0000 7fe7f493d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7f00b21d0 0x7fe7f00b2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:26.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.594+0000 7fe7f493d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe7f00ae480 con 0x7fe7dc005210 2024-04-16T15:52:26.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.594+0000 7fe7f493d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe7f00b0c60 con 0x7fe7f00b21d0 2024-04-16T15:52:26.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.594+0000 7fe7f493d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe7f00ae600 con 0x7fe7f01f7d40 2024-04-16T15:52:26.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.594+0000 7fe7ee59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7dc005210 0x7fe7f01f5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:26.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.594+0000 7fe7ee59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7dc005210 0x7fe7f01f5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35532/0 (socket says 172.21.15.132:35532) 2024-04-16T15:52:26.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.594+0000 7fe7ee59c640 1 -- 172.21.15.132:0/3049887913 learned_addr learned my addr 172.21.15.132:0/3049887913 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:26.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.594+0000 7fe7ee59c640 1 -- 172.21.15.132:0/3049887913 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7f01f7d40 msgr2=0x7fe7f014beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:26.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.594+0000 7fe7ee59c640 1 --2- 172.21.15.132:0/3049887913 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7f01f7d40 0x7fe7f014beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:26.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.594+0000 7fe7ee59c640 1 -- 172.21.15.132:0/3049887913 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7f00b21d0 msgr2=0x7fe7f00b2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:26.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.594+0000 7fe7ee59c640 1 --2- 172.21.15.132:0/3049887913 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7f00b21d0 0x7fe7f00b2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:26.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.594+0000 7fe7ee59c640 1 -- 172.21.15.132:0/3049887913 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7f01f81c0 con 0x7fe7dc005210 2024-04-16T15:52:26.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.594+0000 7fe7ee59c640 1 --2- 172.21.15.132:0/3049887913 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7dc005210 0x7fe7f01f5210 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe7e8011e30 tx=0x7fe7e800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:26.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.595+0000 7fe7e6ffd640 1 -- 172.21.15.132:0/3049887913 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e8015630 con 0x7fe7dc005210 2024-04-16T15:52:26.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.595+0000 7fe7e6ffd640 1 -- 172.21.15.132:0/3049887913 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7e80157d0 con 0x7fe7dc005210 2024-04-16T15:52:26.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.595+0000 7fe7f493d640 1 -- 172.21.15.132:0/3049887913 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7f01f8470 con 0x7fe7dc005210 2024-04-16T15:52:26.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.595+0000 7fe7e6ffd640 1 -- 172.21.15.132:0/3049887913 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e8015bc0 con 0x7fe7dc005210 2024-04-16T15:52:26.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.595+0000 7fe7f493d640 1 -- 172.21.15.132:0/3049887913 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7f01f8a30 con 0x7fe7dc005210 2024-04-16T15:52:26.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.596+0000 7fe7f493d640 1 -- 172.21.15.132:0/3049887913 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7f0070730 con 0x7fe7dc005210 2024-04-16T15:52:26.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.596+0000 7fe7e6ffd640 1 -- 172.21.15.132:0/3049887913 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe7e801d400 con 0x7fe7dc005210 2024-04-16T15:52:26.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.596+0000 7fe7e6ffd640 1 --2- 172.21.15.132:0/3049887913 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fe7d006c8f0 0x7fe7d006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:26.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.596+0000 7fe7e6ffd640 1 -- 172.21.15.132:0/3049887913 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe7e808ccb0 con 0x7fe7dc005210 2024-04-16T15:52:26.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.596+0000 7fe7edd9b640 1 --2- 172.21.15.132:0/3049887913 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fe7d006c8f0 0x7fe7d006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:26.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.597+0000 7fe7edd9b640 1 --2- 172.21.15.132:0/3049887913 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fe7d006c8f0 0x7fe7d006edb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0067dd0 tx=0x7fe7d8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:26.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.601+0000 7fe7e6ffd640 1 -- 172.21.15.132:0/3049887913 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe7f0070730 con 0x7fe7dc005210 2024-04-16T15:52:26.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.774+0000 7fe7f493d640 1 -- 172.21.15.132:0/3049887913 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe7f0075510 con 0x7fe7dc005210 2024-04-16T15:52:26.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.775+0000 7fe7e6ffd640 1 -- 172.21.15.132:0/3049887913 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7fe7e8019030 con 0x7fe7dc005210 2024-04-16T15:52:26.774 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2024-04-16T15:52:26.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.776+0000 7fe7f493d640 1 -- 172.21.15.132:0/3049887913 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fe7d006c8f0 msgr2=0x7fe7d006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:26.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.776+0000 7fe7f493d640 1 --2- 172.21.15.132:0/3049887913 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fe7d006c8f0 0x7fe7d006edb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0067dd0 tx=0x7fe7d8009040 comp rx=0 tx=0).stop 2024-04-16T15:52:26.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.776+0000 7fe7f493d640 1 -- 172.21.15.132:0/3049887913 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7dc005210 msgr2=0x7fe7f01f5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:26.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.776+0000 7fe7f493d640 1 --2- 172.21.15.132:0/3049887913 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7dc005210 0x7fe7f01f5210 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe7e8011e30 tx=0x7fe7e800f580 comp rx=0 tx=0).stop 2024-04-16T15:52:26.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.776+0000 7fe7f493d640 1 -- 172.21.15.132:0/3049887913 shutdown_connections 2024-04-16T15:52:26.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.776+0000 7fe7f493d640 1 --2- 172.21.15.132:0/3049887913 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fe7d006c8f0 0x7fe7d006edb0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:26.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.776+0000 7fe7f493d640 1 --2- 172.21.15.132:0/3049887913 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7f00b21d0 0x7fe7f00b2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:26.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.776+0000 7fe7f493d640 1 --2- 172.21.15.132:0/3049887913 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7f01f7d40 0x7fe7f014beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:26.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.776+0000 7fe7f493d640 1 --2- 172.21.15.132:0/3049887913 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7dc005210 0x7fe7f01f5210 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:26.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.776+0000 7fe7f493d640 1 -- 172.21.15.132:0/3049887913 >> 172.21.15.132:0/3049887913 conn(0x7fe7f009aa30 msgr2=0x7fe7f01598b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:26.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.776+0000 7fe7f493d640 1 -- 172.21.15.132:0/3049887913 shutdown_connections 2024-04-16T15:52:26.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.777+0000 7fe7f493d640 1 -- 172.21.15.132:0/3049887913 wait complete. 2024-04-16T15:52:26.787 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T15:52:26.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.893+0000 7f937b063640 1 Processor -- start 2024-04-16T15:52:26.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.893+0000 7f937b063640 1 -- start start 2024-04-16T15:52:26.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.894+0000 7f937b063640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f937415eda0 0x7f93740d0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:26.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.894+0000 7f937b063640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f937406d7f0 0x7f937415f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:26.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.894+0000 7f937b063640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f937406dc30 0x7f937415f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:26.904 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.894+0000 7f937b063640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f93740d0ec0 con 0x7f937406dc30 2024-04-16T15:52:26.904 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.894+0000 7f937b063640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f93740d11a0 con 0x7f937415eda0 2024-04-16T15:52:26.904 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.894+0000 7f937b063640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f93740d1480 con 0x7f937406d7f0 2024-04-16T15:52:26.904 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.894+0000 7f9379600640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f937406dc30 0x7f937415f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:26.904 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.894+0000 7f9379600640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f937406dc30 0x7f937415f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35544/0 (socket says 172.21.15.132:35544) 2024-04-16T15:52:26.904 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.894+0000 7f9379600640 1 -- 172.21.15.132:0/790554308 learned_addr learned my addr 172.21.15.132:0/790554308 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:26.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.895+0000 7f9378dff640 1 --2- 172.21.15.132:0/790554308 >> v2:172.21.15.179:3300/0 conn(0x7f937415eda0 0x7f93740d0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:26.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.895+0000 7f9379600640 1 -- 172.21.15.132:0/790554308 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f937406d7f0 msgr2=0x7f937415f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:26.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.895+0000 7f9373fff640 1 --2- 172.21.15.132:0/790554308 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f937406d7f0 0x7f937415f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:26.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.895+0000 7f9379600640 1 --2- 172.21.15.132:0/790554308 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f937406d7f0 0x7f937415f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:26.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.895+0000 7f9379600640 1 -- 172.21.15.132:0/790554308 >> v2:172.21.15.179:3300/0 conn(0x7f937415eda0 msgr2=0x7f93740d0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:26.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.895+0000 7f9379600640 1 --2- 172.21.15.132:0/790554308 >> v2:172.21.15.179:3300/0 conn(0x7f937415eda0 0x7f93740d0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:26.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.895+0000 7f9379600640 1 -- 172.21.15.132:0/790554308 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93740d1760 con 0x7f937406dc30 2024-04-16T15:52:26.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.895+0000 7f9378dff640 1 --2- 172.21.15.132:0/790554308 >> v2:172.21.15.179:3300/0 conn(0x7f937415eda0 0x7f93740d0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:52:26.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.895+0000 7f9379600640 1 --2- 172.21.15.132:0/790554308 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f937406dc30 0x7f937415f6d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f93740d3360 tx=0x7f936c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17f3cef72f62d444 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:26.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.896+0000 7f93737fe640 1 -- 172.21.15.132:0/790554308 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f936c02ca70 con 0x7f937406dc30 2024-04-16T15:52:26.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.896+0000 7f93737fe640 1 -- 172.21.15.132:0/790554308 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f936c02cc10 con 0x7f937406dc30 2024-04-16T15:52:26.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.896+0000 7f93737fe640 1 -- 172.21.15.132:0/790554308 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f936c0343f0 con 0x7f937406dc30 2024-04-16T15:52:26.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.896+0000 7f937b063640 1 -- 172.21.15.132:0/790554308 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f937406dc30 msgr2=0x7f937415f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:26.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.896+0000 7f937b063640 1 --2- 172.21.15.132:0/790554308 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f937406dc30 0x7f937415f6d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f93740d3360 tx=0x7f936c02bed0 comp rx=0 tx=0).stop 2024-04-16T15:52:26.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.896+0000 7f937b063640 1 -- 172.21.15.132:0/790554308 shutdown_connections 2024-04-16T15:52:26.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.896+0000 7f937b063640 1 --2- 172.21.15.132:0/790554308 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f937406dc30 0x7f937415f6d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:26.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.896+0000 7f937b063640 1 --2- 172.21.15.132:0/790554308 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f937406d7f0 0x7f937415f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:26.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.896+0000 7f937b063640 1 --2- 172.21.15.132:0/790554308 >> v2:172.21.15.179:3300/0 conn(0x7f937415eda0 0x7f93740d0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:26.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.896+0000 7f937b063640 1 -- 172.21.15.132:0/790554308 >> 172.21.15.132:0/790554308 conn(0x7f93740d26b0 msgr2=0x7f93740d2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:26.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.896+0000 7f937b063640 1 -- 172.21.15.132:0/790554308 shutdown_connections 2024-04-16T15:52:26.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.896+0000 7f937b063640 1 -- 172.21.15.132:0/790554308 wait complete. 2024-04-16T15:52:26.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.897+0000 7f937b063640 1 Processor -- start 2024-04-16T15:52:26.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.898+0000 7f937b063640 1 -- start start 2024-04-16T15:52:26.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.898+0000 7f937b063640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f937406d7f0 0x7f9374157da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:26.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.898+0000 7f937b063640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f937406dc30 0x7f937415cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:26.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.898+0000 7f937b063640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f937415e040 0x7f93740c7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:26.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.898+0000 7f937b063640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f93741628e0 con 0x7f937406d7f0 2024-04-16T15:52:26.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.898+0000 7f937b063640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9374162760 con 0x7f937415e040 2024-04-16T15:52:26.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.898+0000 7f937b063640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9374162a60 con 0x7f937406dc30 2024-04-16T15:52:26.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.898+0000 7f9378dff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f937406d7f0 0x7f9374157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:26.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.899+0000 7f9378dff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f937406d7f0 0x7f9374157da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35560/0 (socket says 172.21.15.132:35560) 2024-04-16T15:52:26.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.899+0000 7f9378dff640 1 -- 172.21.15.132:0/686710048 learned_addr learned my addr 172.21.15.132:0/686710048 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:26.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.899+0000 7f9379600640 1 --2- 172.21.15.132:0/686710048 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f937415e040 0x7f93740c7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:26.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.899+0000 7f9373fff640 1 --2- 172.21.15.132:0/686710048 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f937406dc30 0x7f937415cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:26.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.899+0000 7f9378dff640 1 -- 172.21.15.132:0/686710048 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f937406dc30 msgr2=0x7f937415cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:26.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.899+0000 7f9378dff640 1 --2- 172.21.15.132:0/686710048 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f937406dc30 0x7f937415cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:26.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.899+0000 7f9378dff640 1 -- 172.21.15.132:0/686710048 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f937415e040 msgr2=0x7f93740c7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:26.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.899+0000 7f9378dff640 1 --2- 172.21.15.132:0/686710048 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f937415e040 0x7f93740c7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:26.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.899+0000 7f9378dff640 1 -- 172.21.15.132:0/686710048 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93740b13f0 con 0x7f937406d7f0 2024-04-16T15:52:26.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.899+0000 7f9379600640 1 --2- 172.21.15.132:0/686710048 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f937415e040 0x7f93740c7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:26.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.899+0000 7f9378dff640 1 --2- 172.21.15.132:0/686710048 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f937406d7f0 0x7f9374157da0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f936800c820 tx=0x7f936800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:26.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.899+0000 7f93717fa640 1 -- 172.21.15.132:0/686710048 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9368015070 con 0x7f937406d7f0 2024-04-16T15:52:26.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.899+0000 7f93717fa640 1 -- 172.21.15.132:0/686710048 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9368007a30 con 0x7f937406d7f0 2024-04-16T15:52:26.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.899+0000 7f937b063640 1 -- 172.21.15.132:0/686710048 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93740b16d0 con 0x7f937406d7f0 2024-04-16T15:52:26.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.899+0000 7f93717fa640 1 -- 172.21.15.132:0/686710048 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9368007de0 con 0x7f937406d7f0 2024-04-16T15:52:26.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.899+0000 7f937b063640 1 -- 172.21.15.132:0/686710048 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93740af730 con 0x7f937406d7f0 2024-04-16T15:52:26.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.900+0000 7f937b063640 1 -- 172.21.15.132:0/686710048 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9374075510 con 0x7f937406d7f0 2024-04-16T15:52:26.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.900+0000 7f93717fa640 1 -- 172.21.15.132:0/686710048 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9368018070 con 0x7f937406d7f0 2024-04-16T15:52:26.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.901+0000 7f93717fa640 1 --2- 172.21.15.132:0/686710048 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f935806c8f0 0x7f935806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:26.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.901+0000 7f93717fa640 1 -- 172.21.15.132:0/686710048 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f936808b9b0 con 0x7f937406d7f0 2024-04-16T15:52:26.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.901+0000 7f9373fff640 1 --2- 172.21.15.132:0/686710048 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f935806c8f0 0x7f935806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:26.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.901+0000 7f9373fff640 1 --2- 172.21.15.132:0/686710048 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f935806c8f0 0x7f935806edb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f93740b0b80 tx=0x7f9360008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:26.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:26.905+0000 7f93717fa640 1 -- 172.21.15.132:0/686710048 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9368059e70 con 0x7f937406d7f0 2024-04-16T15:52:27.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.082+0000 7f937b063640 1 -- 172.21.15.132:0/686710048 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f93740d21d0 con 0x7f937406d7f0 2024-04-16T15:52:27.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.082+0000 7f93717fa640 1 -- 172.21.15.132:0/686710048 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f9368059770 con 0x7f937406d7f0 2024-04-16T15:52:27.082 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2024-04-16T15:52:27.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.084+0000 7f937b063640 1 -- 172.21.15.132:0/686710048 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f935806c8f0 msgr2=0x7f935806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:27.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.084+0000 7f937b063640 1 --2- 172.21.15.132:0/686710048 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f935806c8f0 0x7f935806edb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f93740b0b80 tx=0x7f9360008040 comp rx=0 tx=0).stop 2024-04-16T15:52:27.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.084+0000 7f937b063640 1 -- 172.21.15.132:0/686710048 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f937406d7f0 msgr2=0x7f9374157da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:27.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.084+0000 7f937b063640 1 --2- 172.21.15.132:0/686710048 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f937406d7f0 0x7f9374157da0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f936800c820 tx=0x7f936800cce0 comp rx=0 tx=0).stop 2024-04-16T15:52:27.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.084+0000 7f937b063640 1 -- 172.21.15.132:0/686710048 shutdown_connections 2024-04-16T15:52:27.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.084+0000 7f937b063640 1 --2- 172.21.15.132:0/686710048 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f935806c8f0 0x7f935806edb0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:27.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.084+0000 7f937b063640 1 --2- 172.21.15.132:0/686710048 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f937415e040 0x7f93740c7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:27.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.084+0000 7f937b063640 1 --2- 172.21.15.132:0/686710048 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f937406dc30 0x7f937415cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:27.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.084+0000 7f937b063640 1 --2- 172.21.15.132:0/686710048 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f937406d7f0 0x7f9374157da0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:27.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.084+0000 7f937b063640 1 -- 172.21.15.132:0/686710048 >> 172.21.15.132:0/686710048 conn(0x7f93740d26b0 msgr2=0x7f93740ccce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:27.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.084+0000 7f937b063640 1 -- 172.21.15.132:0/686710048 shutdown_connections 2024-04-16T15:52:27.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.084+0000 7f937b063640 1 -- 172.21.15.132:0/686710048 wait complete. 2024-04-16T15:52:27.095 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T15:52:27.197 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.198+0000 7ff5bd060640 1 Processor -- start 2024-04-16T15:52:27.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.198+0000 7ff5bd060640 1 -- start start 2024-04-16T15:52:27.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.199+0000 7ff5bd060640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5b815eaf0 0x7ff5b80ba300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:27.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.199+0000 7ff5bd060640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff5b815eed0 0x7ff5b80b63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:27.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.199+0000 7ff5bd060640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5b8162cc0 con 0x7ff5b81627e0 2024-04-16T15:52:27.202 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.199+0000 7ff5bd060640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7ff5b80d2af0 con 0x7ff5b815eed0 2024-04-16T15:52:27.202 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.199+0000 7ff5bd060640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff5b8162fa0 con 0x7ff5b815eaf0 2024-04-16T15:52:27.202 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.199+0000 7ff5b759e640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7ff5b81627e0 0x7ff5b8067760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47350/0 (socket says 172.21.15.132:47350) 2024-04-16T15:52:27.202 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.199+0000 7ff5b759e640 1 -- 172.21.15.132:0/1604793812 learned_addr learned my addr 172.21.15.132:0/1604793812 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:27.202 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.199+0000 7ff5b5d9b640 1 -- 172.21.15.132:0/1604793812 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1131027963 0 0) 0x7ff5b8162cc0 con 0x7ff5b81627e0 2024-04-16T15:52:27.202 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.199+0000 7ff5b659c640 1 --2- 172.21.15.132:0/1604793812 >> v2:172.21.15.179:3300/0 conn(0x7ff5b815eed0 0x7ff5b80b63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:27.202 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.199+0000 7ff5b5d9b640 1 -- 172.21.15.132:0/1604793812 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5a0003520 con 0x7ff5b81627e0 2024-04-16T15:52:27.202 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.199+0000 7ff5b6d9d640 1 --2- 172.21.15.132:0/1604793812 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5b815eaf0 0x7ff5b80ba300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:27.202 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.200+0000 7ff5b5d9b640 1 -- 172.21.15.132:0/1604793812 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1367734185 0 0) 0x7ff5a0003520 con 0x7ff5b81627e0 2024-04-16T15:52:27.202 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.200+0000 7ff5b5d9b640 1 -- 172.21.15.132:0/1604793812 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5b815eaf0 msgr2=0x7ff5b80ba300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:27.202 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.200+0000 7ff5b5d9b640 1 --2- 172.21.15.132:0/1604793812 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5b815eaf0 0x7ff5b80ba300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:27.202 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.200+0000 7ff5b5d9b640 1 -- 172.21.15.132:0/1604793812 >> v2:172.21.15.179:3300/0 conn(0x7ff5b815eed0 msgr2=0x7ff5b80b63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:27.202 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.200+0000 7ff5b5d9b640 1 --2- 172.21.15.132:0/1604793812 >> v2:172.21.15.179:3300/0 conn(0x7ff5b815eed0 0x7ff5b80b63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:27.203 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.200+0000 7ff5b5d9b640 1 -- 172.21.15.132:0/1604793812 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5b8163280 con 0x7ff5b81627e0 2024-04-16T15:52:27.203 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.200+0000 7ff5b5d9b640 1 -- 172.21.15.132:0/1604793812 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2803668828 0 0) 0x7ff5b0001670 con 0x7ff5b81627e0 2024-04-16T15:52:27.203 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.200+0000 7ff5b5d9b640 1 -- 172.21.15.132:0/1604793812 >> v1:172.21.15.132:6789/0 conn(0x7ff5b81627e0 legacy=0x7ff5b8067760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:27.203 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.200+0000 7ff5b5d9b640 1 --2- 172.21.15.132:0/1604793812 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5a00039b0 0x7ff5a0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:27.203 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.200+0000 7ff5b5d9b640 1 --2- 172.21.15.132:0/1604793812 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5a0004800 0x7ff5a0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:27.203 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.200+0000 7ff5b5d9b640 1 --2- 172.21.15.132:0/1604793812 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5b815eaf0 0x7ff5a00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:27.203 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.200+0000 7ff5b5d9b640 1 -- 172.21.15.132:0/1604793812 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b80d2af0 con 0x7ff5a0004800 2024-04-16T15:52:27.203 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.200+0000 7ff5b5d9b640 1 -- 172.21.15.132:0/1604793812 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b8162fa0 con 0x7ff5a00039b0 2024-04-16T15:52:27.203 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.200+0000 7ff5b5d9b640 1 -- 172.21.15.132:0/1604793812 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff5a000b9c0 con 0x7ff5b815eaf0 2024-04-16T15:52:27.203 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.200+0000 7ff5b659c640 1 --2- 172.21.15.132:0/1604793812 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5a0004800 0x7ff5a0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:27.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.200+0000 7ff5b6d9d640 1 --2- 172.21.15.132:0/1604793812 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5a00039b0 0x7ff5a0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:27.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.200+0000 7ff5b759e640 1 --2- 172.21.15.132:0/1604793812 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5b815eaf0 0x7ff5a00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:27.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.200+0000 7ff5b659c640 1 -- 172.21.15.132:0/1604793812 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5b815eaf0 msgr2=0x7ff5a00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:27.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.200+0000 7ff5b659c640 1 --2- 172.21.15.132:0/1604793812 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5b815eaf0 0x7ff5a00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:27.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.200+0000 7ff5b659c640 1 -- 172.21.15.132:0/1604793812 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5a00039b0 msgr2=0x7ff5a0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:27.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.200+0000 7ff5b659c640 1 --2- 172.21.15.132:0/1604793812 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5a00039b0 0x7ff5a0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:27.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.200+0000 7ff5b659c640 1 -- 172.21.15.132:0/1604793812 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5a0003520 con 0x7ff5a0004800 2024-04-16T15:52:27.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.200+0000 7ff5b759e640 1 --2- 172.21.15.132:0/1604793812 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5b815eaf0 0x7ff5a00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:27.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.201+0000 7ff5b659c640 1 --2- 172.21.15.132:0/1604793812 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5a0004800 0x7ff5a0004c80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac009a90 tx=0x7ff5a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2118f2c55571a131 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:27.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.201+0000 7ff5b5d9b640 1 -- 172.21.15.132:0/1604793812 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac039070 con 0x7ff5a0004800 2024-04-16T15:52:27.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.201+0000 7ff5b5d9b640 1 -- 172.21.15.132:0/1604793812 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5ac02c6b0 con 0x7ff5a0004800 2024-04-16T15:52:27.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.201+0000 7ff5b5d9b640 1 -- 172.21.15.132:0/1604793812 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac009690 con 0x7ff5a0004800 2024-04-16T15:52:27.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.201+0000 7ff5bd060640 1 -- 172.21.15.132:0/1604793812 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5a0004800 msgr2=0x7ff5a0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:27.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.201+0000 7ff5bd060640 1 --2- 172.21.15.132:0/1604793812 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5a0004800 0x7ff5a0004c80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac009a90 tx=0x7ff5a0005830 comp rx=0 tx=0).stop 2024-04-16T15:52:27.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.201+0000 7ff5b759e640 1 -- 172.21.15.132:0/1604793812 reap_dead start 2024-04-16T15:52:27.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.201+0000 7ff5bd060640 1 -- 172.21.15.132:0/1604793812 shutdown_connections 2024-04-16T15:52:27.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.201+0000 7ff5bd060640 1 -- 172.21.15.132:0/1604793812 >> 172.21.15.132:0/1604793812 conn(0x7ff5b80d13f0 msgr2=0x7ff5b80d1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:27.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.201+0000 7ff5bd060640 1 -- 172.21.15.132:0/1604793812 shutdown_connections 2024-04-16T15:52:27.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.202+0000 7ff5bd060640 1 -- 172.21.15.132:0/1604793812 wait complete. 2024-04-16T15:52:27.207 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.203+0000 7ff5bd060640 1 Processor -- start 2024-04-16T15:52:27.207 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.203+0000 7ff5bd060640 1 -- start start 2024-04-16T15:52:27.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.204+0000 7ff5bd060640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5a0004800 0x7ff5b80c8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:27.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.204+0000 7ff5bd060640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5b80ce600 0x7ff5b80ca660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:27.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.204+0000 7ff5bd060640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5b8151940 0x7ff5b8151dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:27.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.204+0000 7ff5bd060640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b80d4110 con 0x7ff5b80ce600 2024-04-16T15:52:27.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.204+0000 7ff5bd060640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b80d3f90 con 0x7ff5a0004800 2024-04-16T15:52:27.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.204+0000 7ff5bd060640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff5b80d4290 con 0x7ff5b8151940 2024-04-16T15:52:27.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.204+0000 7ff5b659c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5b80ce600 0x7ff5b80ca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:27.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.204+0000 7ff5b659c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5b80ce600 0x7ff5b80ca660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35576/0 (socket says 172.21.15.132:35576) 2024-04-16T15:52:27.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.204+0000 7ff5b659c640 1 -- 172.21.15.132:0/2856792291 learned_addr learned my addr 172.21.15.132:0/2856792291 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:27.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.204+0000 7ff5b6d9d640 1 --2- 172.21.15.132:0/2856792291 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5a0004800 0x7ff5b80c8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:27.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.204+0000 7ff5b759e640 1 --2- 172.21.15.132:0/2856792291 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5b8151940 0x7ff5b8151dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:27.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.204+0000 7ff5b659c640 1 -- 172.21.15.132:0/2856792291 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5b8151940 msgr2=0x7ff5b8151dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:27.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.204+0000 7ff5b659c640 1 --2- 172.21.15.132:0/2856792291 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5b8151940 0x7ff5b8151dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:27.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.204+0000 7ff5b659c640 1 -- 172.21.15.132:0/2856792291 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5a0004800 msgr2=0x7ff5b80c8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:27.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.204+0000 7ff5b659c640 1 --2- 172.21.15.132:0/2856792291 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5a0004800 0x7ff5b80c8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:27.209 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.204+0000 7ff5b659c640 1 -- 172.21.15.132:0/2856792291 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5b81f4c70 con 0x7ff5b80ce600 2024-04-16T15:52:27.209 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.204+0000 7ff5b759e640 1 --2- 172.21.15.132:0/2856792291 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5b8151940 0x7ff5b8151dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:27.209 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.204+0000 7ff5b6d9d640 1 --2- 172.21.15.132:0/2856792291 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5a0004800 0x7ff5b80c8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:27.209 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.204+0000 7ff5b659c640 1 --2- 172.21.15.132:0/2856792291 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5b80ce600 0x7ff5b80ca660 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac000c00 tx=0x7ff5ac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:27.209 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.204+0000 7ff59f7fe640 1 -- 172.21.15.132:0/2856792291 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac039050 con 0x7ff5b80ce600 2024-04-16T15:52:27.209 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.204+0000 7ff59f7fe640 1 -- 172.21.15.132:0/2856792291 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5ac045070 con 0x7ff5b80ce600 2024-04-16T15:52:27.209 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.204+0000 7ff5bd060640 1 -- 172.21.15.132:0/2856792291 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5b80c97b0 con 0x7ff5b80ce600 2024-04-16T15:52:27.209 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.205+0000 7ff59f7fe640 1 -- 172.21.15.132:0/2856792291 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac0044e0 con 0x7ff5b80ce600 2024-04-16T15:52:27.209 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.205+0000 7ff5bd060640 1 -- 172.21.15.132:0/2856792291 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5b80cbc90 con 0x7ff5b80ce600 2024-04-16T15:52:27.209 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.205+0000 7ff5bd060640 1 -- 172.21.15.132:0/2856792291 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5b8075510 con 0x7ff5b80ce600 2024-04-16T15:52:27.209 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.206+0000 7ff59f7fe640 1 -- 172.21.15.132:0/2856792291 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff5ac003a50 con 0x7ff5b80ce600 2024-04-16T15:52:27.209 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.206+0000 7ff59f7fe640 1 --2- 172.21.15.132:0/2856792291 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7ff5a406c8f0 0x7ff5a406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:27.209 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.207+0000 7ff59f7fe640 1 -- 172.21.15.132:0/2856792291 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff5ac0ad6e0 con 0x7ff5b80ce600 2024-04-16T15:52:27.209 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.207+0000 7ff5b6d9d640 1 --2- 172.21.15.132:0/2856792291 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7ff5a406c8f0 0x7ff5a406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:27.210 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.207+0000 7ff5b6d9d640 1 --2- 172.21.15.132:0/2856792291 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7ff5a406c8f0 0x7ff5a406edb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff5a8013370 tx=0x7ff5a800b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:27.210 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.211+0000 7ff59f7fe640 1 -- 172.21.15.132:0/2856792291 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff5ac04e020 con 0x7ff5b80ce600 2024-04-16T15:52:27.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.424+0000 7ff5bd060640 1 -- 172.21.15.132:0/2856792291 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff5b80d2610 con 0x7ff5b80ce600 2024-04-16T15:52:27.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.424+0000 7ff59f7fe640 1 -- 172.21.15.132:0/2856792291 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5175 (secure 0 0 0) 0x7ff5ac07bba0 con 0x7ff5b80ce600 2024-04-16T15:52:27.424 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:52:27.424 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/659108212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":659108212},{"type":"v1","addr":"172.21.15.132:6835","nonce":659108212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/811468074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":811468074},{"type":"v1","addr":"172.21.15.132:6837","nonce":811468074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/493922944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":493922944},{"type":"v1","addr":"172.21.15.179:6834","nonce":493922944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T15:52:15.286161+0000","modified":"2024-04-16T15:52:17.305756+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/202618568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":202618568},{"type":"v1","addr":"172.21.15.179:6835","nonce":202618568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1}]} 2024-04-16T15:52:27.425 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 6 2024-04-16T15:52:27.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.426+0000 7ff5bd060640 1 -- 172.21.15.132:0/2856792291 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7ff5a406c8f0 msgr2=0x7ff5a406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:27.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.426+0000 7ff5bd060640 1 --2- 172.21.15.132:0/2856792291 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7ff5a406c8f0 0x7ff5a406edb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff5a8013370 tx=0x7ff5a800b040 comp rx=0 tx=0).stop 2024-04-16T15:52:27.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.427+0000 7ff5bd060640 1 -- 172.21.15.132:0/2856792291 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5b80ce600 msgr2=0x7ff5b80ca660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:27.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.427+0000 7ff5bd060640 1 --2- 172.21.15.132:0/2856792291 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5b80ce600 0x7ff5b80ca660 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac000c00 tx=0x7ff5ac004730 comp rx=0 tx=0).stop 2024-04-16T15:52:27.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.427+0000 7ff5bd060640 1 -- 172.21.15.132:0/2856792291 shutdown_connections 2024-04-16T15:52:27.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.427+0000 7ff5bd060640 1 --2- 172.21.15.132:0/2856792291 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7ff5a406c8f0 0x7ff5a406edb0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:27.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.427+0000 7ff5bd060640 1 --2- 172.21.15.132:0/2856792291 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5b8151940 0x7ff5b8151dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:27.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.427+0000 7ff5bd060640 1 --2- 172.21.15.132:0/2856792291 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5b80ce600 0x7ff5b80ca660 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:27.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.427+0000 7ff5bd060640 1 --2- 172.21.15.132:0/2856792291 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5a0004800 0x7ff5b80c8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:27.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.427+0000 7ff5bd060640 1 -- 172.21.15.132:0/2856792291 >> 172.21.15.132:0/2856792291 conn(0x7ff5b80d13f0 msgr2=0x7ff5b815de20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:27.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.427+0000 7ff5bd060640 1 -- 172.21.15.132:0/2856792291 shutdown_connections 2024-04-16T15:52:27.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.427+0000 7ff5bd060640 1 -- 172.21.15.132:0/2856792291 wait complete. 2024-04-16T15:52:27.437 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:52:27.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.541+0000 7fa700274640 1 Processor -- start 2024-04-16T15:52:27.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.541+0000 7fa700274640 1 -- start start 2024-04-16T15:52:27.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.542+0000 7fa700274640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa6f813f7f0 0x7fa6f80b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:27.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.542+0000 7fa700274640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6f80b5e90 0x7fa6f80ce570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:27.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.542+0000 7fa700274640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6f8142070 con 0x7fa6f80ceab0 2024-04-16T15:52:27.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.542+0000 7fa700274640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fa6f8142350 con 0x7fa6f813f7f0 2024-04-16T15:52:27.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.542+0000 7fa700274640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fa6f8142630 con 0x7fa6f80b5e90 2024-04-16T15:52:27.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.542+0000 7fa6fe010640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa6f813f7f0 0x7fa6f80b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:27.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.542+0000 7fa6fe811640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fa6f80ceab0 0x7fa6f806ef20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47352/0 (socket says 172.21.15.132:47352) 2024-04-16T15:52:27.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.542+0000 7fa6fe811640 1 -- 172.21.15.132:0/2955529918 learned_addr learned my addr 172.21.15.132:0/2955529918 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:27.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.542+0000 7fa6fd80f640 1 --2- 172.21.15.132:0/2955529918 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6f80b5e90 0x7fa6f80ce570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:27.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.542+0000 7fa6fe010640 1 -- 172.21.15.132:0/2955529918 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6f80b5e90 msgr2=0x7fa6f80ce570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:27.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.542+0000 7fa6fe010640 1 --2- 172.21.15.132:0/2955529918 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6f80b5e90 0x7fa6f80ce570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:27.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.542+0000 7fa6fe010640 1 -- 172.21.15.132:0/2955529918 >> v1:172.21.15.132:6789/0 conn(0x7fa6f80ceab0 legacy=0x7fa6f806ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:27.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.542+0000 7fa6fe010640 1 -- 172.21.15.132:0/2955529918 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6f80cef40 con 0x7fa6f813f7f0 2024-04-16T15:52:27.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.542+0000 7fa6fd00e640 1 -- 172.21.15.132:0/2955529918 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 638637205 0 0) 0x7fa6f8142070 con 0x7fa6f80ceab0 2024-04-16T15:52:27.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.543+0000 7fa6fe010640 1 --2- 172.21.15.132:0/2955529918 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6f813f7f0 0x7fa6f80b5950 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa6f40097a0 tx=0x7fa6f402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=252fc374b0d3c69e server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:27.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.543+0000 7fa6fd00e640 1 -- 172.21.15.132:0/2955529918 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f4035020 con 0x7fa6f813f7f0 2024-04-16T15:52:27.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.543+0000 7fa6fd00e640 1 -- 172.21.15.132:0/2955529918 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6f4031830 con 0x7fa6f813f7f0 2024-04-16T15:52:27.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.543+0000 7fa6fd00e640 1 -- 172.21.15.132:0/2955529918 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f4031c00 con 0x7fa6f813f7f0 2024-04-16T15:52:27.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.543+0000 7fa700274640 1 -- 172.21.15.132:0/2955529918 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6f813f7f0 msgr2=0x7fa6f80b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:27.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.543+0000 7fa700274640 1 --2- 172.21.15.132:0/2955529918 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6f813f7f0 0x7fa6f80b5950 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa6f40097a0 tx=0x7fa6f402b8d0 comp rx=0 tx=0).stop 2024-04-16T15:52:27.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.544+0000 7fa700274640 1 -- 172.21.15.132:0/2955529918 shutdown_connections 2024-04-16T15:52:27.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.544+0000 7fa700274640 1 --2- 172.21.15.132:0/2955529918 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6f80b5e90 0x7fa6f80ce570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:27.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.544+0000 7fa700274640 1 --2- 172.21.15.132:0/2955529918 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6f813f7f0 0x7fa6f80b5950 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:27.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.544+0000 7fa700274640 1 -- 172.21.15.132:0/2955529918 >> 172.21.15.132:0/2955529918 conn(0x7fa6f80b2d50 msgr2=0x7fa6f806ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:27.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.544+0000 7fa700274640 1 -- 172.21.15.132:0/2955529918 shutdown_connections 2024-04-16T15:52:27.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.544+0000 7fa700274640 1 -- 172.21.15.132:0/2955529918 wait complete. 2024-04-16T15:52:27.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.545+0000 7fa700274640 1 Processor -- start 2024-04-16T15:52:27.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.545+0000 7fa700274640 1 -- start start 2024-04-16T15:52:27.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.545+0000 7fa700274640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6f80b5e90 0x7fa6f81563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:27.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.545+0000 7fa700274640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6f80ceab0 0x7fa6f8135830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:27.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.546+0000 7fa700274640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6f813f7f0 0x7fa6f8135d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:27.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.546+0000 7fa700274640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f806f7b0 con 0x7fa6f80b5e90 2024-04-16T15:52:27.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.546+0000 7fa700274640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f806f630 con 0x7fa6f813f7f0 2024-04-16T15:52:27.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.546+0000 7fa700274640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fa6f806f930 con 0x7fa6f80ceab0 2024-04-16T15:52:27.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.546+0000 7fa6fe010640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6f80b5e90 0x7fa6f81563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:27.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.546+0000 7fa6fe010640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6f80b5e90 0x7fa6f81563f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35602/0 (socket says 172.21.15.132:35602) 2024-04-16T15:52:27.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.546+0000 7fa6fe010640 1 -- 172.21.15.132:0/3084517853 learned_addr learned my addr 172.21.15.132:0/3084517853 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:27.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.546+0000 7fa6fd80f640 1 --2- 172.21.15.132:0/3084517853 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6f80ceab0 0x7fa6f8135830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:27.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.546+0000 7fa6fe811640 1 --2- 172.21.15.132:0/3084517853 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6f813f7f0 0x7fa6f8135d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:27.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.546+0000 7fa6fe010640 1 -- 172.21.15.132:0/3084517853 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6f80ceab0 msgr2=0x7fa6f8135830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:27.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.546+0000 7fa6fe010640 1 --2- 172.21.15.132:0/3084517853 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6f80ceab0 0x7fa6f8135830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:27.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.546+0000 7fa6fe010640 1 -- 172.21.15.132:0/3084517853 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6f813f7f0 msgr2=0x7fa6f8135d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:27.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.546+0000 7fa6fe010640 1 --2- 172.21.15.132:0/3084517853 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6f813f7f0 0x7fa6f8135d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:27.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.546+0000 7fa6fe010640 1 -- 172.21.15.132:0/3084517853 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6f8154a00 con 0x7fa6f80b5e90 2024-04-16T15:52:27.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.546+0000 7fa6fe010640 1 --2- 172.21.15.132:0/3084517853 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6f80b5e90 0x7fa6f81563f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4034040 tx=0x7fa6f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:27.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.546+0000 7fa6eeffd640 1 -- 172.21.15.132:0/3084517853 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f4040070 con 0x7fa6f80b5e90 2024-04-16T15:52:27.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.546+0000 7fa6eeffd640 1 -- 172.21.15.132:0/3084517853 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6f40399a0 con 0x7fa6f80b5e90 2024-04-16T15:52:27.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.546+0000 7fa700274640 1 -- 172.21.15.132:0/3084517853 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6f8154ce0 con 0x7fa6f80b5e90 2024-04-16T15:52:27.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.546+0000 7fa6eeffd640 1 -- 172.21.15.132:0/3084517853 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f4035040 con 0x7fa6f80b5e90 2024-04-16T15:52:27.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.546+0000 7fa700274640 1 -- 172.21.15.132:0/3084517853 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6f81552a0 con 0x7fa6f80b5e90 2024-04-16T15:52:27.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.547+0000 7fa700274640 1 -- 172.21.15.132:0/3084517853 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6f8075510 con 0x7fa6f80b5e90 2024-04-16T15:52:27.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.548+0000 7fa6eeffd640 1 -- 172.21.15.132:0/3084517853 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa6f4038020 con 0x7fa6f80b5e90 2024-04-16T15:52:27.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.548+0000 7fa6eeffd640 1 --2- 172.21.15.132:0/3084517853 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fa6dc06c8f0 0x7fa6dc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:27.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.548+0000 7fa6eeffd640 1 -- 172.21.15.132:0/3084517853 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa6f40ad4d0 con 0x7fa6f80b5e90 2024-04-16T15:52:27.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.548+0000 7fa6fd80f640 1 --2- 172.21.15.132:0/3084517853 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fa6dc06c8f0 0x7fa6dc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:27.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.548+0000 7fa6fd80f640 1 --2- 172.21.15.132:0/3084517853 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fa6dc06c8f0 0x7fa6dc06edb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa6f815b880 tx=0x7fa6e8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:27.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.552+0000 7fa6eeffd640 1 -- 172.21.15.132:0/3084517853 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa6f407b910 con 0x7fa6f80b5e90 2024-04-16T15:52:27.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.729+0000 7fa700274640 1 -- 172.21.15.132:0/3084517853 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa6f815c800 con 0x7fa6f80b5e90 2024-04-16T15:52:27.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.730+0000 7fa6eeffd640 1 -- 172.21.15.132:0/3084517853 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7fa6f40abe20 con 0x7fa6f80b5e90 2024-04-16T15:52:27.729 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:52:27.729 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"6bdec5d9-f406-43ad-8584-0503b32f6f0d","created":"2024-04-16T15:51:51.073040+0000","modified":"2024-04-16T15:52:16.950186+0000","last_up_change":"2024-04-16T15:52:02.280496+0000","last_in_change":"2024-04-16T15:51:53.376468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:52:03.284927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:52:13.363758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T15:52:14.246647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d45908b-6e22-4619-b190-897af594b712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6801","nonce":1170594668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6803","nonce":1170594668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6807","nonce":1170594668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6805","nonce":1170594668}]},"public_addr":"172.21.15.132:6801/1170594668","cluster_addr":"172.21.15.132:6803/1170594668","heartbeat_back_addr":"172.21.15.132:6807/1170594668","heartbeat_front_addr":"172.21.15.132:6805/1170594668","state":["exists","up"]},{"osd":1,"uuid":"c88bf082-e51f-4ee6-815a-025f6ce0d67b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6809","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6811","nonce":2494780358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6815","nonce":2494780358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6823","nonce":2494780358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6819","nonce":2494780358}]},"public_addr":"172.21.15.132:6811/2494780358","cluster_addr":"172.21.15.132:6815/2494780358","heartbeat_back_addr":"172.21.15.132:6823/2494780358","heartbeat_front_addr":"172.21.15.132:6819/2494780358","state":["exists","up"]},{"osd":2,"uuid":"e5dbd6b4-4e7b-47e4-ad4e-35b4b81696c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6825","nonce":27655483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6827","nonce":27655483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6831","nonce":27655483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6829","nonce":27655483}]},"public_addr":"172.21.15.132:6825/27655483","cluster_addr":"172.21.15.132:6827/27655483","heartbeat_back_addr":"172.21.15.132:6831/27655483","heartbeat_front_addr":"172.21.15.132:6829/27655483","state":["exists","up"]},{"osd":3,"uuid":"9d75cd67-3b8a-4424-8884-5f3660e1f5f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6810","nonce":3100919191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6814","nonce":3100919191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6821","nonce":3100919191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6818","nonce":3100919191}]},"public_addr":"172.21.15.132:6810/3100919191","cluster_addr":"172.21.15.132:6814/3100919191","heartbeat_back_addr":"172.21.15.132:6821/3100919191","heartbeat_front_addr":"172.21.15.132:6818/3100919191","state":["exists","up"]},{"osd":4,"uuid":"83aea46a-8642-4777-912b-c130e5890da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6825","nonce":123637799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6827","nonce":123637799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6831","nonce":123637799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6829","nonce":123637799}]},"public_addr":"172.21.15.179:6825/123637799","cluster_addr":"172.21.15.179:6827/123637799","heartbeat_back_addr":"172.21.15.179:6831/123637799","heartbeat_front_addr":"172.21.15.179:6829/123637799","state":["exists","up"]},{"osd":5,"uuid":"534117c8-3317-48d6-b436-afd5709f71e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6801","nonce":2224750370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6803","nonce":2224750370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6807","nonce":2224750370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6805","nonce":2224750370}]},"public_addr":"172.21.15.179:6801/2224750370","cluster_addr":"172.21.15.179:6803/2224750370","heartbeat_back_addr":"172.21.15.179:6807/2224750370","heartbeat_front_addr":"172.21.15.179:6805/2224750370","state":["exists","up"]},{"osd":6,"uuid":"0ba363e7-fa9d-42b1-ae09-a6a0f57d41f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6809","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6811","nonce":101498164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6813","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6815","nonce":101498164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6823","nonce":101498164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6819","nonce":101498164}]},"public_addr":"172.21.15.179:6811/101498164","cluster_addr":"172.21.15.179:6815/101498164","heartbeat_back_addr":"172.21.15.179:6823/101498164","heartbeat_front_addr":"172.21.15.179:6819/101498164","state":["exists","up"]},{"osd":7,"uuid":"e6830c77-2f2d-4067-9866-ee7625afc1a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6810","nonce":872148365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6814","nonce":872148365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6822","nonce":872148365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6818","nonce":872148365}]},"public_addr":"172.21.15.179:6810/872148365","cluster_addr":"172.21.15.179:6814/872148365","heartbeat_back_addr":"172.21.15.179:6822/872148365","heartbeat_front_addr":"172.21.15.179:6818/872148365","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.535221+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.563769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.520765+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.526264+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.517058+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.500842+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.534332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.512486+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:52:27.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.732+0000 7fa700274640 1 -- 172.21.15.132:0/3084517853 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fa6dc06c8f0 msgr2=0x7fa6dc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:27.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.732+0000 7fa700274640 1 --2- 172.21.15.132:0/3084517853 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fa6dc06c8f0 0x7fa6dc06edb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa6f815b880 tx=0x7fa6e8008040 comp rx=0 tx=0).stop 2024-04-16T15:52:27.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.732+0000 7fa700274640 1 -- 172.21.15.132:0/3084517853 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6f80b5e90 msgr2=0x7fa6f81563f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:27.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.732+0000 7fa700274640 1 --2- 172.21.15.132:0/3084517853 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6f80b5e90 0x7fa6f81563f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4034040 tx=0x7fa6f40046c0 comp rx=0 tx=0).stop 2024-04-16T15:52:27.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.732+0000 7fa700274640 1 -- 172.21.15.132:0/3084517853 shutdown_connections 2024-04-16T15:52:27.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.732+0000 7fa700274640 1 --2- 172.21.15.132:0/3084517853 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fa6dc06c8f0 0x7fa6dc06edb0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:27.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.732+0000 7fa700274640 1 --2- 172.21.15.132:0/3084517853 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6f813f7f0 0x7fa6f8135d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:27.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.732+0000 7fa700274640 1 --2- 172.21.15.132:0/3084517853 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6f80ceab0 0x7fa6f8135830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:27.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.732+0000 7fa700274640 1 --2- 172.21.15.132:0/3084517853 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6f80b5e90 0x7fa6f81563f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:27.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.732+0000 7fa700274640 1 -- 172.21.15.132:0/3084517853 >> 172.21.15.132:0/3084517853 conn(0x7fa6f80b2d50 msgr2=0x7fa6f815ad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:27.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.732+0000 7fa700274640 1 -- 172.21.15.132:0/3084517853 shutdown_connections 2024-04-16T15:52:27.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.732+0000 7fa700274640 1 -- 172.21.15.132:0/3084517853 wait complete. 2024-04-16T15:52:27.742 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T15:52:27.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.847+0000 7f7a39eb1640 1 Processor -- start 2024-04-16T15:52:27.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.847+0000 7f7a39eb1640 1 -- start start 2024-04-16T15:52:27.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.848+0000 7f7a39eb1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7a3406df50 0x7f7a3406cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:27.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.848+0000 7f7a39eb1640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a340d1fe0 con 0x7f7a3409aa30 2024-04-16T15:52:27.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.848+0000 7f7a39eb1640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a340ccee0 con 0x7f7a3415ede0 2024-04-16T15:52:27.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.848+0000 7f7a39eb1640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f7a340b1c00 con 0x7f7a3406df50 2024-04-16T15:52:27.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.848+0000 7f7a337fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f7a3409aa30 0x7f7a3409ae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47358/0 (socket says 172.21.15.132:47358) 2024-04-16T15:52:27.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.848+0000 7f7a337fe640 1 -- 172.21.15.132:0/1291345996 learned_addr learned my addr 172.21.15.132:0/1291345996 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:27.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.848+0000 7f7a33fff640 1 --2- 172.21.15.132:0/1291345996 >> v2:172.21.15.132:3300/0 conn(0x7f7a3406df50 0x7f7a3406cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:27.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.848+0000 7f7a327fc640 1 -- 172.21.15.132:0/1291345996 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1516975046 0 0) 0x7f7a340d1fe0 con 0x7f7a3409aa30 2024-04-16T15:52:27.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.848+0000 7f7a327fc640 1 -- 172.21.15.132:0/1291345996 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a1c003520 con 0x7f7a3409aa30 2024-04-16T15:52:27.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.848+0000 7f7a33fff640 1 -- 172.21.15.132:0/1291345996 >> v1:172.21.15.179:6789/0 conn(0x7f7a3415ede0 legacy=0x7f7a340d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:27.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.848+0000 7f7a33fff640 1 -- 172.21.15.132:0/1291345996 >> v1:172.21.15.132:6789/0 conn(0x7f7a3409aa30 legacy=0x7f7a3409ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:27.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.848+0000 7f7a33fff640 1 -- 172.21.15.132:0/1291345996 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a340cd1c0 con 0x7f7a3406df50 2024-04-16T15:52:27.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.849+0000 7f7a33fff640 1 --2- 172.21.15.132:0/1291345996 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a3406df50 0x7f7a3406cd40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c0097a0 tx=0x7f7a2c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f3a49e05aa8a4ac server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:27.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.849+0000 7f7a327fc640 1 -- 172.21.15.132:0/1291345996 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c034070 con 0x7f7a3406df50 2024-04-16T15:52:27.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.849+0000 7f7a327fc640 1 -- 172.21.15.132:0/1291345996 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a2c030610 con 0x7f7a3406df50 2024-04-16T15:52:27.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.849+0000 7f7a327fc640 1 -- 172.21.15.132:0/1291345996 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c0309e0 con 0x7f7a3406df50 2024-04-16T15:52:27.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.850+0000 7f7a39eb1640 1 -- 172.21.15.132:0/1291345996 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a3406df50 msgr2=0x7f7a3406cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:27.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.850+0000 7f7a39eb1640 1 --2- 172.21.15.132:0/1291345996 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a3406df50 0x7f7a3406cd40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c0097a0 tx=0x7f7a2c02b960 comp rx=0 tx=0).stop 2024-04-16T15:52:27.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.850+0000 7f7a39eb1640 1 -- 172.21.15.132:0/1291345996 shutdown_connections 2024-04-16T15:52:27.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.850+0000 7f7a39eb1640 1 --2- 172.21.15.132:0/1291345996 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a3406df50 0x7f7a3406cd40 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:27.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.850+0000 7f7a39eb1640 1 -- 172.21.15.132:0/1291345996 >> 172.21.15.132:0/1291345996 conn(0x7f7a340b41e0 msgr2=0x7f7a340b45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:27.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.850+0000 7f7a39eb1640 1 -- 172.21.15.132:0/1291345996 shutdown_connections 2024-04-16T15:52:27.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.850+0000 7f7a39eb1640 1 -- 172.21.15.132:0/1291345996 wait complete. 2024-04-16T15:52:27.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.851+0000 7f7a39eb1640 1 Processor -- start 2024-04-16T15:52:27.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.851+0000 7f7a39eb1640 1 -- start start 2024-04-16T15:52:27.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.852+0000 7f7a39eb1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a3406df50 0x7f7a341f53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:27.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.852+0000 7f7a39eb1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a3409aa30 0x7f7a340b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:27.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.852+0000 7f7a39eb1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a341f5a00 0x7f7a340c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:27.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.852+0000 7f7a39eb1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f7a340d1200 con 0x7f7a3409aa30 2024-04-16T15:52:27.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.852+0000 7f7a39eb1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7a340cd530 con 0x7f7a3406df50 2024-04-16T15:52:27.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.852+0000 7f7a39eb1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f7a340d1380 con 0x7f7a341f5a00 2024-04-16T15:52:27.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.852+0000 7f7a32ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a3409aa30 0x7f7a340b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:27.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.852+0000 7f7a32ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a3409aa30 0x7f7a340b1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35618/0 (socket says 172.21.15.132:35618) 2024-04-16T15:52:27.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.852+0000 7f7a32ffd640 1 -- 172.21.15.132:0/2327032252 learned_addr learned my addr 172.21.15.132:0/2327032252 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:27.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.852+0000 7f7a33fff640 1 --2- 172.21.15.132:0/2327032252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a341f5a00 0x7f7a340c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:27.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.852+0000 7f7a337fe640 1 --2- 172.21.15.132:0/2327032252 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a3406df50 0x7f7a341f53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:27.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.852+0000 7f7a32ffd640 1 -- 172.21.15.132:0/2327032252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a341f5a00 msgr2=0x7f7a340c87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:27.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.852+0000 7f7a32ffd640 1 --2- 172.21.15.132:0/2327032252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a341f5a00 0x7f7a340c87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:27.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.852+0000 7f7a32ffd640 1 -- 172.21.15.132:0/2327032252 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a3406df50 msgr2=0x7f7a341f53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:27.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.852+0000 7f7a32ffd640 1 --2- 172.21.15.132:0/2327032252 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a3406df50 0x7f7a341f53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:27.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.852+0000 7f7a32ffd640 1 -- 172.21.15.132:0/2327032252 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a340ca800 con 0x7f7a3409aa30 2024-04-16T15:52:27.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.852+0000 7f7a32ffd640 1 --2- 172.21.15.132:0/2327032252 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a3409aa30 0x7f7a340b1d90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7a2800c3c0 tx=0x7f7a2800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:27.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.853+0000 7f7a1bfff640 1 -- 172.21.15.132:0/2327032252 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a280052d0 con 0x7f7a3409aa30 2024-04-16T15:52:27.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.853+0000 7f7a1bfff640 1 -- 172.21.15.132:0/2327032252 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a28005490 con 0x7f7a3409aa30 2024-04-16T15:52:27.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.853+0000 7f7a39eb1640 1 -- 172.21.15.132:0/2327032252 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a340b2500 con 0x7f7a3409aa30 2024-04-16T15:52:27.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.853+0000 7f7a1bfff640 1 -- 172.21.15.132:0/2327032252 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a28007260 con 0x7f7a3409aa30 2024-04-16T15:52:27.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.853+0000 7f7a39eb1640 1 -- 172.21.15.132:0/2327032252 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a340b2ac0 con 0x7f7a3409aa30 2024-04-16T15:52:27.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.853+0000 7f7a39eb1640 1 -- 172.21.15.132:0/2327032252 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a34075510 con 0x7f7a3409aa30 2024-04-16T15:52:27.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.854+0000 7f7a1bfff640 1 -- 172.21.15.132:0/2327032252 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7a28007400 con 0x7f7a3409aa30 2024-04-16T15:52:27.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.854+0000 7f7a1bfff640 1 --2- 172.21.15.132:0/2327032252 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f7a2006c920 0x7f7a2006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:27.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.854+0000 7f7a337fe640 1 --2- 172.21.15.132:0/2327032252 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f7a2006c920 0x7f7a2006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:27.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.854+0000 7f7a1bfff640 1 -- 172.21.15.132:0/2327032252 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7a2808afb0 con 0x7f7a3409aa30 2024-04-16T15:52:27.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.855+0000 7f7a337fe640 1 --2- 172.21.15.132:0/2327032252 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f7a2006c920 0x7f7a2006ede0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7a24001560 tx=0x7f7a24009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:27.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:27.859+0000 7f7a1bfff640 1 -- 172.21.15.132:0/2327032252 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7a340ca800 con 0x7f7a3409aa30 2024-04-16T15:52:28.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.074+0000 7f7a39eb1640 1 -- 172.21.15.132:0/2327032252 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7a3406bdf0 con 0x7f7a3409aa30 2024-04-16T15:52:28.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.074+0000 7f7a1bfff640 1 -- 172.21.15.132:0/2327032252 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5175 (secure 0 0 0) 0x7f7a280593e0 con 0x7f7a3409aa30 2024-04-16T15:52:28.074 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:52:28.074 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/659108212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":659108212},{"type":"v1","addr":"172.21.15.132:6835","nonce":659108212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/811468074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":811468074},{"type":"v1","addr":"172.21.15.132:6837","nonce":811468074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/493922944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":493922944},{"type":"v1","addr":"172.21.15.179:6834","nonce":493922944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T15:52:15.286161+0000","modified":"2024-04-16T15:52:17.305756+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/202618568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":202618568},{"type":"v1","addr":"172.21.15.179:6835","nonce":202618568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1}]} 2024-04-16T15:52:28.074 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 6 2024-04-16T15:52:28.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.076+0000 7f7a39eb1640 1 -- 172.21.15.132:0/2327032252 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f7a2006c920 msgr2=0x7f7a2006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:28.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.076+0000 7f7a39eb1640 1 --2- 172.21.15.132:0/2327032252 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f7a2006c920 0x7f7a2006ede0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7a24001560 tx=0x7f7a24009040 comp rx=0 tx=0).stop 2024-04-16T15:52:28.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.076+0000 7f7a39eb1640 1 -- 172.21.15.132:0/2327032252 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a3409aa30 msgr2=0x7f7a340b1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:28.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.076+0000 7f7a39eb1640 1 --2- 172.21.15.132:0/2327032252 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a3409aa30 0x7f7a340b1d90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7a2800c3c0 tx=0x7f7a2800c880 comp rx=0 tx=0).stop 2024-04-16T15:52:28.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.076+0000 7f7a39eb1640 1 -- 172.21.15.132:0/2327032252 shutdown_connections 2024-04-16T15:52:28.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.076+0000 7f7a39eb1640 1 --2- 172.21.15.132:0/2327032252 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f7a2006c920 0x7f7a2006ede0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:28.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.076+0000 7f7a39eb1640 1 --2- 172.21.15.132:0/2327032252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a341f5a00 0x7f7a340c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:28.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.076+0000 7f7a39eb1640 1 --2- 172.21.15.132:0/2327032252 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a3409aa30 0x7f7a340b1d90 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:28.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.076+0000 7f7a39eb1640 1 --2- 172.21.15.132:0/2327032252 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a3406df50 0x7f7a341f53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:28.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.076+0000 7f7a39eb1640 1 -- 172.21.15.132:0/2327032252 >> 172.21.15.132:0/2327032252 conn(0x7f7a340b41e0 msgr2=0x7f7a340d0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:28.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.076+0000 7f7a39eb1640 1 -- 172.21.15.132:0/2327032252 shutdown_connections 2024-04-16T15:52:28.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.076+0000 7f7a39eb1640 1 -- 172.21.15.132:0/2327032252 wait complete. 2024-04-16T15:52:28.491 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-16T15:52:15.286161+0000', 'modified': '2024-04-16T15:52:17.305756+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4281}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4281': {'gid': 4281, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.179:6835/202618568', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6833', 'nonce': 202618568}, {'type': 'v1', 'addr': '172.21.15.179:6835', 'nonce': 202618568}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4281, 'qdb_cluster': [4281]} 2024-04-16T15:52:28.492 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-16T15:52:28.492 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-16T15:52:28.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.598+0000 7f5b0839d640 1 Processor -- start 2024-04-16T15:52:28.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.598+0000 7f5b0839d640 1 -- start start 2024-04-16T15:52:28.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.599+0000 7f5b0839d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5b00145c90 0x7f5b000b7060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:28.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.599+0000 7f5b0839d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5b0006be80 0x7f5b00160b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:28.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.599+0000 7f5b0839d640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b000b2c70 con 0x7f5b0006ba20 2024-04-16T15:52:28.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.599+0000 7f5b0839d640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f5b000b75a0 con 0x7f5b00145c90 2024-04-16T15:52:28.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.599+0000 7f5b0839d640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f5b000b0880 con 0x7f5b0006be80 2024-04-16T15:52:28.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.599+0000 7f5b06139640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5b00145c90 0x7f5b000b7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:28.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.599+0000 7f5b06139640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5b00145c90 0x7f5b000b7060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35632/0 (socket says 172.21.15.132:35632) 2024-04-16T15:52:28.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.599+0000 7f5b06139640 1 -- 172.21.15.132:0/3056961992 learned_addr learned my addr 172.21.15.132:0/3056961992 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:28.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.600+0000 7f5b06139640 1 -- 172.21.15.132:0/3056961992 >> v2:172.21.15.179:3300/0 conn(0x7f5b0006be80 msgr2=0x7f5b00160b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:28.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.600+0000 7f5b0693a640 1 --2- 172.21.15.132:0/3056961992 >> v2:172.21.15.179:3300/0 conn(0x7f5b0006be80 0x7f5b00160b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:28.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.600+0000 7f5b06139640 1 --2- 172.21.15.132:0/3056961992 >> v2:172.21.15.179:3300/0 conn(0x7f5b0006be80 0x7f5b00160b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:28.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.600+0000 7f5b06139640 1 -- 172.21.15.132:0/3056961992 >> v1:172.21.15.179:6789/0 conn(0x7f5b0006ba20 legacy=0x7f5b00160420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:28.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.600+0000 7f5b06139640 1 -- 172.21.15.132:0/3056961992 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b000b0ad0 con 0x7f5b00145c90 2024-04-16T15:52:28.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.600+0000 7f5b0693a640 1 --2- 172.21.15.132:0/3056961992 >> v2:172.21.15.179:3300/0 conn(0x7f5b0006be80 0x7f5b00160b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:52:28.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.600+0000 7f5b06139640 1 --2- 172.21.15.132:0/3056961992 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b00145c90 0x7f5b000b7060 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5b001466b0 tx=0x7f5afc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d6f94b37b5b3302 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:28.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.600+0000 7f5b05137640 1 -- 172.21.15.132:0/3056961992 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5afc035020 con 0x7f5b00145c90 2024-04-16T15:52:28.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.601+0000 7f5b05137640 1 -- 172.21.15.132:0/3056961992 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5afc031870 con 0x7f5b00145c90 2024-04-16T15:52:28.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.601+0000 7f5b05137640 1 -- 172.21.15.132:0/3056961992 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5afc031c40 con 0x7f5b00145c90 2024-04-16T15:52:28.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.601+0000 7f5b0839d640 1 -- 172.21.15.132:0/3056961992 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b00145c90 msgr2=0x7f5b000b7060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:28.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.601+0000 7f5b0839d640 1 --2- 172.21.15.132:0/3056961992 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b00145c90 0x7f5b000b7060 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5b001466b0 tx=0x7f5afc02b910 comp rx=0 tx=0).stop 2024-04-16T15:52:28.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.601+0000 7f5b0839d640 1 -- 172.21.15.132:0/3056961992 shutdown_connections 2024-04-16T15:52:28.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.601+0000 7f5b0839d640 1 --2- 172.21.15.132:0/3056961992 >> v2:172.21.15.179:3300/0 conn(0x7f5b0006be80 0x7f5b00160b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:28.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.601+0000 7f5b0839d640 1 --2- 172.21.15.132:0/3056961992 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b00145c90 0x7f5b000b7060 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:28.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.601+0000 7f5b0839d640 1 -- 172.21.15.132:0/3056961992 >> 172.21.15.132:0/3056961992 conn(0x7f5b0009aa30 msgr2=0x7f5b000b6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:28.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.601+0000 7f5b0839d640 1 -- 172.21.15.132:0/3056961992 shutdown_connections 2024-04-16T15:52:28.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.601+0000 7f5b0839d640 1 -- 172.21.15.132:0/3056961992 wait complete. 2024-04-16T15:52:28.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.602+0000 7f5b0839d640 1 Processor -- start 2024-04-16T15:52:28.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.602+0000 7f5b0839d640 1 -- start start 2024-04-16T15:52:28.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.603+0000 7f5b0839d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b0006ba20 0x7f5b0009dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:28.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.603+0000 7f5b0839d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b0006be80 0x7f5b0013beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:28.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.603+0000 7f5b0839d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b00145c90 0x7f5b001e84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:28.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.603+0000 7f5b0839d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f5b0015ce30 con 0x7f5b0006be80 2024-04-16T15:52:28.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.603+0000 7f5b0839d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5b000b1090 con 0x7f5b00145c90 2024-04-16T15:52:28.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.603+0000 7f5b0839d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f5b000b25c0 con 0x7f5b0006ba20 2024-04-16T15:52:28.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.603+0000 7f5b05938640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b0006be80 0x7f5b0013beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:28.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.603+0000 7f5b05938640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b0006be80 0x7f5b0013beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35634/0 (socket says 172.21.15.132:35634) 2024-04-16T15:52:28.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.603+0000 7f5b05938640 1 -- 172.21.15.132:0/1891308830 learned_addr learned my addr 172.21.15.132:0/1891308830 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:28.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.603+0000 7f5b06139640 1 --2- 172.21.15.132:0/1891308830 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b0006ba20 0x7f5b0009dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:28.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.603+0000 7f5b0693a640 1 --2- 172.21.15.132:0/1891308830 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b00145c90 0x7f5b001e84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:28.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.603+0000 7f5b05938640 1 -- 172.21.15.132:0/1891308830 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b0006ba20 msgr2=0x7f5b0009dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:28.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.603+0000 7f5b05938640 1 --2- 172.21.15.132:0/1891308830 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b0006ba20 0x7f5b0009dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:28.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.603+0000 7f5b05938640 1 -- 172.21.15.132:0/1891308830 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b00145c90 msgr2=0x7f5b001e84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:28.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.603+0000 7f5b05938640 1 --2- 172.21.15.132:0/1891308830 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b00145c90 0x7f5b001e84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:28.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.603+0000 7f5b05938640 1 -- 172.21.15.132:0/1891308830 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b0009e5f0 con 0x7f5b0006be80 2024-04-16T15:52:28.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.604+0000 7f5b05938640 1 --2- 172.21.15.132:0/1891308830 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b0006be80 0x7f5b0013beb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5af000b3f0 tx=0x7f5af000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:28.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.604+0000 7f5af6ffd640 1 -- 172.21.15.132:0/1891308830 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af0015020 con 0x7f5b0006be80 2024-04-16T15:52:28.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.604+0000 7f5af6ffd640 1 -- 172.21.15.132:0/1891308830 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5af0011830 con 0x7f5b0006be80 2024-04-16T15:52:28.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.604+0000 7f5b0839d640 1 -- 172.21.15.132:0/1891308830 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b0009e8d0 con 0x7f5b0006be80 2024-04-16T15:52:28.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.604+0000 7f5af6ffd640 1 -- 172.21.15.132:0/1891308830 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af0011c20 con 0x7f5b0006be80 2024-04-16T15:52:28.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.604+0000 7f5b0839d640 1 -- 172.21.15.132:0/1891308830 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b0009f170 con 0x7f5b0006be80 2024-04-16T15:52:28.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.605+0000 7f5af6ffd640 1 -- 172.21.15.132:0/1891308830 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5af0018020 con 0x7f5b0006be80 2024-04-16T15:52:28.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.606+0000 7f5af6ffd640 1 --2- 172.21.15.132:0/1891308830 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f5ae406c8f0 0x7f5ae406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:28.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.606+0000 7f5af6ffd640 1 -- 172.21.15.132:0/1891308830 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5af008b7f0 con 0x7f5b0006be80 2024-04-16T15:52:28.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.606+0000 7f5b06139640 1 --2- 172.21.15.132:0/1891308830 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f5ae406c8f0 0x7f5ae406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:28.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.606+0000 7f5b06139640 1 --2- 172.21.15.132:0/1891308830 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f5ae406c8f0 0x7f5ae406edb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5afc036000 tx=0x7f5afc03c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:28.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.607+0000 7f5b0af89740 1 Processor -- start 2024-04-16T15:52:28.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.607+0000 7f5b0af89740 1 -- start start 2024-04-16T15:52:28.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.608+0000 7f5b0af89740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56192a194af0 0x56192a194ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:28.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.608+0000 7f5b0af89740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56192a164b10 0x56192a191d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:28.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.608+0000 7f5b0af89740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56192a168670 0x56192a1922a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:28.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.608+0000 7f5b0af89740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x56192a0ce9c0 con 0x56192a168670 2024-04-16T15:52:28.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.608+0000 7f5b0af89740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56192a075650 con 0x56192a194af0 2024-04-16T15:52:28.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.608+0000 7f5b0af89740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x56192a0ca980 con 0x56192a164b10 2024-04-16T15:52:28.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.608+0000 7f5b0693a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56192a168670 0x56192a1922a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:28.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.608+0000 7f5b0693a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56192a168670 0x56192a1922a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35650/0 (socket says 172.21.15.132:35650) 2024-04-16T15:52:28.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.608+0000 7f5b0693a640 1 -- 172.21.15.132:0/1450878705 learned_addr learned my addr 172.21.15.132:0/1450878705 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:28.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.608+0000 7f5b06139640 1 --2- 172.21.15.132:0/1450878705 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56192a194af0 0x56192a194ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:28.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.608+0000 7f5b05938640 1 --2- 172.21.15.132:0/1450878705 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56192a164b10 0x56192a191d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:28.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.608+0000 7f5b0693a640 1 -- 172.21.15.132:0/1450878705 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56192a164b10 msgr2=0x56192a191d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:28.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.608+0000 7f5b0693a640 1 --2- 172.21.15.132:0/1450878705 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56192a164b10 0x56192a191d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:28.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.608+0000 7f5b0693a640 1 -- 172.21.15.132:0/1450878705 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56192a194af0 msgr2=0x56192a194ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:28.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.608+0000 7f5b0693a640 1 --2- 172.21.15.132:0/1450878705 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56192a194af0 0x56192a194ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:28.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.608+0000 7f5b0693a640 1 -- 172.21.15.132:0/1450878705 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561929de12d0 con 0x56192a168670 2024-04-16T15:52:28.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.608+0000 7f5b0693a640 1 --2- 172.21.15.132:0/1450878705 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56192a168670 0x56192a1922a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5af800e380 tx=0x7f5af800e840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=679d32b26463b1a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:28.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.608+0000 7f5ae3fff640 1 -- 172.21.15.132:0/1450878705 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af800f6b0 con 0x56192a168670 2024-04-16T15:52:28.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.608+0000 7f5ae3fff640 1 -- 172.21.15.132:0/1450878705 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5af800f850 con 0x56192a168670 2024-04-16T15:52:28.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.608+0000 7f5ae3fff640 1 -- 172.21.15.132:0/1450878705 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af800fc00 con 0x56192a168670 2024-04-16T15:52:28.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.609+0000 7f5b0af89740 1 -- 172.21.15.132:0/1450878705 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56192a168670 msgr2=0x56192a1922a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:28.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.609+0000 7f5b0af89740 1 --2- 172.21.15.132:0/1450878705 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56192a168670 0x56192a1922a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5af800e380 tx=0x7f5af800e840 comp rx=0 tx=0).stop 2024-04-16T15:52:28.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.609+0000 7f5b0af89740 1 -- 172.21.15.132:0/1450878705 shutdown_connections 2024-04-16T15:52:28.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.609+0000 7f5b0af89740 1 --2- 172.21.15.132:0/1450878705 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56192a168670 0x56192a1922a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:28.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.609+0000 7f5b0af89740 1 --2- 172.21.15.132:0/1450878705 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56192a164b10 0x56192a191d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:28.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.609+0000 7f5b0af89740 1 --2- 172.21.15.132:0/1450878705 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56192a194af0 0x56192a194ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:28.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.609+0000 7f5b0af89740 1 -- 172.21.15.132:0/1450878705 >> 172.21.15.132:0/1450878705 conn(0x56192a166d80 msgr2=0x56192a1af900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:28.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.609+0000 7f5b0af89740 1 -- 172.21.15.132:0/1450878705 shutdown_connections 2024-04-16T15:52:28.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.609+0000 7f5b0af89740 1 -- 172.21.15.132:0/1450878705 wait complete. 2024-04-16T15:52:28.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.610+0000 7f5b0af89740 1 -- start start 2024-04-16T15:52:28.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.610+0000 7f5b0af89740 1 Processor -- start 2024-04-16T15:52:28.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.611+0000 7f5b0af89740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56192a168670 0x56192a17ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:28.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.611+0000 7f5b0af89740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56192a194af0 0x56192a18eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:28.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.611+0000 7f5b0af89740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56192a17b080 0x56192a18f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:28.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.611+0000 7f5b0af89740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x56192a169820 con 0x56192a17b080 2024-04-16T15:52:28.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.611+0000 7f5b0af89740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56192a088a10 con 0x56192a194af0 2024-04-16T15:52:28.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.611+0000 7f5b0af89740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x56192a168c10 con 0x56192a168670 2024-04-16T15:52:28.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.611+0000 7f5b0af89740 10 client.0 _ll_register_callbacks cb 0x56192a088400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-16T15:52:28.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.611+0000 7f5b0693a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56192a17b080 0x56192a18f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:28.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.611+0000 7f5b0693a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56192a17b080 0x56192a18f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35658/0 (socket says 172.21.15.132:35658) 2024-04-16T15:52:28.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.611+0000 7f5b0693a640 1 -- 172.21.15.132:0/1672810437 learned_addr learned my addr 172.21.15.132:0/1672810437 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:28.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.611+0000 7f5b06139640 1 --2- 172.21.15.132:0/1672810437 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56192a168670 0x56192a17ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:28.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.611+0000 7f5b05938640 1 --2- 172.21.15.132:0/1672810437 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56192a194af0 0x56192a18eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:28.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.611+0000 7f5b0693a640 1 -- 172.21.15.132:0/1672810437 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56192a168670 msgr2=0x56192a17ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:28.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.611+0000 7f5b0693a640 1 --2- 172.21.15.132:0/1672810437 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56192a168670 0x56192a17ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:28.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.611+0000 7f5b0693a640 1 -- 172.21.15.132:0/1672810437 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56192a194af0 msgr2=0x56192a18eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:28.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.611+0000 7f5b0693a640 1 --2- 172.21.15.132:0/1672810437 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56192a194af0 0x56192a18eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:28.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.611+0000 7f5b0693a640 1 -- 172.21.15.132:0/1672810437 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561929eab6b0 con 0x56192a17b080 2024-04-16T15:52:28.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.611+0000 7f5b06139640 1 --2- 172.21.15.132:0/1672810437 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56192a168670 0x56192a17ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:28.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.611+0000 7f5b0693a640 1 --2- 172.21.15.132:0/1672810437 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56192a17b080 0x56192a18f430 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5af8000f80 tx=0x7f5af8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8500b1f74d472a5e server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:28.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.611+0000 7f5ae17fa640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2024-04-16T15:52:28.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.611+0000 7f5ae17fa640 1 -- 172.21.15.132:0/1672810437 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af801d040 con 0x56192a17b080 2024-04-16T15:52:28.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.611+0000 7f5ae17fa640 1 -- 172.21.15.132:0/1672810437 <== mon.0 v2:172.21.15.132:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5af800fa00 con 0x56192a17b080 2024-04-16T15:52:28.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.611+0000 7f5b0af89740 1 -- 172.21.15.132:0/1672810437 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5af800f850 con 0x56192a17b080 2024-04-16T15:52:28.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.611+0000 7f5ae17fa640 1 -- 172.21.15.132:0/1672810437 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f5af802e050 con 0x56192a17b080 2024-04-16T15:52:28.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.611+0000 7f5b0af89740 10 client.4680 fetch_fsmap learned FSMap version 6 2024-04-16T15:52:28.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.611+0000 7f5b0af89740 1 -- 172.21.15.132:0/1672810437 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x56192a18da80 con 0x56192a17b080 2024-04-16T15:52:28.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.612+0000 7f5ae17fa640 1 -- 172.21.15.132:0/1672810437 <== mon.0 v2:172.21.15.132:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5af800f850 con 0x56192a17b080 2024-04-16T15:52:28.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.612+0000 7f5ae17fa640 1 -- 172.21.15.132:0/1672810437 <== mon.0 v2:172.21.15.132:3300/0 5 ==== fsmap(e 6) ==== 3494+0+0 (secure 0 0 0) 0x7f5af8031020 con 0x56192a17b080 2024-04-16T15:52:28.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.612+0000 7f5b0af89740 10 client.4680 fetch_fsmap finished waiting for FSMap version 6 2024-04-16T15:52:28.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.612+0000 7f5b0af89740 10 client.4680 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-16T15:52:28.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.612+0000 7f5b0af89740 20 client.4680 populate_metadata read hostname 'smithi132' 2024-04-16T15:52:28.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.612+0000 7f5b0af89740 1 --2- 172.21.15.132:0/1672810437 >> [v2:172.21.15.179:6833/202618568,v1:172.21.15.179:6835/202618568] conn(0x56192a1ca070 0x56192a1ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:28.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.612+0000 7f5b0af89740 4 client.4680 mds_command: new command op to 4281 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-16T15:52:28.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.612+0000 7f5b0af89740 1 -- 172.21.15.132:0/1672810437 --> [v2:172.21.15.179:6833/202618568,v1:172.21.15.179:6835/202618568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56192a0dc3e0 con 0x56192a1ca070 2024-04-16T15:52:28.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.612+0000 7f5b06139640 1 --2- 172.21.15.132:0/1672810437 >> [v2:172.21.15.179:6833/202618568,v1:172.21.15.179:6835/202618568] conn(0x56192a1ca070 0x56192a1ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:28.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.612+0000 7f5b06139640 1 --2- 172.21.15.132:0/1672810437 >> [v2:172.21.15.179:6833/202618568,v1:172.21.15.179:6835/202618568] conn(0x56192a1ca070 0x56192a1ce2f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=352fa72bc2529093 server_cookie=2a19a1bb492c1f89 in_seq=0 out_seq=0 2024-04-16T15:52:28.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.612+0000 7f5ae17fa640 10 client.4680 ms_handle_connect on v2:172.21.15.179:6833/202618568 2024-04-16T15:52:28.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.613+0000 7f5ae17fa640 1 -- 172.21.15.132:0/1672810437 <== mds.0 v2:172.21.15.179:6833/202618568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56192a0dc3e0 con 0x56192a1ca070 2024-04-16T15:52:28.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.613+0000 7f5ae17fa640 10 client.4680 handle_command_reply: tid=0 2024-04-16T15:52:28.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.613+0000 7f5b0af89740 1 client.4680 shutdown 2024-04-16T15:52:28.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.613+0000 7f5b0af89740 1 -- 172.21.15.132:0/1672810437 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56192a17b080 msgr2=0x56192a18f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:28.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.613+0000 7f5b0af89740 1 --2- 172.21.15.132:0/1672810437 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56192a17b080 0x56192a18f430 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5af8000f80 tx=0x7f5af8004ab0 comp rx=0 tx=0).stop 2024-04-16T15:52:28.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.613+0000 7f5b0af89740 1 -- 172.21.15.132:0/1672810437 shutdown_connections 2024-04-16T15:52:28.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.613+0000 7f5b0af89740 1 --2- 172.21.15.132:0/1672810437 >> [v2:172.21.15.179:6833/202618568,v1:172.21.15.179:6835/202618568] conn(0x56192a1ca070 0x56192a1ce2f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:28.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.613+0000 7f5b0af89740 1 --2- 172.21.15.132:0/1672810437 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56192a17b080 0x56192a18f430 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:28.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.613+0000 7f5b0af89740 1 --2- 172.21.15.132:0/1672810437 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56192a194af0 0x56192a18eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:28.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.613+0000 7f5b0af89740 1 --2- 172.21.15.132:0/1672810437 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56192a168670 0x56192a17ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:28.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.613+0000 7f5ae17fa640 0 client.4680 ms_handle_reset on v2:172.21.15.179:6833/202618568 2024-04-16T15:52:28.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.613+0000 7f5b0af89740 1 -- 172.21.15.132:0/1672810437 >> 172.21.15.132:0/1672810437 conn(0x56192a164b10 msgr2=0x56192a1b2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:28.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.613+0000 7f5b0af89740 1 -- 172.21.15.132:0/1672810437 shutdown_connections 2024-04-16T15:52:28.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.613+0000 7f5b0af89740 1 -- 172.21.15.132:0/1672810437 wait complete. 2024-04-16T15:52:28.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.613+0000 7f5b0af89740 20 client.4680 trim_cache size 0 max 16384 2024-04-16T15:52:28.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.631+0000 7f5b0af89740 1 Processor -- start 2024-04-16T15:52:28.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.631+0000 7f5b0af89740 1 -- start start 2024-04-16T15:52:28.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.632+0000 7f5b0af89740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56192a168670 0x56192a16a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:28.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.632+0000 7f5b0af89740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56192a17b080 0x56192a17a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:28.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.632+0000 7f5b0af89740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56192a194af0 0x56192a191ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:28.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.632+0000 7f5b0af89740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f5b001fde10 con 0x56192a17b080 2024-04-16T15:52:28.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.632+0000 7f5b0af89740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5b001fd1c0 con 0x56192a168670 2024-04-16T15:52:28.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.632+0000 7f5b0af89740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f5b001fd7c0 con 0x56192a194af0 2024-04-16T15:52:28.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.632+0000 7f5b05938640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56192a17b080 0x56192a17a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:28.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.632+0000 7f5b05938640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56192a17b080 0x56192a17a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35674/0 (socket says 172.21.15.132:35674) 2024-04-16T15:52:28.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.632+0000 7f5b05938640 1 -- 172.21.15.132:0/1378952555 learned_addr learned my addr 172.21.15.132:0/1378952555 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:28.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.632+0000 7f5b05938640 1 -- 172.21.15.132:0/1378952555 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56192a194af0 msgr2=0x56192a191ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:28.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.632+0000 7f5b05938640 1 --2- 172.21.15.132:0/1378952555 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56192a194af0 0x56192a191ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:28.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.632+0000 7f5b05938640 1 -- 172.21.15.132:0/1378952555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56192a168670 msgr2=0x56192a16a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:28.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.632+0000 7f5b05938640 1 --2- 172.21.15.132:0/1378952555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56192a168670 0x56192a16a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:28.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.632+0000 7f5b05938640 1 -- 172.21.15.132:0/1378952555 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56192a18e680 con 0x56192a17b080 2024-04-16T15:52:28.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.632+0000 7f5b05938640 1 --2- 172.21.15.132:0/1378952555 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56192a17b080 0x56192a17a5b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5af00594b0 tx=0x7f5af0058fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7de9b69b7e0224d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:28.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.632+0000 7f5ae37fe640 1 -- 172.21.15.132:0/1378952555 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af0062100 con 0x56192a17b080 2024-04-16T15:52:28.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.633+0000 7f5ae37fe640 1 -- 172.21.15.132:0/1378952555 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5af0088070 con 0x56192a17b080 2024-04-16T15:52:28.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.633+0000 7f5ae37fe640 1 -- 172.21.15.132:0/1378952555 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af0057820 con 0x56192a17b080 2024-04-16T15:52:28.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.633+0000 7f5b0af89740 1 -- 172.21.15.132:0/1378952555 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56192a17b080 msgr2=0x56192a17a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:28.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.633+0000 7f5b0af89740 1 --2- 172.21.15.132:0/1378952555 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56192a17b080 0x56192a17a5b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5af00594b0 tx=0x7f5af0058fb0 comp rx=0 tx=0).stop 2024-04-16T15:52:28.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.633+0000 7f5b0af89740 1 -- 172.21.15.132:0/1378952555 shutdown_connections 2024-04-16T15:52:28.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.633+0000 7f5b0af89740 1 --2- 172.21.15.132:0/1378952555 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56192a194af0 0x56192a191ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:28.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.633+0000 7f5b0af89740 1 --2- 172.21.15.132:0/1378952555 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56192a17b080 0x56192a17a5b0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:28.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.633+0000 7f5b0af89740 1 --2- 172.21.15.132:0/1378952555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56192a168670 0x56192a16a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:28.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.633+0000 7f5b0af89740 1 -- 172.21.15.132:0/1378952555 >> 172.21.15.132:0/1378952555 conn(0x56192a164b10 msgr2=0x56192a1b33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:28.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.633+0000 7f5b0af89740 1 -- 172.21.15.132:0/1378952555 shutdown_connections 2024-04-16T15:52:28.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.633+0000 7f5b0af89740 1 -- 172.21.15.132:0/1378952555 wait complete. 2024-04-16T15:52:28.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.634+0000 7f5b0af89740 1 -- start start 2024-04-16T15:52:28.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.634+0000 7f5b0af89740 1 Processor -- start 2024-04-16T15:52:28.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.635+0000 7f5b0af89740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56192a168670 0x56192a1c9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:28.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.635+0000 7f5b0af89740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56192a17b080 0x56192a169f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:28.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.635+0000 7f5b0af89740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56192a194af0 0x56192a1895b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:28.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.635+0000 7f5b0af89740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x56192a1c9ef0 con 0x56192a17b080 2024-04-16T15:52:28.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.635+0000 7f5b0af89740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56192a18cc90 con 0x56192a168670 2024-04-16T15:52:28.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.635+0000 7f5b0af89740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x56192a1ca480 con 0x56192a194af0 2024-04-16T15:52:28.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.635+0000 7f5b0af89740 10 client.0 _ll_register_callbacks cb 0x7f5af8007e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-16T15:52:28.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.635+0000 7f5b05938640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56192a17b080 0x56192a169f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:28.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.635+0000 7f5b05938640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56192a17b080 0x56192a169f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35688/0 (socket says 172.21.15.132:35688) 2024-04-16T15:52:28.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.635+0000 7f5b05938640 1 -- 172.21.15.132:0/217386846 learned_addr learned my addr 172.21.15.132:0/217386846 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:28.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.635+0000 7f5b05938640 1 -- 172.21.15.132:0/217386846 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56192a194af0 msgr2=0x56192a1895b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:28.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.635+0000 7f5b05938640 1 --2- 172.21.15.132:0/217386846 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56192a194af0 0x56192a1895b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:28.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.635+0000 7f5b05938640 1 -- 172.21.15.132:0/217386846 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56192a168670 msgr2=0x56192a1c9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:28.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.635+0000 7f5b05938640 1 --2- 172.21.15.132:0/217386846 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56192a168670 0x56192a1c9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:28.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.635+0000 7f5b05938640 1 -- 172.21.15.132:0/217386846 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56192a1b0da0 con 0x56192a17b080 2024-04-16T15:52:28.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.635+0000 7f5b05938640 1 --2- 172.21.15.132:0/217386846 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56192a17b080 0x56192a169f90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5af0059220 tx=0x7f5af00558f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf5f15879983f4de server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:28.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.635+0000 7f5ae17fa640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2024-04-16T15:52:28.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.635+0000 7f5ae17fa640 1 -- 172.21.15.132:0/217386846 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af0055b90 con 0x56192a17b080 2024-04-16T15:52:28.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.635+0000 7f5ae17fa640 1 -- 172.21.15.132:0/217386846 <== mon.0 v2:172.21.15.132:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5af0058970 con 0x56192a17b080 2024-04-16T15:52:28.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.635+0000 7f5b0af89740 1 -- 172.21.15.132:0/217386846 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5af0088070 con 0x56192a17b080 2024-04-16T15:52:28.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.635+0000 7f5ae17fa640 1 -- 172.21.15.132:0/217386846 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f5af007e050 con 0x56192a17b080 2024-04-16T15:52:28.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.635+0000 7f5b0af89740 10 client.4686 fetch_fsmap learned FSMap version 6 2024-04-16T15:52:28.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.635+0000 7f5b0af89740 1 -- 172.21.15.132:0/217386846 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x56192a22df20 con 0x56192a17b080 2024-04-16T15:52:28.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.635+0000 7f5ae17fa640 1 -- 172.21.15.132:0/217386846 <== mon.0 v2:172.21.15.132:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5af0088070 con 0x56192a17b080 2024-04-16T15:52:28.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.635+0000 7f5ae17fa640 1 -- 172.21.15.132:0/217386846 <== mon.0 v2:172.21.15.132:3300/0 5 ==== fsmap(e 6) ==== 3494+0+0 (secure 0 0 0) 0x7f5af0081080 con 0x56192a17b080 2024-04-16T15:52:28.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.635+0000 7f5b0af89740 10 client.4686 fetch_fsmap finished waiting for FSMap version 6 2024-04-16T15:52:28.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.635+0000 7f5b0af89740 10 client.4686 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-16T15:52:28.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.635+0000 7f5b0af89740 20 client.4686 populate_metadata read hostname 'smithi132' 2024-04-16T15:52:28.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.635+0000 7f5b0af89740 1 --2- 172.21.15.132:0/217386846 >> [v2:172.21.15.179:6833/202618568,v1:172.21.15.179:6835/202618568] conn(0x56192a22b130 0x56192a1af2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:28.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.636+0000 7f5b0af89740 4 client.4686 mds_command: new command op to 4281 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-16T15:52:28.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.636+0000 7f5b0af89740 1 -- 172.21.15.132:0/217386846 --> [v2:172.21.15.179:6833/202618568,v1:172.21.15.179:6835/202618568] -- command(tid 0: {"prefix": "status"}) -- 0x56192a0d6250 con 0x56192a22b130 2024-04-16T15:52:28.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.636+0000 7f5b06139640 1 --2- 172.21.15.132:0/217386846 >> [v2:172.21.15.179:6833/202618568,v1:172.21.15.179:6835/202618568] conn(0x56192a22b130 0x56192a1af2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:28.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.636+0000 7f5ae17fa640 10 client.4686 ms_handle_connect on v2:172.21.15.179:6833/202618568 2024-04-16T15:52:28.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.636+0000 7f5b06139640 1 --2- 172.21.15.132:0/217386846 >> [v2:172.21.15.179:6833/202618568,v1:172.21.15.179:6835/202618568] conn(0x56192a22b130 0x56192a1af2e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2a70920fdf8412a server_cookie=e5980b212ba8d82e in_seq=0 out_seq=0 2024-04-16T15:52:28.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.636+0000 7f5ae17fa640 1 -- 172.21.15.132:0/217386846 <== mds.0 v2:172.21.15.179:6833/202618568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x56192a0d6250 con 0x56192a22b130 2024-04-16T15:52:28.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.636+0000 7f5ae17fa640 10 client.4686 handle_command_reply: tid=0 2024-04-16T15:52:28.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.636+0000 7f5b0af89740 1 client.4686 shutdown 2024-04-16T15:52:28.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.636+0000 7f5b0af89740 1 -- 172.21.15.132:0/217386846 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56192a17b080 msgr2=0x56192a169f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:28.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.636+0000 7f5b0af89740 1 --2- 172.21.15.132:0/217386846 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56192a17b080 0x56192a169f90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5af0059220 tx=0x7f5af00558f0 comp rx=0 tx=0).stop 2024-04-16T15:52:28.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.636+0000 7f5b0af89740 1 -- 172.21.15.132:0/217386846 shutdown_connections 2024-04-16T15:52:28.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.636+0000 7f5b0af89740 1 --2- 172.21.15.132:0/217386846 >> [v2:172.21.15.179:6833/202618568,v1:172.21.15.179:6835/202618568] conn(0x56192a22b130 0x56192a1af2e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:28.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.636+0000 7f5b0af89740 1 --2- 172.21.15.132:0/217386846 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56192a194af0 0x56192a1895b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:28.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.636+0000 7f5b0af89740 1 --2- 172.21.15.132:0/217386846 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56192a17b080 0x56192a169f90 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:28.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.636+0000 7f5b0af89740 1 --2- 172.21.15.132:0/217386846 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56192a168670 0x56192a1c9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:28.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.636+0000 7f5ae17fa640 0 client.4686 ms_handle_reset on v2:172.21.15.179:6833/202618568 2024-04-16T15:52:28.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.636+0000 7f5b0af89740 1 -- 172.21.15.132:0/217386846 >> 172.21.15.132:0/217386846 conn(0x56192a164b10 msgr2=0x56192a1d3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:28.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.637+0000 7f5b0af89740 1 -- 172.21.15.132:0/217386846 shutdown_connections 2024-04-16T15:52:28.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.637+0000 7f5b0af89740 1 -- 172.21.15.132:0/217386846 wait complete. 2024-04-16T15:52:28.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.637+0000 7f5b0af89740 20 client.4686 trim_cache size 0 max 16384 2024-04-16T15:52:28.654 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-16T15:52:28.655 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_fsid": "6bdec5d9-f406-43ad-8584-0503b32f6f0d", 2024-04-16T15:52:28.655 INFO:teuthology.orchestra.run.smithi132.stdout: "whoami": 0, 2024-04-16T15:52:28.655 INFO:teuthology.orchestra.run.smithi132.stdout: "id": 4281, 2024-04-16T15:52:28.655 INFO:teuthology.orchestra.run.smithi132.stdout: "want_state": "up:active", 2024-04-16T15:52:28.655 INFO:teuthology.orchestra.run.smithi132.stdout: "state": "up:active", 2024-04-16T15:52:28.655 INFO:teuthology.orchestra.run.smithi132.stdout: "fs_name": "cephfs", 2024-04-16T15:52:28.655 INFO:teuthology.orchestra.run.smithi132.stdout: "rank_uptime": 12.684489315, 2024-04-16T15:52:28.655 INFO:teuthology.orchestra.run.smithi132.stdout: "mdsmap_epoch": 6, 2024-04-16T15:52:28.655 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_epoch": 20, 2024-04-16T15:52:28.655 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_epoch_barrier": 20, 2024-04-16T15:52:28.655 INFO:teuthology.orchestra.run.smithi132.stdout: "uptime": 19.725017694000002 2024-04-16T15:52:28.655 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-16T15:52:28.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.637+0000 7f5b0839d640 1 -- 172.21.15.132:0/1891308830 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f5ae406c8f0 msgr2=0x7f5ae406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:28.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.637+0000 7f5b0839d640 1 --2- 172.21.15.132:0/1891308830 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f5ae406c8f0 0x7f5ae406edb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5afc036000 tx=0x7f5afc03c040 comp rx=0 tx=0).stop 2024-04-16T15:52:28.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.637+0000 7f5b0839d640 1 -- 172.21.15.132:0/1891308830 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b0006be80 msgr2=0x7f5b0013beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:28.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.637+0000 7f5b0839d640 1 --2- 172.21.15.132:0/1891308830 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b0006be80 0x7f5b0013beb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5af000b3f0 tx=0x7f5af000b8b0 comp rx=0 tx=0).stop 2024-04-16T15:52:28.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.637+0000 7f5b0839d640 1 -- 172.21.15.132:0/1891308830 shutdown_connections 2024-04-16T15:52:28.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.637+0000 7f5b0839d640 1 --2- 172.21.15.132:0/1891308830 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f5ae406c8f0 0x7f5ae406edb0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:28.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.637+0000 7f5b0839d640 1 --2- 172.21.15.132:0/1891308830 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b00145c90 0x7f5b001e84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:28.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.637+0000 7f5b0839d640 1 --2- 172.21.15.132:0/1891308830 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b0006be80 0x7f5b0013beb0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:28.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.637+0000 7f5b0839d640 1 --2- 172.21.15.132:0/1891308830 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b0006ba20 0x7f5b0009dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:28.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.637+0000 7f5b0839d640 1 -- 172.21.15.132:0/1891308830 >> 172.21.15.132:0/1891308830 conn(0x7f5b0009aa30 msgr2=0x7f5b00160cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:28.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.637+0000 7f5b0839d640 1 -- 172.21.15.132:0/1891308830 shutdown_connections 2024-04-16T15:52:28.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.637+0000 7f5b0839d640 1 -- 172.21.15.132:0/1891308830 wait complete. 2024-04-16T15:52:28.658 INFO:teuthology.run_tasks:Running task sequential... 2024-04-16T15:52:28.668 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-16T15:52:28.668 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-16T15:52:28.669 INFO:teuthology.task.print:Enabling mgr modules 2024-04-16T15:52:28.669 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-16T15:52:28.700 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-16T15:52:28.700 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-04-16T15:52:28.700 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-16T15:52:28.701 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-16T15:52:28.701 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-16T15:52:28.701 INFO:tasks.ceph_fuse:client.2 config is {} 2024-04-16T15:52:28.701 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-16T15:52:28.701 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-16T15:52:28.701 INFO:tasks.ceph_fuse:client.1 config is {} 2024-04-16T15:52:28.701 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-16T15:52:28.701 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-16T15:52:28.701 INFO:tasks.ceph_fuse:client.3 config is {} 2024-04-16T15:52:28.701 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-16T15:52:28.701 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-16T15:52:28.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:52:28.702 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list 2024-04-16T15:52:28.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:52:28.718 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link delete ceph-brx 2024-04-16T15:52:28.788 INFO:teuthology.orchestra.run.smithi132.stderr:Cannot find device "ceph-brx" 2024-04-16T15:52:28.789 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T15:52:28.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:52:28.790 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2024-04-16T15:52:28.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:52:28.811 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link delete ceph-brx 2024-04-16T15:52:28.887 INFO:teuthology.orchestra.run.smithi179.stderr:Cannot find device "ceph-brx" 2024-04-16T15:52:28.888 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T15:52:28.888 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-16T15:52:28.889 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-16T15:52:28.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.992+0000 7f56f60d9640 1 Processor -- start 2024-04-16T15:52:28.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.992+0000 7f56f60d9640 1 -- start start 2024-04-16T15:52:28.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.993+0000 7f56f60d9640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f56f00b6060 0x7f56f00ce570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:28.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.993+0000 7f56f60d9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f56f00ceab0 0x7f56f01602b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:28.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.993+0000 7f56f60d9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56f0142070 con 0x7f56f013f7f0 2024-04-16T15:52:28.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.993+0000 7f56f60d9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f56f0142350 con 0x7f56f00ceab0 2024-04-16T15:52:28.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.993+0000 7f56f60d9640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f56f0142630 con 0x7f56f00b6060 2024-04-16T15:52:28.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.993+0000 7f56effff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f56f00ceab0 0x7f56f01602b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:28.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.993+0000 7f56ef7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f56f013f7f0 0x7f56f00b5950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47362/0 (socket says 172.21.15.132:47362) 2024-04-16T15:52:28.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.993+0000 7f56ef7fe640 1 -- 172.21.15.132:0/1539815122 learned_addr learned my addr 172.21.15.132:0/1539815122 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:28.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.993+0000 7f56effff640 1 -- 172.21.15.132:0/1539815122 >> v2:172.21.15.179:3300/0 conn(0x7f56f00b6060 msgr2=0x7f56f00ce570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:28.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.993+0000 7f56effff640 1 --2- 172.21.15.132:0/1539815122 >> v2:172.21.15.179:3300/0 conn(0x7f56f00b6060 0x7f56f00ce570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:28.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.993+0000 7f56effff640 1 -- 172.21.15.132:0/1539815122 >> v1:172.21.15.132:6789/0 conn(0x7f56f013f7f0 legacy=0x7f56f00b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:28.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.993+0000 7f56effff640 1 -- 172.21.15.132:0/1539815122 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56f00cef40 con 0x7f56f00ceab0 2024-04-16T15:52:28.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.993+0000 7f56ee7fc640 1 -- 172.21.15.132:0/1539815122 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3773244779 0 0) 0x7f56f0142070 con 0x7f56f013f7f0 2024-04-16T15:52:28.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.994+0000 7f56effff640 1 --2- 172.21.15.132:0/1539815122 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56f00ceab0 0x7f56f01602b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f56f006c8e0 tx=0x7f56e802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9dd2ab2e6cabc95 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:28.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.994+0000 7f56ee7fc640 1 -- 172.21.15.132:0/1539815122 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e8035020 con 0x7f56f00ceab0 2024-04-16T15:52:28.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.994+0000 7f56ee7fc640 1 -- 172.21.15.132:0/1539815122 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56e8031830 con 0x7f56f00ceab0 2024-04-16T15:52:28.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.994+0000 7f56ee7fc640 1 -- 172.21.15.132:0/1539815122 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e8031c00 con 0x7f56f00ceab0 2024-04-16T15:52:28.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.995+0000 7f56f60d9640 1 -- 172.21.15.132:0/1539815122 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56f00ceab0 msgr2=0x7f56f01602b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:28.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.995+0000 7f56f60d9640 1 --2- 172.21.15.132:0/1539815122 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56f00ceab0 0x7f56f01602b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f56f006c8e0 tx=0x7f56e802b8d0 comp rx=0 tx=0).stop 2024-04-16T15:52:28.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.995+0000 7f56f60d9640 1 -- 172.21.15.132:0/1539815122 shutdown_connections 2024-04-16T15:52:28.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.995+0000 7f56f60d9640 1 --2- 172.21.15.132:0/1539815122 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56f00ceab0 0x7f56f01602b0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:28.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.995+0000 7f56f60d9640 1 --2- 172.21.15.132:0/1539815122 >> v2:172.21.15.179:3300/0 conn(0x7f56f00b6060 0x7f56f00ce570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:28.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.995+0000 7f56f60d9640 1 -- 172.21.15.132:0/1539815122 >> 172.21.15.132:0/1539815122 conn(0x7f56f00b2d50 msgr2=0x7f56f006ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:28.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.995+0000 7f56f60d9640 1 -- 172.21.15.132:0/1539815122 shutdown_connections 2024-04-16T15:52:28.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.995+0000 7f56f60d9640 1 -- 172.21.15.132:0/1539815122 wait complete. 2024-04-16T15:52:28.996 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.997+0000 7f56f60d9640 1 Processor -- start 2024-04-16T15:52:28.996 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.997+0000 7f56f60d9640 1 -- start start 2024-04-16T15:52:28.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.998+0000 7f56f60d9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56f00b6060 0x7f56f0152aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:28.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.998+0000 7f56f60d9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56f00ceab0 0x7f56f0159b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:28.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.998+0000 7f56f60d9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56f013f7f0 0x7f56f01564b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:28.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.998+0000 7f56f60d9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f56f0160970 con 0x7f56f013f7f0 2024-04-16T15:52:28.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.998+0000 7f56f60d9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f56f01607f0 con 0x7f56f00b6060 2024-04-16T15:52:28.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.998+0000 7f56f60d9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f56f0160af0 con 0x7f56f00ceab0 2024-04-16T15:52:28.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.998+0000 7f56effff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56f013f7f0 0x7f56f01564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:28.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.998+0000 7f56effff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56f013f7f0 0x7f56f01564b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35708/0 (socket says 172.21.15.132:35708) 2024-04-16T15:52:28.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.998+0000 7f56effff640 1 -- 172.21.15.132:0/1720391861 learned_addr learned my addr 172.21.15.132:0/1720391861 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:28.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.998+0000 7f56ef7fe640 1 --2- 172.21.15.132:0/1720391861 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56f00b6060 0x7f56f0152aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:28.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.998+0000 7f56eeffd640 1 --2- 172.21.15.132:0/1720391861 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56f00ceab0 0x7f56f0159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:28.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.998+0000 7f56effff640 1 -- 172.21.15.132:0/1720391861 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56f00ceab0 msgr2=0x7f56f0159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:28.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.998+0000 7f56effff640 1 --2- 172.21.15.132:0/1720391861 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56f00ceab0 0x7f56f0159b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:29.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.998+0000 7f56effff640 1 -- 172.21.15.132:0/1720391861 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56f00b6060 msgr2=0x7f56f0152aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:29.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.998+0000 7f56effff640 1 --2- 172.21.15.132:0/1720391861 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56f00b6060 0x7f56f0152aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:29.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.998+0000 7f56effff640 1 -- 172.21.15.132:0/1720391861 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56f015a0d0 con 0x7f56f013f7f0 2024-04-16T15:52:29.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.999+0000 7f56effff640 1 --2- 172.21.15.132:0/1720391861 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56f013f7f0 0x7f56f01564b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f56e8009860 tx=0x7f56e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:29.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.999+0000 7f56d7fff640 1 -- 172.21.15.132:0/1720391861 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e8004230 con 0x7f56f013f7f0 2024-04-16T15:52:29.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.999+0000 7f56d7fff640 1 -- 172.21.15.132:0/1720391861 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56e80043d0 con 0x7f56f013f7f0 2024-04-16T15:52:29.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.999+0000 7f56f60d9640 1 -- 172.21.15.132:0/1720391861 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56f0155410 con 0x7f56f013f7f0 2024-04-16T15:52:29.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.999+0000 7f56d7fff640 1 -- 172.21.15.132:0/1720391861 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e803c8d0 con 0x7f56f013f7f0 2024-04-16T15:52:29.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:28.999+0000 7f56f60d9640 1 -- 172.21.15.132:0/1720391861 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56f01559d0 con 0x7f56f013f7f0 2024-04-16T15:52:29.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:29.000+0000 7f56f60d9640 1 -- 172.21.15.132:0/1720391861 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56f0075510 con 0x7f56f013f7f0 2024-04-16T15:52:29.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:29.000+0000 7f56d7fff640 1 -- 172.21.15.132:0/1720391861 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f56e8038020 con 0x7f56f013f7f0 2024-04-16T15:52:29.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:29.001+0000 7f56d7fff640 1 --2- 172.21.15.132:0/1720391861 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f56dc06c8f0 0x7f56dc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:29.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:29.001+0000 7f56d7fff640 1 -- 172.21.15.132:0/1720391861 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f56e80adc50 con 0x7f56f013f7f0 2024-04-16T15:52:29.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:29.001+0000 7f56ef7fe640 1 --2- 172.21.15.132:0/1720391861 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f56dc06c8f0 0x7f56dc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:29.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:29.001+0000 7f56ef7fe640 1 --2- 172.21.15.132:0/1720391861 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f56dc06c8f0 0x7f56dc06edb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f56e00012e0 tx=0x7f56e0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:29.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:29.005+0000 7f56d7fff640 1 -- 172.21.15.132:0/1720391861 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f56e80b3020 con 0x7f56f013f7f0 2024-04-16T15:52:29.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:29.218+0000 7f56f60d9640 1 -- 172.21.15.132:0/1720391861 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f56f00b0fb0 con 0x7f56f013f7f0 2024-04-16T15:52:29.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:29.218+0000 7f56d7fff640 1 -- 172.21.15.132:0/1720391861 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7f56e8041070 con 0x7f56f013f7f0 2024-04-16T15:52:29.218 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-16T15:52:29.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:29.220+0000 7f56f60d9640 1 -- 172.21.15.132:0/1720391861 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f56dc06c8f0 msgr2=0x7f56dc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:29.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:29.220+0000 7f56f60d9640 1 --2- 172.21.15.132:0/1720391861 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f56dc06c8f0 0x7f56dc06edb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f56e00012e0 tx=0x7f56e0009040 comp rx=0 tx=0).stop 2024-04-16T15:52:29.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:29.220+0000 7f56f60d9640 1 -- 172.21.15.132:0/1720391861 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56f013f7f0 msgr2=0x7f56f01564b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:29.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:29.220+0000 7f56f60d9640 1 --2- 172.21.15.132:0/1720391861 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56f013f7f0 0x7f56f01564b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f56e8009860 tx=0x7f56e80046c0 comp rx=0 tx=0).stop 2024-04-16T15:52:29.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:29.220+0000 7f56f60d9640 1 -- 172.21.15.132:0/1720391861 shutdown_connections 2024-04-16T15:52:29.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:29.220+0000 7f56f60d9640 1 --2- 172.21.15.132:0/1720391861 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f56dc06c8f0 0x7f56dc06edb0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:29.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:29.220+0000 7f56f60d9640 1 --2- 172.21.15.132:0/1720391861 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56f013f7f0 0x7f56f01564b0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:29.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:29.220+0000 7f56f60d9640 1 --2- 172.21.15.132:0/1720391861 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56f00ceab0 0x7f56f0159b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:29.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:29.220+0000 7f56f60d9640 1 --2- 172.21.15.132:0/1720391861 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56f00b6060 0x7f56f0152aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:29.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:29.220+0000 7f56f60d9640 1 -- 172.21.15.132:0/1720391861 >> 172.21.15.132:0/1720391861 conn(0x7f56f00b2d50 msgr2=0x7f56f00b1850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:29.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:29.220+0000 7f56f60d9640 1 -- 172.21.15.132:0/1720391861 shutdown_connections 2024-04-16T15:52:29.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:29.220+0000 7f56f60d9640 1 -- 172.21.15.132:0/1720391861 wait complete. 2024-04-16T15:52:29.231 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-16T15:52:29.231 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-16T15:52:29.231 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi132.front.sepia.ceph.com 2024-04-16T15:52:29.231 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-16T15:52:29.231 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-16T15:52:29.231 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-16T15:52:29.231 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-16T15:52:29.231 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-16T15:52:29.231 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-16T15:52:29.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:52:29.232 DEBUG:teuthology.orchestra.run.smithi132:> ip addr 2024-04-16T15:52:29.248 INFO:teuthology.orchestra.run.smithi132.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-16T15:52:29.248 INFO:teuthology.orchestra.run.smithi132.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-16T15:52:29.248 INFO:teuthology.orchestra.run.smithi132.stdout: inet 127.0.0.1/8 scope host lo 2024-04-16T15:52:29.248 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:52:29.248 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 ::1/128 scope host 2024-04-16T15:52:29.248 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:52:29.248 INFO:teuthology.orchestra.run.smithi132.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T15:52:29.248 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cc brd ff:ff:ff:ff:ff:ff 2024-04-16T15:52:29.248 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f0 2024-04-16T15:52:29.248 INFO:teuthology.orchestra.run.smithi132.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T15:52:29.249 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cd brd ff:ff:ff:ff:ff:ff 2024-04-16T15:52:29.249 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f1 2024-04-16T15:52:29.249 INFO:teuthology.orchestra.run.smithi132.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T15:52:29.249 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3e brd ff:ff:ff:ff:ff:ff 2024-04-16T15:52:29.249 INFO:teuthology.orchestra.run.smithi132.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-16T15:52:29.249 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3f brd ff:ff:ff:ff:ff:ff 2024-04-16T15:52:29.249 INFO:teuthology.orchestra.run.smithi132.stdout: inet 172.21.15.132/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-16T15:52:29.249 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft 42735sec preferred_lft 42735sec 2024-04-16T15:52:29.249 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::ec4:7aff:fe88:773f/64 scope link 2024-04-16T15:52:29.249 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:52:29.250 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-16T15:52:29.250 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T15:52:29.250 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2024-04-16T15:52:29.250 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link add name ceph-brx type bridge 2024-04-16T15:52:29.250 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip addr flush dev ceph-brx 2024-04-16T15:52:29.250 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set ceph-brx up 2024-04-16T15:52:29.250 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-16T15:52:29.250 DEBUG:teuthology.orchestra.run.smithi132:> ') 2024-04-16T15:52:29.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T15:52:29.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T15:52:29.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:52:29.457 DEBUG:teuthology.orchestra.run.smithi132:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-16T15:52:29.486 INFO:teuthology.orchestra.run.smithi132.stdout:1 2024-04-16T15:52:29.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:52:29.488 DEBUG:teuthology.orchestra.run.smithi132:> route 2024-04-16T15:52:29.558 INFO:teuthology.orchestra.run.smithi132.stdout:Kernel IP routing table 2024-04-16T15:52:29.559 INFO:teuthology.orchestra.run.smithi132.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-16T15:52:29.559 INFO:teuthology.orchestra.run.smithi132.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-16T15:52:29.559 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-16T15:52:29.559 INFO:teuthology.orchestra.run.smithi132.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-16T15:52:29.559 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T15:52:29.559 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2024-04-16T15:52:29.559 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-16T15:52:29.559 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-16T15:52:29.560 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-16T15:52:29.560 DEBUG:teuthology.orchestra.run.smithi132:> ') 2024-04-16T15:52:29.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T15:52:29.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T15:52:29.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:52:29.863 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list 2024-04-16T15:52:29.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:52:29.879 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list-id 2024-04-16T15:52:29.934 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T15:52:29.935 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2024-04-16T15:52:29.935 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-16T15:52:29.935 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-16T15:52:29.935 DEBUG:teuthology.orchestra.run.smithi132:> ') 2024-04-16T15:52:30.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T15:52:30.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T15:52:30.060 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-16T15:52:30.060 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T15:52:30.061 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2024-04-16T15:52:30.061 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-16T15:52:30.061 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-16T15:52:30.061 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-16T15:52:30.061 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-16T15:52:30.061 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-16T15:52:30.061 DEBUG:teuthology.orchestra.run.smithi132:> ') 2024-04-16T15:52:30.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T15:52:30.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T15:52:30.204 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T15:52:30.204 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2024-04-16T15:52:30.204 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set brx.0 up 2024-04-16T15:52:30.204 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set dev brx.0 master ceph-brx 2024-04-16T15:52:30.205 DEBUG:teuthology.orchestra.run.smithi132:> ') 2024-04-16T15:52:30.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T15:52:30.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T15:52:30.288 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-16T15:52:30.288 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T15:52:30.289 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-16T15:52:30.304 INFO:teuthology.orchestra.run.smithi132.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-16T15:52:30.304 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T15:52:30.305 DEBUG:teuthology.orchestra.run.smithi132:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-16T15:52:30.357 DEBUG:teuthology.orchestra.run.smithi132:> sudo modprobe fuse 2024-04-16T15:52:30.427 DEBUG:teuthology.orchestra.run.smithi132:> cat /proc/self/mounts | awk '{print $2}' 2024-04-16T15:52:30.483 INFO:teuthology.orchestra.run.smithi132.stdout:/proc 2024-04-16T15:52:30.483 INFO:teuthology.orchestra.run.smithi132.stdout:/sys 2024-04-16T15:52:30.483 INFO:teuthology.orchestra.run.smithi132.stdout:/dev 2024-04-16T15:52:30.483 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/kernel/security 2024-04-16T15:52:30.483 INFO:teuthology.orchestra.run.smithi132.stdout:/dev/shm 2024-04-16T15:52:30.483 INFO:teuthology.orchestra.run.smithi132.stdout:/dev/pts 2024-04-16T15:52:30.483 INFO:teuthology.orchestra.run.smithi132.stdout:/run 2024-04-16T15:52:30.483 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/fs/cgroup 2024-04-16T15:52:30.483 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/fs/pstore 2024-04-16T15:52:30.483 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/fs/bpf 2024-04-16T15:52:30.483 INFO:teuthology.orchestra.run.smithi132.stdout:/ 2024-04-16T15:52:30.484 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/fs/selinux 2024-04-16T15:52:30.484 INFO:teuthology.orchestra.run.smithi132.stdout:/proc/sys/fs/binfmt_misc 2024-04-16T15:52:30.484 INFO:teuthology.orchestra.run.smithi132.stdout:/dev/mqueue 2024-04-16T15:52:30.484 INFO:teuthology.orchestra.run.smithi132.stdout:/dev/hugepages 2024-04-16T15:52:30.484 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/kernel/debug 2024-04-16T15:52:30.484 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/kernel/tracing 2024-04-16T15:52:30.484 INFO:teuthology.orchestra.run.smithi132.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-16T15:52:30.484 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/fs/fuse/connections 2024-04-16T15:52:30.484 INFO:teuthology.orchestra.run.smithi132.stdout:/run/credentials/systemd-sysctl.service 2024-04-16T15:52:30.484 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/kernel/config 2024-04-16T15:52:30.484 INFO:teuthology.orchestra.run.smithi132.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-16T15:52:30.484 INFO:teuthology.orchestra.run.smithi132.stdout:/var/lib/nfs/rpc_pipefs 2024-04-16T15:52:30.484 INFO:teuthology.orchestra.run.smithi132.stdout:/run/user/1000 2024-04-16T15:52:30.484 INFO:teuthology.orchestra.run.smithi132.stdout:/var/lib/ceph 2024-04-16T15:52:30.485 INFO:teuthology.orchestra.run.smithi132.stdout:/var/lib/ceph/osd/ceph-0 2024-04-16T15:52:30.485 INFO:teuthology.orchestra.run.smithi132.stdout:/var/lib/ceph/osd/ceph-1 2024-04-16T15:52:30.485 INFO:teuthology.orchestra.run.smithi132.stdout:/var/lib/ceph/osd/ceph-2 2024-04-16T15:52:30.485 INFO:teuthology.orchestra.run.smithi132.stdout:/var/lib/ceph/osd/ceph-3 2024-04-16T15:52:30.485 INFO:teuthology.orchestra.run.smithi132.stdout:/run/netns 2024-04-16T15:52:30.485 INFO:teuthology.orchestra.run.smithi132.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-16T15:52:30.485 INFO:teuthology.orchestra.run.smithi132.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-16T15:52:30.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:52:30.486 DEBUG:teuthology.orchestra.run.smithi132:> ls /sys/fs/fuse/connections 2024-04-16T15:52:30.541 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-16T15:52:30.542 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-16T15:52:30.584 DEBUG:teuthology.orchestra.run.smithi132:> sudo modprobe fuse 2024-04-16T15:52:30.612 DEBUG:teuthology.orchestra.run.smithi132:> cat /proc/self/mounts | awk '{print $2}' 2024-04-16T15:52:30.669 INFO:teuthology.orchestra.run.smithi132.stdout:/proc 2024-04-16T15:52:30.669 INFO:teuthology.orchestra.run.smithi132.stdout:/sys 2024-04-16T15:52:30.669 INFO:teuthology.orchestra.run.smithi132.stdout:/dev 2024-04-16T15:52:30.670 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/kernel/security 2024-04-16T15:52:30.670 INFO:teuthology.orchestra.run.smithi132.stdout:/dev/shm 2024-04-16T15:52:30.670 INFO:teuthology.orchestra.run.smithi132.stdout:/dev/pts 2024-04-16T15:52:30.670 INFO:teuthology.orchestra.run.smithi132.stdout:/run 2024-04-16T15:52:30.670 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/fs/cgroup 2024-04-16T15:52:30.670 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/fs/pstore 2024-04-16T15:52:30.670 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/fs/bpf 2024-04-16T15:52:30.670 INFO:teuthology.orchestra.run.smithi132.stdout:/ 2024-04-16T15:52:30.670 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/fs/selinux 2024-04-16T15:52:30.670 INFO:teuthology.orchestra.run.smithi132.stdout:/proc/sys/fs/binfmt_misc 2024-04-16T15:52:30.670 INFO:teuthology.orchestra.run.smithi132.stdout:/dev/mqueue 2024-04-16T15:52:30.671 INFO:teuthology.orchestra.run.smithi132.stdout:/dev/hugepages 2024-04-16T15:52:30.671 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/kernel/debug 2024-04-16T15:52:30.671 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/kernel/tracing 2024-04-16T15:52:30.671 INFO:teuthology.orchestra.run.smithi132.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-16T15:52:30.671 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/fs/fuse/connections 2024-04-16T15:52:30.671 INFO:teuthology.orchestra.run.smithi132.stdout:/run/credentials/systemd-sysctl.service 2024-04-16T15:52:30.671 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/kernel/config 2024-04-16T15:52:30.671 INFO:teuthology.orchestra.run.smithi132.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-16T15:52:30.671 INFO:teuthology.orchestra.run.smithi132.stdout:/var/lib/nfs/rpc_pipefs 2024-04-16T15:52:30.671 INFO:teuthology.orchestra.run.smithi132.stdout:/run/user/1000 2024-04-16T15:52:30.671 INFO:teuthology.orchestra.run.smithi132.stdout:/var/lib/ceph 2024-04-16T15:52:30.671 INFO:teuthology.orchestra.run.smithi132.stdout:/var/lib/ceph/osd/ceph-0 2024-04-16T15:52:30.671 INFO:teuthology.orchestra.run.smithi132.stdout:/var/lib/ceph/osd/ceph-1 2024-04-16T15:52:30.671 INFO:teuthology.orchestra.run.smithi132.stdout:/var/lib/ceph/osd/ceph-2 2024-04-16T15:52:30.671 INFO:teuthology.orchestra.run.smithi132.stdout:/var/lib/ceph/osd/ceph-3 2024-04-16T15:52:30.672 INFO:teuthology.orchestra.run.smithi132.stdout:/run/netns 2024-04-16T15:52:30.672 INFO:teuthology.orchestra.run.smithi132.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-16T15:52:30.672 INFO:teuthology.orchestra.run.smithi132.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-16T15:52:30.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:52:30.672 DEBUG:teuthology.orchestra.run.smithi132:> ls /sys/fs/fuse/connections 2024-04-16T15:52:30.674 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi132.stderr:2024-04-16T15:52:30.675+0000 7fb9257b8480 -1 init, newargv = 0x5643df268370 newargc=15 2024-04-16T15:52:30.674 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi132.stderr:ceph-fuse[46342]: starting ceph client 2024-04-16T15:52:30.679 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi132.stderr:ceph-fuse[46342]: starting fuse 2024-04-16T15:52:30.690 INFO:teuthology.orchestra.run.smithi132.stdout:41 2024-04-16T15:52:30.690 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-04-16T15:52:30.690 DEBUG:teuthology.orchestra.run.smithi132:> sudo stdin-killer -- python3 -c ' 2024-04-16T15:52:30.691 DEBUG:teuthology.orchestra.run.smithi132:> import glob 2024-04-16T15:52:30.691 DEBUG:teuthology.orchestra.run.smithi132:> import re 2024-04-16T15:52:30.691 DEBUG:teuthology.orchestra.run.smithi132:> import os 2024-04-16T15:52:30.691 DEBUG:teuthology.orchestra.run.smithi132:> import subprocess 2024-04-16T15:52:30.691 DEBUG:teuthology.orchestra.run.smithi132:> 2024-04-16T15:52:30.691 DEBUG:teuthology.orchestra.run.smithi132:> def _find_admin_socket(client_name): 2024-04-16T15:52:30.691 DEBUG:teuthology.orchestra.run.smithi132:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-16T15:52:30.691 DEBUG:teuthology.orchestra.run.smithi132:> files = glob.glob(asok_path) 2024-04-16T15:52:30.691 DEBUG:teuthology.orchestra.run.smithi132:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-16T15:52:30.691 DEBUG:teuthology.orchestra.run.smithi132:> 2024-04-16T15:52:30.691 DEBUG:teuthology.orchestra.run.smithi132:> # Given a non-glob path, it better be there 2024-04-16T15:52:30.691 DEBUG:teuthology.orchestra.run.smithi132:> if "*" not in asok_path: 2024-04-16T15:52:30.691 DEBUG:teuthology.orchestra.run.smithi132:> assert(len(files) == 1) 2024-04-16T15:52:30.691 DEBUG:teuthology.orchestra.run.smithi132:> return files[0] 2024-04-16T15:52:30.691 DEBUG:teuthology.orchestra.run.smithi132:> 2024-04-16T15:52:30.691 DEBUG:teuthology.orchestra.run.smithi132:> for f in files: 2024-04-16T15:52:30.691 DEBUG:teuthology.orchestra.run.smithi132:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-16T15:52:30.692 DEBUG:teuthology.orchestra.run.smithi132:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-16T15:52:30.692 DEBUG:teuthology.orchestra.run.smithi132:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-16T15:52:30.692 DEBUG:teuthology.orchestra.run.smithi132:> contents = proc_f.read() 2024-04-16T15:52:30.692 DEBUG:teuthology.orchestra.run.smithi132:> if mountpoint in contents: 2024-04-16T15:52:30.692 DEBUG:teuthology.orchestra.run.smithi132:> return f 2024-04-16T15:52:30.692 DEBUG:teuthology.orchestra.run.smithi132:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-16T15:52:30.692 DEBUG:teuthology.orchestra.run.smithi132:> 2024-04-16T15:52:30.692 DEBUG:teuthology.orchestra.run.smithi132:> print(_find_admin_socket("client.0")) 2024-04-16T15:52:30.692 DEBUG:teuthology.orchestra.run.smithi132:> ' 2024-04-16T15:52:30.811 INFO:teuthology.orchestra.run.smithi132.stdout:/var/run/ceph/ceph-client.0.46342.asok 2024-04-16T15:52:30.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T15:52:30.821 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.46342.asok 2024-04-16T15:52:30.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:52:30.822 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.46342.asok status 2024-04-16T15:52:30.961 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-16T15:52:30.962 INFO:teuthology.orchestra.run.smithi132.stdout: "metadata": { 2024-04-16T15:52:30.962 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_sha1": "c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f", 2024-04-16T15:52:30.962 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_version": "ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev)", 2024-04-16T15:52:30.962 INFO:teuthology.orchestra.run.smithi132.stdout: "entity_id": "0", 2024-04-16T15:52:30.962 INFO:teuthology.orchestra.run.smithi132.stdout: "hostname": "smithi132", 2024-04-16T15:52:30.962 INFO:teuthology.orchestra.run.smithi132.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-16T15:52:30.962 INFO:teuthology.orchestra.run.smithi132.stdout: "pid": "46342", 2024-04-16T15:52:30.962 INFO:teuthology.orchestra.run.smithi132.stdout: "root": "/" 2024-04-16T15:52:30.962 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-16T15:52:30.962 INFO:teuthology.orchestra.run.smithi132.stdout: "dentry_count": 0, 2024-04-16T15:52:30.962 INFO:teuthology.orchestra.run.smithi132.stdout: "dentry_pinned_count": 0, 2024-04-16T15:52:30.962 INFO:teuthology.orchestra.run.smithi132.stdout: "id": 4701, 2024-04-16T15:52:30.963 INFO:teuthology.orchestra.run.smithi132.stdout: "inst": { 2024-04-16T15:52:30.963 INFO:teuthology.orchestra.run.smithi132.stdout: "name": { 2024-04-16T15:52:30.963 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "client", 2024-04-16T15:52:30.963 INFO:teuthology.orchestra.run.smithi132.stdout: "num": 4701 2024-04-16T15:52:30.963 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-16T15:52:30.963 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": { 2024-04-16T15:52:30.963 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2024-04-16T15:52:30.963 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "192.168.0.1:0", 2024-04-16T15:52:30.963 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 3319166908 2024-04-16T15:52:30.963 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-16T15:52:30.963 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-16T15:52:30.963 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": { 2024-04-16T15:52:30.963 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2024-04-16T15:52:30.963 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "192.168.0.1:0", 2024-04-16T15:52:30.963 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 3319166908 2024-04-16T15:52:30.964 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-16T15:52:30.964 INFO:teuthology.orchestra.run.smithi132.stdout: "inst_str": "client.4701 192.168.0.1:0/3319166908", 2024-04-16T15:52:30.964 INFO:teuthology.orchestra.run.smithi132.stdout: "addr_str": "192.168.0.1:0/3319166908", 2024-04-16T15:52:30.964 INFO:teuthology.orchestra.run.smithi132.stdout: "inode_count": 1, 2024-04-16T15:52:30.964 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_epoch": 6, 2024-04-16T15:52:30.964 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_epoch": 20, 2024-04-16T15:52:30.964 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_epoch_barrier": 0, 2024-04-16T15:52:30.964 INFO:teuthology.orchestra.run.smithi132.stdout: "blocklisted": false, 2024-04-16T15:52:30.964 INFO:teuthology.orchestra.run.smithi132.stdout: "fs_name": "cephfs" 2024-04-16T15:52:30.964 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-16T15:52:30.970 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-16T15:52:31.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.074+0000 7f4e4920d640 1 Processor -- start 2024-04-16T15:52:31.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.074+0000 7f4e4920d640 1 -- start start 2024-04-16T15:52:31.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.075+0000 7f4e4920d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4e44146200 0x7f4e4415e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:31.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.075+0000 7f4e4920d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e4415f920 0x7f4e4415fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:31.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.075+0000 7f4e4920d640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e441465e0 con 0x7f4e44071650 2024-04-16T15:52:31.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.075+0000 7f4e4920d640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f4e4415e880 con 0x7f4e44146200 2024-04-16T15:52:31.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.075+0000 7f4e4920d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f4e4415eb60 con 0x7f4e4415f920 2024-04-16T15:52:31.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.075+0000 7f4e42d9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4e44146200 0x7f4e4415e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:31.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.075+0000 7f4e42d9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4e44146200 0x7f4e4415e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35718/0 (socket says 172.21.15.132:35718) 2024-04-16T15:52:31.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.075+0000 7f4e42d9d640 1 -- 172.21.15.132:0/4134233145 learned_addr learned my addr 172.21.15.132:0/4134233145 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:31.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.075+0000 7f4e42d9d640 1 -- 172.21.15.132:0/4134233145 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e4415f920 msgr2=0x7f4e4415fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:31.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.075+0000 7f4e42d9d640 1 --2- 172.21.15.132:0/4134233145 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e4415f920 0x7f4e4415fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:31.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.075+0000 7f4e42d9d640 1 -- 172.21.15.132:0/4134233145 >> v1:172.21.15.179:6789/0 conn(0x7f4e44071650 legacy=0x7f4e440a9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:31.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.075+0000 7f4e42d9d640 1 -- 172.21.15.132:0/4134233145 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e4415ee40 con 0x7f4e44146200 2024-04-16T15:52:31.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.076+0000 7f4e42d9d640 1 --2- 172.21.15.132:0/4134233145 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e44146200 0x7f4e4415e030 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4e34009870 tx=0x7f4e3402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aacf2a5b6297300 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:31.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.076+0000 7f4e41d9b640 1 -- 172.21.15.132:0/4134233145 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e340317c0 con 0x7f4e44146200 2024-04-16T15:52:31.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.076+0000 7f4e41d9b640 1 -- 172.21.15.132:0/4134233145 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e34037070 con 0x7f4e44146200 2024-04-16T15:52:31.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.076+0000 7f4e41d9b640 1 -- 172.21.15.132:0/4134233145 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e34031b80 con 0x7f4e44146200 2024-04-16T15:52:31.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.077+0000 7f4e4920d640 1 -- 172.21.15.132:0/4134233145 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e44146200 msgr2=0x7f4e4415e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:31.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.077+0000 7f4e4920d640 1 --2- 172.21.15.132:0/4134233145 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e44146200 0x7f4e4415e030 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4e34009870 tx=0x7f4e3402b860 comp rx=0 tx=0).stop 2024-04-16T15:52:31.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.077+0000 7f4e4920d640 1 -- 172.21.15.132:0/4134233145 shutdown_connections 2024-04-16T15:52:31.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.077+0000 7f4e4920d640 1 --2- 172.21.15.132:0/4134233145 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e4415f920 0x7f4e4415fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:31.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.077+0000 7f4e4920d640 1 --2- 172.21.15.132:0/4134233145 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e44146200 0x7f4e4415e030 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:31.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.077+0000 7f4e4920d640 1 -- 172.21.15.132:0/4134233145 >> 172.21.15.132:0/4134233145 conn(0x7f4e4406f100 msgr2=0x7f4e4406f510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:31.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.077+0000 7f4e4920d640 1 -- 172.21.15.132:0/4134233145 shutdown_connections 2024-04-16T15:52:31.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.077+0000 7f4e4920d640 1 -- 172.21.15.132:0/4134233145 wait complete. 2024-04-16T15:52:31.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.078+0000 7f4e4920d640 1 Processor -- start 2024-04-16T15:52:31.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.078+0000 7f4e4920d640 1 -- start start 2024-04-16T15:52:31.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.079+0000 7f4e4920d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e44071650 0x7f4e44141190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:31.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.079+0000 7f4e4920d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e44146200 0x7f4e440aecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:31.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.079+0000 7f4e4920d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e4415f920 0x7f4e440af230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:31.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.079+0000 7f4e4920d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f4e4415e570 con 0x7f4e44146200 2024-04-16T15:52:31.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.079+0000 7f4e4920d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4e4415f400 con 0x7f4e44071650 2024-04-16T15:52:31.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.079+0000 7f4e4920d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f4e440a9ba0 con 0x7f4e4415f920 2024-04-16T15:52:31.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.079+0000 7f4e4259c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e44146200 0x7f4e440aecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:31.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.079+0000 7f4e4259c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e44146200 0x7f4e440aecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35732/0 (socket says 172.21.15.132:35732) 2024-04-16T15:52:31.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.079+0000 7f4e4259c640 1 -- 172.21.15.132:0/3295720034 learned_addr learned my addr 172.21.15.132:0/3295720034 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:31.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.079+0000 7f4e4359e640 1 --2- 172.21.15.132:0/3295720034 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e4415f920 0x7f4e440af230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:31.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.079+0000 7f4e4259c640 1 -- 172.21.15.132:0/3295720034 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e4415f920 msgr2=0x7f4e440af230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:31.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.079+0000 7f4e4259c640 1 --2- 172.21.15.132:0/3295720034 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e4415f920 0x7f4e440af230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:31.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.079+0000 7f4e42d9d640 1 --2- 172.21.15.132:0/3295720034 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e44071650 0x7f4e44141190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:31.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.079+0000 7f4e4259c640 1 -- 172.21.15.132:0/3295720034 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e44071650 msgr2=0x7f4e44141190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:31.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.079+0000 7f4e4259c640 1 --2- 172.21.15.132:0/3295720034 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e44071650 0x7f4e44141190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:31.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.079+0000 7f4e4259c640 1 -- 172.21.15.132:0/3295720034 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e440b53e0 con 0x7f4e44146200 2024-04-16T15:52:31.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.080+0000 7f4e4259c640 1 --2- 172.21.15.132:0/3295720034 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e44146200 0x7f4e440aecf0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4e3800c410 tx=0x7f4e3800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:31.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.080+0000 7f4e2b7fe640 1 -- 172.21.15.132:0/3295720034 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e38017070 con 0x7f4e44146200 2024-04-16T15:52:31.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.080+0000 7f4e2b7fe640 1 -- 172.21.15.132:0/3295720034 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e380035f0 con 0x7f4e44146200 2024-04-16T15:52:31.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.080+0000 7f4e4920d640 1 -- 172.21.15.132:0/3295720034 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e440b56c0 con 0x7f4e44146200 2024-04-16T15:52:31.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.080+0000 7f4e2b7fe640 1 -- 172.21.15.132:0/3295720034 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e38003a20 con 0x7f4e44146200 2024-04-16T15:52:31.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.080+0000 7f4e4920d640 1 -- 172.21.15.132:0/3295720034 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e440b5c80 con 0x7f4e44146200 2024-04-16T15:52:31.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.081+0000 7f4e4920d640 1 -- 172.21.15.132:0/3295720034 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e44075510 con 0x7f4e44146200 2024-04-16T15:52:31.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.081+0000 7f4e2b7fe640 1 -- 172.21.15.132:0/3295720034 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4e3801a070 con 0x7f4e44146200 2024-04-16T15:52:31.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.082+0000 7f4e2b7fe640 1 --2- 172.21.15.132:0/3295720034 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f4e3006c8f0 0x7f4e3006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:31.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.082+0000 7f4e2b7fe640 1 -- 172.21.15.132:0/3295720034 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4e3808b000 con 0x7f4e44146200 2024-04-16T15:52:31.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.082+0000 7f4e42d9d640 1 --2- 172.21.15.132:0/3295720034 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f4e3006c8f0 0x7f4e3006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:31.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.082+0000 7f4e42d9d640 1 --2- 172.21.15.132:0/3295720034 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f4e3006c8f0 0x7f4e3006edb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4e34036000 tx=0x7f4e34008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:31.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.086+0000 7f4e2b7fe640 1 -- 172.21.15.132:0/3295720034 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4e38059430 con 0x7f4e44146200 2024-04-16T15:52:31.300 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.301+0000 7f4e4920d640 1 -- 172.21.15.132:0/3295720034 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f4e4406ffe0 con 0x7f4e44146200 2024-04-16T15:52:31.300 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.301+0000 7f4e2b7fe640 1 -- 172.21.15.132:0/3295720034 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7f4e38058d30 con 0x7f4e44146200 2024-04-16T15:52:31.301 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-16T15:52:31.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.303+0000 7f4e4920d640 1 -- 172.21.15.132:0/3295720034 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f4e3006c8f0 msgr2=0x7f4e3006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:31.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.303+0000 7f4e4920d640 1 --2- 172.21.15.132:0/3295720034 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f4e3006c8f0 0x7f4e3006edb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4e34036000 tx=0x7f4e34008030 comp rx=0 tx=0).stop 2024-04-16T15:52:31.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.303+0000 7f4e4920d640 1 -- 172.21.15.132:0/3295720034 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e44146200 msgr2=0x7f4e440aecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:31.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.303+0000 7f4e4920d640 1 --2- 172.21.15.132:0/3295720034 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e44146200 0x7f4e440aecf0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4e3800c410 tx=0x7f4e3800c8d0 comp rx=0 tx=0).stop 2024-04-16T15:52:31.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.304+0000 7f4e4920d640 1 -- 172.21.15.132:0/3295720034 shutdown_connections 2024-04-16T15:52:31.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.304+0000 7f4e4920d640 1 --2- 172.21.15.132:0/3295720034 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f4e3006c8f0 0x7f4e3006edb0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:31.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.304+0000 7f4e4920d640 1 --2- 172.21.15.132:0/3295720034 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e4415f920 0x7f4e440af230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:31.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.304+0000 7f4e4920d640 1 --2- 172.21.15.132:0/3295720034 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e44146200 0x7f4e440aecf0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:31.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.304+0000 7f4e4920d640 1 --2- 172.21.15.132:0/3295720034 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e44071650 0x7f4e44141190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:31.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.304+0000 7f4e4920d640 1 -- 172.21.15.132:0/3295720034 >> 172.21.15.132:0/3295720034 conn(0x7f4e4406f100 msgr2=0x7f4e44142f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:31.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.304+0000 7f4e4920d640 1 -- 172.21.15.132:0/3295720034 shutdown_connections 2024-04-16T15:52:31.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31.304+0000 7f4e4920d640 1 -- 172.21.15.132:0/3295720034 wait complete. 2024-04-16T15:52:31.314 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-16T15:52:31.314 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-16T15:52:31.314 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi132.front.sepia.ceph.com 2024-04-16T15:52:31.314 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-04-16T15:52:31.314 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-16T15:52:31.314 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-16T15:52:31.314 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-16T15:52:31.314 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-16T15:52:31.314 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-04-16T15:52:31.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:52:31.314 DEBUG:teuthology.orchestra.run.smithi132:> ip addr 2024-04-16T15:52:31.330 INFO:teuthology.orchestra.run.smithi132.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-16T15:52:31.330 INFO:teuthology.orchestra.run.smithi132.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-16T15:52:31.330 INFO:teuthology.orchestra.run.smithi132.stdout: inet 127.0.0.1/8 scope host lo 2024-04-16T15:52:31.330 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:52:31.331 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 ::1/128 scope host 2024-04-16T15:52:31.331 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:52:31.331 INFO:teuthology.orchestra.run.smithi132.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T15:52:31.331 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cc brd ff:ff:ff:ff:ff:ff 2024-04-16T15:52:31.331 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f0 2024-04-16T15:52:31.331 INFO:teuthology.orchestra.run.smithi132.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T15:52:31.331 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cd brd ff:ff:ff:ff:ff:ff 2024-04-16T15:52:31.331 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f1 2024-04-16T15:52:31.331 INFO:teuthology.orchestra.run.smithi132.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T15:52:31.331 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3e brd ff:ff:ff:ff:ff:ff 2024-04-16T15:52:31.331 INFO:teuthology.orchestra.run.smithi132.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-16T15:52:31.331 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3f brd ff:ff:ff:ff:ff:ff 2024-04-16T15:52:31.331 INFO:teuthology.orchestra.run.smithi132.stdout: inet 172.21.15.132/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-16T15:52:31.332 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft 42732sec preferred_lft 42732sec 2024-04-16T15:52:31.332 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::ec4:7aff:fe88:773f/64 scope link 2024-04-16T15:52:31.332 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:52:31.332 INFO:teuthology.orchestra.run.smithi132.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-16T15:52:31.332 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether b6:b8:87:f5:52:5a brd ff:ff:ff:ff:ff:ff 2024-04-16T15:52:31.332 INFO:teuthology.orchestra.run.smithi132.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-16T15:52:31.332 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:52:31.332 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::a427:18ff:fe14:6296/64 scope link 2024-04-16T15:52:31.332 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:52:31.332 INFO:teuthology.orchestra.run.smithi132.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-16T15:52:31.332 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether b6:b8:87:f5:52:5a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-16T15:52:31.332 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::b4b8:87ff:fef5:525a/64 scope link tentative 2024-04-16T15:52:31.332 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:52:31.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:52:31.333 DEBUG:teuthology.orchestra.run.smithi132:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-16T15:52:31.398 INFO:teuthology.orchestra.run.smithi132.stdout:1 2024-04-16T15:52:31.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:52:31.400 DEBUG:teuthology.orchestra.run.smithi132:> route 2024-04-16T15:52:31.456 INFO:teuthology.orchestra.run.smithi132.stdout:Kernel IP routing table 2024-04-16T15:52:31.457 INFO:teuthology.orchestra.run.smithi132.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-16T15:52:31.457 INFO:teuthology.orchestra.run.smithi132.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-16T15:52:31.457 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-16T15:52:31.457 INFO:teuthology.orchestra.run.smithi132.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-16T15:52:31.457 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T15:52:31.457 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2024-04-16T15:52:31.458 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-16T15:52:31.458 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-16T15:52:31.458 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-16T15:52:31.458 DEBUG:teuthology.orchestra.run.smithi132:> ') 2024-04-16T15:52:31.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T15:52:31.590 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T15:52:31.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:52:31.596 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list 2024-04-16T15:52:31.611 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-16T15:52:31.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:52:31.612 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list-id 2024-04-16T15:52:31.667 INFO:teuthology.orchestra.run.smithi132.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-04-16T15:52:31.668 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T15:52:31.668 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2024-04-16T15:52:31.668 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-16T15:52:31.668 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-04-16T15:52:31.668 DEBUG:teuthology.orchestra.run.smithi132:> ') 2024-04-16T15:52:31.757 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T15:52:31.786 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T15:52:31.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:52:31.792 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-16T15:52:31.820 INFO:teuthology.orchestra.run.smithi132.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-16T15:52:31.821 INFO:teuthology.orchestra.run.smithi132.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-16T15:52:31.821 INFO:teuthology.orchestra.run.smithi132.stdout: inet 127.0.0.1/8 scope host lo 2024-04-16T15:52:31.821 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:52:31.821 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 ::1/128 scope host 2024-04-16T15:52:31.821 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:52:31.821 INFO:teuthology.orchestra.run.smithi132.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-16T15:52:31.821 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 3a:74:be:bc:79:41 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-16T15:52:31.821 INFO:teuthology.orchestra.run.smithi132.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-16T15:52:31.821 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:52:31.821 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::3874:beff:febc:7941/64 scope link 2024-04-16T15:52:31.821 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:52:31.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:52:31.827 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-16T15:52:31.891 INFO:teuthology.orchestra.run.smithi132.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-16T15:52:31.891 INFO:teuthology.orchestra.run.smithi132.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-16T15:52:31.891 INFO:teuthology.orchestra.run.smithi132.stdout: inet 127.0.0.1/8 scope host lo 2024-04-16T15:52:31.891 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:52:31.891 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 ::1/128 scope host 2024-04-16T15:52:31.891 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:52:31.891 INFO:teuthology.orchestra.run.smithi132.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-16T15:52:31.891 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 3a:74:be:bc:79:41 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-16T15:52:31.892 INFO:teuthology.orchestra.run.smithi132.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-16T15:52:31.892 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:52:31.892 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::3874:beff:febc:7941/64 scope link 2024-04-16T15:52:31.892 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:52:31.893 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-04-16T15:52:31.893 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T15:52:31.893 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2024-04-16T15:52:31.893 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-04-16T15:52:31.893 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-16T15:52:31.893 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-04-16T15:52:31.893 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-04-16T15:52:31.893 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-04-16T15:52:31.893 DEBUG:teuthology.orchestra.run.smithi132:> ') 2024-04-16T15:52:31.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T15:52:32.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T15:52:32.067 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T15:52:32.067 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2024-04-16T15:52:32.067 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set brx.1 up 2024-04-16T15:52:32.067 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set dev brx.1 master ceph-brx 2024-04-16T15:52:32.067 DEBUG:teuthology.orchestra.run.smithi132:> ') 2024-04-16T15:52:32.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T15:52:32.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T15:52:32.151 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-04-16T15:52:32.151 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T15:52:32.151 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-04-16T15:52:32.167 INFO:teuthology.orchestra.run.smithi132.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-04-16T15:52:32.167 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T15:52:32.167 DEBUG:teuthology.orchestra.run.smithi132:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-04-16T15:52:32.222 DEBUG:teuthology.orchestra.run.smithi132:> sudo modprobe fuse 2024-04-16T15:52:32.291 DEBUG:teuthology.orchestra.run.smithi132:> cat /proc/self/mounts | awk '{print $2}' 2024-04-16T15:52:32.349 INFO:teuthology.orchestra.run.smithi132.stdout:/proc 2024-04-16T15:52:32.349 INFO:teuthology.orchestra.run.smithi132.stdout:/sys 2024-04-16T15:52:32.349 INFO:teuthology.orchestra.run.smithi132.stdout:/dev 2024-04-16T15:52:32.349 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/kernel/security 2024-04-16T15:52:32.349 INFO:teuthology.orchestra.run.smithi132.stdout:/dev/shm 2024-04-16T15:52:32.349 INFO:teuthology.orchestra.run.smithi132.stdout:/dev/pts 2024-04-16T15:52:32.349 INFO:teuthology.orchestra.run.smithi132.stdout:/run 2024-04-16T15:52:32.349 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/fs/cgroup 2024-04-16T15:52:32.349 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/fs/pstore 2024-04-16T15:52:32.350 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/fs/bpf 2024-04-16T15:52:32.350 INFO:teuthology.orchestra.run.smithi132.stdout:/ 2024-04-16T15:52:32.350 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/fs/selinux 2024-04-16T15:52:32.350 INFO:teuthology.orchestra.run.smithi132.stdout:/proc/sys/fs/binfmt_misc 2024-04-16T15:52:32.350 INFO:teuthology.orchestra.run.smithi132.stdout:/dev/mqueue 2024-04-16T15:52:32.350 INFO:teuthology.orchestra.run.smithi132.stdout:/dev/hugepages 2024-04-16T15:52:32.350 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/kernel/debug 2024-04-16T15:52:32.350 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/kernel/tracing 2024-04-16T15:52:32.350 INFO:teuthology.orchestra.run.smithi132.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-16T15:52:32.350 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/fs/fuse/connections 2024-04-16T15:52:32.350 INFO:teuthology.orchestra.run.smithi132.stdout:/run/credentials/systemd-sysctl.service 2024-04-16T15:52:32.350 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/kernel/config 2024-04-16T15:52:32.350 INFO:teuthology.orchestra.run.smithi132.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-16T15:52:32.350 INFO:teuthology.orchestra.run.smithi132.stdout:/var/lib/nfs/rpc_pipefs 2024-04-16T15:52:32.351 INFO:teuthology.orchestra.run.smithi132.stdout:/run/user/1000 2024-04-16T15:52:32.351 INFO:teuthology.orchestra.run.smithi132.stdout:/var/lib/ceph 2024-04-16T15:52:32.351 INFO:teuthology.orchestra.run.smithi132.stdout:/var/lib/ceph/osd/ceph-0 2024-04-16T15:52:32.351 INFO:teuthology.orchestra.run.smithi132.stdout:/var/lib/ceph/osd/ceph-1 2024-04-16T15:52:32.351 INFO:teuthology.orchestra.run.smithi132.stdout:/var/lib/ceph/osd/ceph-2 2024-04-16T15:52:32.351 INFO:teuthology.orchestra.run.smithi132.stdout:/var/lib/ceph/osd/ceph-3 2024-04-16T15:52:32.351 INFO:teuthology.orchestra.run.smithi132.stdout:/run/netns 2024-04-16T15:52:32.351 INFO:teuthology.orchestra.run.smithi132.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-16T15:52:32.351 INFO:teuthology.orchestra.run.smithi132.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-16T15:52:32.351 INFO:teuthology.orchestra.run.smithi132.stdout:/home/ubuntu/cephtest/mnt.0 2024-04-16T15:52:32.351 INFO:teuthology.orchestra.run.smithi132.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-16T15:52:32.351 INFO:teuthology.orchestra.run.smithi132.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-16T15:52:32.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:52:32.352 DEBUG:teuthology.orchestra.run.smithi132:> ls /sys/fs/fuse/connections 2024-04-16T15:52:32.404 INFO:teuthology.orchestra.run.smithi132.stdout:41 2024-04-16T15:52:32.404 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [41] 2024-04-16T15:52:32.405 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-04-16T15:52:32.447 DEBUG:teuthology.orchestra.run.smithi132:> sudo modprobe fuse 2024-04-16T15:52:32.476 DEBUG:teuthology.orchestra.run.smithi132:> cat /proc/self/mounts | awk '{print $2}' 2024-04-16T15:52:32.532 INFO:teuthology.orchestra.run.smithi132.stdout:/proc 2024-04-16T15:52:32.532 INFO:teuthology.orchestra.run.smithi132.stdout:/sys 2024-04-16T15:52:32.533 INFO:teuthology.orchestra.run.smithi132.stdout:/dev 2024-04-16T15:52:32.533 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/kernel/security 2024-04-16T15:52:32.533 INFO:teuthology.orchestra.run.smithi132.stdout:/dev/shm 2024-04-16T15:52:32.533 INFO:teuthology.orchestra.run.smithi132.stdout:/dev/pts 2024-04-16T15:52:32.533 INFO:teuthology.orchestra.run.smithi132.stdout:/run 2024-04-16T15:52:32.533 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/fs/cgroup 2024-04-16T15:52:32.533 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/fs/pstore 2024-04-16T15:52:32.533 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/fs/bpf 2024-04-16T15:52:32.533 INFO:teuthology.orchestra.run.smithi132.stdout:/ 2024-04-16T15:52:32.533 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/fs/selinux 2024-04-16T15:52:32.533 INFO:teuthology.orchestra.run.smithi132.stdout:/proc/sys/fs/binfmt_misc 2024-04-16T15:52:32.534 INFO:teuthology.orchestra.run.smithi132.stdout:/dev/mqueue 2024-04-16T15:52:32.534 INFO:teuthology.orchestra.run.smithi132.stdout:/dev/hugepages 2024-04-16T15:52:32.534 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/kernel/debug 2024-04-16T15:52:32.534 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/kernel/tracing 2024-04-16T15:52:32.534 INFO:teuthology.orchestra.run.smithi132.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-16T15:52:32.534 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/fs/fuse/connections 2024-04-16T15:52:32.534 INFO:teuthology.orchestra.run.smithi132.stdout:/run/credentials/systemd-sysctl.service 2024-04-16T15:52:32.534 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/kernel/config 2024-04-16T15:52:32.534 INFO:teuthology.orchestra.run.smithi132.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-16T15:52:32.534 INFO:teuthology.orchestra.run.smithi132.stdout:/var/lib/nfs/rpc_pipefs 2024-04-16T15:52:32.534 INFO:teuthology.orchestra.run.smithi132.stdout:/run/user/1000 2024-04-16T15:52:32.535 INFO:teuthology.orchestra.run.smithi132.stdout:/var/lib/ceph 2024-04-16T15:52:32.535 INFO:teuthology.orchestra.run.smithi132.stdout:/var/lib/ceph/osd/ceph-0 2024-04-16T15:52:32.535 INFO:teuthology.orchestra.run.smithi132.stdout:/var/lib/ceph/osd/ceph-1 2024-04-16T15:52:32.535 INFO:teuthology.orchestra.run.smithi132.stdout:/var/lib/ceph/osd/ceph-2 2024-04-16T15:52:32.535 INFO:teuthology.orchestra.run.smithi132.stdout:/var/lib/ceph/osd/ceph-3 2024-04-16T15:52:32.535 INFO:teuthology.orchestra.run.smithi132.stdout:/run/netns 2024-04-16T15:52:32.535 INFO:teuthology.orchestra.run.smithi132.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-16T15:52:32.535 INFO:teuthology.orchestra.run.smithi132.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-16T15:52:32.535 INFO:teuthology.orchestra.run.smithi132.stdout:/home/ubuntu/cephtest/mnt.0 2024-04-16T15:52:32.535 INFO:teuthology.orchestra.run.smithi132.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-16T15:52:32.535 INFO:teuthology.orchestra.run.smithi132.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-16T15:52:32.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:52:32.536 DEBUG:teuthology.orchestra.run.smithi132:> ls /sys/fs/fuse/connections 2024-04-16T15:52:32.537 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi132.stderr:2024-04-16T15:52:32.537+0000 7f0b75645480 -1 init, newargv = 0x5595c4b30690 newargc=15 2024-04-16T15:52:32.537 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi132.stderr:ceph-fuse[46840]: starting ceph client 2024-04-16T15:52:32.541 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi132.stderr:ceph-fuse[46840]: starting fuse 2024-04-16T15:52:32.552 INFO:teuthology.orchestra.run.smithi132.stdout:41 2024-04-16T15:52:32.552 INFO:teuthology.orchestra.run.smithi132.stdout:44 2024-04-16T15:52:32.552 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41, 44] 2024-04-16T15:52:32.553 DEBUG:teuthology.orchestra.run.smithi132:> sudo stdin-killer -- python3 -c ' 2024-04-16T15:52:32.553 DEBUG:teuthology.orchestra.run.smithi132:> import glob 2024-04-16T15:52:32.553 DEBUG:teuthology.orchestra.run.smithi132:> import re 2024-04-16T15:52:32.553 DEBUG:teuthology.orchestra.run.smithi132:> import os 2024-04-16T15:52:32.553 DEBUG:teuthology.orchestra.run.smithi132:> import subprocess 2024-04-16T15:52:32.553 DEBUG:teuthology.orchestra.run.smithi132:> 2024-04-16T15:52:32.553 DEBUG:teuthology.orchestra.run.smithi132:> def _find_admin_socket(client_name): 2024-04-16T15:52:32.553 DEBUG:teuthology.orchestra.run.smithi132:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-04-16T15:52:32.553 DEBUG:teuthology.orchestra.run.smithi132:> files = glob.glob(asok_path) 2024-04-16T15:52:32.553 DEBUG:teuthology.orchestra.run.smithi132:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-04-16T15:52:32.553 DEBUG:teuthology.orchestra.run.smithi132:> 2024-04-16T15:52:32.553 DEBUG:teuthology.orchestra.run.smithi132:> # Given a non-glob path, it better be there 2024-04-16T15:52:32.553 DEBUG:teuthology.orchestra.run.smithi132:> if "*" not in asok_path: 2024-04-16T15:52:32.553 DEBUG:teuthology.orchestra.run.smithi132:> assert(len(files) == 1) 2024-04-16T15:52:32.554 DEBUG:teuthology.orchestra.run.smithi132:> return files[0] 2024-04-16T15:52:32.554 DEBUG:teuthology.orchestra.run.smithi132:> 2024-04-16T15:52:32.554 DEBUG:teuthology.orchestra.run.smithi132:> for f in files: 2024-04-16T15:52:32.554 DEBUG:teuthology.orchestra.run.smithi132:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-16T15:52:32.554 DEBUG:teuthology.orchestra.run.smithi132:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-16T15:52:32.554 DEBUG:teuthology.orchestra.run.smithi132:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-16T15:52:32.554 DEBUG:teuthology.orchestra.run.smithi132:> contents = proc_f.read() 2024-04-16T15:52:32.554 DEBUG:teuthology.orchestra.run.smithi132:> if mountpoint in contents: 2024-04-16T15:52:32.554 DEBUG:teuthology.orchestra.run.smithi132:> return f 2024-04-16T15:52:32.554 DEBUG:teuthology.orchestra.run.smithi132:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-16T15:52:32.554 DEBUG:teuthology.orchestra.run.smithi132:> 2024-04-16T15:52:32.554 DEBUG:teuthology.orchestra.run.smithi132:> print(_find_admin_socket("client.2")) 2024-04-16T15:52:32.554 DEBUG:teuthology.orchestra.run.smithi132:> ' 2024-04-16T15:52:32.674 INFO:teuthology.orchestra.run.smithi132.stdout:/var/run/ceph/ceph-client.2.46840.asok 2024-04-16T15:52:32.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T15:52:32.684 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.46840.asok 2024-04-16T15:52:32.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:52:32.685 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.46840.asok status 2024-04-16T15:52:32.823 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-16T15:52:32.823 INFO:teuthology.orchestra.run.smithi132.stdout: "metadata": { 2024-04-16T15:52:32.823 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_sha1": "c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f", 2024-04-16T15:52:32.823 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_version": "ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev)", 2024-04-16T15:52:32.823 INFO:teuthology.orchestra.run.smithi132.stdout: "entity_id": "2", 2024-04-16T15:52:32.823 INFO:teuthology.orchestra.run.smithi132.stdout: "hostname": "smithi132", 2024-04-16T15:52:32.823 INFO:teuthology.orchestra.run.smithi132.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-04-16T15:52:32.823 INFO:teuthology.orchestra.run.smithi132.stdout: "pid": "46840", 2024-04-16T15:52:32.824 INFO:teuthology.orchestra.run.smithi132.stdout: "root": "/" 2024-04-16T15:52:32.824 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-16T15:52:32.824 INFO:teuthology.orchestra.run.smithi132.stdout: "dentry_count": 0, 2024-04-16T15:52:32.824 INFO:teuthology.orchestra.run.smithi132.stdout: "dentry_pinned_count": 0, 2024-04-16T15:52:32.824 INFO:teuthology.orchestra.run.smithi132.stdout: "id": 4713, 2024-04-16T15:52:32.824 INFO:teuthology.orchestra.run.smithi132.stdout: "inst": { 2024-04-16T15:52:32.824 INFO:teuthology.orchestra.run.smithi132.stdout: "name": { 2024-04-16T15:52:32.824 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "client", 2024-04-16T15:52:32.824 INFO:teuthology.orchestra.run.smithi132.stdout: "num": 4713 2024-04-16T15:52:32.824 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-16T15:52:32.824 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": { 2024-04-16T15:52:32.824 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2024-04-16T15:52:32.824 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "192.168.0.2:0", 2024-04-16T15:52:32.824 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 3224626364 2024-04-16T15:52:32.824 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-16T15:52:32.825 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-16T15:52:32.825 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": { 2024-04-16T15:52:32.825 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2024-04-16T15:52:32.825 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "192.168.0.2:0", 2024-04-16T15:52:32.825 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 3224626364 2024-04-16T15:52:32.825 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-16T15:52:32.825 INFO:teuthology.orchestra.run.smithi132.stdout: "inst_str": "client.4713 192.168.0.2:0/3224626364", 2024-04-16T15:52:32.825 INFO:teuthology.orchestra.run.smithi132.stdout: "addr_str": "192.168.0.2:0/3224626364", 2024-04-16T15:52:32.825 INFO:teuthology.orchestra.run.smithi132.stdout: "inode_count": 1, 2024-04-16T15:52:32.825 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_epoch": 6, 2024-04-16T15:52:32.825 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_epoch": 20, 2024-04-16T15:52:32.825 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_epoch_barrier": 0, 2024-04-16T15:52:32.825 INFO:teuthology.orchestra.run.smithi132.stdout: "blocklisted": false, 2024-04-16T15:52:32.825 INFO:teuthology.orchestra.run.smithi132.stdout: "fs_name": "cephfs" 2024-04-16T15:52:32.825 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-16T15:52:32.832 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-16T15:52:32.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.936+0000 7f8949782640 1 Processor -- start 2024-04-16T15:52:32.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.936+0000 7f8949782640 1 -- start start 2024-04-16T15:52:32.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.937+0000 7f8949782640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f894415eaf0 0x7f89440ba300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:32.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.937+0000 7f8949782640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f894415eed0 0x7f89440b63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:32.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.937+0000 7f8949782640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f89441627e0 0x7f89440b6930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:32.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.937+0000 7f8949782640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f89440d2af0 con 0x7f894415eed0 2024-04-16T15:52:32.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.937+0000 7f8949782640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f8944162cc0 con 0x7f89441627e0 2024-04-16T15:52:32.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.937+0000 7f8949782640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f8944162fa0 con 0x7f894415eaf0 2024-04-16T15:52:32.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.937+0000 7f89427fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f894415eed0 0x7f89440b63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:32.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.937+0000 7f89427fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f894415eed0 0x7f89440b63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42566/0 (socket says 172.21.15.132:42566) 2024-04-16T15:52:32.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.937+0000 7f89427fc640 1 -- 172.21.15.132:0/2707869024 learned_addr learned my addr 172.21.15.132:0/2707869024 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:32.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.937+0000 7f89437fe640 1 --2- 172.21.15.132:0/2707869024 >> v2:172.21.15.179:3300/0 conn(0x7f89441627e0 0x7f89440b6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:32.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.937+0000 7f8942ffd640 1 --2- 172.21.15.132:0/2707869024 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f894415eaf0 0x7f89440ba300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:32.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.937+0000 7f89427fc640 1 -- 172.21.15.132:0/2707869024 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f894415eaf0 msgr2=0x7f89440ba300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:32.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.937+0000 7f89427fc640 1 --2- 172.21.15.132:0/2707869024 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f894415eaf0 0x7f89440ba300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:32.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.937+0000 7f89427fc640 1 -- 172.21.15.132:0/2707869024 >> v2:172.21.15.179:3300/0 conn(0x7f89441627e0 msgr2=0x7f89440b6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:32.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.937+0000 7f89427fc640 1 --2- 172.21.15.132:0/2707869024 >> v2:172.21.15.179:3300/0 conn(0x7f89441627e0 0x7f89440b6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:32.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.937+0000 7f89427fc640 1 -- 172.21.15.132:0/2707869024 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8944163280 con 0x7f894415eed0 2024-04-16T15:52:32.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.937+0000 7f89437fe640 1 --2- 172.21.15.132:0/2707869024 >> v2:172.21.15.179:3300/0 conn(0x7f89441627e0 0x7f89440b6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:32.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.937+0000 7f8942ffd640 1 --2- 172.21.15.132:0/2707869024 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f894415eaf0 0x7f89440ba300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:32.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.938+0000 7f89427fc640 1 --2- 172.21.15.132:0/2707869024 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f894415eed0 0x7f89440b63f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f89440cb9f0 tx=0x7f893802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a55f7b27a9a3d5a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:32.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.938+0000 7f8941ffb640 1 -- 172.21.15.132:0/2707869024 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8938035020 con 0x7f894415eed0 2024-04-16T15:52:32.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.938+0000 7f8941ffb640 1 -- 172.21.15.132:0/2707869024 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8938031870 con 0x7f894415eed0 2024-04-16T15:52:32.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.938+0000 7f8941ffb640 1 -- 172.21.15.132:0/2707869024 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8938031c40 con 0x7f894415eed0 2024-04-16T15:52:32.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.939+0000 7f8949782640 1 -- 172.21.15.132:0/2707869024 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f894415eed0 msgr2=0x7f89440b63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:32.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.939+0000 7f8949782640 1 --2- 172.21.15.132:0/2707869024 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f894415eed0 0x7f89440b63f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f89440cb9f0 tx=0x7f893802b910 comp rx=0 tx=0).stop 2024-04-16T15:52:32.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.939+0000 7f8949782640 1 -- 172.21.15.132:0/2707869024 shutdown_connections 2024-04-16T15:52:32.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.939+0000 7f8949782640 1 --2- 172.21.15.132:0/2707869024 >> v2:172.21.15.179:3300/0 conn(0x7f89441627e0 0x7f89440b6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:32.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.939+0000 7f8949782640 1 --2- 172.21.15.132:0/2707869024 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f894415eed0 0x7f89440b63f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:32.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.939+0000 7f8949782640 1 --2- 172.21.15.132:0/2707869024 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f894415eaf0 0x7f89440ba300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:32.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.939+0000 7f8949782640 1 -- 172.21.15.132:0/2707869024 >> 172.21.15.132:0/2707869024 conn(0x7f89440d13f0 msgr2=0x7f89440d1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:32.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.939+0000 7f8949782640 1 -- 172.21.15.132:0/2707869024 shutdown_connections 2024-04-16T15:52:32.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.939+0000 7f8949782640 1 -- 172.21.15.132:0/2707869024 wait complete. 2024-04-16T15:52:32.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.940+0000 7f8949782640 1 Processor -- start 2024-04-16T15:52:32.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.940+0000 7f8949782640 1 -- start start 2024-04-16T15:52:32.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.941+0000 7f8949782640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f894415eaf0 0x7f89440ab2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:32.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.941+0000 7f8949782640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f894415eed0 0x7f89440cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:32.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.941+0000 7f8949782640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89441627e0 0x7f89440c85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:32.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.941+0000 7f8949782640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f8944067760 con 0x7f894415eed0 2024-04-16T15:52:32.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.941+0000 7f8949782640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f89440ba840 con 0x7f894415eaf0 2024-04-16T15:52:32.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.941+0000 7f8949782640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f89440678e0 con 0x7f89441627e0 2024-04-16T15:52:32.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.941+0000 7f89427fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f894415eed0 0x7f89440cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:32.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.941+0000 7f89427fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f894415eed0 0x7f89440cd2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42574/0 (socket says 172.21.15.132:42574) 2024-04-16T15:52:32.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.941+0000 7f89427fc640 1 -- 172.21.15.132:0/3834153697 learned_addr learned my addr 172.21.15.132:0/3834153697 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:32.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.941+0000 7f89437fe640 1 --2- 172.21.15.132:0/3834153697 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89441627e0 0x7f89440c85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:32.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.941+0000 7f8942ffd640 1 --2- 172.21.15.132:0/3834153697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f894415eaf0 0x7f89440ab2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:32.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.941+0000 7f89427fc640 1 -- 172.21.15.132:0/3834153697 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89441627e0 msgr2=0x7f89440c85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:32.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.941+0000 7f89427fc640 1 --2- 172.21.15.132:0/3834153697 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89441627e0 0x7f89440c85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:32.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.941+0000 7f89427fc640 1 -- 172.21.15.132:0/3834153697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f894415eaf0 msgr2=0x7f89440ab2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:32.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.941+0000 7f89427fc640 1 --2- 172.21.15.132:0/3834153697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f894415eaf0 0x7f89440ab2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:32.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.941+0000 7f89427fc640 1 -- 172.21.15.132:0/3834153697 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f894414e3e0 con 0x7f894415eed0 2024-04-16T15:52:32.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.941+0000 7f89437fe640 1 --2- 172.21.15.132:0/3834153697 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89441627e0 0x7f89440c85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:32.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.941+0000 7f8942ffd640 1 --2- 172.21.15.132:0/3834153697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f894415eaf0 0x7f89440ab2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:32.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.942+0000 7f89427fc640 1 --2- 172.21.15.132:0/3834153697 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f894415eed0 0x7f89440cd2f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8938000c00 tx=0x7f89380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:32.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.942+0000 7f892b7fe640 1 -- 172.21.15.132:0/3834153697 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8938035040 con 0x7f894415eed0 2024-04-16T15:52:32.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.942+0000 7f892b7fe640 1 -- 172.21.15.132:0/3834153697 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8938030d00 con 0x7f894415eed0 2024-04-16T15:52:32.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.942+0000 7f8949782640 1 -- 172.21.15.132:0/3834153697 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f894414e6c0 con 0x7f894415eed0 2024-04-16T15:52:32.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.942+0000 7f892b7fe640 1 -- 172.21.15.132:0/3834153697 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89380456a0 con 0x7f894415eed0 2024-04-16T15:52:32.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.942+0000 7f8949782640 1 -- 172.21.15.132:0/3834153697 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f894414ec80 con 0x7f894415eed0 2024-04-16T15:52:32.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.943+0000 7f8949782640 1 -- 172.21.15.132:0/3834153697 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8944075510 con 0x7f894415eed0 2024-04-16T15:52:32.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.943+0000 7f892b7fe640 1 -- 172.21.15.132:0/3834153697 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8938038020 con 0x7f894415eed0 2024-04-16T15:52:32.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.944+0000 7f892b7fe640 1 --2- 172.21.15.132:0/3834153697 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f893006c8f0 0x7f893006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:32.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.944+0000 7f892b7fe640 1 -- 172.21.15.132:0/3834153697 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f89380ade00 con 0x7f894415eed0 2024-04-16T15:52:32.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.944+0000 7f8942ffd640 1 --2- 172.21.15.132:0/3834153697 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f893006c8f0 0x7f893006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:32.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.944+0000 7f8942ffd640 1 --2- 172.21.15.132:0/3834153697 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f893006c8f0 0x7f893006edb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f89440d1c20 tx=0x7f89340039d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:32.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:32.948+0000 7f892b7fe640 1 -- 172.21.15.132:0/3834153697 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f893807c2c0 con 0x7f894415eed0 2024-04-16T15:52:33.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:33.161+0000 7f8949782640 1 -- 172.21.15.132:0/3834153697 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f89440b34b0 con 0x7f894415eed0 2024-04-16T15:52:33.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:33.162+0000 7f892b7fe640 1 -- 172.21.15.132:0/3834153697 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7f893807bbc0 con 0x7f894415eed0 2024-04-16T15:52:33.161 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-16T15:52:33.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:33.164+0000 7f8949782640 1 -- 172.21.15.132:0/3834153697 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f893006c8f0 msgr2=0x7f893006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:33.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:33.164+0000 7f8949782640 1 --2- 172.21.15.132:0/3834153697 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f893006c8f0 0x7f893006edb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f89440d1c20 tx=0x7f89340039d0 comp rx=0 tx=0).stop 2024-04-16T15:52:33.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:33.164+0000 7f8949782640 1 -- 172.21.15.132:0/3834153697 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f894415eed0 msgr2=0x7f89440cd2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:33.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:33.164+0000 7f8949782640 1 --2- 172.21.15.132:0/3834153697 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f894415eed0 0x7f89440cd2f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8938000c00 tx=0x7f89380046c0 comp rx=0 tx=0).stop 2024-04-16T15:52:33.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:33.164+0000 7f8949782640 1 -- 172.21.15.132:0/3834153697 shutdown_connections 2024-04-16T15:52:33.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:33.164+0000 7f8949782640 1 --2- 172.21.15.132:0/3834153697 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f893006c8f0 0x7f893006edb0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:33.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:33.164+0000 7f8949782640 1 --2- 172.21.15.132:0/3834153697 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89441627e0 0x7f89440c85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:33.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:33.164+0000 7f8949782640 1 --2- 172.21.15.132:0/3834153697 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f894415eed0 0x7f89440cd2f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:33.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:33.164+0000 7f8949782640 1 --2- 172.21.15.132:0/3834153697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f894415eaf0 0x7f89440ab2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:33.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:33.164+0000 7f8949782640 1 -- 172.21.15.132:0/3834153697 >> 172.21.15.132:0/3834153697 conn(0x7f89440d13f0 msgr2=0x7f89440cfbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:33.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:33.164+0000 7f8949782640 1 -- 172.21.15.132:0/3834153697 shutdown_connections 2024-04-16T15:52:33.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:33.164+0000 7f8949782640 1 -- 172.21.15.132:0/3834153697 wait complete. 2024-04-16T15:52:33.174 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-16T15:52:33.174 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-16T15:52:33.174 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi179.front.sepia.ceph.com 2024-04-16T15:52:33.174 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-16T15:52:33.174 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-16T15:52:33.174 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-16T15:52:33.174 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-16T15:52:33.174 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-16T15:52:33.174 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-16T15:52:33.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:52:33.174 DEBUG:teuthology.orchestra.run.smithi179:> ip addr 2024-04-16T15:52:33.194 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-16T15:52:33.194 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-16T15:52:33.194 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2024-04-16T15:52:33.194 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:52:33.195 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2024-04-16T15:52:33.195 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:52:33.195 INFO:teuthology.orchestra.run.smithi179.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T15:52:33.195 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:34 brd ff:ff:ff:ff:ff:ff 2024-04-16T15:52:33.195 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f0 2024-04-16T15:52:33.195 INFO:teuthology.orchestra.run.smithi179.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T15:52:33.195 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:35 brd ff:ff:ff:ff:ff:ff 2024-04-16T15:52:33.195 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f1 2024-04-16T15:52:33.195 INFO:teuthology.orchestra.run.smithi179.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T15:52:33.195 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5a brd ff:ff:ff:ff:ff:ff 2024-04-16T15:52:33.195 INFO:teuthology.orchestra.run.smithi179.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-16T15:52:33.195 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5b brd ff:ff:ff:ff:ff:ff 2024-04-16T15:52:33.195 INFO:teuthology.orchestra.run.smithi179.stdout: inet 172.21.15.179/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-16T15:52:33.195 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft 42732sec preferred_lft 42732sec 2024-04-16T15:52:33.195 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::ec4:7aff:fe88:725b/64 scope link 2024-04-16T15:52:33.196 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:52:33.196 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-16T15:52:33.196 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T15:52:33.196 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2024-04-16T15:52:33.196 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link add name ceph-brx type bridge 2024-04-16T15:52:33.196 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip addr flush dev ceph-brx 2024-04-16T15:52:33.196 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set ceph-brx up 2024-04-16T15:52:33.196 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-16T15:52:33.196 DEBUG:teuthology.orchestra.run.smithi179:> ') 2024-04-16T15:52:33.292 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:52:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T15:52:33.409 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:52:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T15:52:33.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:52:33.416 DEBUG:teuthology.orchestra.run.smithi179:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-16T15:52:33.445 INFO:teuthology.orchestra.run.smithi179.stdout:1 2024-04-16T15:52:33.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:52:33.447 DEBUG:teuthology.orchestra.run.smithi179:> route 2024-04-16T15:52:33.521 INFO:teuthology.orchestra.run.smithi179.stdout:Kernel IP routing table 2024-04-16T15:52:33.521 INFO:teuthology.orchestra.run.smithi179.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-16T15:52:33.521 INFO:teuthology.orchestra.run.smithi179.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-16T15:52:33.521 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-16T15:52:33.521 INFO:teuthology.orchestra.run.smithi179.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-16T15:52:33.522 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T15:52:33.522 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2024-04-16T15:52:33.522 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-16T15:52:33.522 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-16T15:52:33.522 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-16T15:52:33.522 DEBUG:teuthology.orchestra.run.smithi179:> ') 2024-04-16T15:52:33.610 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:52:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T15:52:33.848 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:52:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T15:52:33.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:52:33.855 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2024-04-16T15:52:33.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:52:33.874 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list-id 2024-04-16T15:52:33.927 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T15:52:33.928 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2024-04-16T15:52:33.928 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-16T15:52:33.928 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-16T15:52:33.928 DEBUG:teuthology.orchestra.run.smithi179:> ') 2024-04-16T15:52:34.016 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:52:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T15:52:34.046 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:52:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T15:52:34.053 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-16T15:52:34.053 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T15:52:34.053 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2024-04-16T15:52:34.053 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-16T15:52:34.053 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-16T15:52:34.053 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-16T15:52:34.053 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-16T15:52:34.053 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-16T15:52:34.053 DEBUG:teuthology.orchestra.run.smithi179:> ') 2024-04-16T15:52:34.102 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:52:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T15:52:34.192 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:52:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T15:52:34.198 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T15:52:34.198 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2024-04-16T15:52:34.198 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set brx.0 up 2024-04-16T15:52:34.198 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set dev brx.0 master ceph-brx 2024-04-16T15:52:34.198 DEBUG:teuthology.orchestra.run.smithi179:> ') 2024-04-16T15:52:34.248 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:52:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T15:52:34.277 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:52:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T15:52:34.284 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-04-16T15:52:34.284 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T15:52:34.284 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-16T15:52:34.300 INFO:teuthology.orchestra.run.smithi179.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-16T15:52:34.300 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T15:52:34.300 DEBUG:teuthology.orchestra.run.smithi179:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-16T15:52:34.355 DEBUG:teuthology.orchestra.run.smithi179:> sudo modprobe fuse 2024-04-16T15:52:34.425 DEBUG:teuthology.orchestra.run.smithi179:> cat /proc/self/mounts | awk '{print $2}' 2024-04-16T15:52:34.483 INFO:teuthology.orchestra.run.smithi179.stdout:/proc 2024-04-16T15:52:34.483 INFO:teuthology.orchestra.run.smithi179.stdout:/sys 2024-04-16T15:52:34.483 INFO:teuthology.orchestra.run.smithi179.stdout:/dev 2024-04-16T15:52:34.483 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/kernel/security 2024-04-16T15:52:34.483 INFO:teuthology.orchestra.run.smithi179.stdout:/dev/shm 2024-04-16T15:52:34.483 INFO:teuthology.orchestra.run.smithi179.stdout:/dev/pts 2024-04-16T15:52:34.483 INFO:teuthology.orchestra.run.smithi179.stdout:/run 2024-04-16T15:52:34.483 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/fs/cgroup 2024-04-16T15:52:34.483 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/fs/pstore 2024-04-16T15:52:34.483 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/fs/bpf 2024-04-16T15:52:34.484 INFO:teuthology.orchestra.run.smithi179.stdout:/ 2024-04-16T15:52:34.484 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/fs/selinux 2024-04-16T15:52:34.484 INFO:teuthology.orchestra.run.smithi179.stdout:/proc/sys/fs/binfmt_misc 2024-04-16T15:52:34.484 INFO:teuthology.orchestra.run.smithi179.stdout:/dev/hugepages 2024-04-16T15:52:34.484 INFO:teuthology.orchestra.run.smithi179.stdout:/dev/mqueue 2024-04-16T15:52:34.484 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/kernel/debug 2024-04-16T15:52:34.484 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/kernel/tracing 2024-04-16T15:52:34.484 INFO:teuthology.orchestra.run.smithi179.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-16T15:52:34.484 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/fs/fuse/connections 2024-04-16T15:52:34.484 INFO:teuthology.orchestra.run.smithi179.stdout:/run/credentials/systemd-sysctl.service 2024-04-16T15:52:34.484 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/kernel/config 2024-04-16T15:52:34.484 INFO:teuthology.orchestra.run.smithi179.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-16T15:52:34.484 INFO:teuthology.orchestra.run.smithi179.stdout:/var/lib/nfs/rpc_pipefs 2024-04-16T15:52:34.484 INFO:teuthology.orchestra.run.smithi179.stdout:/run/user/1000 2024-04-16T15:52:34.484 INFO:teuthology.orchestra.run.smithi179.stdout:/var/lib/ceph 2024-04-16T15:52:34.485 INFO:teuthology.orchestra.run.smithi179.stdout:/var/lib/ceph/osd/ceph-4 2024-04-16T15:52:34.485 INFO:teuthology.orchestra.run.smithi179.stdout:/var/lib/ceph/osd/ceph-5 2024-04-16T15:52:34.485 INFO:teuthology.orchestra.run.smithi179.stdout:/var/lib/ceph/osd/ceph-6 2024-04-16T15:52:34.485 INFO:teuthology.orchestra.run.smithi179.stdout:/var/lib/ceph/osd/ceph-7 2024-04-16T15:52:34.485 INFO:teuthology.orchestra.run.smithi179.stdout:/run/netns 2024-04-16T15:52:34.485 INFO:teuthology.orchestra.run.smithi179.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-16T15:52:34.485 INFO:teuthology.orchestra.run.smithi179.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-16T15:52:34.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:52:34.486 DEBUG:teuthology.orchestra.run.smithi179:> ls /sys/fs/fuse/connections 2024-04-16T15:52:34.539 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-16T15:52:34.540 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-04-16T15:52:34.583 DEBUG:teuthology.orchestra.run.smithi179:> sudo modprobe fuse 2024-04-16T15:52:34.612 DEBUG:teuthology.orchestra.run.smithi179:> cat /proc/self/mounts | awk '{print $2}' 2024-04-16T15:52:34.669 INFO:teuthology.orchestra.run.smithi179.stdout:/proc 2024-04-16T15:52:34.670 INFO:teuthology.orchestra.run.smithi179.stdout:/sys 2024-04-16T15:52:34.670 INFO:teuthology.orchestra.run.smithi179.stdout:/dev 2024-04-16T15:52:34.670 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/kernel/security 2024-04-16T15:52:34.670 INFO:teuthology.orchestra.run.smithi179.stdout:/dev/shm 2024-04-16T15:52:34.670 INFO:teuthology.orchestra.run.smithi179.stdout:/dev/pts 2024-04-16T15:52:34.670 INFO:teuthology.orchestra.run.smithi179.stdout:/run 2024-04-16T15:52:34.670 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/fs/cgroup 2024-04-16T15:52:34.670 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/fs/pstore 2024-04-16T15:52:34.670 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/fs/bpf 2024-04-16T15:52:34.670 INFO:teuthology.orchestra.run.smithi179.stdout:/ 2024-04-16T15:52:34.670 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/fs/selinux 2024-04-16T15:52:34.670 INFO:teuthology.orchestra.run.smithi179.stdout:/proc/sys/fs/binfmt_misc 2024-04-16T15:52:34.670 INFO:teuthology.orchestra.run.smithi179.stdout:/dev/hugepages 2024-04-16T15:52:34.671 INFO:teuthology.orchestra.run.smithi179.stdout:/dev/mqueue 2024-04-16T15:52:34.671 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/kernel/debug 2024-04-16T15:52:34.671 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/kernel/tracing 2024-04-16T15:52:34.671 INFO:teuthology.orchestra.run.smithi179.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-16T15:52:34.671 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/fs/fuse/connections 2024-04-16T15:52:34.671 INFO:teuthology.orchestra.run.smithi179.stdout:/run/credentials/systemd-sysctl.service 2024-04-16T15:52:34.671 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/kernel/config 2024-04-16T15:52:34.671 INFO:teuthology.orchestra.run.smithi179.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-16T15:52:34.671 INFO:teuthology.orchestra.run.smithi179.stdout:/var/lib/nfs/rpc_pipefs 2024-04-16T15:52:34.671 INFO:teuthology.orchestra.run.smithi179.stdout:/run/user/1000 2024-04-16T15:52:34.671 INFO:teuthology.orchestra.run.smithi179.stdout:/var/lib/ceph 2024-04-16T15:52:34.671 INFO:teuthology.orchestra.run.smithi179.stdout:/var/lib/ceph/osd/ceph-4 2024-04-16T15:52:34.671 INFO:teuthology.orchestra.run.smithi179.stdout:/var/lib/ceph/osd/ceph-5 2024-04-16T15:52:34.671 INFO:teuthology.orchestra.run.smithi179.stdout:/var/lib/ceph/osd/ceph-6 2024-04-16T15:52:34.672 INFO:teuthology.orchestra.run.smithi179.stdout:/var/lib/ceph/osd/ceph-7 2024-04-16T15:52:34.672 INFO:teuthology.orchestra.run.smithi179.stdout:/run/netns 2024-04-16T15:52:34.672 INFO:teuthology.orchestra.run.smithi179.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-16T15:52:34.672 INFO:teuthology.orchestra.run.smithi179.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-16T15:52:34.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:52:34.672 DEBUG:teuthology.orchestra.run.smithi179:> ls /sys/fs/fuse/connections 2024-04-16T15:52:34.673 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi179.stderr:2024-04-16T15:52:34.673+0000 7ff54ae10480 -1 init, newargv = 0x55713c5d7180 newargc=15 2024-04-16T15:52:34.673 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi179.stderr:ceph-fuse[43520]: starting ceph client 2024-04-16T15:52:34.677 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi179.stderr:ceph-fuse[43520]: starting fuse 2024-04-16T15:52:34.689 INFO:teuthology.orchestra.run.smithi179.stdout:41 2024-04-16T15:52:34.689 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-04-16T15:52:34.689 DEBUG:teuthology.orchestra.run.smithi179:> sudo stdin-killer -- python3 -c ' 2024-04-16T15:52:34.689 DEBUG:teuthology.orchestra.run.smithi179:> import glob 2024-04-16T15:52:34.690 DEBUG:teuthology.orchestra.run.smithi179:> import re 2024-04-16T15:52:34.690 DEBUG:teuthology.orchestra.run.smithi179:> import os 2024-04-16T15:52:34.690 DEBUG:teuthology.orchestra.run.smithi179:> import subprocess 2024-04-16T15:52:34.690 DEBUG:teuthology.orchestra.run.smithi179:> 2024-04-16T15:52:34.690 DEBUG:teuthology.orchestra.run.smithi179:> def _find_admin_socket(client_name): 2024-04-16T15:52:34.690 DEBUG:teuthology.orchestra.run.smithi179:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-04-16T15:52:34.690 DEBUG:teuthology.orchestra.run.smithi179:> files = glob.glob(asok_path) 2024-04-16T15:52:34.690 DEBUG:teuthology.orchestra.run.smithi179:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-04-16T15:52:34.690 DEBUG:teuthology.orchestra.run.smithi179:> 2024-04-16T15:52:34.690 DEBUG:teuthology.orchestra.run.smithi179:> # Given a non-glob path, it better be there 2024-04-16T15:52:34.690 DEBUG:teuthology.orchestra.run.smithi179:> if "*" not in asok_path: 2024-04-16T15:52:34.690 DEBUG:teuthology.orchestra.run.smithi179:> assert(len(files) == 1) 2024-04-16T15:52:34.690 DEBUG:teuthology.orchestra.run.smithi179:> return files[0] 2024-04-16T15:52:34.690 DEBUG:teuthology.orchestra.run.smithi179:> 2024-04-16T15:52:34.690 DEBUG:teuthology.orchestra.run.smithi179:> for f in files: 2024-04-16T15:52:34.691 DEBUG:teuthology.orchestra.run.smithi179:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-16T15:52:34.691 DEBUG:teuthology.orchestra.run.smithi179:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-16T15:52:34.691 DEBUG:teuthology.orchestra.run.smithi179:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-16T15:52:34.691 DEBUG:teuthology.orchestra.run.smithi179:> contents = proc_f.read() 2024-04-16T15:52:34.691 DEBUG:teuthology.orchestra.run.smithi179:> if mountpoint in contents: 2024-04-16T15:52:34.691 DEBUG:teuthology.orchestra.run.smithi179:> return f 2024-04-16T15:52:34.691 DEBUG:teuthology.orchestra.run.smithi179:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-16T15:52:34.691 DEBUG:teuthology.orchestra.run.smithi179:> 2024-04-16T15:52:34.691 DEBUG:teuthology.orchestra.run.smithi179:> print(_find_admin_socket("client.1")) 2024-04-16T15:52:34.691 DEBUG:teuthology.orchestra.run.smithi179:> ' 2024-04-16T15:52:34.811 INFO:teuthology.orchestra.run.smithi179.stdout:/var/run/ceph/ceph-client.1.43520.asok 2024-04-16T15:52:34.814 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:52:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T15:52:34.821 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.43520.asok 2024-04-16T15:52:34.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:52:34.822 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.43520.asok status 2024-04-16T15:52:34.959 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-04-16T15:52:34.960 INFO:teuthology.orchestra.run.smithi179.stdout: "metadata": { 2024-04-16T15:52:34.960 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_sha1": "c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f", 2024-04-16T15:52:34.960 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_version": "ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev)", 2024-04-16T15:52:34.960 INFO:teuthology.orchestra.run.smithi179.stdout: "entity_id": "1", 2024-04-16T15:52:34.960 INFO:teuthology.orchestra.run.smithi179.stdout: "hostname": "smithi179", 2024-04-16T15:52:34.960 INFO:teuthology.orchestra.run.smithi179.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-04-16T15:52:34.960 INFO:teuthology.orchestra.run.smithi179.stdout: "pid": "43520", 2024-04-16T15:52:34.960 INFO:teuthology.orchestra.run.smithi179.stdout: "root": "/" 2024-04-16T15:52:34.960 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-04-16T15:52:34.960 INFO:teuthology.orchestra.run.smithi179.stdout: "dentry_count": 0, 2024-04-16T15:52:34.960 INFO:teuthology.orchestra.run.smithi179.stdout: "dentry_pinned_count": 0, 2024-04-16T15:52:34.960 INFO:teuthology.orchestra.run.smithi179.stdout: "id": 4490, 2024-04-16T15:52:34.960 INFO:teuthology.orchestra.run.smithi179.stdout: "inst": { 2024-04-16T15:52:34.960 INFO:teuthology.orchestra.run.smithi179.stdout: "name": { 2024-04-16T15:52:34.961 INFO:teuthology.orchestra.run.smithi179.stdout: "type": "client", 2024-04-16T15:52:34.961 INFO:teuthology.orchestra.run.smithi179.stdout: "num": 4490 2024-04-16T15:52:34.961 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-04-16T15:52:34.961 INFO:teuthology.orchestra.run.smithi179.stdout: "addr": { 2024-04-16T15:52:34.961 INFO:teuthology.orchestra.run.smithi179.stdout: "type": "v1", 2024-04-16T15:52:34.961 INFO:teuthology.orchestra.run.smithi179.stdout: "addr": "192.168.0.1:0", 2024-04-16T15:52:34.961 INFO:teuthology.orchestra.run.smithi179.stdout: "nonce": 350327153 2024-04-16T15:52:34.961 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-04-16T15:52:34.961 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-04-16T15:52:34.961 INFO:teuthology.orchestra.run.smithi179.stdout: "addr": { 2024-04-16T15:52:34.961 INFO:teuthology.orchestra.run.smithi179.stdout: "type": "v1", 2024-04-16T15:52:34.961 INFO:teuthology.orchestra.run.smithi179.stdout: "addr": "192.168.0.1:0", 2024-04-16T15:52:34.961 INFO:teuthology.orchestra.run.smithi179.stdout: "nonce": 350327153 2024-04-16T15:52:34.961 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-04-16T15:52:34.962 INFO:teuthology.orchestra.run.smithi179.stdout: "inst_str": "client.4490 192.168.0.1:0/350327153", 2024-04-16T15:52:34.962 INFO:teuthology.orchestra.run.smithi179.stdout: "addr_str": "192.168.0.1:0/350327153", 2024-04-16T15:52:34.962 INFO:teuthology.orchestra.run.smithi179.stdout: "inode_count": 1, 2024-04-16T15:52:34.962 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_epoch": 6, 2024-04-16T15:52:34.962 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_epoch": 20, 2024-04-16T15:52:34.962 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_epoch_barrier": 0, 2024-04-16T15:52:34.962 INFO:teuthology.orchestra.run.smithi179.stdout: "blocklisted": false, 2024-04-16T15:52:34.962 INFO:teuthology.orchestra.run.smithi179.stdout: "fs_name": "cephfs" 2024-04-16T15:52:34.962 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-04-16T15:52:34.968 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-16T15:52:35.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.084+0000 7f5631c7b640 1 Processor -- start 2024-04-16T15:52:35.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.084+0000 7f5631c7b640 1 -- start start 2024-04-16T15:52:35.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.085+0000 7f5631c7b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f562c0b67d0 0x7f562c0b6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:35.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.085+0000 7f5631c7b640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f562c0d35e0 0x7f562c0d3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:35.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.085+0000 7f5631c7b640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f562c0b70f0 con 0x7f562c0ba720 2024-04-16T15:52:35.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.085+0000 7f5631c7b640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f562c06dda0 con 0x7f562c0d35e0 2024-04-16T15:52:35.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.085+0000 7f5631c7b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f562c06d510 con 0x7f562c0b67d0 2024-04-16T15:52:35.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.085+0000 7f562affd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f562c0ba720 0x7f562c06ce00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:59508/0 (socket says 172.21.15.132:59508) 2024-04-16T15:52:35.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.085+0000 7f562affd640 1 -- 172.21.15.132:0/1136523558 learned_addr learned my addr 172.21.15.132:0/1136523558 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:35.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.085+0000 7f562bfff640 1 --2- 172.21.15.132:0/1136523558 >> v2:172.21.15.179:3300/0 conn(0x7f562c0d35e0 0x7f562c0d3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:35.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.085+0000 7f562b7fe640 1 --2- 172.21.15.132:0/1136523558 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f562c0b67d0 0x7f562c0b6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:35.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.086+0000 7f562a7fc640 1 -- 172.21.15.132:0/1136523558 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2806346562 0 0) 0x7f562c0b70f0 con 0x7f562c0ba720 2024-04-16T15:52:35.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.086+0000 7f562a7fc640 1 -- 172.21.15.132:0/1136523558 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5614003520 con 0x7f562c0ba720 2024-04-16T15:52:35.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.086+0000 7f562b7fe640 1 -- 172.21.15.132:0/1136523558 >> v2:172.21.15.179:3300/0 conn(0x7f562c0d35e0 msgr2=0x7f562c0d3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:35.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.086+0000 7f562b7fe640 1 --2- 172.21.15.132:0/1136523558 >> v2:172.21.15.179:3300/0 conn(0x7f562c0d35e0 0x7f562c0d3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:35.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.086+0000 7f562b7fe640 1 -- 172.21.15.132:0/1136523558 >> v1:172.21.15.132:6789/0 conn(0x7f562c0ba720 legacy=0x7f562c06ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:35.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.086+0000 7f562b7fe640 1 -- 172.21.15.132:0/1136523558 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f562c06d7e0 con 0x7f562c0b67d0 2024-04-16T15:52:35.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.086+0000 7f562bfff640 1 --2- 172.21.15.132:0/1136523558 >> v2:172.21.15.179:3300/0 conn(0x7f562c0d35e0 0x7f562c0d3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:52:35.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.087+0000 7f562b7fe640 1 --2- 172.21.15.132:0/1136523558 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f562c0b67d0 0x7f562c0b6bb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f561c0097a0 tx=0x7f561c02b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12ab3484815d509a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:35.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.087+0000 7f562a7fc640 1 -- 172.21.15.132:0/1136523558 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f561c0315a0 con 0x7f562c0b67d0 2024-04-16T15:52:35.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.087+0000 7f562a7fc640 1 -- 172.21.15.132:0/1136523558 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f561c037070 con 0x7f562c0b67d0 2024-04-16T15:52:35.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.087+0000 7f562a7fc640 1 -- 172.21.15.132:0/1136523558 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f561c031960 con 0x7f562c0b67d0 2024-04-16T15:52:35.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.087+0000 7f5631c7b640 1 -- 172.21.15.132:0/1136523558 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f562c0b67d0 msgr2=0x7f562c0b6bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:35.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.087+0000 7f5631c7b640 1 --2- 172.21.15.132:0/1136523558 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f562c0b67d0 0x7f562c0b6bb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f561c0097a0 tx=0x7f561c02b840 comp rx=0 tx=0).stop 2024-04-16T15:52:35.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.087+0000 7f5631c7b640 1 -- 172.21.15.132:0/1136523558 shutdown_connections 2024-04-16T15:52:35.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.087+0000 7f5631c7b640 1 --2- 172.21.15.132:0/1136523558 >> v2:172.21.15.179:3300/0 conn(0x7f562c0d35e0 0x7f562c0d3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:35.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.087+0000 7f5631c7b640 1 --2- 172.21.15.132:0/1136523558 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f562c0b67d0 0x7f562c0b6bb0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:35.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.087+0000 7f5631c7b640 1 -- 172.21.15.132:0/1136523558 >> 172.21.15.132:0/1136523558 conn(0x7f562c0d1810 msgr2=0x7f562c0d1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:35.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.087+0000 7f5631c7b640 1 -- 172.21.15.132:0/1136523558 shutdown_connections 2024-04-16T15:52:35.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.087+0000 7f5631c7b640 1 -- 172.21.15.132:0/1136523558 wait complete. 2024-04-16T15:52:35.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.089+0000 7f5631c7b640 1 Processor -- start 2024-04-16T15:52:35.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.089+0000 7f5631c7b640 1 -- start start 2024-04-16T15:52:35.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.089+0000 7f5631c7b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f562c0b67d0 0x7f562c154a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:35.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.089+0000 7f5631c7b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f562c0d35e0 0x7f562c1f4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:35.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.090+0000 7f5631c7b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f562c1ea0e0 0x7f562c1ea540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:35.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.090+0000 7f5631c7b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f562c0d30c0 con 0x7f562c0d35e0 2024-04-16T15:52:35.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.090+0000 7f5631c7b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f562c0d2de0 con 0x7f562c1ea0e0 2024-04-16T15:52:35.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.090+0000 7f5631c7b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f562c0b7aa0 con 0x7f562c0b67d0 2024-04-16T15:52:35.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.090+0000 7f562affd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f562c0d35e0 0x7f562c1f4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:35.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.090+0000 7f562affd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f562c0d35e0 0x7f562c1f4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42584/0 (socket says 172.21.15.132:42584) 2024-04-16T15:52:35.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.090+0000 7f562affd640 1 -- 172.21.15.132:0/1532497793 learned_addr learned my addr 172.21.15.132:0/1532497793 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:35.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.090+0000 7f562bfff640 1 --2- 172.21.15.132:0/1532497793 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f562c1ea0e0 0x7f562c1ea540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:35.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.090+0000 7f562b7fe640 1 --2- 172.21.15.132:0/1532497793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f562c0b67d0 0x7f562c154a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:35.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.090+0000 7f562affd640 1 -- 172.21.15.132:0/1532497793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f562c0b67d0 msgr2=0x7f562c154a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:35.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.090+0000 7f562affd640 1 --2- 172.21.15.132:0/1532497793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f562c0b67d0 0x7f562c154a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:35.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.090+0000 7f562affd640 1 -- 172.21.15.132:0/1532497793 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f562c1ea0e0 msgr2=0x7f562c1ea540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:35.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.090+0000 7f562affd640 1 --2- 172.21.15.132:0/1532497793 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f562c1ea0e0 0x7f562c1ea540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:35.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.090+0000 7f562affd640 1 -- 172.21.15.132:0/1532497793 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f562c154f70 con 0x7f562c0d35e0 2024-04-16T15:52:35.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.090+0000 7f562affd640 1 --2- 172.21.15.132:0/1532497793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f562c0d35e0 0x7f562c1f4700 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f562000c430 tx=0x7f562000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:35.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.090+0000 7f5613fff640 1 -- 172.21.15.132:0/1532497793 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5620017070 con 0x7f562c0d35e0 2024-04-16T15:52:35.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.090+0000 7f5613fff640 1 -- 172.21.15.132:0/1532497793 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5620005ce0 con 0x7f562c0d35e0 2024-04-16T15:52:35.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.090+0000 7f5631c7b640 1 -- 172.21.15.132:0/1532497793 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f562c15fa40 con 0x7f562c0d35e0 2024-04-16T15:52:35.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.090+0000 7f5613fff640 1 -- 172.21.15.132:0/1532497793 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56200072f0 con 0x7f562c0d35e0 2024-04-16T15:52:35.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.090+0000 7f5631c7b640 1 -- 172.21.15.132:0/1532497793 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f562c1602e0 con 0x7f562c0d35e0 2024-04-16T15:52:35.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.091+0000 7f5631c7b640 1 -- 172.21.15.132:0/1532497793 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f562c15fe30 con 0x7f562c0d35e0 2024-04-16T15:52:35.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.092+0000 7f5613fff640 1 -- 172.21.15.132:0/1532497793 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f562001a070 con 0x7f562c0d35e0 2024-04-16T15:52:35.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.092+0000 7f5613fff640 1 --2- 172.21.15.132:0/1532497793 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f561806c8f0 0x7f561806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:35.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.092+0000 7f5613fff640 1 -- 172.21.15.132:0/1532497793 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f562008ae30 con 0x7f562c0d35e0 2024-04-16T15:52:35.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.092+0000 7f562b7fe640 1 --2- 172.21.15.132:0/1532497793 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f561806c8f0 0x7f561806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:35.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.093+0000 7f562b7fe640 1 --2- 172.21.15.132:0/1532497793 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f561806c8f0 0x7f561806edb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f561c036000 tx=0x7f561c03d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:35.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.097+0000 7f5613fff640 1 -- 172.21.15.132:0/1532497793 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f562c154f70 con 0x7f562c0d35e0 2024-04-16T15:52:35.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.310+0000 7f5631c7b640 1 -- 172.21.15.132:0/1532497793 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f562c0b7680 con 0x7f562c0d35e0 2024-04-16T15:52:35.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.311+0000 7f5613fff640 1 -- 172.21.15.132:0/1532497793 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7f562c0b7680 con 0x7f562c0d35e0 2024-04-16T15:52:35.316 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-16T15:52:35.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.313+0000 7f5631c7b640 1 -- 172.21.15.132:0/1532497793 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f561806c8f0 msgr2=0x7f561806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:35.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.313+0000 7f5631c7b640 1 --2- 172.21.15.132:0/1532497793 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f561806c8f0 0x7f561806edb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f561c036000 tx=0x7f561c03d040 comp rx=0 tx=0).stop 2024-04-16T15:52:35.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.313+0000 7f5631c7b640 1 -- 172.21.15.132:0/1532497793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f562c0d35e0 msgr2=0x7f562c1f4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:35.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.313+0000 7f5631c7b640 1 --2- 172.21.15.132:0/1532497793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f562c0d35e0 0x7f562c1f4700 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f562000c430 tx=0x7f562000c830 comp rx=0 tx=0).stop 2024-04-16T15:52:35.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.313+0000 7f5631c7b640 1 -- 172.21.15.132:0/1532497793 shutdown_connections 2024-04-16T15:52:35.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.313+0000 7f5631c7b640 1 --2- 172.21.15.132:0/1532497793 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f561806c8f0 0x7f561806edb0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:35.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.313+0000 7f5631c7b640 1 --2- 172.21.15.132:0/1532497793 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f562c1ea0e0 0x7f562c1ea540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:35.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.313+0000 7f5631c7b640 1 --2- 172.21.15.132:0/1532497793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f562c0d35e0 0x7f562c1f4700 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:35.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.313+0000 7f5631c7b640 1 --2- 172.21.15.132:0/1532497793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f562c0b67d0 0x7f562c154a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:35.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.313+0000 7f5631c7b640 1 -- 172.21.15.132:0/1532497793 >> 172.21.15.132:0/1532497793 conn(0x7f562c0d1810 msgr2=0x7f562c0d5150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:35.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.313+0000 7f5631c7b640 1 -- 172.21.15.132:0/1532497793 shutdown_connections 2024-04-16T15:52:35.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:35.313+0000 7f5631c7b640 1 -- 172.21.15.132:0/1532497793 wait complete. 2024-04-16T15:52:35.323 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-16T15:52:35.323 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-16T15:52:35.323 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi179.front.sepia.ceph.com 2024-04-16T15:52:35.324 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-04-16T15:52:35.324 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-16T15:52:35.324 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-16T15:52:35.324 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-16T15:52:35.324 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-16T15:52:35.324 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-04-16T15:52:35.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:52:35.325 DEBUG:teuthology.orchestra.run.smithi179:> ip addr 2024-04-16T15:52:35.342 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-16T15:52:35.343 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-16T15:52:35.343 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2024-04-16T15:52:35.343 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:52:35.343 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2024-04-16T15:52:35.343 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:52:35.343 INFO:teuthology.orchestra.run.smithi179.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T15:52:35.344 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:34 brd ff:ff:ff:ff:ff:ff 2024-04-16T15:52:35.344 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f0 2024-04-16T15:52:35.344 INFO:teuthology.orchestra.run.smithi179.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T15:52:35.344 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:35 brd ff:ff:ff:ff:ff:ff 2024-04-16T15:52:35.344 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f1 2024-04-16T15:52:35.345 INFO:teuthology.orchestra.run.smithi179.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T15:52:35.345 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5a brd ff:ff:ff:ff:ff:ff 2024-04-16T15:52:35.345 INFO:teuthology.orchestra.run.smithi179.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-16T15:52:35.345 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5b brd ff:ff:ff:ff:ff:ff 2024-04-16T15:52:35.346 INFO:teuthology.orchestra.run.smithi179.stdout: inet 172.21.15.179/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-16T15:52:35.346 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft 42730sec preferred_lft 42730sec 2024-04-16T15:52:35.347 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::ec4:7aff:fe88:725b/64 scope link 2024-04-16T15:52:35.347 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:52:35.347 INFO:teuthology.orchestra.run.smithi179.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-16T15:52:35.347 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether d6:9c:69:d6:d2:14 brd ff:ff:ff:ff:ff:ff 2024-04-16T15:52:35.347 INFO:teuthology.orchestra.run.smithi179.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-16T15:52:35.347 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:52:35.347 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::77:48ff:fe0c:46db/64 scope link 2024-04-16T15:52:35.347 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:52:35.347 INFO:teuthology.orchestra.run.smithi179.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-16T15:52:35.347 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether d6:9c:69:d6:d2:14 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-16T15:52:35.347 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::d49c:69ff:fed6:d214/64 scope link tentative 2024-04-16T15:52:35.347 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:52:35.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:52:35.348 DEBUG:teuthology.orchestra.run.smithi179:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-16T15:52:35.411 INFO:teuthology.orchestra.run.smithi179.stdout:1 2024-04-16T15:52:35.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:52:35.412 DEBUG:teuthology.orchestra.run.smithi179:> route 2024-04-16T15:52:35.469 INFO:teuthology.orchestra.run.smithi179.stdout:Kernel IP routing table 2024-04-16T15:52:35.469 INFO:teuthology.orchestra.run.smithi179.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-16T15:52:35.469 INFO:teuthology.orchestra.run.smithi179.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-16T15:52:35.469 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-16T15:52:35.469 INFO:teuthology.orchestra.run.smithi179.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-16T15:52:35.470 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T15:52:35.470 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2024-04-16T15:52:35.470 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-16T15:52:35.470 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-16T15:52:35.470 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-16T15:52:35.470 DEBUG:teuthology.orchestra.run.smithi179:> ') 2024-04-16T15:52:35.559 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:52:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T15:52:35.605 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:52:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T15:52:35.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:52:35.612 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2024-04-16T15:52:35.628 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-16T15:52:35.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:52:35.630 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list-id 2024-04-16T15:52:35.685 INFO:teuthology.orchestra.run.smithi179.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-04-16T15:52:35.686 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T15:52:35.686 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2024-04-16T15:52:35.686 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-16T15:52:35.686 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-04-16T15:52:35.686 DEBUG:teuthology.orchestra.run.smithi179:> ') 2024-04-16T15:52:35.776 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:52:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T15:52:35.806 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:52:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T15:52:35.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:52:35.812 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-16T15:52:35.841 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-16T15:52:35.841 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-16T15:52:35.841 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2024-04-16T15:52:35.841 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:52:35.841 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2024-04-16T15:52:35.841 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:52:35.841 INFO:teuthology.orchestra.run.smithi179.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-16T15:52:35.841 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether e6:10:81:4e:2b:35 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-16T15:52:35.842 INFO:teuthology.orchestra.run.smithi179.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-16T15:52:35.842 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:52:35.842 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::e410:81ff:fe4e:2b35/64 scope link 2024-04-16T15:52:35.842 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:52:35.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:52:35.843 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-16T15:52:35.912 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-16T15:52:35.912 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-16T15:52:35.912 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2024-04-16T15:52:35.912 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:52:35.913 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2024-04-16T15:52:35.913 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:52:35.913 INFO:teuthology.orchestra.run.smithi179.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-16T15:52:35.913 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether e6:10:81:4e:2b:35 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-16T15:52:35.913 INFO:teuthology.orchestra.run.smithi179.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-16T15:52:35.913 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:52:35.913 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::e410:81ff:fe4e:2b35/64 scope link 2024-04-16T15:52:35.913 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:52:35.914 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-04-16T15:52:35.915 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T15:52:35.915 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2024-04-16T15:52:35.915 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-04-16T15:52:35.915 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-16T15:52:35.915 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-04-16T15:52:35.915 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-04-16T15:52:35.915 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-04-16T15:52:35.915 DEBUG:teuthology.orchestra.run.smithi179:> ') 2024-04-16T15:52:36.005 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:52:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T15:52:36.083 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:52:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T15:52:36.091 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T15:52:36.091 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2024-04-16T15:52:36.092 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set brx.1 up 2024-04-16T15:52:36.092 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set dev brx.1 master ceph-brx 2024-04-16T15:52:36.092 DEBUG:teuthology.orchestra.run.smithi179:> ') 2024-04-16T15:52:36.142 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:52:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T15:52:36.171 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:52:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T15:52:36.177 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-04-16T15:52:36.178 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T15:52:36.178 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-04-16T15:52:36.193 INFO:teuthology.orchestra.run.smithi179.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-04-16T15:52:36.193 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T15:52:36.193 DEBUG:teuthology.orchestra.run.smithi179:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-04-16T15:52:36.249 DEBUG:teuthology.orchestra.run.smithi179:> sudo modprobe fuse 2024-04-16T15:52:36.318 DEBUG:teuthology.orchestra.run.smithi179:> cat /proc/self/mounts | awk '{print $2}' 2024-04-16T15:52:36.375 INFO:teuthology.orchestra.run.smithi179.stdout:/proc 2024-04-16T15:52:36.375 INFO:teuthology.orchestra.run.smithi179.stdout:/sys 2024-04-16T15:52:36.375 INFO:teuthology.orchestra.run.smithi179.stdout:/dev 2024-04-16T15:52:36.375 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/kernel/security 2024-04-16T15:52:36.376 INFO:teuthology.orchestra.run.smithi179.stdout:/dev/shm 2024-04-16T15:52:36.376 INFO:teuthology.orchestra.run.smithi179.stdout:/dev/pts 2024-04-16T15:52:36.376 INFO:teuthology.orchestra.run.smithi179.stdout:/run 2024-04-16T15:52:36.376 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/fs/cgroup 2024-04-16T15:52:36.376 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/fs/pstore 2024-04-16T15:52:36.376 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/fs/bpf 2024-04-16T15:52:36.376 INFO:teuthology.orchestra.run.smithi179.stdout:/ 2024-04-16T15:52:36.376 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/fs/selinux 2024-04-16T15:52:36.376 INFO:teuthology.orchestra.run.smithi179.stdout:/proc/sys/fs/binfmt_misc 2024-04-16T15:52:36.376 INFO:teuthology.orchestra.run.smithi179.stdout:/dev/hugepages 2024-04-16T15:52:36.377 INFO:teuthology.orchestra.run.smithi179.stdout:/dev/mqueue 2024-04-16T15:52:36.377 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/kernel/debug 2024-04-16T15:52:36.377 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/kernel/tracing 2024-04-16T15:52:36.377 INFO:teuthology.orchestra.run.smithi179.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-16T15:52:36.377 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/fs/fuse/connections 2024-04-16T15:52:36.377 INFO:teuthology.orchestra.run.smithi179.stdout:/run/credentials/systemd-sysctl.service 2024-04-16T15:52:36.377 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/kernel/config 2024-04-16T15:52:36.377 INFO:teuthology.orchestra.run.smithi179.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-16T15:52:36.377 INFO:teuthology.orchestra.run.smithi179.stdout:/var/lib/nfs/rpc_pipefs 2024-04-16T15:52:36.377 INFO:teuthology.orchestra.run.smithi179.stdout:/run/user/1000 2024-04-16T15:52:36.377 INFO:teuthology.orchestra.run.smithi179.stdout:/var/lib/ceph 2024-04-16T15:52:36.377 INFO:teuthology.orchestra.run.smithi179.stdout:/var/lib/ceph/osd/ceph-4 2024-04-16T15:52:36.377 INFO:teuthology.orchestra.run.smithi179.stdout:/var/lib/ceph/osd/ceph-5 2024-04-16T15:52:36.377 INFO:teuthology.orchestra.run.smithi179.stdout:/var/lib/ceph/osd/ceph-6 2024-04-16T15:52:36.377 INFO:teuthology.orchestra.run.smithi179.stdout:/var/lib/ceph/osd/ceph-7 2024-04-16T15:52:36.378 INFO:teuthology.orchestra.run.smithi179.stdout:/run/netns 2024-04-16T15:52:36.378 INFO:teuthology.orchestra.run.smithi179.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-16T15:52:36.378 INFO:teuthology.orchestra.run.smithi179.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-16T15:52:36.378 INFO:teuthology.orchestra.run.smithi179.stdout:/home/ubuntu/cephtest/mnt.1 2024-04-16T15:52:36.378 INFO:teuthology.orchestra.run.smithi179.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-16T15:52:36.378 INFO:teuthology.orchestra.run.smithi179.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-16T15:52:36.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:52:36.379 DEBUG:teuthology.orchestra.run.smithi179:> ls /sys/fs/fuse/connections 2024-04-16T15:52:36.430 INFO:teuthology.orchestra.run.smithi179.stdout:41 2024-04-16T15:52:36.430 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [41] 2024-04-16T15:52:36.431 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-04-16T15:52:36.473 DEBUG:teuthology.orchestra.run.smithi179:> sudo modprobe fuse 2024-04-16T15:52:36.501 DEBUG:teuthology.orchestra.run.smithi179:> cat /proc/self/mounts | awk '{print $2}' 2024-04-16T15:52:36.556 INFO:teuthology.orchestra.run.smithi179.stdout:/proc 2024-04-16T15:52:36.556 INFO:teuthology.orchestra.run.smithi179.stdout:/sys 2024-04-16T15:52:36.556 INFO:teuthology.orchestra.run.smithi179.stdout:/dev 2024-04-16T15:52:36.557 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/kernel/security 2024-04-16T15:52:36.557 INFO:teuthology.orchestra.run.smithi179.stdout:/dev/shm 2024-04-16T15:52:36.557 INFO:teuthology.orchestra.run.smithi179.stdout:/dev/pts 2024-04-16T15:52:36.557 INFO:teuthology.orchestra.run.smithi179.stdout:/run 2024-04-16T15:52:36.557 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/fs/cgroup 2024-04-16T15:52:36.557 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/fs/pstore 2024-04-16T15:52:36.557 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/fs/bpf 2024-04-16T15:52:36.557 INFO:teuthology.orchestra.run.smithi179.stdout:/ 2024-04-16T15:52:36.557 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/fs/selinux 2024-04-16T15:52:36.557 INFO:teuthology.orchestra.run.smithi179.stdout:/proc/sys/fs/binfmt_misc 2024-04-16T15:52:36.557 INFO:teuthology.orchestra.run.smithi179.stdout:/dev/hugepages 2024-04-16T15:52:36.557 INFO:teuthology.orchestra.run.smithi179.stdout:/dev/mqueue 2024-04-16T15:52:36.558 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/kernel/debug 2024-04-16T15:52:36.558 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/kernel/tracing 2024-04-16T15:52:36.558 INFO:teuthology.orchestra.run.smithi179.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-16T15:52:36.558 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/fs/fuse/connections 2024-04-16T15:52:36.558 INFO:teuthology.orchestra.run.smithi179.stdout:/run/credentials/systemd-sysctl.service 2024-04-16T15:52:36.558 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/kernel/config 2024-04-16T15:52:36.558 INFO:teuthology.orchestra.run.smithi179.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-16T15:52:36.558 INFO:teuthology.orchestra.run.smithi179.stdout:/var/lib/nfs/rpc_pipefs 2024-04-16T15:52:36.558 INFO:teuthology.orchestra.run.smithi179.stdout:/run/user/1000 2024-04-16T15:52:36.558 INFO:teuthology.orchestra.run.smithi179.stdout:/var/lib/ceph 2024-04-16T15:52:36.558 INFO:teuthology.orchestra.run.smithi179.stdout:/var/lib/ceph/osd/ceph-4 2024-04-16T15:52:36.558 INFO:teuthology.orchestra.run.smithi179.stdout:/var/lib/ceph/osd/ceph-5 2024-04-16T15:52:36.559 INFO:teuthology.orchestra.run.smithi179.stdout:/var/lib/ceph/osd/ceph-6 2024-04-16T15:52:36.559 INFO:teuthology.orchestra.run.smithi179.stdout:/var/lib/ceph/osd/ceph-7 2024-04-16T15:52:36.559 INFO:teuthology.orchestra.run.smithi179.stdout:/run/netns 2024-04-16T15:52:36.559 INFO:teuthology.orchestra.run.smithi179.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-16T15:52:36.559 INFO:teuthology.orchestra.run.smithi179.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-16T15:52:36.559 INFO:teuthology.orchestra.run.smithi179.stdout:/home/ubuntu/cephtest/mnt.1 2024-04-16T15:52:36.559 INFO:teuthology.orchestra.run.smithi179.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-16T15:52:36.559 INFO:teuthology.orchestra.run.smithi179.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-16T15:52:36.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:52:36.561 DEBUG:teuthology.orchestra.run.smithi179:> ls /sys/fs/fuse/connections 2024-04-16T15:52:36.563 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi179.stderr:2024-04-16T15:52:36.563+0000 7f6f58767480 -1 init, newargv = 0x55e5975f6840 newargc=15 2024-04-16T15:52:36.563 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi179.stderr:ceph-fuse[43987]: starting ceph client 2024-04-16T15:52:36.567 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi179.stderr:ceph-fuse[43987]: starting fuse 2024-04-16T15:52:36.579 INFO:teuthology.orchestra.run.smithi179.stdout:41 2024-04-16T15:52:36.579 INFO:teuthology.orchestra.run.smithi179.stdout:44 2024-04-16T15:52:36.579 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41, 44] 2024-04-16T15:52:36.580 DEBUG:teuthology.orchestra.run.smithi179:> sudo stdin-killer -- python3 -c ' 2024-04-16T15:52:36.580 DEBUG:teuthology.orchestra.run.smithi179:> import glob 2024-04-16T15:52:36.580 DEBUG:teuthology.orchestra.run.smithi179:> import re 2024-04-16T15:52:36.580 DEBUG:teuthology.orchestra.run.smithi179:> import os 2024-04-16T15:52:36.580 DEBUG:teuthology.orchestra.run.smithi179:> import subprocess 2024-04-16T15:52:36.580 DEBUG:teuthology.orchestra.run.smithi179:> 2024-04-16T15:52:36.580 DEBUG:teuthology.orchestra.run.smithi179:> def _find_admin_socket(client_name): 2024-04-16T15:52:36.580 DEBUG:teuthology.orchestra.run.smithi179:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-04-16T15:52:36.580 DEBUG:teuthology.orchestra.run.smithi179:> files = glob.glob(asok_path) 2024-04-16T15:52:36.580 DEBUG:teuthology.orchestra.run.smithi179:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-04-16T15:52:36.580 DEBUG:teuthology.orchestra.run.smithi179:> 2024-04-16T15:52:36.580 DEBUG:teuthology.orchestra.run.smithi179:> # Given a non-glob path, it better be there 2024-04-16T15:52:36.580 DEBUG:teuthology.orchestra.run.smithi179:> if "*" not in asok_path: 2024-04-16T15:52:36.581 DEBUG:teuthology.orchestra.run.smithi179:> assert(len(files) == 1) 2024-04-16T15:52:36.581 DEBUG:teuthology.orchestra.run.smithi179:> return files[0] 2024-04-16T15:52:36.581 DEBUG:teuthology.orchestra.run.smithi179:> 2024-04-16T15:52:36.581 DEBUG:teuthology.orchestra.run.smithi179:> for f in files: 2024-04-16T15:52:36.581 DEBUG:teuthology.orchestra.run.smithi179:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-16T15:52:36.581 DEBUG:teuthology.orchestra.run.smithi179:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-16T15:52:36.581 DEBUG:teuthology.orchestra.run.smithi179:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-16T15:52:36.581 DEBUG:teuthology.orchestra.run.smithi179:> contents = proc_f.read() 2024-04-16T15:52:36.581 DEBUG:teuthology.orchestra.run.smithi179:> if mountpoint in contents: 2024-04-16T15:52:36.581 DEBUG:teuthology.orchestra.run.smithi179:> return f 2024-04-16T15:52:36.581 DEBUG:teuthology.orchestra.run.smithi179:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-16T15:52:36.581 DEBUG:teuthology.orchestra.run.smithi179:> 2024-04-16T15:52:36.581 DEBUG:teuthology.orchestra.run.smithi179:> print(_find_admin_socket("client.3")) 2024-04-16T15:52:36.581 DEBUG:teuthology.orchestra.run.smithi179:> ' 2024-04-16T15:52:36.702 INFO:teuthology.orchestra.run.smithi179.stdout:/var/run/ceph/ceph-client.3.43987.asok 2024-04-16T15:52:36.706 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-16T15:52:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T15:52:36.713 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.43987.asok 2024-04-16T15:52:36.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:52:36.714 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.43987.asok status 2024-04-16T15:52:36.852 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-04-16T15:52:36.852 INFO:teuthology.orchestra.run.smithi179.stdout: "metadata": { 2024-04-16T15:52:36.852 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_sha1": "c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f", 2024-04-16T15:52:36.852 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_version": "ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev)", 2024-04-16T15:52:36.852 INFO:teuthology.orchestra.run.smithi179.stdout: "entity_id": "3", 2024-04-16T15:52:36.852 INFO:teuthology.orchestra.run.smithi179.stdout: "hostname": "smithi179", 2024-04-16T15:52:36.853 INFO:teuthology.orchestra.run.smithi179.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-04-16T15:52:36.853 INFO:teuthology.orchestra.run.smithi179.stdout: "pid": "43987", 2024-04-16T15:52:36.853 INFO:teuthology.orchestra.run.smithi179.stdout: "root": "/" 2024-04-16T15:52:36.853 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-04-16T15:52:36.853 INFO:teuthology.orchestra.run.smithi179.stdout: "dentry_count": 0, 2024-04-16T15:52:36.853 INFO:teuthology.orchestra.run.smithi179.stdout: "dentry_pinned_count": 0, 2024-04-16T15:52:36.853 INFO:teuthology.orchestra.run.smithi179.stdout: "id": 4600, 2024-04-16T15:52:36.853 INFO:teuthology.orchestra.run.smithi179.stdout: "inst": { 2024-04-16T15:52:36.853 INFO:teuthology.orchestra.run.smithi179.stdout: "name": { 2024-04-16T15:52:36.853 INFO:teuthology.orchestra.run.smithi179.stdout: "type": "client", 2024-04-16T15:52:36.853 INFO:teuthology.orchestra.run.smithi179.stdout: "num": 4600 2024-04-16T15:52:36.854 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-04-16T15:52:36.854 INFO:teuthology.orchestra.run.smithi179.stdout: "addr": { 2024-04-16T15:52:36.854 INFO:teuthology.orchestra.run.smithi179.stdout: "type": "v1", 2024-04-16T15:52:36.854 INFO:teuthology.orchestra.run.smithi179.stdout: "addr": "192.168.0.2:0", 2024-04-16T15:52:36.854 INFO:teuthology.orchestra.run.smithi179.stdout: "nonce": 3457877061 2024-04-16T15:52:36.854 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-04-16T15:52:36.854 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-04-16T15:52:36.854 INFO:teuthology.orchestra.run.smithi179.stdout: "addr": { 2024-04-16T15:52:36.854 INFO:teuthology.orchestra.run.smithi179.stdout: "type": "v1", 2024-04-16T15:52:36.855 INFO:teuthology.orchestra.run.smithi179.stdout: "addr": "192.168.0.2:0", 2024-04-16T15:52:36.855 INFO:teuthology.orchestra.run.smithi179.stdout: "nonce": 3457877061 2024-04-16T15:52:36.855 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-04-16T15:52:36.855 INFO:teuthology.orchestra.run.smithi179.stdout: "inst_str": "client.4600 192.168.0.2:0/3457877061", 2024-04-16T15:52:36.855 INFO:teuthology.orchestra.run.smithi179.stdout: "addr_str": "192.168.0.2:0/3457877061", 2024-04-16T15:52:36.855 INFO:teuthology.orchestra.run.smithi179.stdout: "inode_count": 1, 2024-04-16T15:52:36.855 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_epoch": 6, 2024-04-16T15:52:36.855 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_epoch": 20, 2024-04-16T15:52:36.855 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_epoch_barrier": 0, 2024-04-16T15:52:36.855 INFO:teuthology.orchestra.run.smithi179.stdout: "blocklisted": false, 2024-04-16T15:52:36.855 INFO:teuthology.orchestra.run.smithi179.stdout: "fs_name": "cephfs" 2024-04-16T15:52:36.855 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-04-16T15:52:36.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:52:36.860 DEBUG:teuthology.orchestra.run.smithi132:> stat --file-system '--printf=%T 2024-04-16T15:52:36.860 DEBUG:teuthology.orchestra.run.smithi132:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-16T15:52:36.880 INFO:teuthology.orchestra.run.smithi132.stdout:fuseblk 2024-04-16T15:52:36.881 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-16T15:52:36.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:52:36.881 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-16T15:52:36.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:52:36.956 DEBUG:teuthology.orchestra.run.smithi132:> stat --file-system '--printf=%T 2024-04-16T15:52:36.956 DEBUG:teuthology.orchestra.run.smithi132:> ' -- /home/ubuntu/cephtest/mnt.2 2024-04-16T15:52:37.014 INFO:teuthology.orchestra.run.smithi132.stdout:fuseblk 2024-04-16T15:52:37.014 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-04-16T15:52:37.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:52:37.015 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-04-16T15:52:37.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:52:37.090 DEBUG:teuthology.orchestra.run.smithi179:> stat --file-system '--printf=%T 2024-04-16T15:52:37.090 DEBUG:teuthology.orchestra.run.smithi179:> ' -- /home/ubuntu/cephtest/mnt.1 2024-04-16T15:52:37.107 INFO:teuthology.orchestra.run.smithi179.stdout:fuseblk 2024-04-16T15:52:37.107 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-04-16T15:52:37.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:52:37.107 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-16T15:52:37.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:52:37.176 DEBUG:teuthology.orchestra.run.smithi179:> stat --file-system '--printf=%T 2024-04-16T15:52:37.176 DEBUG:teuthology.orchestra.run.smithi179:> ' -- /home/ubuntu/cephtest/mnt.3 2024-04-16T15:52:37.232 INFO:teuthology.orchestra.run.smithi179.stdout:fuseblk 2024-04-16T15:52:37.232 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-04-16T15:52:37.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:52:37.233 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-04-16T15:52:37.301 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-04-16T15:52:37.318 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:52:37.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.428+0000 7fe384d1c640 1 Processor -- start 2024-04-16T15:52:37.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.428+0000 7fe384d1c640 1 -- start start 2024-04-16T15:52:37.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.429+0000 7fe384d1c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe380151e90 0x7fe3800cf9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:37.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.429+0000 7fe384d1c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3800cec90 con 0x7fe3800b5cc0 2024-04-16T15:52:37.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.429+0000 7fe384d1c640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3800cef10 con 0x7fe38006e3a0 2024-04-16T15:52:37.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.429+0000 7fe384d1c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fe3800cf540 con 0x7fe380151e90 2024-04-16T15:52:37.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.429+0000 7fe37e59c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe380151e90 0x7fe3800cf9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:37.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.429+0000 7fe37dd9b640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fe3800b5cc0 0x7fe38006dc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:59520/0 (socket says 172.21.15.132:59520) 2024-04-16T15:52:37.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.429+0000 7fe37dd9b640 1 -- 172.21.15.132:0/2705592741 learned_addr learned my addr 172.21.15.132:0/2705592741 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:37.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.429+0000 7fe37e59c640 1 -- 172.21.15.132:0/2705592741 >> v1:172.21.15.179:6789/0 conn(0x7fe38006e3a0 legacy=0x7fe38015b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:37.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.429+0000 7fe37e59c640 1 -- 172.21.15.132:0/2705592741 >> v1:172.21.15.132:6789/0 conn(0x7fe3800b5cc0 legacy=0x7fe38006dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:37.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.429+0000 7fe37e59c640 1 -- 172.21.15.132:0/2705592741 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe380152270 con 0x7fe380151e90 2024-04-16T15:52:37.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.429+0000 7fe37d59a640 1 -- 172.21.15.132:0/2705592741 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3294768357 0 0) 0x7fe374001110 con 0x7fe3800b5cc0 2024-04-16T15:52:37.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.430+0000 7fe37e59c640 1 --2- 172.21.15.132:0/2705592741 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe380151e90 0x7fe3800cf9d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe370009d90 tx=0x7fe37002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ad017c3bc518e68 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:37.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.430+0000 7fe37d59a640 1 -- 172.21.15.132:0/2705592741 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe370039070 con 0x7fe380151e90 2024-04-16T15:52:37.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.430+0000 7fe37d59a640 1 -- 172.21.15.132:0/2705592741 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe37002cc60 con 0x7fe380151e90 2024-04-16T15:52:37.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.430+0000 7fe37d59a640 1 -- 172.21.15.132:0/2705592741 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe370034660 con 0x7fe380151e90 2024-04-16T15:52:37.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.431+0000 7fe384d1c640 1 -- 172.21.15.132:0/2705592741 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe380151e90 msgr2=0x7fe3800cf9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:37.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.431+0000 7fe384d1c640 1 --2- 172.21.15.132:0/2705592741 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe380151e90 0x7fe3800cf9d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe370009d90 tx=0x7fe37002beb0 comp rx=0 tx=0).stop 2024-04-16T15:52:37.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.431+0000 7fe384d1c640 1 -- 172.21.15.132:0/2705592741 shutdown_connections 2024-04-16T15:52:37.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.431+0000 7fe384d1c640 1 --2- 172.21.15.132:0/2705592741 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe380151e90 0x7fe3800cf9d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:37.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.431+0000 7fe384d1c640 1 -- 172.21.15.132:0/2705592741 >> 172.21.15.132:0/2705592741 conn(0x7fe3800b2d50 msgr2=0x7fe38006ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:37.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.431+0000 7fe384d1c640 1 -- 172.21.15.132:0/2705592741 shutdown_connections 2024-04-16T15:52:37.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.431+0000 7fe384d1c640 1 -- 172.21.15.132:0/2705592741 wait complete. 2024-04-16T15:52:37.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.432+0000 7fe384d1c640 1 Processor -- start 2024-04-16T15:52:37.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.432+0000 7fe384d1c640 1 -- start start 2024-04-16T15:52:37.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.433+0000 7fe384d1c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe38006e3a0 0x7fe38014a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:37.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.433+0000 7fe384d1c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3800b5cc0 0x7fe3801482a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:37.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.433+0000 7fe384d1c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe380151e90 0x7fe380132140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:37.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.433+0000 7fe384d1c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe3800cff10 con 0x7fe38006e3a0 2024-04-16T15:52:37.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.433+0000 7fe384d1c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe3800cf1d0 con 0x7fe3800b5cc0 2024-04-16T15:52:37.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.433+0000 7fe384d1c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe3800d0090 con 0x7fe380151e90 2024-04-16T15:52:37.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.433+0000 7fe37e59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe38006e3a0 0x7fe38014a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:37.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.433+0000 7fe37e59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe38006e3a0 0x7fe38014a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42612/0 (socket says 172.21.15.132:42612) 2024-04-16T15:52:37.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.433+0000 7fe37e59c640 1 -- 172.21.15.132:0/602664326 learned_addr learned my addr 172.21.15.132:0/602664326 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:37.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.433+0000 7fe37dd9b640 1 --2- 172.21.15.132:0/602664326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3800b5cc0 0x7fe3801482a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:37.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.433+0000 7fe37ed9d640 1 --2- 172.21.15.132:0/602664326 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe380151e90 0x7fe380132140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:37.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.433+0000 7fe37e59c640 1 -- 172.21.15.132:0/602664326 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe380151e90 msgr2=0x7fe380132140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:37.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.433+0000 7fe37e59c640 1 --2- 172.21.15.132:0/602664326 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe380151e90 0x7fe380132140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:37.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.433+0000 7fe37e59c640 1 -- 172.21.15.132:0/602664326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3800b5cc0 msgr2=0x7fe3801482a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:37.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.433+0000 7fe37e59c640 1 --2- 172.21.15.132:0/602664326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3800b5cc0 0x7fe3801482a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:37.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.433+0000 7fe37e59c640 1 -- 172.21.15.132:0/602664326 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe38014a5f0 con 0x7fe38006e3a0 2024-04-16T15:52:37.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.433+0000 7fe37dd9b640 1 --2- 172.21.15.132:0/602664326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3800b5cc0 0x7fe3801482a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:37.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.434+0000 7fe37e59c640 1 --2- 172.21.15.132:0/602664326 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe38006e3a0 0x7fe38014a0b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe370037040 tx=0x7fe370004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:37.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.434+0000 7fe36effd640 1 -- 172.21.15.132:0/602664326 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe370003990 con 0x7fe38006e3a0 2024-04-16T15:52:37.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.434+0000 7fe36effd640 1 -- 172.21.15.132:0/602664326 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe370003b30 con 0x7fe38006e3a0 2024-04-16T15:52:37.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.434+0000 7fe384d1c640 1 -- 172.21.15.132:0/602664326 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3801310a0 con 0x7fe38006e3a0 2024-04-16T15:52:37.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.434+0000 7fe36effd640 1 -- 172.21.15.132:0/602664326 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe370004030 con 0x7fe38006e3a0 2024-04-16T15:52:37.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.434+0000 7fe384d1c640 1 -- 172.21.15.132:0/602664326 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe380131660 con 0x7fe38006e3a0 2024-04-16T15:52:37.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.435+0000 7fe384d1c640 1 -- 172.21.15.132:0/602664326 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe380075510 con 0x7fe38006e3a0 2024-04-16T15:52:37.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.435+0000 7fe36effd640 1 -- 172.21.15.132:0/602664326 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe3700041d0 con 0x7fe38006e3a0 2024-04-16T15:52:37.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.436+0000 7fe36effd640 1 --2- 172.21.15.132:0/602664326 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fe36006c8f0 0x7fe36006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:37.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.436+0000 7fe36effd640 1 -- 172.21.15.132:0/602664326 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe3700b0110 con 0x7fe38006e3a0 2024-04-16T15:52:37.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.436+0000 7fe37dd9b640 1 --2- 172.21.15.132:0/602664326 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fe36006c8f0 0x7fe36006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:37.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.436+0000 7fe37dd9b640 1 --2- 172.21.15.132:0/602664326 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fe36006c8f0 0x7fe36006edb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe380130b00 tx=0x7fe374007a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:37.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.440+0000 7fe36effd640 1 -- 172.21.15.132:0/602664326 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe370041070 con 0x7fe38006e3a0 2024-04-16T15:52:37.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.617+0000 7fe384d1c640 1 -- 172.21.15.132:0/602664326 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe3800b5030 con 0x7fe38006e3a0 2024-04-16T15:52:37.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.618+0000 7fe36effd640 1 -- 172.21.15.132:0/602664326 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7fe37007e540 con 0x7fe38006e3a0 2024-04-16T15:52:37.617 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:52:37.618 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"6bdec5d9-f406-43ad-8584-0503b32f6f0d","created":"2024-04-16T15:51:51.073040+0000","modified":"2024-04-16T15:52:16.950186+0000","last_up_change":"2024-04-16T15:52:02.280496+0000","last_in_change":"2024-04-16T15:51:53.376468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:52:03.284927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:52:13.363758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T15:52:14.246647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d45908b-6e22-4619-b190-897af594b712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6801","nonce":1170594668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6803","nonce":1170594668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6807","nonce":1170594668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6805","nonce":1170594668}]},"public_addr":"172.21.15.132:6801/1170594668","cluster_addr":"172.21.15.132:6803/1170594668","heartbeat_back_addr":"172.21.15.132:6807/1170594668","heartbeat_front_addr":"172.21.15.132:6805/1170594668","state":["exists","up"]},{"osd":1,"uuid":"c88bf082-e51f-4ee6-815a-025f6ce0d67b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6809","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6811","nonce":2494780358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6815","nonce":2494780358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6823","nonce":2494780358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6819","nonce":2494780358}]},"public_addr":"172.21.15.132:6811/2494780358","cluster_addr":"172.21.15.132:6815/2494780358","heartbeat_back_addr":"172.21.15.132:6823/2494780358","heartbeat_front_addr":"172.21.15.132:6819/2494780358","state":["exists","up"]},{"osd":2,"uuid":"e5dbd6b4-4e7b-47e4-ad4e-35b4b81696c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6825","nonce":27655483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6827","nonce":27655483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6831","nonce":27655483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6829","nonce":27655483}]},"public_addr":"172.21.15.132:6825/27655483","cluster_addr":"172.21.15.132:6827/27655483","heartbeat_back_addr":"172.21.15.132:6831/27655483","heartbeat_front_addr":"172.21.15.132:6829/27655483","state":["exists","up"]},{"osd":3,"uuid":"9d75cd67-3b8a-4424-8884-5f3660e1f5f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6810","nonce":3100919191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6814","nonce":3100919191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6821","nonce":3100919191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6818","nonce":3100919191}]},"public_addr":"172.21.15.132:6810/3100919191","cluster_addr":"172.21.15.132:6814/3100919191","heartbeat_back_addr":"172.21.15.132:6821/3100919191","heartbeat_front_addr":"172.21.15.132:6818/3100919191","state":["exists","up"]},{"osd":4,"uuid":"83aea46a-8642-4777-912b-c130e5890da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6825","nonce":123637799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6827","nonce":123637799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6831","nonce":123637799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6829","nonce":123637799}]},"public_addr":"172.21.15.179:6825/123637799","cluster_addr":"172.21.15.179:6827/123637799","heartbeat_back_addr":"172.21.15.179:6831/123637799","heartbeat_front_addr":"172.21.15.179:6829/123637799","state":["exists","up"]},{"osd":5,"uuid":"534117c8-3317-48d6-b436-afd5709f71e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6801","nonce":2224750370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6803","nonce":2224750370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6807","nonce":2224750370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6805","nonce":2224750370}]},"public_addr":"172.21.15.179:6801/2224750370","cluster_addr":"172.21.15.179:6803/2224750370","heartbeat_back_addr":"172.21.15.179:6807/2224750370","heartbeat_front_addr":"172.21.15.179:6805/2224750370","state":["exists","up"]},{"osd":6,"uuid":"0ba363e7-fa9d-42b1-ae09-a6a0f57d41f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6809","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6811","nonce":101498164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6813","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6815","nonce":101498164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6823","nonce":101498164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6819","nonce":101498164}]},"public_addr":"172.21.15.179:6811/101498164","cluster_addr":"172.21.15.179:6815/101498164","heartbeat_back_addr":"172.21.15.179:6823/101498164","heartbeat_front_addr":"172.21.15.179:6819/101498164","state":["exists","up"]},{"osd":7,"uuid":"e6830c77-2f2d-4067-9866-ee7625afc1a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6810","nonce":872148365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6814","nonce":872148365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6822","nonce":872148365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6818","nonce":872148365}]},"public_addr":"172.21.15.179:6810/872148365","cluster_addr":"172.21.15.179:6814/872148365","heartbeat_back_addr":"172.21.15.179:6822/872148365","heartbeat_front_addr":"172.21.15.179:6818/872148365","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.535221+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.563769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.520765+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.526264+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.517058+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.500842+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.534332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.512486+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:52:37.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.620+0000 7fe384d1c640 1 -- 172.21.15.132:0/602664326 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fe36006c8f0 msgr2=0x7fe36006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:37.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.620+0000 7fe384d1c640 1 --2- 172.21.15.132:0/602664326 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fe36006c8f0 0x7fe36006edb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe380130b00 tx=0x7fe374007a10 comp rx=0 tx=0).stop 2024-04-16T15:52:37.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.620+0000 7fe384d1c640 1 -- 172.21.15.132:0/602664326 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe38006e3a0 msgr2=0x7fe38014a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:37.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.620+0000 7fe384d1c640 1 --2- 172.21.15.132:0/602664326 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe38006e3a0 0x7fe38014a0b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe370037040 tx=0x7fe370004a40 comp rx=0 tx=0).stop 2024-04-16T15:52:37.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.620+0000 7fe384d1c640 1 -- 172.21.15.132:0/602664326 shutdown_connections 2024-04-16T15:52:37.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.620+0000 7fe384d1c640 1 --2- 172.21.15.132:0/602664326 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fe36006c8f0 0x7fe36006edb0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:37.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.620+0000 7fe384d1c640 1 --2- 172.21.15.132:0/602664326 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe380151e90 0x7fe380132140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:37.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.620+0000 7fe384d1c640 1 --2- 172.21.15.132:0/602664326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3800b5cc0 0x7fe3801482a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:37.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.620+0000 7fe384d1c640 1 --2- 172.21.15.132:0/602664326 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe38006e3a0 0x7fe38014a0b0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:37.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.620+0000 7fe384d1c640 1 -- 172.21.15.132:0/602664326 >> 172.21.15.132:0/602664326 conn(0x7fe3800b2d50 msgr2=0x7fe3800b02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:37.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.620+0000 7fe384d1c640 1 -- 172.21.15.132:0/602664326 shutdown_connections 2024-04-16T15:52:37.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.620+0000 7fe384d1c640 1 -- 172.21.15.132:0/602664326 wait complete. 2024-04-16T15:52:37.631 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T15:52:03.284927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T15:52:13.363758+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T15:52:14.246647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T15:52:37.631 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T15:52:37.737 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.738+0000 7fc1bd538640 1 Processor -- start 2024-04-16T15:52:37.737 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.738+0000 7fc1bd538640 1 -- start start 2024-04-16T15:52:37.739 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.739+0000 7fc1bd538640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc1b815ec20 0x7fc1b80d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:37.739 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.739+0000 7fc1bd538640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1b80d3340 0x7fc1b80d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:37.739 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.739+0000 7fc1bd538640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1b80d3850 con 0x7fc1b80d1e60 2024-04-16T15:52:37.739 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.739+0000 7fc1bd538640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fc1b80d3b30 con 0x7fc1b815ec20 2024-04-16T15:52:37.739 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.739+0000 7fc1bd538640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc1b80d3e10 con 0x7fc1b80d3340 2024-04-16T15:52:37.739 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.739+0000 7fc1affff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1b80d3340 0x7fc1b80d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:37.739 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.739+0000 7fc1affff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1b80d3340 0x7fc1b80d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.132:52740/0 (socket says 172.21.15.132:52740) 2024-04-16T15:52:37.739 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.739+0000 7fc1b6ffd640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc1b815ec20 0x7fc1b80d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:37.739 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.739+0000 7fc1affff640 1 -- 172.21.15.132:0/1012965851 learned_addr learned my addr 172.21.15.132:0/1012965851 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:37.739 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.739+0000 7fc1affff640 1 -- 172.21.15.132:0/1012965851 >> v2:172.21.15.179:3300/0 conn(0x7fc1b815ec20 msgr2=0x7fc1b80d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:37.740 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.739+0000 7fc1affff640 1 --2- 172.21.15.132:0/1012965851 >> v2:172.21.15.179:3300/0 conn(0x7fc1b815ec20 0x7fc1b80d2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:37.740 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.739+0000 7fc1affff640 1 -- 172.21.15.132:0/1012965851 >> v1:172.21.15.179:6789/0 conn(0x7fc1b80d1e60 legacy=0x7fc1b80b6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:37.740 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.740+0000 7fc1affff640 1 -- 172.21.15.132:0/1012965851 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1b80d40f0 con 0x7fc1b80d3340 2024-04-16T15:52:37.740 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.740+0000 7fc1b6ffd640 1 --2- 172.21.15.132:0/1012965851 >> v2:172.21.15.179:3300/0 conn(0x7fc1b815ec20 0x7fc1b80d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:52:37.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.740+0000 7fc1affff640 1 --2- 172.21.15.132:0/1012965851 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1b80d3340 0x7fc1b80d1920 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0009870 tx=0x7fc1a002ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acba04ff1e56ad13 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:37.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.740+0000 7fc1b67fc640 1 -- 172.21.15.132:0/1012965851 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a002f840 con 0x7fc1b80d3340 2024-04-16T15:52:37.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.741+0000 7fc1b67fc640 1 -- 172.21.15.132:0/1012965851 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1a002f9e0 con 0x7fc1b80d3340 2024-04-16T15:52:37.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.741+0000 7fc1b67fc640 1 -- 172.21.15.132:0/1012965851 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a002fdb0 con 0x7fc1b80d3340 2024-04-16T15:52:37.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.741+0000 7fc1bd538640 1 -- 172.21.15.132:0/1012965851 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1b80d3340 msgr2=0x7fc1b80d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:37.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.741+0000 7fc1bd538640 1 --2- 172.21.15.132:0/1012965851 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1b80d3340 0x7fc1b80d1920 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0009870 tx=0x7fc1a002ba20 comp rx=0 tx=0).stop 2024-04-16T15:52:37.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.741+0000 7fc1bd538640 1 -- 172.21.15.132:0/1012965851 shutdown_connections 2024-04-16T15:52:37.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.741+0000 7fc1bd538640 1 --2- 172.21.15.132:0/1012965851 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1b80d3340 0x7fc1b80d1920 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:37.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.741+0000 7fc1bd538640 1 --2- 172.21.15.132:0/1012965851 >> v2:172.21.15.179:3300/0 conn(0x7fc1b815ec20 0x7fc1b80d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:37.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.741+0000 7fc1bd538640 1 -- 172.21.15.132:0/1012965851 >> 172.21.15.132:0/1012965851 conn(0x7fc1b806d2d0 msgr2=0x7fc1b806d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:37.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.741+0000 7fc1bd538640 1 -- 172.21.15.132:0/1012965851 shutdown_connections 2024-04-16T15:52:37.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.741+0000 7fc1bd538640 1 -- 172.21.15.132:0/1012965851 wait complete. 2024-04-16T15:52:37.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.742+0000 7fc1bd538640 1 Processor -- start 2024-04-16T15:52:37.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.742+0000 7fc1bd538640 1 -- start start 2024-04-16T15:52:37.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.743+0000 7fc1bd538640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1b80d1e60 0x7fc1b81f3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:37.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.743+0000 7fc1bd538640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1b80d3340 0x7fc1b80cd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:37.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.743+0000 7fc1bd538640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1b815ec20 0x7fc1b80b8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:37.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.743+0000 7fc1bd538640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b80cf3a0 con 0x7fc1b80d1e60 2024-04-16T15:52:37.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.743+0000 7fc1bd538640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b815f000 con 0x7fc1b815ec20 2024-04-16T15:52:37.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.743+0000 7fc1bd538640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc1b80cf520 con 0x7fc1b80d3340 2024-04-16T15:52:37.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.743+0000 7fc1b6ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1b80d1e60 0x7fc1b81f3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:37.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.743+0000 7fc1b6ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1b80d1e60 0x7fc1b81f3c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42620/0 (socket says 172.21.15.132:42620) 2024-04-16T15:52:37.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.743+0000 7fc1b6ffd640 1 -- 172.21.15.132:0/3519610833 learned_addr learned my addr 172.21.15.132:0/3519610833 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:37.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.743+0000 7fc1affff640 1 --2- 172.21.15.132:0/3519610833 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1b80d3340 0x7fc1b80cd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:37.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.743+0000 7fc1b77fe640 1 --2- 172.21.15.132:0/3519610833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1b815ec20 0x7fc1b80b8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:37.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.743+0000 7fc1b6ffd640 1 -- 172.21.15.132:0/3519610833 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1b80d3340 msgr2=0x7fc1b80cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:37.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.743+0000 7fc1b6ffd640 1 --2- 172.21.15.132:0/3519610833 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1b80d3340 0x7fc1b80cd4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:37.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.743+0000 7fc1b6ffd640 1 -- 172.21.15.132:0/3519610833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1b815ec20 msgr2=0x7fc1b80b8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:37.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.743+0000 7fc1b6ffd640 1 --2- 172.21.15.132:0/3519610833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1b815ec20 0x7fc1b80b8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:37.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.743+0000 7fc1b6ffd640 1 -- 172.21.15.132:0/3519610833 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1b80cdfb0 con 0x7fc1b80d1e60 2024-04-16T15:52:37.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.744+0000 7fc1b6ffd640 1 --2- 172.21.15.132:0/3519610833 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1b80d1e60 0x7fc1b81f3c80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc1a800e960 tx=0x7fc1a800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:37.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.744+0000 7fc1af7fe640 1 -- 172.21.15.132:0/3519610833 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a8017070 con 0x7fc1b80d1e60 2024-04-16T15:52:37.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.744+0000 7fc1af7fe640 1 -- 172.21.15.132:0/3519610833 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1a800ca00 con 0x7fc1b80d1e60 2024-04-16T15:52:37.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.744+0000 7fc1af7fe640 1 -- 172.21.15.132:0/3519610833 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a800cdd0 con 0x7fc1b80d1e60 2024-04-16T15:52:37.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.744+0000 7fc1bd538640 1 -- 172.21.15.132:0/3519610833 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1b80ce290 con 0x7fc1b80d1e60 2024-04-16T15:52:37.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.744+0000 7fc1bd538640 1 -- 172.21.15.132:0/3519610833 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1b80ab490 con 0x7fc1b80d1e60 2024-04-16T15:52:37.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.745+0000 7fc1bd538640 1 -- 172.21.15.132:0/3519610833 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1b8075510 con 0x7fc1b80d1e60 2024-04-16T15:52:37.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.745+0000 7fc1af7fe640 1 -- 172.21.15.132:0/3519610833 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc1a801a070 con 0x7fc1b80d1e60 2024-04-16T15:52:37.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.745+0000 7fc1af7fe640 1 --2- 172.21.15.132:0/3519610833 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fc19806c8f0 0x7fc19806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:37.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.746+0000 7fc1af7fe640 1 -- 172.21.15.132:0/3519610833 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc1a808bd00 con 0x7fc1b80d1e60 2024-04-16T15:52:37.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.746+0000 7fc1affff640 1 --2- 172.21.15.132:0/3519610833 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fc19806c8f0 0x7fc19806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:37.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.746+0000 7fc1affff640 1 --2- 172.21.15.132:0/3519610833 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fc19806c8f0 0x7fc19806edb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0036000 tx=0x7fc1a0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:37.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.750+0000 7fc1af7fe640 1 -- 172.21.15.132:0/3519610833 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc1a8059af0 con 0x7fc1b80d1e60 2024-04-16T15:52:37.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.925+0000 7fc1bd538640 1 -- 172.21.15.132:0/3519610833 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc1b80cec00 con 0x7fc1b80d1e60 2024-04-16T15:52:37.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.926+0000 7fc1af7fe640 1 -- 172.21.15.132:0/3519610833 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fc1a805ddf0 con 0x7fc1b80d1e60 2024-04-16T15:52:37.925 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2024-04-16T15:52:37.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.928+0000 7fc1bd538640 1 -- 172.21.15.132:0/3519610833 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fc19806c8f0 msgr2=0x7fc19806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:37.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.928+0000 7fc1bd538640 1 --2- 172.21.15.132:0/3519610833 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fc19806c8f0 0x7fc19806edb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0036000 tx=0x7fc1a0008030 comp rx=0 tx=0).stop 2024-04-16T15:52:37.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.928+0000 7fc1bd538640 1 -- 172.21.15.132:0/3519610833 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1b80d1e60 msgr2=0x7fc1b81f3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:37.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.928+0000 7fc1bd538640 1 --2- 172.21.15.132:0/3519610833 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1b80d1e60 0x7fc1b81f3c80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc1a800e960 tx=0x7fc1a800ee20 comp rx=0 tx=0).stop 2024-04-16T15:52:37.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.928+0000 7fc1bd538640 1 -- 172.21.15.132:0/3519610833 shutdown_connections 2024-04-16T15:52:37.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.928+0000 7fc1bd538640 1 --2- 172.21.15.132:0/3519610833 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fc19806c8f0 0x7fc19806edb0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:37.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.928+0000 7fc1bd538640 1 --2- 172.21.15.132:0/3519610833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1b815ec20 0x7fc1b80b8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:37.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.928+0000 7fc1bd538640 1 --2- 172.21.15.132:0/3519610833 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1b80d3340 0x7fc1b80cd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:37.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.928+0000 7fc1bd538640 1 --2- 172.21.15.132:0/3519610833 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1b80d1e60 0x7fc1b81f3c80 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:37.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.928+0000 7fc1bd538640 1 -- 172.21.15.132:0/3519610833 >> 172.21.15.132:0/3519610833 conn(0x7fc1b806d2d0 msgr2=0x7fc1b806d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:37.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.928+0000 7fc1bd538640 1 -- 172.21.15.132:0/3519610833 shutdown_connections 2024-04-16T15:52:37.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:37.928+0000 7fc1bd538640 1 -- 172.21.15.132:0/3519610833 wait complete. 2024-04-16T15:52:37.938 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T15:52:38.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.045+0000 7f1a5157c640 1 Processor -- start 2024-04-16T15:52:38.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.045+0000 7f1a5157c640 1 -- start start 2024-04-16T15:52:38.047 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.045+0000 7f1a5157c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a4c0d1920 0x7f1a4c0d1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:38.047 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.046+0000 7f1a5157c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1a4c0b7bb0 0x7f1a4c0b8040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:38.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.046+0000 7f1a5157c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a4c0d3850 con 0x7f1a4c15ec20 2024-04-16T15:52:38.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.046+0000 7f1a5157c640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f1a4c0d22c0 con 0x7f1a4c0b7bb0 2024-04-16T15:52:38.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.046+0000 7f1a5157c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1a4c0d3b30 con 0x7f1a4c0d1920 2024-04-16T15:52:38.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.046+0000 7f1a4affd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f1a4c15ec20 0x7f1a4c0d2e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:59534/0 (socket says 172.21.15.132:59534) 2024-04-16T15:52:38.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.046+0000 7f1a4affd640 1 -- 172.21.15.132:0/1256887182 learned_addr learned my addr 172.21.15.132:0/1256887182 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:38.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.046+0000 7f1a427fc640 1 --2- 172.21.15.132:0/1256887182 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a4c0d1920 0x7f1a4c0d1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:38.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.046+0000 7f1a4b7fe640 1 --2- 172.21.15.132:0/1256887182 >> v2:172.21.15.179:3300/0 conn(0x7f1a4c0b7bb0 0x7f1a4c0b8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:38.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.046+0000 7f1a4a7fc640 1 -- 172.21.15.132:0/1256887182 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1578113382 0 0) 0x7f1a4c0d3850 con 0x7f1a4c15ec20 2024-04-16T15:52:38.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.046+0000 7f1a4a7fc640 1 -- 172.21.15.132:0/1256887182 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a38003520 con 0x7f1a4c15ec20 2024-04-16T15:52:38.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.046+0000 7f1a427fc640 1 -- 172.21.15.132:0/1256887182 >> v2:172.21.15.179:3300/0 conn(0x7f1a4c0b7bb0 msgr2=0x7f1a4c0b8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:38.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.046+0000 7f1a4a7fc640 1 -- 172.21.15.132:0/1256887182 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 606502789 0 0) 0x7f1a38003520 con 0x7f1a4c15ec20 2024-04-16T15:52:38.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.046+0000 7f1a427fc640 1 --2- 172.21.15.132:0/1256887182 >> v2:172.21.15.179:3300/0 conn(0x7f1a4c0b7bb0 0x7f1a4c0b8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:38.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.046+0000 7f1a427fc640 1 -- 172.21.15.132:0/1256887182 >> v1:172.21.15.132:6789/0 conn(0x7f1a4c15ec20 legacy=0x7f1a4c0d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:38.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.046+0000 7f1a427fc640 1 -- 172.21.15.132:0/1256887182 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a4c0d3e10 con 0x7f1a4c0d1920 2024-04-16T15:52:38.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.047+0000 7f1a427fc640 1 --2- 172.21.15.132:0/1256887182 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a4c0d1920 0x7f1a4c0d1d80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1a340097a0 tx=0x7f1a3402b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=971327cbf8e94b7a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:38.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.047+0000 7f1a4a7fc640 1 -- 172.21.15.132:0/1256887182 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a34038070 con 0x7f1a4c0d1920 2024-04-16T15:52:38.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.047+0000 7f1a4a7fc640 1 -- 172.21.15.132:0/1256887182 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a34031500 con 0x7f1a4c0d1920 2024-04-16T15:52:38.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.047+0000 7f1a4a7fc640 1 -- 172.21.15.132:0/1256887182 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c001670 con 0x7f1a4c0d1920 2024-04-16T15:52:38.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.048+0000 7f1a5157c640 1 -- 172.21.15.132:0/1256887182 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a4c0d1920 msgr2=0x7f1a4c0d1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:38.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.048+0000 7f1a5157c640 1 --2- 172.21.15.132:0/1256887182 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a4c0d1920 0x7f1a4c0d1d80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1a340097a0 tx=0x7f1a3402b820 comp rx=0 tx=0).stop 2024-04-16T15:52:38.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.048+0000 7f1a5157c640 1 -- 172.21.15.132:0/1256887182 shutdown_connections 2024-04-16T15:52:38.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.048+0000 7f1a5157c640 1 --2- 172.21.15.132:0/1256887182 >> v2:172.21.15.179:3300/0 conn(0x7f1a4c0b7bb0 0x7f1a4c0b8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:38.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.048+0000 7f1a5157c640 1 --2- 172.21.15.132:0/1256887182 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a4c0d1920 0x7f1a4c0d1d80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:38.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.048+0000 7f1a5157c640 1 -- 172.21.15.132:0/1256887182 >> 172.21.15.132:0/1256887182 conn(0x7f1a4c06d2d0 msgr2=0x7f1a4c06d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:38.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.048+0000 7f1a5157c640 1 -- 172.21.15.132:0/1256887182 shutdown_connections 2024-04-16T15:52:38.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.048+0000 7f1a5157c640 1 -- 172.21.15.132:0/1256887182 wait complete. 2024-04-16T15:52:38.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.049+0000 7f1a5157c640 1 Processor -- start 2024-04-16T15:52:38.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.049+0000 7f1a5157c640 1 -- start start 2024-04-16T15:52:38.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.050+0000 7f1a5157c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a4c0b7bb0 0x7f1a4c14e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:38.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.050+0000 7f1a5157c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a4c0d1920 0x7f1a4c14e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:38.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.050+0000 7f1a5157c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a4c15ec20 0x7f1a4c1615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:38.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.050+0000 7f1a5157c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f1a4c0d3510 con 0x7f1a4c0d1920 2024-04-16T15:52:38.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.050+0000 7f1a5157c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1a4c0d43d0 con 0x7f1a4c15ec20 2024-04-16T15:52:38.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.050+0000 7f1a5157c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1a4c15f000 con 0x7f1a4c0b7bb0 2024-04-16T15:52:38.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.050+0000 7f1a427fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a4c0d1920 0x7f1a4c14e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:38.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.050+0000 7f1a427fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a4c0d1920 0x7f1a4c14e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42626/0 (socket says 172.21.15.132:42626) 2024-04-16T15:52:38.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.050+0000 7f1a427fc640 1 -- 172.21.15.132:0/2069177135 learned_addr learned my addr 172.21.15.132:0/2069177135 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:38.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.050+0000 7f1a4affd640 1 --2- 172.21.15.132:0/2069177135 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a4c0b7bb0 0x7f1a4c14e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:38.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.050+0000 7f1a4b7fe640 1 --2- 172.21.15.132:0/2069177135 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a4c15ec20 0x7f1a4c1615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:38.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.050+0000 7f1a427fc640 1 -- 172.21.15.132:0/2069177135 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a4c0b7bb0 msgr2=0x7f1a4c14e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:38.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.050+0000 7f1a427fc640 1 --2- 172.21.15.132:0/2069177135 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a4c0b7bb0 0x7f1a4c14e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:38.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.050+0000 7f1a427fc640 1 -- 172.21.15.132:0/2069177135 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a4c15ec20 msgr2=0x7f1a4c1615e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:38.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.050+0000 7f1a427fc640 1 --2- 172.21.15.132:0/2069177135 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a4c15ec20 0x7f1a4c1615e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:38.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.050+0000 7f1a427fc640 1 -- 172.21.15.132:0/2069177135 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a4c15b910 con 0x7f1a4c0d1920 2024-04-16T15:52:38.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.050+0000 7f1a427fc640 1 --2- 172.21.15.132:0/2069177135 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a4c0d1920 0x7f1a4c14e980 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1a34000c00 tx=0x7f1a340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:38.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.050+0000 7f1a43fff640 1 -- 172.21.15.132:0/2069177135 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a34042030 con 0x7f1a4c0d1920 2024-04-16T15:52:38.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.050+0000 7f1a43fff640 1 -- 172.21.15.132:0/2069177135 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a3403d670 con 0x7f1a4c0d1920 2024-04-16T15:52:38.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.050+0000 7f1a5157c640 1 -- 172.21.15.132:0/2069177135 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a4c0cbca0 con 0x7f1a4c0d1920 2024-04-16T15:52:38.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.050+0000 7f1a43fff640 1 -- 172.21.15.132:0/2069177135 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a34038040 con 0x7f1a4c0d1920 2024-04-16T15:52:38.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.050+0000 7f1a5157c640 1 -- 172.21.15.132:0/2069177135 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a4c0cc260 con 0x7f1a4c0d1920 2024-04-16T15:52:38.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.051+0000 7f1a5157c640 1 -- 172.21.15.132:0/2069177135 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a4c0cba30 con 0x7f1a4c0d1920 2024-04-16T15:52:38.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.052+0000 7f1a43fff640 1 -- 172.21.15.132:0/2069177135 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1a34045070 con 0x7f1a4c0d1920 2024-04-16T15:52:38.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.052+0000 7f1a43fff640 1 --2- 172.21.15.132:0/2069177135 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f1a2c06c8f0 0x7f1a2c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:38.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.052+0000 7f1a43fff640 1 -- 172.21.15.132:0/2069177135 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1a340ad290 con 0x7f1a4c0d1920 2024-04-16T15:52:38.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.052+0000 7f1a4affd640 1 --2- 172.21.15.132:0/2069177135 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f1a2c06c8f0 0x7f1a2c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:38.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.053+0000 7f1a4affd640 1 --2- 172.21.15.132:0/2069177135 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f1a2c06c8f0 0x7f1a2c06edb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c001320 tx=0x7f1a3c0012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:38.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.057+0000 7f1a43fff640 1 -- 172.21.15.132:0/2069177135 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1a34030070 con 0x7f1a4c0d1920 2024-04-16T15:52:38.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.235+0000 7f1a5157c640 1 -- 172.21.15.132:0/2069177135 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f1a4c075510 con 0x7f1a4c0d1920 2024-04-16T15:52:38.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.235+0000 7f1a43fff640 1 -- 172.21.15.132:0/2069177135 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f1a3407b100 con 0x7f1a4c0d1920 2024-04-16T15:52:38.234 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2024-04-16T15:52:38.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.237+0000 7f1a5157c640 1 -- 172.21.15.132:0/2069177135 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f1a2c06c8f0 msgr2=0x7f1a2c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:38.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.237+0000 7f1a5157c640 1 --2- 172.21.15.132:0/2069177135 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f1a2c06c8f0 0x7f1a2c06edb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c001320 tx=0x7f1a3c0012b0 comp rx=0 tx=0).stop 2024-04-16T15:52:38.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.237+0000 7f1a5157c640 1 -- 172.21.15.132:0/2069177135 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a4c0d1920 msgr2=0x7f1a4c14e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:38.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.237+0000 7f1a5157c640 1 --2- 172.21.15.132:0/2069177135 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a4c0d1920 0x7f1a4c14e980 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1a34000c00 tx=0x7f1a340046c0 comp rx=0 tx=0).stop 2024-04-16T15:52:38.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.237+0000 7f1a5157c640 1 -- 172.21.15.132:0/2069177135 shutdown_connections 2024-04-16T15:52:38.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.237+0000 7f1a5157c640 1 --2- 172.21.15.132:0/2069177135 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f1a2c06c8f0 0x7f1a2c06edb0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:38.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.237+0000 7f1a5157c640 1 --2- 172.21.15.132:0/2069177135 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a4c15ec20 0x7f1a4c1615e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:38.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.237+0000 7f1a5157c640 1 --2- 172.21.15.132:0/2069177135 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a4c0d1920 0x7f1a4c14e980 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:38.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.237+0000 7f1a5157c640 1 --2- 172.21.15.132:0/2069177135 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a4c0b7bb0 0x7f1a4c14e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:38.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.237+0000 7f1a5157c640 1 -- 172.21.15.132:0/2069177135 >> 172.21.15.132:0/2069177135 conn(0x7f1a4c06d2d0 msgr2=0x7f1a4c06d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:38.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.237+0000 7f1a5157c640 1 -- 172.21.15.132:0/2069177135 shutdown_connections 2024-04-16T15:52:38.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.237+0000 7f1a5157c640 1 -- 172.21.15.132:0/2069177135 wait complete. 2024-04-16T15:52:38.247 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T15:52:38.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.355+0000 7f3023247640 1 Processor -- start 2024-04-16T15:52:38.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.355+0000 7f3023247640 1 -- start start 2024-04-16T15:52:38.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.355+0000 7f3023247640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f301c15eda0 0x7f301c0d0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:38.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.356+0000 7f3023247640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f301c15f8a0 0x7f301c09ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:38.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.356+0000 7f3023247640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f301c0d0ec0 con 0x7f301c06d7f0 2024-04-16T15:52:38.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.356+0000 7f3023247640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f301c0d11a0 con 0x7f301c15f8a0 2024-04-16T15:52:38.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.356+0000 7f3023247640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f301c0d1480 con 0x7f301c15eda0 2024-04-16T15:52:38.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.356+0000 7f30217e4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f301c15f8a0 0x7f301c09ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:38.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.356+0000 7f30217e4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f301c15f8a0 0x7f301c09ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42634/0 (socket says 172.21.15.132:42634) 2024-04-16T15:52:38.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.356+0000 7f30217e4640 1 -- 172.21.15.132:0/3270430443 learned_addr learned my addr 172.21.15.132:0/3270430443 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:38.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.356+0000 7f3020fe3640 1 --2- 172.21.15.132:0/3270430443 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f301c15eda0 0x7f301c0d0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:38.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.356+0000 7f30217e4640 1 -- 172.21.15.132:0/3270430443 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f301c15eda0 msgr2=0x7f301c0d0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:38.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.356+0000 7f30217e4640 1 --2- 172.21.15.132:0/3270430443 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f301c15eda0 0x7f301c0d0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:38.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.356+0000 7f30217e4640 1 -- 172.21.15.132:0/3270430443 >> v1:172.21.15.179:6789/0 conn(0x7f301c06d7f0 legacy=0x7f301c15f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:38.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.356+0000 7f30217e4640 1 -- 172.21.15.132:0/3270430443 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f301c0d1760 con 0x7f301c15f8a0 2024-04-16T15:52:38.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.357+0000 7f30217e4640 1 --2- 172.21.15.132:0/3270430443 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f301c15f8a0 0x7f301c09ab30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3014009e50 tx=0x7f301402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e158ddf39d4c19e server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:38.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.357+0000 7f301b7fe640 1 -- 172.21.15.132:0/3270430443 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f301402ca70 con 0x7f301c15f8a0 2024-04-16T15:52:38.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.357+0000 7f301b7fe640 1 -- 172.21.15.132:0/3270430443 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f301402cc10 con 0x7f301c15f8a0 2024-04-16T15:52:38.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.357+0000 7f301b7fe640 1 -- 172.21.15.132:0/3270430443 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30140343f0 con 0x7f301c15f8a0 2024-04-16T15:52:38.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.357+0000 7f3023247640 1 -- 172.21.15.132:0/3270430443 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f301c15f8a0 msgr2=0x7f301c09ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:38.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.357+0000 7f3023247640 1 --2- 172.21.15.132:0/3270430443 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f301c15f8a0 0x7f301c09ab30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3014009e50 tx=0x7f301402bed0 comp rx=0 tx=0).stop 2024-04-16T15:52:38.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.358+0000 7f3023247640 1 -- 172.21.15.132:0/3270430443 shutdown_connections 2024-04-16T15:52:38.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.358+0000 7f3023247640 1 --2- 172.21.15.132:0/3270430443 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f301c15f8a0 0x7f301c09ab30 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:38.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.358+0000 7f3023247640 1 --2- 172.21.15.132:0/3270430443 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f301c15eda0 0x7f301c0d0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:38.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.358+0000 7f3023247640 1 -- 172.21.15.132:0/3270430443 >> 172.21.15.132:0/3270430443 conn(0x7f301c0d26b0 msgr2=0x7f301c0d2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:38.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.358+0000 7f3023247640 1 -- 172.21.15.132:0/3270430443 shutdown_connections 2024-04-16T15:52:38.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.358+0000 7f3023247640 1 -- 172.21.15.132:0/3270430443 wait complete. 2024-04-16T15:52:38.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.359+0000 7f3023247640 1 Processor -- start 2024-04-16T15:52:38.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.359+0000 7f3023247640 1 -- start start 2024-04-16T15:52:38.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.360+0000 7f3023247640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f301c06d7f0 0x7f301c152990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:38.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.360+0000 7f3023247640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f301c15f8a0 0x7f301c0b0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:38.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.360+0000 7f3023247640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f301c0b0a70 0x7f301c0caef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:38.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.360+0000 7f3023247640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f301c06ddb0 con 0x7f301c06d7f0 2024-04-16T15:52:38.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.360+0000 7f3023247640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f301c06dc30 con 0x7f301c15f8a0 2024-04-16T15:52:38.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.360+0000 7f3023247640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f301c0b2d80 con 0x7f301c0b0a70 2024-04-16T15:52:38.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.360+0000 7f3020fe3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f301c06d7f0 0x7f301c152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:38.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.360+0000 7f3020fe3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f301c06d7f0 0x7f301c152990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42650/0 (socket says 172.21.15.132:42650) 2024-04-16T15:52:38.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.360+0000 7f3020fe3640 1 -- 172.21.15.132:0/714348167 learned_addr learned my addr 172.21.15.132:0/714348167 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:38.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.360+0000 7f30217e4640 1 --2- 172.21.15.132:0/714348167 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f301c0b0a70 0x7f301c0caef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:38.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.360+0000 7f301bfff640 1 --2- 172.21.15.132:0/714348167 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f301c15f8a0 0x7f301c0b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:38.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.360+0000 7f3020fe3640 1 -- 172.21.15.132:0/714348167 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f301c0b0a70 msgr2=0x7f301c0caef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:38.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.360+0000 7f3020fe3640 1 --2- 172.21.15.132:0/714348167 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f301c0b0a70 0x7f301c0caef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:38.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.360+0000 7f3020fe3640 1 -- 172.21.15.132:0/714348167 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f301c15f8a0 msgr2=0x7f301c0b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:38.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.360+0000 7f3020fe3640 1 --2- 172.21.15.132:0/714348167 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f301c15f8a0 0x7f301c0b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:38.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.360+0000 7f3020fe3640 1 -- 172.21.15.132:0/714348167 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f301c152ed0 con 0x7f301c06d7f0 2024-04-16T15:52:38.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.360+0000 7f301bfff640 1 --2- 172.21.15.132:0/714348167 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f301c15f8a0 0x7f301c0b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:52:38.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.360+0000 7f3020fe3640 1 --2- 172.21.15.132:0/714348167 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f301c06d7f0 0x7f301c152990 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f301000d830 tx=0x7f301000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:38.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.360+0000 7f30197fa640 1 -- 172.21.15.132:0/714348167 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f301000b6c0 con 0x7f301c06d7f0 2024-04-16T15:52:38.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.360+0000 7f30197fa640 1 -- 172.21.15.132:0/714348167 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3010019070 con 0x7f301c06d7f0 2024-04-16T15:52:38.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.360+0000 7f30197fa640 1 -- 172.21.15.132:0/714348167 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f301000ba80 con 0x7f301c06d7f0 2024-04-16T15:52:38.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.360+0000 7f3023247640 1 -- 172.21.15.132:0/714348167 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f301c0b1fc0 con 0x7f301c06d7f0 2024-04-16T15:52:38.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.360+0000 7f3023247640 1 -- 172.21.15.132:0/714348167 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f301c0b2580 con 0x7f301c06d7f0 2024-04-16T15:52:38.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.361+0000 7f3023247640 1 -- 172.21.15.132:0/714348167 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f301c075510 con 0x7f301c06d7f0 2024-04-16T15:52:38.363 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.362+0000 7f30197fa640 1 -- 172.21.15.132:0/714348167 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f301001e460 con 0x7f301c06d7f0 2024-04-16T15:52:38.363 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.362+0000 7f30197fa640 1 --2- 172.21.15.132:0/714348167 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f300006c920 0x7f300006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:38.363 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.362+0000 7f301bfff640 1 --2- 172.21.15.132:0/714348167 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f300006c920 0x7f300006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:38.363 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.362+0000 7f30197fa640 1 -- 172.21.15.132:0/714348167 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f301008c200 con 0x7f301c06d7f0 2024-04-16T15:52:38.363 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.363+0000 7f301bfff640 1 --2- 172.21.15.132:0/714348167 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f300006c920 0x7f300006ede0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f301c09b430 tx=0x7f3008008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:38.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.366+0000 7f30197fa640 1 -- 172.21.15.132:0/714348167 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f301005a630 con 0x7f301c06d7f0 2024-04-16T15:52:38.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.540+0000 7f3023247640 1 -- 172.21.15.132:0/714348167 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f301c0d21d0 con 0x7f301c06d7f0 2024-04-16T15:52:38.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.541+0000 7f30197fa640 1 -- 172.21.15.132:0/714348167 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f3010059f30 con 0x7f301c06d7f0 2024-04-16T15:52:38.540 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2024-04-16T15:52:38.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.543+0000 7f3023247640 1 -- 172.21.15.132:0/714348167 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f300006c920 msgr2=0x7f300006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:38.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.543+0000 7f3023247640 1 --2- 172.21.15.132:0/714348167 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f300006c920 0x7f300006ede0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f301c09b430 tx=0x7f3008008040 comp rx=0 tx=0).stop 2024-04-16T15:52:38.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.543+0000 7f3023247640 1 -- 172.21.15.132:0/714348167 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f301c06d7f0 msgr2=0x7f301c152990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:38.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.543+0000 7f3023247640 1 --2- 172.21.15.132:0/714348167 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f301c06d7f0 0x7f301c152990 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f301000d830 tx=0x7f301000dcf0 comp rx=0 tx=0).stop 2024-04-16T15:52:38.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.543+0000 7f3023247640 1 -- 172.21.15.132:0/714348167 shutdown_connections 2024-04-16T15:52:38.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.543+0000 7f3023247640 1 --2- 172.21.15.132:0/714348167 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f300006c920 0x7f300006ede0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:38.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.543+0000 7f3023247640 1 --2- 172.21.15.132:0/714348167 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f301c0b0a70 0x7f301c0caef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:38.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.543+0000 7f3023247640 1 --2- 172.21.15.132:0/714348167 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f301c15f8a0 0x7f301c0b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:38.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.543+0000 7f3023247640 1 --2- 172.21.15.132:0/714348167 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f301c06d7f0 0x7f301c152990 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:38.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.543+0000 7f3023247640 1 -- 172.21.15.132:0/714348167 >> 172.21.15.132:0/714348167 conn(0x7f301c0d26b0 msgr2=0x7f301c0ce4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:38.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.543+0000 7f3023247640 1 -- 172.21.15.132:0/714348167 shutdown_connections 2024-04-16T15:52:38.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.543+0000 7f3023247640 1 -- 172.21.15.132:0/714348167 wait complete. 2024-04-16T15:52:38.553 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:52:38.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.657+0000 7f0543532640 1 Processor -- start 2024-04-16T15:52:38.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.658+0000 7f0543532640 1 -- start start 2024-04-16T15:52:38.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.658+0000 7f0543532640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f053c163420 0x7f053c0b3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:38.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.658+0000 7f0543532640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f053c0b37c0 0x7f053c073050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:38.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.658+0000 7f0543532640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f053c0b4790 con 0x7f053c15eb10 2024-04-16T15:52:38.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.658+0000 7f0543532640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f053c0b55a0 con 0x7f053c0b37c0 2024-04-16T15:52:38.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.658+0000 7f0543532640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f053c0b4d10 con 0x7f053c163420 2024-04-16T15:52:38.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.659+0000 7f0541acf640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f053c0b37c0 0x7f053c073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:38.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.659+0000 7f0541acf640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f053c0b37c0 0x7f053c073050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42654/0 (socket says 172.21.15.132:42654) 2024-04-16T15:52:38.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.659+0000 7f0541acf640 1 -- 172.21.15.132:0/3001434996 learned_addr learned my addr 172.21.15.132:0/3001434996 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:38.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.659+0000 7f0540acd640 1 --2- 172.21.15.132:0/3001434996 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f053c163420 0x7f053c0b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:38.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.659+0000 7f0541acf640 1 -- 172.21.15.132:0/3001434996 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f053c163420 msgr2=0x7f053c0b3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:38.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.659+0000 7f0541acf640 1 --2- 172.21.15.132:0/3001434996 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f053c163420 0x7f053c0b3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:38.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.659+0000 7f0541acf640 1 -- 172.21.15.132:0/3001434996 >> v1:172.21.15.179:6789/0 conn(0x7f053c15eb10 legacy=0x7f053c0d1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:38.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.659+0000 7f0541acf640 1 -- 172.21.15.132:0/3001434996 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f053c0b4a30 con 0x7f053c0b37c0 2024-04-16T15:52:38.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.660+0000 7f0541acf640 1 --2- 172.21.15.132:0/3001434996 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f053c0b37c0 0x7f053c073050 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0534009e50 tx=0x7f053402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c32d29e2878df4 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:38.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.660+0000 7f0533fff640 1 -- 172.21.15.132:0/3001434996 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f053402ca70 con 0x7f053c0b37c0 2024-04-16T15:52:38.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.660+0000 7f0533fff640 1 -- 172.21.15.132:0/3001434996 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f053402cc10 con 0x7f053c0b37c0 2024-04-16T15:52:38.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.660+0000 7f0533fff640 1 -- 172.21.15.132:0/3001434996 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05340343f0 con 0x7f053c0b37c0 2024-04-16T15:52:38.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.660+0000 7f0543532640 1 -- 172.21.15.132:0/3001434996 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f053c0b37c0 msgr2=0x7f053c073050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:38.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.660+0000 7f0543532640 1 --2- 172.21.15.132:0/3001434996 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f053c0b37c0 0x7f053c073050 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0534009e50 tx=0x7f053402bed0 comp rx=0 tx=0).stop 2024-04-16T15:52:38.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.660+0000 7f0543532640 1 -- 172.21.15.132:0/3001434996 shutdown_connections 2024-04-16T15:52:38.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.660+0000 7f0543532640 1 --2- 172.21.15.132:0/3001434996 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f053c0b37c0 0x7f053c073050 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:38.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.660+0000 7f0543532640 1 --2- 172.21.15.132:0/3001434996 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f053c163420 0x7f053c0b3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:38.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.660+0000 7f0543532640 1 -- 172.21.15.132:0/3001434996 >> 172.21.15.132:0/3001434996 conn(0x7f053c06cb30 msgr2=0x7f053c06cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:38.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.660+0000 7f0543532640 1 -- 172.21.15.132:0/3001434996 shutdown_connections 2024-04-16T15:52:38.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.660+0000 7f0543532640 1 -- 172.21.15.132:0/3001434996 wait complete. 2024-04-16T15:52:38.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.661+0000 7f0543532640 1 Processor -- start 2024-04-16T15:52:38.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.662+0000 7f0543532640 1 -- start start 2024-04-16T15:52:38.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.662+0000 7f0543532640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f053c0b37c0 0x7f053c156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:38.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.662+0000 7f0543532640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f053c15eb10 0x7f053c15f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:38.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.662+0000 7f0543532640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f053c163420 0x7f053c15f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:38.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.662+0000 7f0543532640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f053c0ce480 con 0x7f053c0b37c0 2024-04-16T15:52:38.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.662+0000 7f0543532640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f053c0ce300 con 0x7f053c163420 2024-04-16T15:52:38.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.662+0000 7f0543532640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f053c15eef0 con 0x7f053c15eb10 2024-04-16T15:52:38.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.662+0000 7f05412ce640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f053c0b37c0 0x7f053c156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:38.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.662+0000 7f05412ce640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f053c0b37c0 0x7f053c156fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42662/0 (socket says 172.21.15.132:42662) 2024-04-16T15:52:38.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.662+0000 7f05412ce640 1 -- 172.21.15.132:0/3578558888 learned_addr learned my addr 172.21.15.132:0/3578558888 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:38.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.662+0000 7f0541acf640 1 --2- 172.21.15.132:0/3578558888 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f053c163420 0x7f053c15f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:38.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.662+0000 7f0540acd640 1 --2- 172.21.15.132:0/3578558888 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f053c15eb10 0x7f053c15f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:38.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.663+0000 7f05412ce640 1 -- 172.21.15.132:0/3578558888 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f053c15eb10 msgr2=0x7f053c15f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:38.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.663+0000 7f05412ce640 1 --2- 172.21.15.132:0/3578558888 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f053c15eb10 0x7f053c15f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:38.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.663+0000 7f05412ce640 1 -- 172.21.15.132:0/3578558888 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f053c163420 msgr2=0x7f053c15f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:38.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.663+0000 7f05412ce640 1 --2- 172.21.15.132:0/3578558888 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f053c163420 0x7f053c15f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:38.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.663+0000 7f05412ce640 1 -- 172.21.15.132:0/3578558888 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f053c1e88a0 con 0x7f053c0b37c0 2024-04-16T15:52:38.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.663+0000 7f0541acf640 1 --2- 172.21.15.132:0/3578558888 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f053c163420 0x7f053c15f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:38.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.663+0000 7f05412ce640 1 --2- 172.21.15.132:0/3578558888 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f053c0b37c0 0x7f053c156fd0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f053800c400 tx=0x7f053800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:38.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.663+0000 7f0531ffb640 1 -- 172.21.15.132:0/3578558888 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05380052d0 con 0x7f053c0b37c0 2024-04-16T15:52:38.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.663+0000 7f0531ffb640 1 -- 172.21.15.132:0/3578558888 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0538005490 con 0x7f053c0b37c0 2024-04-16T15:52:38.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.663+0000 7f0543532640 1 -- 172.21.15.132:0/3578558888 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f053c15fde0 con 0x7f053c0b37c0 2024-04-16T15:52:38.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.663+0000 7f0531ffb640 1 -- 172.21.15.132:0/3578558888 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0538007260 con 0x7f053c0b37c0 2024-04-16T15:52:38.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.663+0000 7f0543532640 1 -- 172.21.15.132:0/3578558888 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f053c1603a0 con 0x7f053c0b37c0 2024-04-16T15:52:38.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.664+0000 7f0543532640 1 -- 172.21.15.132:0/3578558888 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f053c075510 con 0x7f053c0b37c0 2024-04-16T15:52:38.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.665+0000 7f0531ffb640 1 -- 172.21.15.132:0/3578558888 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0538007400 con 0x7f053c0b37c0 2024-04-16T15:52:38.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.665+0000 7f0531ffb640 1 --2- 172.21.15.132:0/3578558888 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f052006c8f0 0x7f052006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:38.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.665+0000 7f0531ffb640 1 -- 172.21.15.132:0/3578558888 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f053808b050 con 0x7f053c0b37c0 2024-04-16T15:52:38.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.665+0000 7f0540acd640 1 --2- 172.21.15.132:0/3578558888 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f052006c8f0 0x7f052006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:38.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.666+0000 7f0540acd640 1 --2- 172.21.15.132:0/3578558888 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f052006c8f0 0x7f052006edb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f052c006fd0 tx=0x7f052c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:38.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.669+0000 7f0531ffb640 1 -- 172.21.15.132:0/3578558888 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0538059510 con 0x7f053c0b37c0 2024-04-16T15:52:38.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.844+0000 7f0543532640 1 -- 172.21.15.132:0/3578558888 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f053c15e1c0 con 0x7f053c0b37c0 2024-04-16T15:52:38.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.845+0000 7f0531ffb640 1 -- 172.21.15.132:0/3578558888 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7f0538058e10 con 0x7f053c0b37c0 2024-04-16T15:52:38.844 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:52:38.844 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"6bdec5d9-f406-43ad-8584-0503b32f6f0d","created":"2024-04-16T15:51:51.073040+0000","modified":"2024-04-16T15:52:16.950186+0000","last_up_change":"2024-04-16T15:52:02.280496+0000","last_in_change":"2024-04-16T15:51:53.376468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:52:03.284927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:52:13.363758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T15:52:14.246647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d45908b-6e22-4619-b190-897af594b712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6801","nonce":1170594668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6803","nonce":1170594668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6807","nonce":1170594668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6805","nonce":1170594668}]},"public_addr":"172.21.15.132:6801/1170594668","cluster_addr":"172.21.15.132:6803/1170594668","heartbeat_back_addr":"172.21.15.132:6807/1170594668","heartbeat_front_addr":"172.21.15.132:6805/1170594668","state":["exists","up"]},{"osd":1,"uuid":"c88bf082-e51f-4ee6-815a-025f6ce0d67b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6809","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6811","nonce":2494780358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6815","nonce":2494780358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6823","nonce":2494780358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6819","nonce":2494780358}]},"public_addr":"172.21.15.132:6811/2494780358","cluster_addr":"172.21.15.132:6815/2494780358","heartbeat_back_addr":"172.21.15.132:6823/2494780358","heartbeat_front_addr":"172.21.15.132:6819/2494780358","state":["exists","up"]},{"osd":2,"uuid":"e5dbd6b4-4e7b-47e4-ad4e-35b4b81696c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6825","nonce":27655483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6827","nonce":27655483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6831","nonce":27655483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6829","nonce":27655483}]},"public_addr":"172.21.15.132:6825/27655483","cluster_addr":"172.21.15.132:6827/27655483","heartbeat_back_addr":"172.21.15.132:6831/27655483","heartbeat_front_addr":"172.21.15.132:6829/27655483","state":["exists","up"]},{"osd":3,"uuid":"9d75cd67-3b8a-4424-8884-5f3660e1f5f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6810","nonce":3100919191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6814","nonce":3100919191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6821","nonce":3100919191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6818","nonce":3100919191}]},"public_addr":"172.21.15.132:6810/3100919191","cluster_addr":"172.21.15.132:6814/3100919191","heartbeat_back_addr":"172.21.15.132:6821/3100919191","heartbeat_front_addr":"172.21.15.132:6818/3100919191","state":["exists","up"]},{"osd":4,"uuid":"83aea46a-8642-4777-912b-c130e5890da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6825","nonce":123637799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6827","nonce":123637799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6831","nonce":123637799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6829","nonce":123637799}]},"public_addr":"172.21.15.179:6825/123637799","cluster_addr":"172.21.15.179:6827/123637799","heartbeat_back_addr":"172.21.15.179:6831/123637799","heartbeat_front_addr":"172.21.15.179:6829/123637799","state":["exists","up"]},{"osd":5,"uuid":"534117c8-3317-48d6-b436-afd5709f71e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6801","nonce":2224750370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6803","nonce":2224750370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6807","nonce":2224750370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6805","nonce":2224750370}]},"public_addr":"172.21.15.179:6801/2224750370","cluster_addr":"172.21.15.179:6803/2224750370","heartbeat_back_addr":"172.21.15.179:6807/2224750370","heartbeat_front_addr":"172.21.15.179:6805/2224750370","state":["exists","up"]},{"osd":6,"uuid":"0ba363e7-fa9d-42b1-ae09-a6a0f57d41f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6809","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6811","nonce":101498164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6813","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6815","nonce":101498164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6823","nonce":101498164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6819","nonce":101498164}]},"public_addr":"172.21.15.179:6811/101498164","cluster_addr":"172.21.15.179:6815/101498164","heartbeat_back_addr":"172.21.15.179:6823/101498164","heartbeat_front_addr":"172.21.15.179:6819/101498164","state":["exists","up"]},{"osd":7,"uuid":"e6830c77-2f2d-4067-9866-ee7625afc1a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6810","nonce":872148365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6814","nonce":872148365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6822","nonce":872148365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6818","nonce":872148365}]},"public_addr":"172.21.15.179:6810/872148365","cluster_addr":"172.21.15.179:6814/872148365","heartbeat_back_addr":"172.21.15.179:6822/872148365","heartbeat_front_addr":"172.21.15.179:6818/872148365","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.535221+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.563769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.520765+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.526264+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.517058+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.500842+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.534332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.512486+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:52:38.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.847+0000 7f0543532640 1 -- 172.21.15.132:0/3578558888 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f052006c8f0 msgr2=0x7f052006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:38.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.847+0000 7f0543532640 1 --2- 172.21.15.132:0/3578558888 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f052006c8f0 0x7f052006edb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f052c006fd0 tx=0x7f052c008040 comp rx=0 tx=0).stop 2024-04-16T15:52:38.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.847+0000 7f0543532640 1 -- 172.21.15.132:0/3578558888 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f053c0b37c0 msgr2=0x7f053c156fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:38.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.847+0000 7f0543532640 1 --2- 172.21.15.132:0/3578558888 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f053c0b37c0 0x7f053c156fd0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f053800c400 tx=0x7f053800c8c0 comp rx=0 tx=0).stop 2024-04-16T15:52:38.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.847+0000 7f0543532640 1 -- 172.21.15.132:0/3578558888 shutdown_connections 2024-04-16T15:52:38.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.847+0000 7f0543532640 1 --2- 172.21.15.132:0/3578558888 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f052006c8f0 0x7f052006edb0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:38.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.847+0000 7f0543532640 1 --2- 172.21.15.132:0/3578558888 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f053c163420 0x7f053c15f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:38.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.847+0000 7f0543532640 1 --2- 172.21.15.132:0/3578558888 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f053c15eb10 0x7f053c15f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:38.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.847+0000 7f0543532640 1 --2- 172.21.15.132:0/3578558888 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f053c0b37c0 0x7f053c156fd0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:38.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.847+0000 7f0543532640 1 -- 172.21.15.132:0/3578558888 >> 172.21.15.132:0/3578558888 conn(0x7f053c06cb30 msgr2=0x7f053c06ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:38.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.847+0000 7f0543532640 1 -- 172.21.15.132:0/3578558888 shutdown_connections 2024-04-16T15:52:38.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.847+0000 7f0543532640 1 -- 172.21.15.132:0/3578558888 wait complete. 2024-04-16T15:52:38.858 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T15:52:03.284927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T15:52:13.363758+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T15:52:14.246647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T15:52:38.858 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T15:52:38.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.967+0000 7f0cb9d15640 1 Processor -- start 2024-04-16T15:52:38.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.967+0000 7f0cb9d15640 1 -- start start 2024-04-16T15:52:38.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.968+0000 7f0cb9d15640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0cb415ad10 0x7f0cb40b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:38.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.968+0000 7f0cb9d15640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cb40b3e40 con 0x7f0cb415ea80 2024-04-16T15:52:38.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.968+0000 7f0cb9d15640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cb40b4120 con 0x7f0cb40727e0 2024-04-16T15:52:38.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.968+0000 7f0cb9d15640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f0cb40b4400 con 0x7f0cb415ad10 2024-04-16T15:52:38.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.968+0000 7f0cb2ffd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f0cb415ea80 0x7f0cb40b3540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:59550/0 (socket says 172.21.15.132:59550) 2024-04-16T15:52:38.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.968+0000 7f0cb2ffd640 1 -- 172.21.15.132:0/2166682861 learned_addr learned my addr 172.21.15.132:0/2166682861 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:38.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.968+0000 7f0cb37fe640 1 --2- 172.21.15.132:0/2166682861 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0cb415ad10 0x7f0cb40b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:38.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.968+0000 7f0cb27fc640 1 -- 172.21.15.132:0/2166682861 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3394087908 0 0) 0x7f0cb40b3e40 con 0x7f0cb415ea80 2024-04-16T15:52:38.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.968+0000 7f0cb27fc640 1 -- 172.21.15.132:0/2166682861 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c9c003520 con 0x7f0cb415ea80 2024-04-16T15:52:38.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.968+0000 7f0cb27fc640 1 -- 172.21.15.132:0/2166682861 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2996592754 0 0) 0x7f0c9c003520 con 0x7f0cb415ea80 2024-04-16T15:52:38.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.968+0000 7f0cb27fc640 1 -- 172.21.15.132:0/2166682861 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0cb415ad10 msgr2=0x7f0cb40b4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:38.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.968+0000 7f0cb27fc640 1 --2- 172.21.15.132:0/2166682861 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0cb415ad10 0x7f0cb40b4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:38.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.968+0000 7f0cb27fc640 1 -- 172.21.15.132:0/2166682861 >> v1:172.21.15.179:6789/0 conn(0x7f0cb40727e0 legacy=0x7f0cb40cdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:38.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.968+0000 7f0cb27fc640 1 -- 172.21.15.132:0/2166682861 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cb40b46e0 con 0x7f0cb415ea80 2024-04-16T15:52:38.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.968+0000 7f0cb27fc640 1 -- 172.21.15.132:0/2166682861 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2803668828 0 0) 0x7f0ca8001670 con 0x7f0cb415ea80 2024-04-16T15:52:38.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.968+0000 7f0cb27fc640 1 -- 172.21.15.132:0/2166682861 >> v1:172.21.15.132:6789/0 conn(0x7f0cb415ea80 legacy=0x7f0cb40b3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:38.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.968+0000 7f0cb27fc640 1 --2- 172.21.15.132:0/2166682861 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0cb415ad10 0x7f0c9c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:38.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.968+0000 7f0cb27fc640 1 --2- 172.21.15.132:0/2166682861 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0c9c003f20 0x7f0c9c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:38.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.968+0000 7f0cb27fc640 1 --2- 172.21.15.132:0/2166682861 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c9c004d40 0x7f0c9c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:38.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.968+0000 7f0cb27fc640 1 -- 172.21.15.132:0/2166682861 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f0cb40b4400 con 0x7f0c9c003f20 2024-04-16T15:52:38.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.968+0000 7f0cb27fc640 1 -- 172.21.15.132:0/2166682861 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0c9c00ba20 con 0x7f0c9c004d40 2024-04-16T15:52:38.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.968+0000 7f0cb27fc640 1 -- 172.21.15.132:0/2166682861 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f0c9c00bc20 con 0x7f0cb415ad10 2024-04-16T15:52:38.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.969+0000 7f0cb2ffd640 1 --2- 172.21.15.132:0/2166682861 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0c9c003f20 0x7f0c9c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:38.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.969+0000 7f0cb37fe640 1 --2- 172.21.15.132:0/2166682861 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0cb415ad10 0x7f0c9c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:38.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.969+0000 7f0cb3fff640 1 --2- 172.21.15.132:0/2166682861 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c9c004d40 0x7f0c9c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:38.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.969+0000 7f0cb2ffd640 1 -- 172.21.15.132:0/2166682861 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0cb415ad10 msgr2=0x7f0c9c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:38.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.969+0000 7f0cb2ffd640 1 --2- 172.21.15.132:0/2166682861 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0cb415ad10 0x7f0c9c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:38.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.969+0000 7f0cb2ffd640 1 -- 172.21.15.132:0/2166682861 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c9c004d40 msgr2=0x7f0c9c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:38.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.969+0000 7f0cb2ffd640 1 --2- 172.21.15.132:0/2166682861 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c9c004d40 0x7f0c9c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:38.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.969+0000 7f0cb2ffd640 1 -- 172.21.15.132:0/2166682861 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c9c003520 con 0x7f0c9c003f20 2024-04-16T15:52:38.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.970+0000 7f0cb2ffd640 1 --2- 172.21.15.132:0/2166682861 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0c9c003f20 0x7f0c9c004800 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0cb415eec0 tx=0x7f0c9c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4905ff74ad75c6ad server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:38.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.970+0000 7f0cb27fc640 1 -- 172.21.15.132:0/2166682861 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca8007ca0 con 0x7f0c9c003f20 2024-04-16T15:52:38.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.970+0000 7f0cb27fc640 1 -- 172.21.15.132:0/2166682861 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ca8030070 con 0x7f0c9c003f20 2024-04-16T15:52:38.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.970+0000 7f0cb27fc640 1 -- 172.21.15.132:0/2166682861 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca8005d70 con 0x7f0c9c003f20 2024-04-16T15:52:38.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.970+0000 7f0cb9d15640 1 -- 172.21.15.132:0/2166682861 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0c9c003f20 msgr2=0x7f0c9c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:38.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.970+0000 7f0cb9d15640 1 --2- 172.21.15.132:0/2166682861 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0c9c003f20 0x7f0c9c004800 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0cb415eec0 tx=0x7f0c9c005830 comp rx=0 tx=0).stop 2024-04-16T15:52:38.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.970+0000 7f0cb3fff640 1 -- 172.21.15.132:0/2166682861 reap_dead start 2024-04-16T15:52:38.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.970+0000 7f0cb9d15640 1 -- 172.21.15.132:0/2166682861 shutdown_connections 2024-04-16T15:52:38.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.970+0000 7f0cb9d15640 1 -- 172.21.15.132:0/2166682861 >> 172.21.15.132:0/2166682861 conn(0x7f0cb40d0490 msgr2=0x7f0cb40d08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:38.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.970+0000 7f0cb9d15640 1 -- 172.21.15.132:0/2166682861 shutdown_connections 2024-04-16T15:52:38.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.970+0000 7f0cb9d15640 1 -- 172.21.15.132:0/2166682861 wait complete. 2024-04-16T15:52:38.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.972+0000 7f0cb9d15640 1 Processor -- start 2024-04-16T15:52:38.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.972+0000 7f0cb9d15640 1 -- start start 2024-04-16T15:52:38.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.972+0000 7f0cb9d15640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c9c003f20 0x7f0cb413a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:38.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.972+0000 7f0cb9d15640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0cb4158fb0 0x7f0cb4159430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:38.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.972+0000 7f0cb9d15640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0cb4152450 0x7f0cb41528d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:38.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.972+0000 7f0cb9d15640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f0cb415b270 con 0x7f0cb4152450 2024-04-16T15:52:38.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.972+0000 7f0cb9d15640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0cb415b0f0 con 0x7f0cb4158fb0 2024-04-16T15:52:38.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.972+0000 7f0cb9d15640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f0cb4072c70 con 0x7f0c9c003f20 2024-04-16T15:52:38.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.973+0000 7f0cb3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0cb4152450 0x7f0cb41528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:38.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.973+0000 7f0cb3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0cb4152450 0x7f0cb41528d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42670/0 (socket says 172.21.15.132:42670) 2024-04-16T15:52:38.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.973+0000 7f0cb3fff640 1 -- 172.21.15.132:0/3654774256 learned_addr learned my addr 172.21.15.132:0/3654774256 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:38.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.973+0000 7f0cb37fe640 1 --2- 172.21.15.132:0/3654774256 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c9c003f20 0x7f0cb413a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:38.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.973+0000 7f0cb2ffd640 1 --2- 172.21.15.132:0/3654774256 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0cb4158fb0 0x7f0cb4159430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:38.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.973+0000 7f0cb3fff640 1 -- 172.21.15.132:0/3654774256 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c9c003f20 msgr2=0x7f0cb413a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:38.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.973+0000 7f0cb3fff640 1 --2- 172.21.15.132:0/3654774256 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c9c003f20 0x7f0cb413a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:38.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.973+0000 7f0cb3fff640 1 -- 172.21.15.132:0/3654774256 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0cb4158fb0 msgr2=0x7f0cb4159430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:38.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.973+0000 7f0cb3fff640 1 --2- 172.21.15.132:0/3654774256 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0cb4158fb0 0x7f0cb4159430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:38.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.973+0000 7f0cb3fff640 1 -- 172.21.15.132:0/3654774256 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cb41531f0 con 0x7f0cb4152450 2024-04-16T15:52:38.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.973+0000 7f0cb37fe640 1 --2- 172.21.15.132:0/3654774256 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c9c003f20 0x7f0cb413a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:38.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.973+0000 7f0cb3fff640 1 --2- 172.21.15.132:0/3654774256 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0cb4152450 0x7f0cb41528d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0cac00fae0 tx=0x7f0cac002160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:38.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.973+0000 7f0c9bfff640 1 -- 172.21.15.132:0/3654774256 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cac019070 con 0x7f0cb4152450 2024-04-16T15:52:38.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.973+0000 7f0c9bfff640 1 -- 172.21.15.132:0/3654774256 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cac006d60 con 0x7f0cb4152450 2024-04-16T15:52:38.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.973+0000 7f0cb9d15640 1 -- 172.21.15.132:0/3654774256 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cb413ac60 con 0x7f0cb4152450 2024-04-16T15:52:38.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.973+0000 7f0c9bfff640 1 -- 172.21.15.132:0/3654774256 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cac003bb0 con 0x7f0cb4152450 2024-04-16T15:52:38.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.973+0000 7f0cb9d15640 1 -- 172.21.15.132:0/3654774256 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cb413b220 con 0x7f0cb4152450 2024-04-16T15:52:38.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.974+0000 7f0cb9d15640 1 -- 172.21.15.132:0/3654774256 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cb413b420 con 0x7f0cb4152450 2024-04-16T15:52:38.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.975+0000 7f0c9bfff640 1 -- 172.21.15.132:0/3654774256 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0cac00d7d0 con 0x7f0cb4152450 2024-04-16T15:52:38.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.975+0000 7f0c9bfff640 1 --2- 172.21.15.132:0/3654774256 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f0ca006c8f0 0x7f0ca006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:38.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.975+0000 7f0c9bfff640 1 -- 172.21.15.132:0/3654774256 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0cac08b190 con 0x7f0cb4152450 2024-04-16T15:52:38.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.975+0000 7f0cb37fe640 1 --2- 172.21.15.132:0/3654774256 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f0ca006c8f0 0x7f0ca006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:38.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.976+0000 7f0cb37fe640 1 --2- 172.21.15.132:0/3654774256 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f0ca006c8f0 0x7f0ca006edb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0ca4009bc0 tx=0x7f0ca4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:38.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:38.980+0000 7f0c9bfff640 1 -- 172.21.15.132:0/3654774256 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0cb413b420 con 0x7f0cb4152450 2024-04-16T15:52:39.155 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.156+0000 7f0cb9d15640 1 -- 172.21.15.132:0/3654774256 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0cb4075510 con 0x7f0cb4152450 2024-04-16T15:52:39.155 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.156+0000 7f0c9bfff640 1 -- 172.21.15.132:0/3654774256 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f0cac0594b0 con 0x7f0cb4152450 2024-04-16T15:52:39.155 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2024-04-16T15:52:39.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.158+0000 7f0cb9d15640 1 -- 172.21.15.132:0/3654774256 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f0ca006c8f0 msgr2=0x7f0ca006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:39.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.158+0000 7f0cb9d15640 1 --2- 172.21.15.132:0/3654774256 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f0ca006c8f0 0x7f0ca006edb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0ca4009bc0 tx=0x7f0ca4008040 comp rx=0 tx=0).stop 2024-04-16T15:52:39.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.158+0000 7f0cb9d15640 1 -- 172.21.15.132:0/3654774256 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0cb4152450 msgr2=0x7f0cb41528d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:39.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.158+0000 7f0cb9d15640 1 --2- 172.21.15.132:0/3654774256 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0cb4152450 0x7f0cb41528d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0cac00fae0 tx=0x7f0cac002160 comp rx=0 tx=0).stop 2024-04-16T15:52:39.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.158+0000 7f0cb9d15640 1 -- 172.21.15.132:0/3654774256 shutdown_connections 2024-04-16T15:52:39.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.158+0000 7f0cb9d15640 1 --2- 172.21.15.132:0/3654774256 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f0ca006c8f0 0x7f0ca006edb0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:39.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.158+0000 7f0cb9d15640 1 --2- 172.21.15.132:0/3654774256 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0cb4152450 0x7f0cb41528d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:39.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.158+0000 7f0cb9d15640 1 --2- 172.21.15.132:0/3654774256 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0cb4158fb0 0x7f0cb4159430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:39.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.158+0000 7f0cb9d15640 1 --2- 172.21.15.132:0/3654774256 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c9c003f20 0x7f0cb413a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:39.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.158+0000 7f0cb9d15640 1 -- 172.21.15.132:0/3654774256 >> 172.21.15.132:0/3654774256 conn(0x7f0cb40d0490 msgr2=0x7f0cb415a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:39.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.158+0000 7f0cb9d15640 1 -- 172.21.15.132:0/3654774256 shutdown_connections 2024-04-16T15:52:39.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.158+0000 7f0cb9d15640 1 -- 172.21.15.132:0/3654774256 wait complete. 2024-04-16T15:52:39.168 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T15:52:39.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.276+0000 7f3b2ffa8640 1 Processor -- start 2024-04-16T15:52:39.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.276+0000 7f3b2ffa8640 1 -- start start 2024-04-16T15:52:39.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.277+0000 7f3b2ffa8640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3b2809b140 0x7f3b2806d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:39.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.277+0000 7f3b2ffa8640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3b2809b970 0x7f3b280cd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:39.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.277+0000 7f3b2ffa8640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b280ccd90 con 0x7f3b2815eab0 2024-04-16T15:52:39.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.277+0000 7f3b2ffa8640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f3b2806dbd0 con 0x7f3b2809b970 2024-04-16T15:52:39.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.277+0000 7f3b2ffa8640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f3b280cd000 con 0x7f3b2809b140 2024-04-16T15:52:39.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.277+0000 7f3b2e545640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3b2809b970 0x7f3b280cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:39.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.277+0000 7f3b2e545640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3b2809b970 0x7f3b280cd800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42672/0 (socket says 172.21.15.132:42672) 2024-04-16T15:52:39.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.277+0000 7f3b2e545640 1 -- 172.21.15.132:0/1178698889 learned_addr learned my addr 172.21.15.132:0/1178698889 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:39.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.277+0000 7f3b2d543640 1 --2- 172.21.15.132:0/1178698889 >> v2:172.21.15.179:3300/0 conn(0x7f3b2809b140 0x7f3b2806d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:39.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.277+0000 7f3b2e545640 1 -- 172.21.15.132:0/1178698889 >> v2:172.21.15.179:3300/0 conn(0x7f3b2809b140 msgr2=0x7f3b2806d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:39.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.277+0000 7f3b2e545640 1 --2- 172.21.15.132:0/1178698889 >> v2:172.21.15.179:3300/0 conn(0x7f3b2809b140 0x7f3b2806d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:39.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.277+0000 7f3b2e545640 1 -- 172.21.15.132:0/1178698889 >> v1:172.21.15.179:6789/0 conn(0x7f3b2815eab0 legacy=0x7f3b2809aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:39.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.277+0000 7f3b2e545640 1 -- 172.21.15.132:0/1178698889 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b280cd2e0 con 0x7f3b2809b970 2024-04-16T15:52:39.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.278+0000 7f3b2e545640 1 --2- 172.21.15.132:0/1178698889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b2809b970 0x7f3b280cd800 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3b280b5270 tx=0x7f3b2002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=515fc92709a07457 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:39.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.278+0000 7f3b2cd42640 1 -- 172.21.15.132:0/1178698889 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b2002ca80 con 0x7f3b2809b970 2024-04-16T15:52:39.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.278+0000 7f3b2cd42640 1 -- 172.21.15.132:0/1178698889 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b2002cc20 con 0x7f3b2809b970 2024-04-16T15:52:39.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.278+0000 7f3b2cd42640 1 -- 172.21.15.132:0/1178698889 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b200343f0 con 0x7f3b2809b970 2024-04-16T15:52:39.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.278+0000 7f3b2ffa8640 1 -- 172.21.15.132:0/1178698889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b2809b970 msgr2=0x7f3b280cd800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:39.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.278+0000 7f3b2ffa8640 1 --2- 172.21.15.132:0/1178698889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b2809b970 0x7f3b280cd800 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3b280b5270 tx=0x7f3b2002bee0 comp rx=0 tx=0).stop 2024-04-16T15:52:39.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.279+0000 7f3b2ffa8640 1 -- 172.21.15.132:0/1178698889 shutdown_connections 2024-04-16T15:52:39.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.279+0000 7f3b2ffa8640 1 --2- 172.21.15.132:0/1178698889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b2809b970 0x7f3b280cd800 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:39.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.279+0000 7f3b2ffa8640 1 --2- 172.21.15.132:0/1178698889 >> v2:172.21.15.179:3300/0 conn(0x7f3b2809b140 0x7f3b2806d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:39.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.279+0000 7f3b2ffa8640 1 -- 172.21.15.132:0/1178698889 >> 172.21.15.132:0/1178698889 conn(0x7f3b280b4190 msgr2=0x7f3b280b45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:39.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.279+0000 7f3b2ffa8640 1 -- 172.21.15.132:0/1178698889 shutdown_connections 2024-04-16T15:52:39.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.279+0000 7f3b2ffa8640 1 -- 172.21.15.132:0/1178698889 wait complete. 2024-04-16T15:52:39.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.280+0000 7f3b2ffa8640 1 Processor -- start 2024-04-16T15:52:39.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.280+0000 7f3b2ffa8640 1 -- start start 2024-04-16T15:52:39.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.280+0000 7f3b2ffa8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b2809b140 0x7f3b28153a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:39.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.280+0000 7f3b2ffa8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b2809b970 0x7f3b280cbf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:39.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.280+0000 7f3b2ffa8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b2815eab0 0x7f3b281607d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:39.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.280+0000 7f3b2ffa8640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f3b2806deb0 con 0x7f3b2815eab0 2024-04-16T15:52:39.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.280+0000 7f3b2ffa8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3b2809bda0 con 0x7f3b2809b970 2024-04-16T15:52:39.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.280+0000 7f3b2ffa8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f3b2806e030 con 0x7f3b2809b140 2024-04-16T15:52:39.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.281+0000 7f3b2e545640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b2815eab0 0x7f3b281607d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:39.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.281+0000 7f3b2e545640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b2815eab0 0x7f3b281607d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42674/0 (socket says 172.21.15.132:42674) 2024-04-16T15:52:39.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.281+0000 7f3b2e545640 1 -- 172.21.15.132:0/3134666579 learned_addr learned my addr 172.21.15.132:0/3134666579 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:39.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.281+0000 7f3b2e545640 1 -- 172.21.15.132:0/3134666579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b2809b140 msgr2=0x7f3b28153a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:39.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.281+0000 7f3b2dd44640 1 --2- 172.21.15.132:0/3134666579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b2809b140 0x7f3b28153a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:39.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.281+0000 7f3b2d543640 1 --2- 172.21.15.132:0/3134666579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b2809b970 0x7f3b280cbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:39.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.281+0000 7f3b2e545640 1 --2- 172.21.15.132:0/3134666579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b2809b140 0x7f3b28153a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:39.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.281+0000 7f3b2e545640 1 -- 172.21.15.132:0/3134666579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b2809b970 msgr2=0x7f3b280cbf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:39.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.281+0000 7f3b2e545640 1 --2- 172.21.15.132:0/3134666579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b2809b970 0x7f3b280cbf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:39.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.281+0000 7f3b2e545640 1 -- 172.21.15.132:0/3134666579 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b280cc6d0 con 0x7f3b2815eab0 2024-04-16T15:52:39.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.281+0000 7f3b2e545640 1 --2- 172.21.15.132:0/3134666579 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b2815eab0 0x7f3b281607d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3b20009f40 tx=0x7f3b20004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:39.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.281+0000 7f3b1e7fc640 1 -- 172.21.15.132:0/3134666579 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b20043020 con 0x7f3b2815eab0 2024-04-16T15:52:39.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.281+0000 7f3b1e7fc640 1 -- 172.21.15.132:0/3134666579 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b2003e450 con 0x7f3b2815eab0 2024-04-16T15:52:39.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.281+0000 7f3b2ffa8640 1 -- 172.21.15.132:0/3134666579 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b280cc450 con 0x7f3b2815eab0 2024-04-16T15:52:39.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.281+0000 7f3b1e7fc640 1 -- 172.21.15.132:0/3134666579 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b20009510 con 0x7f3b2815eab0 2024-04-16T15:52:39.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.281+0000 7f3b2ffa8640 1 -- 172.21.15.132:0/3134666579 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b280ca570 con 0x7f3b2815eab0 2024-04-16T15:52:39.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.282+0000 7f3b2ffa8640 1 -- 172.21.15.132:0/3134666579 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b2806c550 con 0x7f3b2815eab0 2024-04-16T15:52:39.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.283+0000 7f3b1e7fc640 1 -- 172.21.15.132:0/3134666579 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3b20046020 con 0x7f3b2815eab0 2024-04-16T15:52:39.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.283+0000 7f3b1e7fc640 1 --2- 172.21.15.132:0/3134666579 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f3b0c06c8f0 0x7f3b0c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:39.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.283+0000 7f3b1e7fc640 1 -- 172.21.15.132:0/3134666579 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3b200ae380 con 0x7f3b2815eab0 2024-04-16T15:52:39.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.283+0000 7f3b2dd44640 1 --2- 172.21.15.132:0/3134666579 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f3b0c06c8f0 0x7f3b0c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:39.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.284+0000 7f3b2dd44640 1 --2- 172.21.15.132:0/3134666579 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f3b0c06c8f0 0x7f3b0c06edb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3b24001500 tx=0x7f3b24009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:39.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.287+0000 7f3b1e7fc640 1 -- 172.21.15.132:0/3134666579 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3b2806c550 con 0x7f3b2815eab0 2024-04-16T15:52:39.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.461+0000 7f3b2ffa8640 1 -- 172.21.15.132:0/3134666579 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f3b280b3f70 con 0x7f3b2815eab0 2024-04-16T15:52:39.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.461+0000 7f3b1e7fc640 1 -- 172.21.15.132:0/3134666579 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f3b2004d030 con 0x7f3b2815eab0 2024-04-16T15:52:39.461 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2024-04-16T15:52:39.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.463+0000 7f3b2ffa8640 1 -- 172.21.15.132:0/3134666579 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f3b0c06c8f0 msgr2=0x7f3b0c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:39.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.463+0000 7f3b2ffa8640 1 --2- 172.21.15.132:0/3134666579 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f3b0c06c8f0 0x7f3b0c06edb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3b24001500 tx=0x7f3b24009040 comp rx=0 tx=0).stop 2024-04-16T15:52:39.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.463+0000 7f3b2ffa8640 1 -- 172.21.15.132:0/3134666579 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b2815eab0 msgr2=0x7f3b281607d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:39.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.463+0000 7f3b2ffa8640 1 --2- 172.21.15.132:0/3134666579 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b2815eab0 0x7f3b281607d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3b20009f40 tx=0x7f3b20004a40 comp rx=0 tx=0).stop 2024-04-16T15:52:39.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.463+0000 7f3b2ffa8640 1 -- 172.21.15.132:0/3134666579 shutdown_connections 2024-04-16T15:52:39.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.463+0000 7f3b2ffa8640 1 --2- 172.21.15.132:0/3134666579 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f3b0c06c8f0 0x7f3b0c06edb0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:39.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.463+0000 7f3b2ffa8640 1 --2- 172.21.15.132:0/3134666579 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b2815eab0 0x7f3b281607d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:39.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.463+0000 7f3b2ffa8640 1 --2- 172.21.15.132:0/3134666579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b2809b970 0x7f3b280cbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:39.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.463+0000 7f3b2ffa8640 1 --2- 172.21.15.132:0/3134666579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b2809b140 0x7f3b28153a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:39.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.463+0000 7f3b2ffa8640 1 -- 172.21.15.132:0/3134666579 >> 172.21.15.132:0/3134666579 conn(0x7f3b280b4190 msgr2=0x7f3b280ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:39.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.464+0000 7f3b2ffa8640 1 -- 172.21.15.132:0/3134666579 shutdown_connections 2024-04-16T15:52:39.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.464+0000 7f3b2ffa8640 1 -- 172.21.15.132:0/3134666579 wait complete. 2024-04-16T15:52:39.474 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T15:52:39.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.583+0000 7f15406b1640 1 Processor -- start 2024-04-16T15:52:39.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.583+0000 7f15406b1640 1 -- start start 2024-04-16T15:52:39.584 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.583+0000 7f15406b1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f153815eaa0 0x7f153806e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:39.584 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.584+0000 7f15406b1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f153815ee80 0x7f15380700f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:39.584 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.584+0000 7f15406b1640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f153806edb0 con 0x7f1538067a00 2024-04-16T15:52:39.584 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.584+0000 7f15406b1640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f153806fc60 con 0x7f153815ee80 2024-04-16T15:52:39.584 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.584+0000 7f15406b1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f153806f050 con 0x7f153815eaa0 2024-04-16T15:52:39.584 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.584+0000 7f153dc4c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f153815ee80 0x7f15380700f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:39.584 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.584+0000 7f153dc4c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f153815ee80 0x7f15380700f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42680/0 (socket says 172.21.15.132:42680) 2024-04-16T15:52:39.584 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.584+0000 7f153dc4c640 1 -- 172.21.15.132:0/3247202718 learned_addr learned my addr 172.21.15.132:0/3247202718 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:39.584 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.584+0000 7f153ec4e640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f1538067a00 0x7f153806ca30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:59560/0 (socket says 172.21.15.132:59560) 2024-04-16T15:52:39.584 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.584+0000 7f153e44d640 1 --2- 172.21.15.132:0/3247202718 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f153815eaa0 0x7f153806e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:39.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.584+0000 7f153dc4c640 1 -- 172.21.15.132:0/3247202718 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f153815eaa0 msgr2=0x7f153806e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:39.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.584+0000 7f153dc4c640 1 --2- 172.21.15.132:0/3247202718 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f153815eaa0 0x7f153806e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:39.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.584+0000 7f153dc4c640 1 -- 172.21.15.132:0/3247202718 >> v1:172.21.15.132:6789/0 conn(0x7f1538067a00 legacy=0x7f153806ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:39.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.584+0000 7f153dc4c640 1 -- 172.21.15.132:0/3247202718 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f153806f330 con 0x7f153815ee80 2024-04-16T15:52:39.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.584+0000 7f153d44b640 1 -- 172.21.15.132:0/3247202718 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3561118894 0 0) 0x7f153806edb0 con 0x7f1538067a00 2024-04-16T15:52:39.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.585+0000 7f153dc4c640 1 --2- 172.21.15.132:0/3247202718 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f153815ee80 0x7f15380700f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f152c009e50 tx=0x7f152c02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a9abe2f400e59b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:39.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.585+0000 7f153d44b640 1 -- 172.21.15.132:0/3247202718 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f152c02cb00 con 0x7f153815ee80 2024-04-16T15:52:39.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.585+0000 7f153d44b640 1 -- 172.21.15.132:0/3247202718 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f152c02cca0 con 0x7f153815ee80 2024-04-16T15:52:39.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.585+0000 7f153d44b640 1 -- 172.21.15.132:0/3247202718 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f152c034610 con 0x7f153815ee80 2024-04-16T15:52:39.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.585+0000 7f15406b1640 1 -- 172.21.15.132:0/3247202718 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f153815ee80 msgr2=0x7f15380700f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:39.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.585+0000 7f15406b1640 1 --2- 172.21.15.132:0/3247202718 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f153815ee80 0x7f15380700f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f152c009e50 tx=0x7f152c02bf60 comp rx=0 tx=0).stop 2024-04-16T15:52:39.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.586+0000 7f15406b1640 1 -- 172.21.15.132:0/3247202718 shutdown_connections 2024-04-16T15:52:39.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.586+0000 7f15406b1640 1 --2- 172.21.15.132:0/3247202718 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f153815ee80 0x7f15380700f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:39.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.586+0000 7f15406b1640 1 --2- 172.21.15.132:0/3247202718 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f153815eaa0 0x7f153806e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:39.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.586+0000 7f15406b1640 1 -- 172.21.15.132:0/3247202718 >> 172.21.15.132:0/3247202718 conn(0x7f1538072810 msgr2=0x7f1538072c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:39.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.586+0000 7f15406b1640 1 -- 172.21.15.132:0/3247202718 shutdown_connections 2024-04-16T15:52:39.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.586+0000 7f15406b1640 1 -- 172.21.15.132:0/3247202718 wait complete. 2024-04-16T15:52:39.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.587+0000 7f15406b1640 1 Processor -- start 2024-04-16T15:52:39.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.587+0000 7f15406b1640 1 -- start start 2024-04-16T15:52:39.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.587+0000 7f15406b1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1538067a00 0x7f153815f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:39.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.587+0000 7f15406b1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f153815eaa0 0x7f1538149750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:39.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.587+0000 7f15406b1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f153815ee80 0x7f153815fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:39.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.587+0000 7f15406b1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f1538070630 con 0x7f153815ee80 2024-04-16T15:52:39.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.587+0000 7f15406b1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f153806f8f0 con 0x7f1538067a00 2024-04-16T15:52:39.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.587+0000 7f15406b1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f153806d140 con 0x7f153815eaa0 2024-04-16T15:52:39.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.588+0000 7f153ec4e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f153815ee80 0x7f153815fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:39.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.588+0000 7f153ec4e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f153815ee80 0x7f153815fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42688/0 (socket says 172.21.15.132:42688) 2024-04-16T15:52:39.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.588+0000 7f153ec4e640 1 -- 172.21.15.132:0/1455436367 learned_addr learned my addr 172.21.15.132:0/1455436367 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:39.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.588+0000 7f153dc4c640 1 --2- 172.21.15.132:0/1455436367 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f153815eaa0 0x7f1538149750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:39.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.588+0000 7f153e44d640 1 --2- 172.21.15.132:0/1455436367 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1538067a00 0x7f153815f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:39.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.588+0000 7f153ec4e640 1 -- 172.21.15.132:0/1455436367 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f153815eaa0 msgr2=0x7f1538149750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:39.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.588+0000 7f153ec4e640 1 --2- 172.21.15.132:0/1455436367 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f153815eaa0 0x7f1538149750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:39.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.588+0000 7f153ec4e640 1 -- 172.21.15.132:0/1455436367 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1538067a00 msgr2=0x7f153815f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:39.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.588+0000 7f153ec4e640 1 --2- 172.21.15.132:0/1455436367 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1538067a00 0x7f153815f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:39.590 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.588+0000 7f153ec4e640 1 -- 172.21.15.132:0/1455436367 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15380cdbc0 con 0x7f153815ee80 2024-04-16T15:52:39.590 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.588+0000 7f153ec4e640 1 --2- 172.21.15.132:0/1455436367 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f153815ee80 0x7f153815fd00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f152800c450 tx=0x7f152800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:39.590 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.588+0000 7f1536ffd640 1 -- 172.21.15.132:0/1455436367 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1528018070 con 0x7f153815ee80 2024-04-16T15:52:39.590 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.588+0000 7f1536ffd640 1 -- 172.21.15.132:0/1455436367 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1528007500 con 0x7f153815ee80 2024-04-16T15:52:39.590 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.588+0000 7f15406b1640 1 -- 172.21.15.132:0/1455436367 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15380cdea0 con 0x7f153815ee80 2024-04-16T15:52:39.590 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.588+0000 7f1536ffd640 1 -- 172.21.15.132:0/1455436367 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1528004a20 con 0x7f153815ee80 2024-04-16T15:52:39.590 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.588+0000 7f15406b1640 1 -- 172.21.15.132:0/1455436367 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15380ce460 con 0x7f153815ee80 2024-04-16T15:52:39.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.589+0000 7f15406b1640 1 -- 172.21.15.132:0/1455436367 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15380ce840 con 0x7f153815ee80 2024-04-16T15:52:39.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.590+0000 7f1536ffd640 1 -- 172.21.15.132:0/1455436367 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f152801b070 con 0x7f153815ee80 2024-04-16T15:52:39.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.590+0000 7f1536ffd640 1 --2- 172.21.15.132:0/1455436367 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f152406c8f0 0x7f152406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:39.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.590+0000 7f1536ffd640 1 -- 172.21.15.132:0/1455436367 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f152808ad20 con 0x7f153815ee80 2024-04-16T15:52:39.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.590+0000 7f153e44d640 1 --2- 172.21.15.132:0/1455436367 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f152406c8f0 0x7f152406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:39.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.591+0000 7f153e44d640 1 --2- 172.21.15.132:0/1455436367 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f152406c8f0 0x7f152406edb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1530009a10 tx=0x7f1530008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:39.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.594+0000 7f1536ffd640 1 -- 172.21.15.132:0/1455436367 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f15380ce840 con 0x7f153815ee80 2024-04-16T15:52:39.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.768+0000 7f15406b1640 1 -- 172.21.15.132:0/1455436367 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f1538075510 con 0x7f153815ee80 2024-04-16T15:52:39.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.769+0000 7f1536ffd640 1 -- 172.21.15.132:0/1455436367 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f15280591e0 con 0x7f153815ee80 2024-04-16T15:52:39.768 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2024-04-16T15:52:39.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.771+0000 7f15406b1640 1 -- 172.21.15.132:0/1455436367 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f152406c8f0 msgr2=0x7f152406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:39.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.771+0000 7f15406b1640 1 --2- 172.21.15.132:0/1455436367 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f152406c8f0 0x7f152406edb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1530009a10 tx=0x7f1530008040 comp rx=0 tx=0).stop 2024-04-16T15:52:39.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.771+0000 7f15406b1640 1 -- 172.21.15.132:0/1455436367 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f153815ee80 msgr2=0x7f153815fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:39.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.771+0000 7f15406b1640 1 --2- 172.21.15.132:0/1455436367 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f153815ee80 0x7f153815fd00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f152800c450 tx=0x7f152800c910 comp rx=0 tx=0).stop 2024-04-16T15:52:39.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.771+0000 7f15406b1640 1 -- 172.21.15.132:0/1455436367 shutdown_connections 2024-04-16T15:52:39.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.771+0000 7f15406b1640 1 --2- 172.21.15.132:0/1455436367 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f152406c8f0 0x7f152406edb0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:39.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.771+0000 7f15406b1640 1 --2- 172.21.15.132:0/1455436367 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f153815ee80 0x7f153815fd00 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:39.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.771+0000 7f15406b1640 1 --2- 172.21.15.132:0/1455436367 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f153815eaa0 0x7f1538149750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:39.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.771+0000 7f15406b1640 1 --2- 172.21.15.132:0/1455436367 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1538067a00 0x7f153815f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:39.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.771+0000 7f15406b1640 1 -- 172.21.15.132:0/1455436367 >> 172.21.15.132:0/1455436367 conn(0x7f1538072810 msgr2=0x7f1538072bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:39.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.771+0000 7f15406b1640 1 -- 172.21.15.132:0/1455436367 shutdown_connections 2024-04-16T15:52:39.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.771+0000 7f15406b1640 1 -- 172.21.15.132:0/1455436367 wait complete. 2024-04-16T15:52:39.781 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:52:39.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.885+0000 7fd439d72640 1 Processor -- start 2024-04-16T15:52:39.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.885+0000 7fd439d72640 1 -- start start 2024-04-16T15:52:39.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.886+0000 7fd439d72640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd43406df50 0x7fd43406cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:39.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.886+0000 7fd439d72640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4340d1fe0 con 0x7fd43415ede0 2024-04-16T15:52:39.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.886+0000 7fd439d72640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4340ccee0 con 0x7fd43409aa30 2024-04-16T15:52:39.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.886+0000 7fd439d72640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fd4340b1c00 con 0x7fd43406df50 2024-04-16T15:52:39.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.886+0000 7fd433fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd43406df50 0x7fd43406cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:39.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.886+0000 7fd432ffd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fd43415ede0 0x7fd4340d0af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:59562/0 (socket says 172.21.15.132:59562) 2024-04-16T15:52:39.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.886+0000 7fd432ffd640 1 -- 172.21.15.132:0/3622809161 learned_addr learned my addr 172.21.15.132:0/3622809161 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:39.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.886+0000 7fd433fff640 1 -- 172.21.15.132:0/3622809161 >> v1:172.21.15.179:6789/0 conn(0x7fd43409aa30 legacy=0x7fd43409ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:39.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.886+0000 7fd433fff640 1 -- 172.21.15.132:0/3622809161 >> v1:172.21.15.132:6789/0 conn(0x7fd43415ede0 legacy=0x7fd4340d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:39.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.886+0000 7fd433fff640 1 -- 172.21.15.132:0/3622809161 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4340cd1c0 con 0x7fd43406df50 2024-04-16T15:52:39.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.886+0000 7fd4327fc640 1 -- 172.21.15.132:0/3622809161 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 817454365 0 0) 0x7fd4340d1fe0 con 0x7fd43415ede0 2024-04-16T15:52:39.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.887+0000 7fd433fff640 1 --2- 172.21.15.132:0/3622809161 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd43406df50 0x7fd43406cd40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd42c0097a0 tx=0x7fd42c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8853e11854af85 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:39.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.887+0000 7fd4327fc640 1 -- 172.21.15.132:0/3622809161 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd42c035020 con 0x7fd43406df50 2024-04-16T15:52:39.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.887+0000 7fd4327fc640 1 -- 172.21.15.132:0/3622809161 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd42c031830 con 0x7fd43406df50 2024-04-16T15:52:39.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.887+0000 7fd4327fc640 1 -- 172.21.15.132:0/3622809161 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd42c031c00 con 0x7fd43406df50 2024-04-16T15:52:39.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.888+0000 7fd439d72640 1 -- 172.21.15.132:0/3622809161 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd43406df50 msgr2=0x7fd43406cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:39.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.888+0000 7fd439d72640 1 --2- 172.21.15.132:0/3622809161 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd43406df50 0x7fd43406cd40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd42c0097a0 tx=0x7fd42c02b8d0 comp rx=0 tx=0).stop 2024-04-16T15:52:39.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.888+0000 7fd439d72640 1 -- 172.21.15.132:0/3622809161 shutdown_connections 2024-04-16T15:52:39.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.888+0000 7fd439d72640 1 --2- 172.21.15.132:0/3622809161 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd43406df50 0x7fd43406cd40 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:39.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.888+0000 7fd439d72640 1 -- 172.21.15.132:0/3622809161 >> 172.21.15.132:0/3622809161 conn(0x7fd4340b41e0 msgr2=0x7fd4340b45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:39.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.888+0000 7fd439d72640 1 -- 172.21.15.132:0/3622809161 shutdown_connections 2024-04-16T15:52:39.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.888+0000 7fd439d72640 1 -- 172.21.15.132:0/3622809161 wait complete. 2024-04-16T15:52:39.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.889+0000 7fd439d72640 1 Processor -- start 2024-04-16T15:52:39.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.889+0000 7fd439d72640 1 -- start start 2024-04-16T15:52:39.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.890+0000 7fd439d72640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd43406df50 0x7fd4340cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:39.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.890+0000 7fd439d72640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd43409aa30 0x7fd4341f4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:39.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.890+0000 7fd439d72640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4340c9910 0x7fd4341f7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:39.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.890+0000 7fd439d72640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fd4340d1200 con 0x7fd43409aa30 2024-04-16T15:52:39.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.890+0000 7fd439d72640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd4340cd530 con 0x7fd4340c9910 2024-04-16T15:52:39.894 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.890+0000 7fd439d72640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fd4340d1380 con 0x7fd43406df50 2024-04-16T15:52:39.894 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.890+0000 7fd432ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd43409aa30 0x7fd4341f4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:39.894 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.890+0000 7fd432ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd43409aa30 0x7fd4341f4f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42708/0 (socket says 172.21.15.132:42708) 2024-04-16T15:52:39.894 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.890+0000 7fd432ffd640 1 -- 172.21.15.132:0/31016487 learned_addr learned my addr 172.21.15.132:0/31016487 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:39.894 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.890+0000 7fd4337fe640 1 --2- 172.21.15.132:0/31016487 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd43406df50 0x7fd4340cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:39.894 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.890+0000 7fd433fff640 1 --2- 172.21.15.132:0/31016487 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4340c9910 0x7fd4341f7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:39.894 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.890+0000 7fd432ffd640 1 -- 172.21.15.132:0/31016487 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd43406df50 msgr2=0x7fd4340cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:39.894 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.890+0000 7fd432ffd640 1 --2- 172.21.15.132:0/31016487 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd43406df50 0x7fd4340cc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:39.894 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.890+0000 7fd432ffd640 1 -- 172.21.15.132:0/31016487 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4340c9910 msgr2=0x7fd4341f7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:39.894 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.890+0000 7fd432ffd640 1 --2- 172.21.15.132:0/31016487 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4340c9910 0x7fd4341f7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:39.894 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.890+0000 7fd432ffd640 1 -- 172.21.15.132:0/31016487 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4341f54a0 con 0x7fd43409aa30 2024-04-16T15:52:39.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.890+0000 7fd433fff640 1 --2- 172.21.15.132:0/31016487 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4340c9910 0x7fd4341f7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:52:39.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.890+0000 7fd432ffd640 1 --2- 172.21.15.132:0/31016487 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd43409aa30 0x7fd4341f4f60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd42800c420 tx=0x7fd42800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:39.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.890+0000 7fd41bfff640 1 -- 172.21.15.132:0/31016487 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4280074e0 con 0x7fd43409aa30 2024-04-16T15:52:39.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.891+0000 7fd439d72640 1 -- 172.21.15.132:0/31016487 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4340cb350 con 0x7fd43409aa30 2024-04-16T15:52:39.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.891+0000 7fd41bfff640 1 -- 172.21.15.132:0/31016487 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4280047e0 con 0x7fd43409aa30 2024-04-16T15:52:39.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.891+0000 7fd41bfff640 1 -- 172.21.15.132:0/31016487 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd428004c10 con 0x7fd43409aa30 2024-04-16T15:52:39.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.891+0000 7fd439d72640 1 -- 172.21.15.132:0/31016487 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4340cb910 con 0x7fd43409aa30 2024-04-16T15:52:39.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.892+0000 7fd439d72640 1 -- 172.21.15.132:0/31016487 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd434075510 con 0x7fd43409aa30 2024-04-16T15:52:39.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.892+0000 7fd41bfff640 1 -- 172.21.15.132:0/31016487 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd428011070 con 0x7fd43409aa30 2024-04-16T15:52:39.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.892+0000 7fd41bfff640 1 --2- 172.21.15.132:0/31016487 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fd42006c8f0 0x7fd42006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:39.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.893+0000 7fd41bfff640 1 -- 172.21.15.132:0/31016487 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd42808b7d0 con 0x7fd43409aa30 2024-04-16T15:52:39.896 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.893+0000 7fd4337fe640 1 --2- 172.21.15.132:0/31016487 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fd42006c8f0 0x7fd42006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:39.896 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.893+0000 7fd4337fe640 1 --2- 172.21.15.132:0/31016487 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fd42006c8f0 0x7fd42006edb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd43415e0d0 tx=0x7fd424009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:39.896 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:39.897+0000 7fd41bfff640 1 -- 172.21.15.132:0/31016487 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd42800e280 con 0x7fd43409aa30 2024-04-16T15:52:40.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.075+0000 7fd439d72640 1 -- 172.21.15.132:0/31016487 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd4340cb040 con 0x7fd43409aa30 2024-04-16T15:52:40.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.076+0000 7fd41bfff640 1 -- 172.21.15.132:0/31016487 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7fd428059b80 con 0x7fd43409aa30 2024-04-16T15:52:40.075 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:52:40.075 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"6bdec5d9-f406-43ad-8584-0503b32f6f0d","created":"2024-04-16T15:51:51.073040+0000","modified":"2024-04-16T15:52:16.950186+0000","last_up_change":"2024-04-16T15:52:02.280496+0000","last_in_change":"2024-04-16T15:51:53.376468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:52:03.284927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:52:13.363758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T15:52:14.246647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d45908b-6e22-4619-b190-897af594b712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6801","nonce":1170594668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6803","nonce":1170594668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6807","nonce":1170594668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6805","nonce":1170594668}]},"public_addr":"172.21.15.132:6801/1170594668","cluster_addr":"172.21.15.132:6803/1170594668","heartbeat_back_addr":"172.21.15.132:6807/1170594668","heartbeat_front_addr":"172.21.15.132:6805/1170594668","state":["exists","up"]},{"osd":1,"uuid":"c88bf082-e51f-4ee6-815a-025f6ce0d67b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6809","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6811","nonce":2494780358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6815","nonce":2494780358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6823","nonce":2494780358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6819","nonce":2494780358}]},"public_addr":"172.21.15.132:6811/2494780358","cluster_addr":"172.21.15.132:6815/2494780358","heartbeat_back_addr":"172.21.15.132:6823/2494780358","heartbeat_front_addr":"172.21.15.132:6819/2494780358","state":["exists","up"]},{"osd":2,"uuid":"e5dbd6b4-4e7b-47e4-ad4e-35b4b81696c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6825","nonce":27655483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6827","nonce":27655483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6831","nonce":27655483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6829","nonce":27655483}]},"public_addr":"172.21.15.132:6825/27655483","cluster_addr":"172.21.15.132:6827/27655483","heartbeat_back_addr":"172.21.15.132:6831/27655483","heartbeat_front_addr":"172.21.15.132:6829/27655483","state":["exists","up"]},{"osd":3,"uuid":"9d75cd67-3b8a-4424-8884-5f3660e1f5f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6810","nonce":3100919191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6814","nonce":3100919191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6821","nonce":3100919191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6818","nonce":3100919191}]},"public_addr":"172.21.15.132:6810/3100919191","cluster_addr":"172.21.15.132:6814/3100919191","heartbeat_back_addr":"172.21.15.132:6821/3100919191","heartbeat_front_addr":"172.21.15.132:6818/3100919191","state":["exists","up"]},{"osd":4,"uuid":"83aea46a-8642-4777-912b-c130e5890da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6825","nonce":123637799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6827","nonce":123637799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6831","nonce":123637799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6829","nonce":123637799}]},"public_addr":"172.21.15.179:6825/123637799","cluster_addr":"172.21.15.179:6827/123637799","heartbeat_back_addr":"172.21.15.179:6831/123637799","heartbeat_front_addr":"172.21.15.179:6829/123637799","state":["exists","up"]},{"osd":5,"uuid":"534117c8-3317-48d6-b436-afd5709f71e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6801","nonce":2224750370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6803","nonce":2224750370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6807","nonce":2224750370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6805","nonce":2224750370}]},"public_addr":"172.21.15.179:6801/2224750370","cluster_addr":"172.21.15.179:6803/2224750370","heartbeat_back_addr":"172.21.15.179:6807/2224750370","heartbeat_front_addr":"172.21.15.179:6805/2224750370","state":["exists","up"]},{"osd":6,"uuid":"0ba363e7-fa9d-42b1-ae09-a6a0f57d41f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6809","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6811","nonce":101498164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6813","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6815","nonce":101498164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6823","nonce":101498164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6819","nonce":101498164}]},"public_addr":"172.21.15.179:6811/101498164","cluster_addr":"172.21.15.179:6815/101498164","heartbeat_back_addr":"172.21.15.179:6823/101498164","heartbeat_front_addr":"172.21.15.179:6819/101498164","state":["exists","up"]},{"osd":7,"uuid":"e6830c77-2f2d-4067-9866-ee7625afc1a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6810","nonce":872148365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6814","nonce":872148365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6822","nonce":872148365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6818","nonce":872148365}]},"public_addr":"172.21.15.179:6810/872148365","cluster_addr":"172.21.15.179:6814/872148365","heartbeat_back_addr":"172.21.15.179:6822/872148365","heartbeat_front_addr":"172.21.15.179:6818/872148365","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.535221+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.563769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.520765+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.526264+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.517058+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.500842+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.534332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.512486+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:52:40.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.078+0000 7fd439d72640 1 -- 172.21.15.132:0/31016487 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fd42006c8f0 msgr2=0x7fd42006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:40.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.078+0000 7fd439d72640 1 --2- 172.21.15.132:0/31016487 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fd42006c8f0 0x7fd42006edb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd43415e0d0 tx=0x7fd424009040 comp rx=0 tx=0).stop 2024-04-16T15:52:40.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.078+0000 7fd439d72640 1 -- 172.21.15.132:0/31016487 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd43409aa30 msgr2=0x7fd4341f4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:40.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.078+0000 7fd439d72640 1 --2- 172.21.15.132:0/31016487 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd43409aa30 0x7fd4341f4f60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd42800c420 tx=0x7fd42800c8e0 comp rx=0 tx=0).stop 2024-04-16T15:52:40.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.078+0000 7fd439d72640 1 -- 172.21.15.132:0/31016487 shutdown_connections 2024-04-16T15:52:40.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.078+0000 7fd439d72640 1 --2- 172.21.15.132:0/31016487 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fd42006c8f0 0x7fd42006edb0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:40.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.078+0000 7fd439d72640 1 --2- 172.21.15.132:0/31016487 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4340c9910 0x7fd4341f7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:40.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.078+0000 7fd439d72640 1 --2- 172.21.15.132:0/31016487 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd43409aa30 0x7fd4341f4f60 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:40.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.078+0000 7fd439d72640 1 --2- 172.21.15.132:0/31016487 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd43406df50 0x7fd4340cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:40.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.078+0000 7fd439d72640 1 -- 172.21.15.132:0/31016487 >> 172.21.15.132:0/31016487 conn(0x7fd4340b41e0 msgr2=0x7fd43406d5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:40.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.078+0000 7fd439d72640 1 -- 172.21.15.132:0/31016487 shutdown_connections 2024-04-16T15:52:40.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.078+0000 7fd439d72640 1 -- 172.21.15.132:0/31016487 wait complete. 2024-04-16T15:52:40.090 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T15:52:03.284927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T15:52:13.363758+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T15:52:14.246647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T15:52:40.091 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T15:52:40.196 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.197+0000 7f7eedc4a640 1 Processor -- start 2024-04-16T15:52:40.197 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.197+0000 7f7eedc4a640 1 -- start start 2024-04-16T15:52:40.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.198+0000 7f7eedc4a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ee815ee80 0x7f7ee80700f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:40.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.198+0000 7f7eedc4a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7ee8067a00 0x7f7ee806ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:40.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.198+0000 7f7eedc4a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ee806f050 con 0x7f7ee815eaa0 2024-04-16T15:52:40.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.198+0000 7f7eedc4a640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f7ee806fc60 con 0x7f7ee8067a00 2024-04-16T15:52:40.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.198+0000 7f7eedc4a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f7ee806f330 con 0x7f7ee815ee80 2024-04-16T15:52:40.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.198+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7ee8067a00 0x7f7ee806ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:40.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.198+0000 7f7ee6ffd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ee815ee80 0x7f7ee80700f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:40.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.198+0000 7f7ee7fff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7ee8067a00 0x7f7ee806ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.132:45430/0 (socket says 172.21.15.132:45430) 2024-04-16T15:52:40.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.198+0000 7f7ee77fe640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f7ee815eaa0 0x7f7ee806e870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.132:38838/0 (socket says 172.21.15.132:38838) 2024-04-16T15:52:40.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.198+0000 7f7ee7fff640 1 -- 172.21.15.132:0/606995302 learned_addr learned my addr 172.21.15.132:0/606995302 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:40.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.198+0000 7f7ee6ffd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ee815ee80 0x7f7ee80700f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.132:52872/0 (socket says 172.21.15.132:52872) 2024-04-16T15:52:40.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.199+0000 7f7ee7fff640 1 -- 172.21.15.132:0/606995302 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ee815ee80 msgr2=0x7f7ee80700f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:40.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.199+0000 7f7ee7fff640 1 --2- 172.21.15.132:0/606995302 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ee815ee80 0x7f7ee80700f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:40.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.199+0000 7f7ee7fff640 1 -- 172.21.15.132:0/606995302 >> v1:172.21.15.179:6789/0 conn(0x7f7ee815eaa0 legacy=0x7f7ee806e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:40.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.199+0000 7f7ee7fff640 1 -- 172.21.15.132:0/606995302 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ee806f610 con 0x7f7ee8067a00 2024-04-16T15:52:40.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.199+0000 7f7ee6ffd640 1 --2- 172.21.15.132:0/606995302 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ee815ee80 0x7f7ee80700f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:52:40.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.200+0000 7f7ee7fff640 1 --2- 172.21.15.132:0/606995302 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ee8067a00 0x7f7ee806ca30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7ee0009870 tx=0x7f7ee002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f68710b1e099b877 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:40.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.200+0000 7f7ee67fc640 1 -- 172.21.15.132:0/606995302 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee0034070 con 0x7f7ee8067a00 2024-04-16T15:52:40.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.200+0000 7f7ee67fc640 1 -- 172.21.15.132:0/606995302 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ee0030840 con 0x7f7ee8067a00 2024-04-16T15:52:40.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.200+0000 7f7ee67fc640 1 -- 172.21.15.132:0/606995302 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee0030c10 con 0x7f7ee8067a00 2024-04-16T15:52:40.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.200+0000 7f7eedc4a640 1 -- 172.21.15.132:0/606995302 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ee8067a00 msgr2=0x7f7ee806ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:40.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.200+0000 7f7eedc4a640 1 --2- 172.21.15.132:0/606995302 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ee8067a00 0x7f7ee806ca30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7ee0009870 tx=0x7f7ee002b980 comp rx=0 tx=0).stop 2024-04-16T15:52:40.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.200+0000 7f7eedc4a640 1 -- 172.21.15.132:0/606995302 shutdown_connections 2024-04-16T15:52:40.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.200+0000 7f7eedc4a640 1 --2- 172.21.15.132:0/606995302 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ee8067a00 0x7f7ee806ca30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:40.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.200+0000 7f7eedc4a640 1 --2- 172.21.15.132:0/606995302 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ee815ee80 0x7f7ee80700f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:40.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.200+0000 7f7eedc4a640 1 -- 172.21.15.132:0/606995302 >> 172.21.15.132:0/606995302 conn(0x7f7ee8072810 msgr2=0x7f7ee8072c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:40.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.200+0000 7f7eedc4a640 1 -- 172.21.15.132:0/606995302 shutdown_connections 2024-04-16T15:52:40.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.200+0000 7f7eedc4a640 1 -- 172.21.15.132:0/606995302 wait complete. 2024-04-16T15:52:40.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.202+0000 7f7eedc4a640 1 Processor -- start 2024-04-16T15:52:40.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.202+0000 7f7eedc4a640 1 -- start start 2024-04-16T15:52:40.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.202+0000 7f7eedc4a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ee8067a00 0x7f7ee81618c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:40.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.202+0000 7f7eedc4a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ee815eaa0 0x7f7ee815aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:40.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.202+0000 7f7eedc4a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ee815ee80 0x7f7ee80c6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:40.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.202+0000 7f7eedc4a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee806cf70 con 0x7f7ee815eaa0 2024-04-16T15:52:40.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.202+0000 7f7eedc4a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee8070630 con 0x7f7ee8067a00 2024-04-16T15:52:40.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.202+0000 7f7eedc4a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f7ee806d0f0 con 0x7f7ee815ee80 2024-04-16T15:52:40.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.203+0000 7f7ee6ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ee815eaa0 0x7f7ee815aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:40.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.203+0000 7f7ee6ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ee815eaa0 0x7f7ee815aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42724/0 (socket says 172.21.15.132:42724) 2024-04-16T15:52:40.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.203+0000 7f7ee6ffd640 1 -- 172.21.15.132:0/943464070 learned_addr learned my addr 172.21.15.132:0/943464070 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:40.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.203+0000 7f7ee7fff640 1 --2- 172.21.15.132:0/943464070 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ee815ee80 0x7f7ee80c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:40.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.203+0000 7f7ee77fe640 1 --2- 172.21.15.132:0/943464070 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ee8067a00 0x7f7ee81618c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:40.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.203+0000 7f7ee6ffd640 1 -- 172.21.15.132:0/943464070 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ee815ee80 msgr2=0x7f7ee80c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:40.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.203+0000 7f7ee6ffd640 1 --2- 172.21.15.132:0/943464070 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ee815ee80 0x7f7ee80c6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:40.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.203+0000 7f7ee6ffd640 1 -- 172.21.15.132:0/943464070 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ee8067a00 msgr2=0x7f7ee81618c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:40.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.203+0000 7f7ee6ffd640 1 --2- 172.21.15.132:0/943464070 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ee8067a00 0x7f7ee81618c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:40.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.203+0000 7f7ee6ffd640 1 -- 172.21.15.132:0/943464070 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ee81621a0 con 0x7f7ee815eaa0 2024-04-16T15:52:40.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.203+0000 7f7ee6ffd640 1 --2- 172.21.15.132:0/943464070 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ee815eaa0 0x7f7ee815aa40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7edc00e960 tx=0x7f7edc00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:40.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.203+0000 7f7ecffff640 1 -- 172.21.15.132:0/943464070 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7edc017070 con 0x7f7ee815eaa0 2024-04-16T15:52:40.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.203+0000 7f7ecffff640 1 -- 172.21.15.132:0/943464070 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7edc00ca00 con 0x7f7ee815eaa0 2024-04-16T15:52:40.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.203+0000 7f7eedc4a640 1 -- 172.21.15.132:0/943464070 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ee8162480 con 0x7f7ee815eaa0 2024-04-16T15:52:40.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.203+0000 7f7ecffff640 1 -- 172.21.15.132:0/943464070 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7edc00cdd0 con 0x7f7ee815eaa0 2024-04-16T15:52:40.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.203+0000 7f7eedc4a640 1 -- 172.21.15.132:0/943464070 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ee8162a40 con 0x7f7ee815eaa0 2024-04-16T15:52:40.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.204+0000 7f7eedc4a640 1 -- 172.21.15.132:0/943464070 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ee8162f20 con 0x7f7ee815eaa0 2024-04-16T15:52:40.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.205+0000 7f7ecffff640 1 -- 172.21.15.132:0/943464070 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7edc01a070 con 0x7f7ee815eaa0 2024-04-16T15:52:40.207 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.205+0000 7f7ecffff640 1 --2- 172.21.15.132:0/943464070 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f7ed406c920 0x7f7ed406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:40.207 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.205+0000 7f7ecffff640 1 -- 172.21.15.132:0/943464070 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7edc08bd80 con 0x7f7ee815eaa0 2024-04-16T15:52:40.207 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.206+0000 7f7ee77fe640 1 --2- 172.21.15.132:0/943464070 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f7ed406c920 0x7f7ed406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:40.207 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.206+0000 7f7ee77fe640 1 --2- 172.21.15.132:0/943464070 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f7ed406c920 0x7f7ed406ede0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7ed80012e0 tx=0x7f7ed8005b90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:40.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.210+0000 7f7ecffff640 1 -- 172.21.15.132:0/943464070 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7ee8162f20 con 0x7f7ee815eaa0 2024-04-16T15:52:40.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.384+0000 7f7eedc4a640 1 -- 172.21.15.132:0/943464070 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7ee8073400 con 0x7f7ee815eaa0 2024-04-16T15:52:40.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.384+0000 7f7ecffff640 1 -- 172.21.15.132:0/943464070 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f7edc05a1a0 con 0x7f7ee815eaa0 2024-04-16T15:52:40.384 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2024-04-16T15:52:40.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.386+0000 7f7eedc4a640 1 -- 172.21.15.132:0/943464070 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f7ed406c920 msgr2=0x7f7ed406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:40.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.386+0000 7f7eedc4a640 1 --2- 172.21.15.132:0/943464070 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f7ed406c920 0x7f7ed406ede0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7ed80012e0 tx=0x7f7ed8005b90 comp rx=0 tx=0).stop 2024-04-16T15:52:40.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.386+0000 7f7eedc4a640 1 -- 172.21.15.132:0/943464070 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ee815eaa0 msgr2=0x7f7ee815aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:40.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.386+0000 7f7eedc4a640 1 --2- 172.21.15.132:0/943464070 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ee815eaa0 0x7f7ee815aa40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7edc00e960 tx=0x7f7edc00ee20 comp rx=0 tx=0).stop 2024-04-16T15:52:40.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.386+0000 7f7eedc4a640 1 -- 172.21.15.132:0/943464070 shutdown_connections 2024-04-16T15:52:40.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.386+0000 7f7eedc4a640 1 --2- 172.21.15.132:0/943464070 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f7ed406c920 0x7f7ed406ede0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:40.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.386+0000 7f7eedc4a640 1 --2- 172.21.15.132:0/943464070 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ee815ee80 0x7f7ee80c6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:40.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.386+0000 7f7eedc4a640 1 --2- 172.21.15.132:0/943464070 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ee815eaa0 0x7f7ee815aa40 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:40.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.386+0000 7f7eedc4a640 1 --2- 172.21.15.132:0/943464070 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ee8067a00 0x7f7ee81618c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:40.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.386+0000 7f7eedc4a640 1 -- 172.21.15.132:0/943464070 >> 172.21.15.132:0/943464070 conn(0x7f7ee8072810 msgr2=0x7f7ee815bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:40.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.386+0000 7f7eedc4a640 1 -- 172.21.15.132:0/943464070 shutdown_connections 2024-04-16T15:52:40.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.386+0000 7f7eedc4a640 1 -- 172.21.15.132:0/943464070 wait complete. 2024-04-16T15:52:40.397 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T15:52:40.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.504+0000 7f8c7d488640 1 Processor -- start 2024-04-16T15:52:40.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.504+0000 7f8c7d488640 1 -- start start 2024-04-16T15:52:40.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.505+0000 7f8c7d488640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c780b0df0 0x7f8c780b6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:40.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.505+0000 7f8c7d488640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8c780b66a0 0x7f8c78073590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:40.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.505+0000 7f8c7d488640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c780b5980 con 0x7f8c7815b830 2024-04-16T15:52:40.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.505+0000 7f8c7d488640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f8c780b4eb0 con 0x7f8c780b66a0 2024-04-16T15:52:40.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.505+0000 7f8c7d488640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f8c780b5190 con 0x7f8c780b0df0 2024-04-16T15:52:40.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.505+0000 7f8c6e7fc640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c780b0df0 0x7f8c780b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:40.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.505+0000 7f8c777fe640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8c780b66a0 0x7f8c78073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:40.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.505+0000 7f8c777fe640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8c780b66a0 0x7f8c78073590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.132:45440/0 (socket says 172.21.15.132:45440) 2024-04-16T15:52:40.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.505+0000 7f8c6e7fc640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c780b0df0 0x7f8c780b6160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.132:52892/0 (socket says 172.21.15.132:52892) 2024-04-16T15:52:40.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.505+0000 7f8c777fe640 1 -- 172.21.15.132:0/3881475880 learned_addr learned my addr 172.21.15.132:0/3881475880 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:40.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.505+0000 7f8c76ffd640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f8c7815b830 0x7f8c780b4660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.132:38840/0 (socket says 172.21.15.132:38840) 2024-04-16T15:52:40.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.506+0000 7f8c777fe640 1 -- 172.21.15.132:0/3881475880 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c780b0df0 msgr2=0x7f8c780b6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:40.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.506+0000 7f8c777fe640 1 --2- 172.21.15.132:0/3881475880 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c780b0df0 0x7f8c780b6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:40.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.506+0000 7f8c777fe640 1 -- 172.21.15.132:0/3881475880 >> v1:172.21.15.179:6789/0 conn(0x7f8c7815b830 legacy=0x7f8c780b4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:40.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.506+0000 7f8c777fe640 1 -- 172.21.15.132:0/3881475880 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c780b5470 con 0x7f8c780b66a0 2024-04-16T15:52:40.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.506+0000 7f8c6e7fc640 1 --2- 172.21.15.132:0/3881475880 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c780b0df0 0x7f8c780b6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:52:40.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.507+0000 7f8c777fe640 1 --2- 172.21.15.132:0/3881475880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c780b66a0 0x7f8c78073590 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8c70009e50 tx=0x7f8c7002bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3eba63c502ef6996 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:40.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.507+0000 7f8c767fc640 1 -- 172.21.15.132:0/3881475880 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7002cb00 con 0x7f8c780b66a0 2024-04-16T15:52:40.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.507+0000 7f8c767fc640 1 -- 172.21.15.132:0/3881475880 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c7002cca0 con 0x7f8c780b66a0 2024-04-16T15:52:40.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.507+0000 7f8c767fc640 1 -- 172.21.15.132:0/3881475880 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c70034610 con 0x7f8c780b66a0 2024-04-16T15:52:40.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.507+0000 7f8c7d488640 1 -- 172.21.15.132:0/3881475880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c780b66a0 msgr2=0x7f8c78073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:40.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.507+0000 7f8c7d488640 1 --2- 172.21.15.132:0/3881475880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c780b66a0 0x7f8c78073590 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8c70009e50 tx=0x7f8c7002bf60 comp rx=0 tx=0).stop 2024-04-16T15:52:40.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.507+0000 7f8c7d488640 1 -- 172.21.15.132:0/3881475880 shutdown_connections 2024-04-16T15:52:40.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.507+0000 7f8c7d488640 1 --2- 172.21.15.132:0/3881475880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c780b66a0 0x7f8c78073590 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:40.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.507+0000 7f8c7d488640 1 --2- 172.21.15.132:0/3881475880 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c780b0df0 0x7f8c780b6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:40.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.507+0000 7f8c7d488640 1 -- 172.21.15.132:0/3881475880 >> 172.21.15.132:0/3881475880 conn(0x7f8c780b6b80 msgr2=0x7f8c780b6f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:40.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.507+0000 7f8c7d488640 1 -- 172.21.15.132:0/3881475880 shutdown_connections 2024-04-16T15:52:40.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.507+0000 7f8c7d488640 1 -- 172.21.15.132:0/3881475880 wait complete. 2024-04-16T15:52:40.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.509+0000 7f8c7d488640 1 Processor -- start 2024-04-16T15:52:40.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.509+0000 7f8c7d488640 1 -- start start 2024-04-16T15:52:40.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.509+0000 7f8c7d488640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c780b0df0 0x7f8c7813ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:40.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.509+0000 7f8c7d488640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c780b66a0 0x7f8c7815cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:40.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.509+0000 7f8c7d488640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c7815b830 0x7f8c7815d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:40.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.509+0000 7f8c7d488640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f8c78073c50 con 0x7f8c780b66a0 2024-04-16T15:52:40.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.509+0000 7f8c7d488640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8c78073ad0 con 0x7f8c780b0df0 2024-04-16T15:52:40.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.509+0000 7f8c7d488640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f8c78073dd0 con 0x7f8c7815b830 2024-04-16T15:52:40.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.510+0000 7f8c6e7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c780b66a0 0x7f8c7815cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:40.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.510+0000 7f8c6e7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c780b66a0 0x7f8c7815cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42736/0 (socket says 172.21.15.132:42736) 2024-04-16T15:52:40.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.510+0000 7f8c6e7fc640 1 -- 172.21.15.132:0/3506484669 learned_addr learned my addr 172.21.15.132:0/3506484669 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:40.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.510+0000 7f8c777fe640 1 --2- 172.21.15.132:0/3506484669 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c7815b830 0x7f8c7815d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:40.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.510+0000 7f8c76ffd640 1 --2- 172.21.15.132:0/3506484669 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c780b0df0 0x7f8c7813ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:40.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.510+0000 7f8c6e7fc640 1 -- 172.21.15.132:0/3506484669 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c7815b830 msgr2=0x7f8c7815d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:40.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.510+0000 7f8c6e7fc640 1 --2- 172.21.15.132:0/3506484669 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c7815b830 0x7f8c7815d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:40.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.510+0000 7f8c6e7fc640 1 -- 172.21.15.132:0/3506484669 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c780b0df0 msgr2=0x7f8c7813ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:40.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.510+0000 7f8c6e7fc640 1 --2- 172.21.15.132:0/3506484669 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c780b0df0 0x7f8c7813ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:40.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.510+0000 7f8c6e7fc640 1 -- 172.21.15.132:0/3506484669 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c78152300 con 0x7f8c780b66a0 2024-04-16T15:52:40.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.510+0000 7f8c76ffd640 1 --2- 172.21.15.132:0/3506484669 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c780b0df0 0x7f8c7813ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:52:40.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.510+0000 7f8c777fe640 1 --2- 172.21.15.132:0/3506484669 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c7815b830 0x7f8c7815d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:52:40.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.510+0000 7f8c6e7fc640 1 --2- 172.21.15.132:0/3506484669 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c780b66a0 0x7f8c7815cc60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8c6000e960 tx=0x7f8c6000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:40.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.510+0000 7f8c6ffff640 1 -- 172.21.15.132:0/3506484669 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c60017070 con 0x7f8c780b66a0 2024-04-16T15:52:40.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.510+0000 7f8c6ffff640 1 -- 172.21.15.132:0/3506484669 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c6000ca00 con 0x7f8c780b66a0 2024-04-16T15:52:40.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.510+0000 7f8c6ffff640 1 -- 172.21.15.132:0/3506484669 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c6000cdd0 con 0x7f8c780b66a0 2024-04-16T15:52:40.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.510+0000 7f8c7d488640 1 -- 172.21.15.132:0/3506484669 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c78152020 con 0x7f8c780b66a0 2024-04-16T15:52:40.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.510+0000 7f8c7d488640 1 -- 172.21.15.132:0/3506484669 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c7813bc00 con 0x7f8c780b66a0 2024-04-16T15:52:40.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.511+0000 7f8c7d488640 1 -- 172.21.15.132:0/3506484669 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c7813c040 con 0x7f8c780b66a0 2024-04-16T15:52:40.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.512+0000 7f8c6ffff640 1 -- 172.21.15.132:0/3506484669 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8c6001a070 con 0x7f8c780b66a0 2024-04-16T15:52:40.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.512+0000 7f8c6ffff640 1 --2- 172.21.15.132:0/3506484669 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f8c5806c8f0 0x7f8c5806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:40.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.512+0000 7f8c76ffd640 1 --2- 172.21.15.132:0/3506484669 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f8c5806c8f0 0x7f8c5806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:40.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.512+0000 7f8c6ffff640 1 -- 172.21.15.132:0/3506484669 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8c6008bd30 con 0x7f8c780b66a0 2024-04-16T15:52:40.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.513+0000 7f8c76ffd640 1 --2- 172.21.15.132:0/3506484669 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f8c5806c8f0 0x7f8c5806edb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8c68000f60 tx=0x7f8c68009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:40.516 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.517+0000 7f8c6ffff640 1 -- 172.21.15.132:0/3506484669 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8c6005a1f0 con 0x7f8c780b66a0 2024-04-16T15:52:40.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.694+0000 7f8c7d488640 1 -- 172.21.15.132:0/3506484669 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f8c7806f960 con 0x7f8c780b66a0 2024-04-16T15:52:40.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.695+0000 7f8c6ffff640 1 -- 172.21.15.132:0/3506484669 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f8c60059af0 con 0x7f8c780b66a0 2024-04-16T15:52:40.694 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2024-04-16T15:52:40.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.697+0000 7f8c7d488640 1 -- 172.21.15.132:0/3506484669 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f8c5806c8f0 msgr2=0x7f8c5806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:40.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.697+0000 7f8c7d488640 1 --2- 172.21.15.132:0/3506484669 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f8c5806c8f0 0x7f8c5806edb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8c68000f60 tx=0x7f8c68009040 comp rx=0 tx=0).stop 2024-04-16T15:52:40.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.697+0000 7f8c7d488640 1 -- 172.21.15.132:0/3506484669 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c780b66a0 msgr2=0x7f8c7815cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:40.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.697+0000 7f8c7d488640 1 --2- 172.21.15.132:0/3506484669 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c780b66a0 0x7f8c7815cc60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8c6000e960 tx=0x7f8c6000ee20 comp rx=0 tx=0).stop 2024-04-16T15:52:40.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.697+0000 7f8c7d488640 1 -- 172.21.15.132:0/3506484669 shutdown_connections 2024-04-16T15:52:40.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.697+0000 7f8c7d488640 1 --2- 172.21.15.132:0/3506484669 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f8c5806c8f0 0x7f8c5806edb0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:40.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.697+0000 7f8c7d488640 1 --2- 172.21.15.132:0/3506484669 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c7815b830 0x7f8c7815d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:40.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.697+0000 7f8c7d488640 1 --2- 172.21.15.132:0/3506484669 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c780b66a0 0x7f8c7815cc60 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:40.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.697+0000 7f8c7d488640 1 --2- 172.21.15.132:0/3506484669 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c780b0df0 0x7f8c7813ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:40.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.697+0000 7f8c7d488640 1 -- 172.21.15.132:0/3506484669 >> 172.21.15.132:0/3506484669 conn(0x7f8c780b6b80 msgr2=0x7f8c7815a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:40.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.697+0000 7f8c7d488640 1 -- 172.21.15.132:0/3506484669 shutdown_connections 2024-04-16T15:52:40.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.697+0000 7f8c7d488640 1 -- 172.21.15.132:0/3506484669 wait complete. 2024-04-16T15:52:40.708 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T15:52:40.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.815+0000 7fc5f65db640 1 Processor -- start 2024-04-16T15:52:40.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.815+0000 7fc5f65db640 1 -- start start 2024-04-16T15:52:40.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.816+0000 7fc5f65db640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5f015b840 0x7fc5f00cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:40.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.816+0000 7fc5f65db640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc5f00cf470 0x7fc5f00b4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:40.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.816+0000 7fc5f65db640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc5f00b4c90 0x7fc5f0071f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:40.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.816+0000 7fc5f65db640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fc5f006dfb0 con 0x7fc5f00b4c90 2024-04-16T15:52:40.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.816+0000 7fc5f65db640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fc5f006e290 con 0x7fc5f00cf470 2024-04-16T15:52:40.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.816+0000 7fc5f65db640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc5f006e570 con 0x7fc5f015b840 2024-04-16T15:52:40.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.816+0000 7fc5f4b78640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc5f00b4c90 0x7fc5f0071f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:40.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.816+0000 7fc5f4b78640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc5f00b4c90 0x7fc5f0071f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42752/0 (socket says 172.21.15.132:42752) 2024-04-16T15:52:40.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.816+0000 7fc5f4b78640 1 -- 172.21.15.132:0/2959075693 learned_addr learned my addr 172.21.15.132:0/2959075693 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:40.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.816+0000 7fc5ef7fe640 1 --2- 172.21.15.132:0/2959075693 >> v2:172.21.15.179:3300/0 conn(0x7fc5f00cf470 0x7fc5f00b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:40.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.816+0000 7fc5effff640 1 --2- 172.21.15.132:0/2959075693 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5f015b840 0x7fc5f00cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:40.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.816+0000 7fc5f4b78640 1 -- 172.21.15.132:0/2959075693 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5f015b840 msgr2=0x7fc5f00cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:40.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.816+0000 7fc5f4b78640 1 --2- 172.21.15.132:0/2959075693 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5f015b840 0x7fc5f00cef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:40.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.816+0000 7fc5f4b78640 1 -- 172.21.15.132:0/2959075693 >> v2:172.21.15.179:3300/0 conn(0x7fc5f00cf470 msgr2=0x7fc5f00b4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:40.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.816+0000 7fc5f4b78640 1 --2- 172.21.15.132:0/2959075693 >> v2:172.21.15.179:3300/0 conn(0x7fc5f00cf470 0x7fc5f00b4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:40.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.816+0000 7fc5f4b78640 1 -- 172.21.15.132:0/2959075693 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5f006e850 con 0x7fc5f00b4c90 2024-04-16T15:52:40.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.816+0000 7fc5effff640 1 --2- 172.21.15.132:0/2959075693 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5f015b840 0x7fc5f00cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:40.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.817+0000 7fc5f4b78640 1 --2- 172.21.15.132:0/2959075693 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc5f00b4c90 0x7fc5f0071f50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc5f0073790 tx=0x7fc5e802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=616c9409392511c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:40.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.817+0000 7fc5eeffd640 1 -- 172.21.15.132:0/2959075693 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e802ca70 con 0x7fc5f00b4c90 2024-04-16T15:52:40.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.817+0000 7fc5eeffd640 1 -- 172.21.15.132:0/2959075693 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5e802cc10 con 0x7fc5f00b4c90 2024-04-16T15:52:40.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.817+0000 7fc5eeffd640 1 -- 172.21.15.132:0/2959075693 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e80343f0 con 0x7fc5f00b4c90 2024-04-16T15:52:40.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.818+0000 7fc5f65db640 1 -- 172.21.15.132:0/2959075693 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc5f00b4c90 msgr2=0x7fc5f0071f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:40.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.818+0000 7fc5f65db640 1 --2- 172.21.15.132:0/2959075693 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc5f00b4c90 0x7fc5f0071f50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc5f0073790 tx=0x7fc5e802bed0 comp rx=0 tx=0).stop 2024-04-16T15:52:40.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.818+0000 7fc5f65db640 1 -- 172.21.15.132:0/2959075693 shutdown_connections 2024-04-16T15:52:40.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.818+0000 7fc5f65db640 1 --2- 172.21.15.132:0/2959075693 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc5f00b4c90 0x7fc5f0071f50 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:40.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.818+0000 7fc5f65db640 1 --2- 172.21.15.132:0/2959075693 >> v2:172.21.15.179:3300/0 conn(0x7fc5f00cf470 0x7fc5f00b4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:40.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.818+0000 7fc5f65db640 1 --2- 172.21.15.132:0/2959075693 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5f015b840 0x7fc5f00cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:40.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.818+0000 7fc5f65db640 1 -- 172.21.15.132:0/2959075693 >> 172.21.15.132:0/2959075693 conn(0x7fc5f00d0490 msgr2=0x7fc5f00d08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:40.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.818+0000 7fc5f65db640 1 -- 172.21.15.132:0/2959075693 shutdown_connections 2024-04-16T15:52:40.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.818+0000 7fc5f65db640 1 -- 172.21.15.132:0/2959075693 wait complete. 2024-04-16T15:52:40.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.819+0000 7fc5f65db640 1 Processor -- start 2024-04-16T15:52:40.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.819+0000 7fc5f65db640 1 -- start start 2024-04-16T15:52:40.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.820+0000 7fc5f65db640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc5f00b4c90 0x7fc5f0145600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:40.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.820+0000 7fc5f65db640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5f00cf470 0x7fc5f00ad8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:40.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.820+0000 7fc5f65db640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5f015b840 0x7fc5f01f8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:40.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.820+0000 7fc5f65db640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fc5f015bc20 con 0x7fc5f00b4c90 2024-04-16T15:52:40.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.820+0000 7fc5f65db640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc5f00b5740 con 0x7fc5f015b840 2024-04-16T15:52:40.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.820+0000 7fc5f65db640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc5f00aef00 con 0x7fc5f00cf470 2024-04-16T15:52:40.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.820+0000 7fc5effff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc5f00b4c90 0x7fc5f0145600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:40.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.820+0000 7fc5effff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc5f00b4c90 0x7fc5f0145600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42756/0 (socket says 172.21.15.132:42756) 2024-04-16T15:52:40.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.820+0000 7fc5effff640 1 -- 172.21.15.132:0/1879315118 learned_addr learned my addr 172.21.15.132:0/1879315118 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:40.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.820+0000 7fc5ef7fe640 1 --2- 172.21.15.132:0/1879315118 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5f00cf470 0x7fc5f00ad8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:40.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.820+0000 7fc5f4b78640 1 --2- 172.21.15.132:0/1879315118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5f015b840 0x7fc5f01f8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:40.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.820+0000 7fc5effff640 1 -- 172.21.15.132:0/1879315118 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5f00cf470 msgr2=0x7fc5f00ad8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:40.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.820+0000 7fc5effff640 1 --2- 172.21.15.132:0/1879315118 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5f00cf470 0x7fc5f00ad8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:40.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.820+0000 7fc5effff640 1 -- 172.21.15.132:0/1879315118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5f015b840 msgr2=0x7fc5f01f8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:40.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.820+0000 7fc5effff640 1 --2- 172.21.15.132:0/1879315118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5f015b840 0x7fc5f01f8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:40.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.820+0000 7fc5effff640 1 -- 172.21.15.132:0/1879315118 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5f00ae2f0 con 0x7fc5f00b4c90 2024-04-16T15:52:40.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.820+0000 7fc5effff640 1 --2- 172.21.15.132:0/1879315118 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc5f00b4c90 0x7fc5f0145600 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc5e000d7d0 tx=0x7fc5e000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:40.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.820+0000 7fc5ecff9640 1 -- 172.21.15.132:0/1879315118 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e0004030 con 0x7fc5f00b4c90 2024-04-16T15:52:40.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.820+0000 7fc5ecff9640 1 -- 172.21.15.132:0/1879315118 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5e00041d0 con 0x7fc5f00b4c90 2024-04-16T15:52:40.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.820+0000 7fc5f65db640 1 -- 172.21.15.132:0/1879315118 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5f00ae5d0 con 0x7fc5f00b4c90 2024-04-16T15:52:40.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.820+0000 7fc5ecff9640 1 -- 172.21.15.132:0/1879315118 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e00096a0 con 0x7fc5f00b4c90 2024-04-16T15:52:40.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.820+0000 7fc5f65db640 1 -- 172.21.15.132:0/1879315118 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5f00aeb90 con 0x7fc5f00b4c90 2024-04-16T15:52:40.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.821+0000 7fc5f65db640 1 -- 172.21.15.132:0/1879315118 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5f0075510 con 0x7fc5f00b4c90 2024-04-16T15:52:40.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.822+0000 7fc5ecff9640 1 -- 172.21.15.132:0/1879315118 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc5e0009840 con 0x7fc5f00b4c90 2024-04-16T15:52:40.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.822+0000 7fc5ecff9640 1 --2- 172.21.15.132:0/1879315118 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fc5dc06c8f0 0x7fc5dc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:40.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.822+0000 7fc5ecff9640 1 -- 172.21.15.132:0/1879315118 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc5e008bd00 con 0x7fc5f00b4c90 2024-04-16T15:52:40.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.822+0000 7fc5ef7fe640 1 --2- 172.21.15.132:0/1879315118 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fc5dc06c8f0 0x7fc5dc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:40.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.823+0000 7fc5ef7fe640 1 --2- 172.21.15.132:0/1879315118 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fc5dc06c8f0 0x7fc5dc06edb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc5f01f7f90 tx=0x7fc5e4009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:40.826 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:40.827+0000 7fc5ecff9640 1 -- 172.21.15.132:0/1879315118 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc5e0059ae0 con 0x7fc5f00b4c90 2024-04-16T15:52:40.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.000+0000 7fc5f65db640 1 -- 172.21.15.132:0/1879315118 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc5f00708e0 con 0x7fc5f00b4c90 2024-04-16T15:52:41.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.000+0000 7fc5ecff9640 1 -- 172.21.15.132:0/1879315118 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fc5e005dde0 con 0x7fc5f00b4c90 2024-04-16T15:52:41.001 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2024-04-16T15:52:41.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.002+0000 7fc5f65db640 1 -- 172.21.15.132:0/1879315118 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fc5dc06c8f0 msgr2=0x7fc5dc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:41.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.002+0000 7fc5f65db640 1 --2- 172.21.15.132:0/1879315118 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fc5dc06c8f0 0x7fc5dc06edb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc5f01f7f90 tx=0x7fc5e4009190 comp rx=0 tx=0).stop 2024-04-16T15:52:41.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.002+0000 7fc5f65db640 1 -- 172.21.15.132:0/1879315118 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc5f00b4c90 msgr2=0x7fc5f0145600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:41.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.002+0000 7fc5f65db640 1 --2- 172.21.15.132:0/1879315118 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc5f00b4c90 0x7fc5f0145600 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc5e000d7d0 tx=0x7fc5e000dc90 comp rx=0 tx=0).stop 2024-04-16T15:52:41.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.002+0000 7fc5f65db640 1 -- 172.21.15.132:0/1879315118 shutdown_connections 2024-04-16T15:52:41.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.002+0000 7fc5f65db640 1 --2- 172.21.15.132:0/1879315118 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fc5dc06c8f0 0x7fc5dc06edb0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:41.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.003+0000 7fc5f65db640 1 --2- 172.21.15.132:0/1879315118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5f015b840 0x7fc5f01f8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:41.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.003+0000 7fc5f65db640 1 --2- 172.21.15.132:0/1879315118 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5f00cf470 0x7fc5f00ad8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:41.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.003+0000 7fc5f65db640 1 --2- 172.21.15.132:0/1879315118 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc5f00b4c90 0x7fc5f0145600 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:41.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.003+0000 7fc5f65db640 1 -- 172.21.15.132:0/1879315118 >> 172.21.15.132:0/1879315118 conn(0x7fc5f00d0490 msgr2=0x7fc5f00ce500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:41.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.003+0000 7fc5f65db640 1 -- 172.21.15.132:0/1879315118 shutdown_connections 2024-04-16T15:52:41.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.003+0000 7fc5f65db640 1 -- 172.21.15.132:0/1879315118 wait complete. 2024-04-16T15:52:41.013 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:52:41.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.118+0000 7f58ffb0e640 1 Processor -- start 2024-04-16T15:52:41.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.118+0000 7f58ffb0e640 1 -- start start 2024-04-16T15:52:41.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.119+0000 7f58ffb0e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f58f8146290 0x7f58f815ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:41.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.119+0000 7f58ffb0e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58f815d200 0x7f58f80b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:41.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.119+0000 7f58ffb0e640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58f80ae6a0 con 0x7f58f8145eb0 2024-04-16T15:52:41.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.119+0000 7f58ffb0e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f58f815d7f0 con 0x7f58f8146290 2024-04-16T15:52:41.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.119+0000 7f58ffb0e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f58f815dad0 con 0x7f58f815d200 2024-04-16T15:52:41.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.119+0000 7f58fd0a9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f58f8146290 0x7f58f815ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:41.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.119+0000 7f58fd0a9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f58f8146290 0x7f58f815ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42770/0 (socket says 172.21.15.132:42770) 2024-04-16T15:52:41.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.119+0000 7f58fd0a9640 1 -- 172.21.15.132:0/230093447 learned_addr learned my addr 172.21.15.132:0/230093447 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:41.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.119+0000 7f58fe0ab640 1 --2- 172.21.15.132:0/230093447 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58f815d200 0x7f58f80b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:41.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.119+0000 7f58fd0a9640 1 -- 172.21.15.132:0/230093447 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58f815d200 msgr2=0x7f58f80b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:41.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.119+0000 7f58fd0a9640 1 --2- 172.21.15.132:0/230093447 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58f815d200 0x7f58f80b5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:41.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.119+0000 7f58fd0a9640 1 -- 172.21.15.132:0/230093447 >> v1:172.21.15.179:6789/0 conn(0x7f58f8145eb0 legacy=0x7f58f80b0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:41.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.119+0000 7f58fd0a9640 1 -- 172.21.15.132:0/230093447 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58f80b0080 con 0x7f58f8146290 2024-04-16T15:52:41.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.120+0000 7f58fd0a9640 1 --2- 172.21.15.132:0/230093447 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58f8146290 0x7f58f815ccc0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f58e8009870 tx=0x7f58e802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97f29ed1136942d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:41.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.120+0000 7f58fc8a8640 1 -- 172.21.15.132:0/230093447 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e8035020 con 0x7f58f8146290 2024-04-16T15:52:41.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.120+0000 7f58fc8a8640 1 -- 172.21.15.132:0/230093447 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58e8031640 con 0x7f58f8146290 2024-04-16T15:52:41.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.120+0000 7f58fc8a8640 1 -- 172.21.15.132:0/230093447 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e802d040 con 0x7f58f8146290 2024-04-16T15:52:41.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.121+0000 7f58ffb0e640 1 -- 172.21.15.132:0/230093447 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58f8146290 msgr2=0x7f58f815ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:41.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.121+0000 7f58ffb0e640 1 --2- 172.21.15.132:0/230093447 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58f8146290 0x7f58f815ccc0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f58e8009870 tx=0x7f58e802b8f0 comp rx=0 tx=0).stop 2024-04-16T15:52:41.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.121+0000 7f58ffb0e640 1 -- 172.21.15.132:0/230093447 shutdown_connections 2024-04-16T15:52:41.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.121+0000 7f58ffb0e640 1 --2- 172.21.15.132:0/230093447 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58f815d200 0x7f58f80b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:41.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.121+0000 7f58ffb0e640 1 --2- 172.21.15.132:0/230093447 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58f8146290 0x7f58f815ccc0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:41.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.121+0000 7f58ffb0e640 1 -- 172.21.15.132:0/230093447 >> 172.21.15.132:0/230093447 conn(0x7f58f809aa30 msgr2=0x7f58f80b6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:41.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.121+0000 7f58ffb0e640 1 -- 172.21.15.132:0/230093447 shutdown_connections 2024-04-16T15:52:41.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.121+0000 7f58ffb0e640 1 -- 172.21.15.132:0/230093447 wait complete. 2024-04-16T15:52:41.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.122+0000 7f58ffb0e640 1 Processor -- start 2024-04-16T15:52:41.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.122+0000 7f58ffb0e640 1 -- start start 2024-04-16T15:52:41.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.123+0000 7f58ffb0e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58f8145eb0 0x7f58f8132d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:41.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.123+0000 7f58ffb0e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58f8146290 0x7f58f815dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:41.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.123+0000 7f58ffb0e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58f815d200 0x7f58f809b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:41.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.123+0000 7f58ffb0e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f58f80b62e0 con 0x7f58f815d200 2024-04-16T15:52:41.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.123+0000 7f58ffb0e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f58f80afd70 con 0x7f58f8146290 2024-04-16T15:52:41.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.123+0000 7f58ffb0e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f58f80b6460 con 0x7f58f8145eb0 2024-04-16T15:52:41.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.123+0000 7f58fe0ab640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58f815d200 0x7f58f809b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:41.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.123+0000 7f58fe0ab640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58f815d200 0x7f58f809b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42776/0 (socket says 172.21.15.132:42776) 2024-04-16T15:52:41.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.123+0000 7f58fe0ab640 1 -- 172.21.15.132:0/3482722127 learned_addr learned my addr 172.21.15.132:0/3482722127 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:41.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.123+0000 7f58fd8aa640 1 --2- 172.21.15.132:0/3482722127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58f8145eb0 0x7f58f8132d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:41.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.123+0000 7f58fd0a9640 1 --2- 172.21.15.132:0/3482722127 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58f8146290 0x7f58f815dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:41.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.123+0000 7f58fe0ab640 1 -- 172.21.15.132:0/3482722127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58f8145eb0 msgr2=0x7f58f8132d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:41.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.123+0000 7f58fe0ab640 1 --2- 172.21.15.132:0/3482722127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58f8145eb0 0x7f58f8132d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:41.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.123+0000 7f58fe0ab640 1 -- 172.21.15.132:0/3482722127 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58f8146290 msgr2=0x7f58f815dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:41.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.123+0000 7f58fe0ab640 1 --2- 172.21.15.132:0/3482722127 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58f8146290 0x7f58f815dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:41.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.123+0000 7f58fe0ab640 1 -- 172.21.15.132:0/3482722127 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58f81332c0 con 0x7f58f815d200 2024-04-16T15:52:41.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.123+0000 7f58fe0ab640 1 --2- 172.21.15.132:0/3482722127 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58f815d200 0x7f58f809b6e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f58f000e7f0 tx=0x7f58f000ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:41.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.124+0000 7f58ee7fc640 1 -- 172.21.15.132:0/3482722127 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f0017070 con 0x7f58f815d200 2024-04-16T15:52:41.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.124+0000 7f58ee7fc640 1 -- 172.21.15.132:0/3482722127 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58f000ee40 con 0x7f58f815d200 2024-04-16T15:52:41.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.124+0000 7f58ffb0e640 1 -- 172.21.15.132:0/3482722127 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58f815e6f0 con 0x7f58f815d200 2024-04-16T15:52:41.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.124+0000 7f58ee7fc640 1 -- 172.21.15.132:0/3482722127 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f000cb80 con 0x7f58f815d200 2024-04-16T15:52:41.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.124+0000 7f58ffb0e640 1 -- 172.21.15.132:0/3482722127 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58f815ecb0 con 0x7f58f815d200 2024-04-16T15:52:41.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.125+0000 7f58ffb0e640 1 -- 172.21.15.132:0/3482722127 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58f8075510 con 0x7f58f815d200 2024-04-16T15:52:41.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.125+0000 7f58ee7fc640 1 -- 172.21.15.132:0/3482722127 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f58f001a070 con 0x7f58f815d200 2024-04-16T15:52:41.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.126+0000 7f58ee7fc640 1 --2- 172.21.15.132:0/3482722127 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f58dc06c8f0 0x7f58dc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:41.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.126+0000 7f58ee7fc640 1 -- 172.21.15.132:0/3482722127 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f58f008b940 con 0x7f58f815d200 2024-04-16T15:52:41.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.126+0000 7f58fd8aa640 1 --2- 172.21.15.132:0/3482722127 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f58dc06c8f0 0x7f58dc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:41.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.126+0000 7f58fd8aa640 1 --2- 172.21.15.132:0/3482722127 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f58dc06c8f0 0x7f58dc06edb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f58f4001f10 tx=0x7f58f4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:41.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.130+0000 7f58ee7fc640 1 -- 172.21.15.132:0/3482722127 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f58f0059720 con 0x7f58f815d200 2024-04-16T15:52:41.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.308+0000 7f58ffb0e640 1 -- 172.21.15.132:0/3482722127 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f58f806c620 con 0x7f58f815d200 2024-04-16T15:52:41.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.309+0000 7f58ee7fc640 1 -- 172.21.15.132:0/3482722127 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7f58f005da20 con 0x7f58f815d200 2024-04-16T15:52:41.309 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:52:41.309 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"6bdec5d9-f406-43ad-8584-0503b32f6f0d","created":"2024-04-16T15:51:51.073040+0000","modified":"2024-04-16T15:52:16.950186+0000","last_up_change":"2024-04-16T15:52:02.280496+0000","last_in_change":"2024-04-16T15:51:53.376468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:52:03.284927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:52:13.363758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T15:52:14.246647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d45908b-6e22-4619-b190-897af594b712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6801","nonce":1170594668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6803","nonce":1170594668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6807","nonce":1170594668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6805","nonce":1170594668}]},"public_addr":"172.21.15.132:6801/1170594668","cluster_addr":"172.21.15.132:6803/1170594668","heartbeat_back_addr":"172.21.15.132:6807/1170594668","heartbeat_front_addr":"172.21.15.132:6805/1170594668","state":["exists","up"]},{"osd":1,"uuid":"c88bf082-e51f-4ee6-815a-025f6ce0d67b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6809","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6811","nonce":2494780358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6815","nonce":2494780358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6823","nonce":2494780358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6819","nonce":2494780358}]},"public_addr":"172.21.15.132:6811/2494780358","cluster_addr":"172.21.15.132:6815/2494780358","heartbeat_back_addr":"172.21.15.132:6823/2494780358","heartbeat_front_addr":"172.21.15.132:6819/2494780358","state":["exists","up"]},{"osd":2,"uuid":"e5dbd6b4-4e7b-47e4-ad4e-35b4b81696c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6825","nonce":27655483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6827","nonce":27655483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6831","nonce":27655483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6829","nonce":27655483}]},"public_addr":"172.21.15.132:6825/27655483","cluster_addr":"172.21.15.132:6827/27655483","heartbeat_back_addr":"172.21.15.132:6831/27655483","heartbeat_front_addr":"172.21.15.132:6829/27655483","state":["exists","up"]},{"osd":3,"uuid":"9d75cd67-3b8a-4424-8884-5f3660e1f5f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6810","nonce":3100919191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6814","nonce":3100919191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6821","nonce":3100919191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6818","nonce":3100919191}]},"public_addr":"172.21.15.132:6810/3100919191","cluster_addr":"172.21.15.132:6814/3100919191","heartbeat_back_addr":"172.21.15.132:6821/3100919191","heartbeat_front_addr":"172.21.15.132:6818/3100919191","state":["exists","up"]},{"osd":4,"uuid":"83aea46a-8642-4777-912b-c130e5890da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6825","nonce":123637799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6827","nonce":123637799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6831","nonce":123637799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6829","nonce":123637799}]},"public_addr":"172.21.15.179:6825/123637799","cluster_addr":"172.21.15.179:6827/123637799","heartbeat_back_addr":"172.21.15.179:6831/123637799","heartbeat_front_addr":"172.21.15.179:6829/123637799","state":["exists","up"]},{"osd":5,"uuid":"534117c8-3317-48d6-b436-afd5709f71e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6801","nonce":2224750370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6803","nonce":2224750370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6807","nonce":2224750370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6805","nonce":2224750370}]},"public_addr":"172.21.15.179:6801/2224750370","cluster_addr":"172.21.15.179:6803/2224750370","heartbeat_back_addr":"172.21.15.179:6807/2224750370","heartbeat_front_addr":"172.21.15.179:6805/2224750370","state":["exists","up"]},{"osd":6,"uuid":"0ba363e7-fa9d-42b1-ae09-a6a0f57d41f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6809","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6811","nonce":101498164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6813","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6815","nonce":101498164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6823","nonce":101498164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6819","nonce":101498164}]},"public_addr":"172.21.15.179:6811/101498164","cluster_addr":"172.21.15.179:6815/101498164","heartbeat_back_addr":"172.21.15.179:6823/101498164","heartbeat_front_addr":"172.21.15.179:6819/101498164","state":["exists","up"]},{"osd":7,"uuid":"e6830c77-2f2d-4067-9866-ee7625afc1a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6810","nonce":872148365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6814","nonce":872148365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6822","nonce":872148365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6818","nonce":872148365}]},"public_addr":"172.21.15.179:6810/872148365","cluster_addr":"172.21.15.179:6814/872148365","heartbeat_back_addr":"172.21.15.179:6822/872148365","heartbeat_front_addr":"172.21.15.179:6818/872148365","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.535221+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.563769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.520765+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.526264+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.517058+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.500842+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.534332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.512486+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:52:41.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.312+0000 7f58ffb0e640 1 -- 172.21.15.132:0/3482722127 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f58dc06c8f0 msgr2=0x7f58dc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:41.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.312+0000 7f58ffb0e640 1 --2- 172.21.15.132:0/3482722127 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f58dc06c8f0 0x7f58dc06edb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f58f4001f10 tx=0x7f58f4009040 comp rx=0 tx=0).stop 2024-04-16T15:52:41.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.312+0000 7f58ffb0e640 1 -- 172.21.15.132:0/3482722127 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58f815d200 msgr2=0x7f58f809b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:41.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.312+0000 7f58ffb0e640 1 --2- 172.21.15.132:0/3482722127 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58f815d200 0x7f58f809b6e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f58f000e7f0 tx=0x7f58f000ebf0 comp rx=0 tx=0).stop 2024-04-16T15:52:41.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.312+0000 7f58ffb0e640 1 -- 172.21.15.132:0/3482722127 shutdown_connections 2024-04-16T15:52:41.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.312+0000 7f58ffb0e640 1 --2- 172.21.15.132:0/3482722127 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f58dc06c8f0 0x7f58dc06edb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:41.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.312+0000 7f58ffb0e640 1 --2- 172.21.15.132:0/3482722127 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58f815d200 0x7f58f809b6e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:41.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.312+0000 7f58ffb0e640 1 --2- 172.21.15.132:0/3482722127 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58f8146290 0x7f58f815dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:41.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.312+0000 7f58ffb0e640 1 --2- 172.21.15.132:0/3482722127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58f8145eb0 0x7f58f8132d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:41.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.312+0000 7f58ffb0e640 1 -- 172.21.15.132:0/3482722127 >> 172.21.15.132:0/3482722127 conn(0x7f58f809aa30 msgr2=0x7f58f80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:41.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.312+0000 7f58ffb0e640 1 -- 172.21.15.132:0/3482722127 shutdown_connections 2024-04-16T15:52:41.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.312+0000 7f58ffb0e640 1 -- 172.21.15.132:0/3482722127 wait complete. 2024-04-16T15:52:41.323 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T15:52:03.284927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T15:52:13.363758+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T15:52:14.246647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T15:52:41.324 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T15:52:41.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.430+0000 7fab2718f640 1 Processor -- start 2024-04-16T15:52:41.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.430+0000 7fab2718f640 1 -- start start 2024-04-16T15:52:41.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.431+0000 7fab2718f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fab2015ea10 0x7fab2006ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:41.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.431+0000 7fab2718f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab2006d850 con 0x7fab200ba6d0 2024-04-16T15:52:41.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.431+0000 7fab2718f640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab2006db30 con 0x7fab2006d3b0 2024-04-16T15:52:41.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.431+0000 7fab2718f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fab200d2f70 con 0x7fab2015ea10 2024-04-16T15:52:41.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.431+0000 7fab24f2b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fab2015ea10 0x7fab2006ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:41.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.431+0000 7fab1ffff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fab200ba6d0 0x7fab200b6700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:59578/0 (socket says 172.21.15.132:59578) 2024-04-16T15:52:41.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.431+0000 7fab1ffff640 1 -- 172.21.15.132:0/4234263854 learned_addr learned my addr 172.21.15.132:0/4234263854 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:41.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.432+0000 7fab24f2b640 1 -- 172.21.15.132:0/4234263854 >> v1:172.21.15.179:6789/0 conn(0x7fab2006d3b0 legacy=0x7fab200d3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:41.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.432+0000 7fab24f2b640 1 -- 172.21.15.132:0/4234263854 >> v1:172.21.15.132:6789/0 conn(0x7fab200ba6d0 legacy=0x7fab200b6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:41.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.432+0000 7fab1f7fe640 1 -- 172.21.15.132:0/4234263854 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 641980717 0 0) 0x7fab2006d850 con 0x7fab200ba6d0 2024-04-16T15:52:41.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.432+0000 7fab24f2b640 1 -- 172.21.15.132:0/4234263854 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab2006de10 con 0x7fab2015ea10 2024-04-16T15:52:41.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.432+0000 7fab24f2b640 1 --2- 172.21.15.132:0/4234263854 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab2015ea10 0x7fab2006ce70 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fab10009d90 tx=0x7fab1002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f264fd31bedb5d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:41.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.432+0000 7fab1f7fe640 1 -- 172.21.15.132:0/4234263854 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab10039070 con 0x7fab2015ea10 2024-04-16T15:52:41.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.433+0000 7fab1f7fe640 1 -- 172.21.15.132:0/4234263854 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab1002cc60 con 0x7fab2015ea10 2024-04-16T15:52:41.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.433+0000 7fab1f7fe640 1 -- 172.21.15.132:0/4234263854 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab10034660 con 0x7fab2015ea10 2024-04-16T15:52:41.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.433+0000 7fab2718f640 1 -- 172.21.15.132:0/4234263854 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab2015ea10 msgr2=0x7fab2006ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:41.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.433+0000 7fab2718f640 1 --2- 172.21.15.132:0/4234263854 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab2015ea10 0x7fab2006ce70 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fab10009d90 tx=0x7fab1002beb0 comp rx=0 tx=0).stop 2024-04-16T15:52:41.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.433+0000 7fab2718f640 1 -- 172.21.15.132:0/4234263854 shutdown_connections 2024-04-16T15:52:41.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.433+0000 7fab2718f640 1 --2- 172.21.15.132:0/4234263854 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab2015ea10 0x7fab2006ce70 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:41.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.433+0000 7fab2718f640 1 -- 172.21.15.132:0/4234263854 >> 172.21.15.132:0/4234263854 conn(0x7fab200d17c0 msgr2=0x7fab200d1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:41.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.433+0000 7fab2718f640 1 -- 172.21.15.132:0/4234263854 shutdown_connections 2024-04-16T15:52:41.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.433+0000 7fab2718f640 1 -- 172.21.15.132:0/4234263854 wait complete. 2024-04-16T15:52:41.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.434+0000 7fab2718f640 1 Processor -- start 2024-04-16T15:52:41.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.434+0000 7fab2718f640 1 -- start start 2024-04-16T15:52:41.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.435+0000 7fab2718f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab2006d3b0 0x7fab201560f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:41.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.435+0000 7fab2718f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab2015ea10 0x7fab200c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:41.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.435+0000 7fab2718f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab200c94b0 0x7fab200ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:41.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.435+0000 7fab2718f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fab200b6e10 con 0x7fab200c94b0 2024-04-16T15:52:41.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.435+0000 7fab2718f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fab2015f080 con 0x7fab2015ea10 2024-04-16T15:52:41.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.435+0000 7fab2718f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fab200b6f90 con 0x7fab2006d3b0 2024-04-16T15:52:41.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.435+0000 7fab2572c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab200c94b0 0x7fab200ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:41.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.435+0000 7fab2572c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab200c94b0 0x7fab200ccd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42804/0 (socket says 172.21.15.132:42804) 2024-04-16T15:52:41.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.435+0000 7fab2572c640 1 -- 172.21.15.132:0/3373198546 learned_addr learned my addr 172.21.15.132:0/3373198546 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:41.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.436+0000 7fab24f2b640 1 --2- 172.21.15.132:0/3373198546 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab2006d3b0 0x7fab201560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:41.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.436+0000 7fab2572c640 1 -- 172.21.15.132:0/3373198546 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab2006d3b0 msgr2=0x7fab201560f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:41.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.436+0000 7fab2572c640 1 --2- 172.21.15.132:0/3373198546 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab2006d3b0 0x7fab201560f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:41.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.436+0000 7fab2572c640 1 -- 172.21.15.132:0/3373198546 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab2015ea10 msgr2=0x7fab200c8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:41.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.436+0000 7fab2572c640 1 --2- 172.21.15.132:0/3373198546 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab2015ea10 0x7fab200c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:41.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.436+0000 7fab2572c640 1 -- 172.21.15.132:0/3373198546 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab200cda20 con 0x7fab200c94b0 2024-04-16T15:52:41.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.436+0000 7fab2572c640 1 --2- 172.21.15.132:0/3373198546 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab200c94b0 0x7fab200ccd10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fab1800c390 tx=0x7fab1800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:41.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.436+0000 7fab1d7fa640 1 -- 172.21.15.132:0/3373198546 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab18017070 con 0x7fab200c94b0 2024-04-16T15:52:41.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.436+0000 7fab1d7fa640 1 -- 172.21.15.132:0/3373198546 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab180035f0 con 0x7fab200c94b0 2024-04-16T15:52:41.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.436+0000 7fab2718f640 1 -- 172.21.15.132:0/3373198546 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab200cdd00 con 0x7fab200c94b0 2024-04-16T15:52:41.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.436+0000 7fab1d7fa640 1 -- 172.21.15.132:0/3373198546 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab180039e0 con 0x7fab200c94b0 2024-04-16T15:52:41.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.436+0000 7fab2718f640 1 -- 172.21.15.132:0/3373198546 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab200ce2c0 con 0x7fab200c94b0 2024-04-16T15:52:41.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.437+0000 7fab2718f640 1 -- 172.21.15.132:0/3373198546 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab20075510 con 0x7fab200c94b0 2024-04-16T15:52:41.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.437+0000 7fab1d7fa640 1 -- 172.21.15.132:0/3373198546 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fab1801a070 con 0x7fab200c94b0 2024-04-16T15:52:41.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.438+0000 7fab1d7fa640 1 --2- 172.21.15.132:0/3373198546 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fab0006c8f0 0x7fab0006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:41.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.438+0000 7fab1d7fa640 1 -- 172.21.15.132:0/3373198546 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fab1808af00 con 0x7fab200c94b0 2024-04-16T15:52:41.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.438+0000 7fab24f2b640 1 --2- 172.21.15.132:0/3373198546 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fab0006c8f0 0x7fab0006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:41.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.438+0000 7fab24f2b640 1 --2- 172.21.15.132:0/3373198546 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fab0006c8f0 0x7fab0006edb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fab10036000 tx=0x7fab10030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:41.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.442+0000 7fab1d7fa640 1 -- 172.21.15.132:0/3373198546 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fab180593c0 con 0x7fab200c94b0 2024-04-16T15:52:41.615 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.616+0000 7fab2718f640 1 -- 172.21.15.132:0/3373198546 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fab200d25a0 con 0x7fab200c94b0 2024-04-16T15:52:41.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.617+0000 7fab1d7fa640 1 -- 172.21.15.132:0/3373198546 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fab18058cc0 con 0x7fab200c94b0 2024-04-16T15:52:41.616 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2024-04-16T15:52:41.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.619+0000 7fab2718f640 1 -- 172.21.15.132:0/3373198546 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fab0006c8f0 msgr2=0x7fab0006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:41.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.619+0000 7fab2718f640 1 --2- 172.21.15.132:0/3373198546 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fab0006c8f0 0x7fab0006edb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fab10036000 tx=0x7fab10030000 comp rx=0 tx=0).stop 2024-04-16T15:52:41.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.619+0000 7fab2718f640 1 -- 172.21.15.132:0/3373198546 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab200c94b0 msgr2=0x7fab200ccd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:41.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.619+0000 7fab2718f640 1 --2- 172.21.15.132:0/3373198546 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab200c94b0 0x7fab200ccd10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fab1800c390 tx=0x7fab1800c850 comp rx=0 tx=0).stop 2024-04-16T15:52:41.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.619+0000 7fab2718f640 1 -- 172.21.15.132:0/3373198546 shutdown_connections 2024-04-16T15:52:41.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.619+0000 7fab2718f640 1 --2- 172.21.15.132:0/3373198546 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fab0006c8f0 0x7fab0006edb0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:41.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.619+0000 7fab2718f640 1 --2- 172.21.15.132:0/3373198546 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab200c94b0 0x7fab200ccd10 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:41.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.619+0000 7fab2718f640 1 --2- 172.21.15.132:0/3373198546 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab2015ea10 0x7fab200c8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:41.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.619+0000 7fab2718f640 1 --2- 172.21.15.132:0/3373198546 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab2006d3b0 0x7fab201560f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:41.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.619+0000 7fab2718f640 1 -- 172.21.15.132:0/3373198546 >> 172.21.15.132:0/3373198546 conn(0x7fab200d17c0 msgr2=0x7fab2015c750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:41.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.619+0000 7fab2718f640 1 -- 172.21.15.132:0/3373198546 shutdown_connections 2024-04-16T15:52:41.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.619+0000 7fab2718f640 1 -- 172.21.15.132:0/3373198546 wait complete. 2024-04-16T15:52:41.629 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T15:52:41.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.736+0000 7f6497fd5640 1 Processor -- start 2024-04-16T15:52:41.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.737+0000 7f6497fd5640 1 -- start start 2024-04-16T15:52:41.738 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.737+0000 7f6497fd5640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f649015ec20 0x7f64900d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:41.738 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.737+0000 7f6497fd5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64900d3340 0x7f64900d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:41.738 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.737+0000 7f6497fd5640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f64900d1e60 0x7f64900b6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:41.738 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.737+0000 7f6497fd5640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f64900d3850 con 0x7f64900d1e60 2024-04-16T15:52:41.738 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.737+0000 7f6497fd5640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f64900d3b30 con 0x7f649015ec20 2024-04-16T15:52:41.738 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.737+0000 7f6497fd5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f64900d3e10 con 0x7f64900d3340 2024-04-16T15:52:41.738 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.738+0000 7f6496572640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f64900d1e60 0x7f64900b6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:41.738 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.738+0000 7f6496572640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f64900d1e60 0x7f64900b6400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53312/0 (socket says 172.21.15.132:53312) 2024-04-16T15:52:41.738 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.738+0000 7f6496572640 1 -- 172.21.15.132:0/1293864000 learned_addr learned my addr 172.21.15.132:0/1293864000 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:41.739 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.738+0000 7f6495570640 1 --2- 172.21.15.132:0/1293864000 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64900d3340 0x7f64900d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:41.739 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.738+0000 7f6495d71640 1 --2- 172.21.15.132:0/1293864000 >> v2:172.21.15.179:3300/0 conn(0x7f649015ec20 0x7f64900d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:41.739 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.738+0000 7f6496572640 1 -- 172.21.15.132:0/1293864000 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64900d3340 msgr2=0x7f64900d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:41.739 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.738+0000 7f6496572640 1 --2- 172.21.15.132:0/1293864000 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64900d3340 0x7f64900d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:41.739 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.738+0000 7f6496572640 1 -- 172.21.15.132:0/1293864000 >> v2:172.21.15.179:3300/0 conn(0x7f649015ec20 msgr2=0x7f64900d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:41.739 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.738+0000 7f6496572640 1 --2- 172.21.15.132:0/1293864000 >> v2:172.21.15.179:3300/0 conn(0x7f649015ec20 0x7f64900d2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:41.739 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.738+0000 7f6496572640 1 -- 172.21.15.132:0/1293864000 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64900d40f0 con 0x7f64900d1e60 2024-04-16T15:52:41.739 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.739+0000 7f6496572640 1 --2- 172.21.15.132:0/1293864000 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f64900d1e60 0x7f64900b6400 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f64900d59d0 tx=0x7f648802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2ff6835f02a8668 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:41.739 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.739+0000 7f6494d6f640 1 -- 172.21.15.132:0/1293864000 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f648802cb00 con 0x7f64900d1e60 2024-04-16T15:52:41.739 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.739+0000 7f6494d6f640 1 -- 172.21.15.132:0/1293864000 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f648802cca0 con 0x7f64900d1e60 2024-04-16T15:52:41.739 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.739+0000 7f6494d6f640 1 -- 172.21.15.132:0/1293864000 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6488034610 con 0x7f64900d1e60 2024-04-16T15:52:41.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.739+0000 7f6497fd5640 1 -- 172.21.15.132:0/1293864000 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f64900d1e60 msgr2=0x7f64900b6400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:41.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.739+0000 7f6497fd5640 1 --2- 172.21.15.132:0/1293864000 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f64900d1e60 0x7f64900b6400 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f64900d59d0 tx=0x7f648802bf60 comp rx=0 tx=0).stop 2024-04-16T15:52:41.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.739+0000 7f6497fd5640 1 -- 172.21.15.132:0/1293864000 shutdown_connections 2024-04-16T15:52:41.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.739+0000 7f6497fd5640 1 --2- 172.21.15.132:0/1293864000 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f64900d1e60 0x7f64900b6400 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:41.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.739+0000 7f6497fd5640 1 --2- 172.21.15.132:0/1293864000 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64900d3340 0x7f64900d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:41.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.739+0000 7f6497fd5640 1 --2- 172.21.15.132:0/1293864000 >> v2:172.21.15.179:3300/0 conn(0x7f649015ec20 0x7f64900d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:41.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.739+0000 7f6497fd5640 1 -- 172.21.15.132:0/1293864000 >> 172.21.15.132:0/1293864000 conn(0x7f649006d2d0 msgr2=0x7f649006d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:41.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.740+0000 7f6497fd5640 1 -- 172.21.15.132:0/1293864000 shutdown_connections 2024-04-16T15:52:41.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.740+0000 7f6497fd5640 1 -- 172.21.15.132:0/1293864000 wait complete. 2024-04-16T15:52:41.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.741+0000 7f6497fd5640 1 Processor -- start 2024-04-16T15:52:41.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.741+0000 7f6497fd5640 1 -- start start 2024-04-16T15:52:41.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.741+0000 7f6497fd5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64900d1e60 0x7f649015c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:41.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.741+0000 7f6497fd5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f64900d3340 0x7f64900b9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:41.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.741+0000 7f6497fd5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f649015ec20 0x7f64900ace90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:41.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.741+0000 7f6497fd5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f64900cf3a0 con 0x7f64900d3340 2024-04-16T15:52:41.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.741+0000 7f6497fd5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f649015f000 con 0x7f649015ec20 2024-04-16T15:52:41.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.741+0000 7f6497fd5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f64900cf520 con 0x7f64900d1e60 2024-04-16T15:52:41.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.741+0000 7f6495570640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f64900d3340 0x7f64900b9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:41.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.742+0000 7f6495570640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f64900d3340 0x7f64900b9290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53318/0 (socket says 172.21.15.132:53318) 2024-04-16T15:52:41.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.742+0000 7f6495570640 1 -- 172.21.15.132:0/183274478 learned_addr learned my addr 172.21.15.132:0/183274478 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:41.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.742+0000 7f6495570640 1 -- 172.21.15.132:0/183274478 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64900d1e60 msgr2=0x7f649015c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:41.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.742+0000 7f6495570640 1 --2- 172.21.15.132:0/183274478 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64900d1e60 0x7f649015c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:41.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.742+0000 7f6495570640 1 -- 172.21.15.132:0/183274478 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f649015ec20 msgr2=0x7f64900ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:41.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.742+0000 7f6495570640 1 --2- 172.21.15.132:0/183274478 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f649015ec20 0x7f64900ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:41.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.742+0000 7f6495570640 1 -- 172.21.15.132:0/183274478 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f649015cbb0 con 0x7f64900d3340 2024-04-16T15:52:41.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.742+0000 7f6495570640 1 --2- 172.21.15.132:0/183274478 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f64900d3340 0x7f64900b9290 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f648000e860 tx=0x7f648000ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:41.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.742+0000 7f64867fc640 1 -- 172.21.15.132:0/183274478 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6480017070 con 0x7f64900d3340 2024-04-16T15:52:41.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.742+0000 7f64867fc640 1 -- 172.21.15.132:0/183274478 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f648000c940 con 0x7f64900d3340 2024-04-16T15:52:41.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.742+0000 7f6497fd5640 1 -- 172.21.15.132:0/183274478 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6490160be0 con 0x7f64900d3340 2024-04-16T15:52:41.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.742+0000 7f64867fc640 1 -- 172.21.15.132:0/183274478 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f648000cd10 con 0x7f64900d3340 2024-04-16T15:52:41.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.742+0000 7f6497fd5640 1 -- 172.21.15.132:0/183274478 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64901611a0 con 0x7f64900d3340 2024-04-16T15:52:41.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.743+0000 7f6497fd5640 1 -- 172.21.15.132:0/183274478 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6490075510 con 0x7f64900d3340 2024-04-16T15:52:41.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.744+0000 7f64867fc640 1 -- 172.21.15.132:0/183274478 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f648001a070 con 0x7f64900d3340 2024-04-16T15:52:41.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.744+0000 7f64867fc640 1 --2- 172.21.15.132:0/183274478 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f647406c8f0 0x7f647406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:41.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.744+0000 7f64867fc640 1 -- 172.21.15.132:0/183274478 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f648008bbd0 con 0x7f64900d3340 2024-04-16T15:52:41.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.744+0000 7f6495d71640 1 --2- 172.21.15.132:0/183274478 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f647406c8f0 0x7f647406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:41.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.744+0000 7f6495d71640 1 --2- 172.21.15.132:0/183274478 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f647406c8f0 0x7f647406edb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f648c006a90 tx=0x7f648c006a20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:41.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.748+0000 7f64867fc640 1 -- 172.21.15.132:0/183274478 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f648005a000 con 0x7f64900d3340 2024-04-16T15:52:41.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.922+0000 7f6497fd5640 1 -- 172.21.15.132:0/183274478 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f64900cea70 con 0x7f64900d3340 2024-04-16T15:52:41.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.922+0000 7f64867fc640 1 -- 172.21.15.132:0/183274478 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f6480059900 con 0x7f64900d3340 2024-04-16T15:52:41.921 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2024-04-16T15:52:41.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.924+0000 7f6497fd5640 1 -- 172.21.15.132:0/183274478 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f647406c8f0 msgr2=0x7f647406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:41.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.924+0000 7f6497fd5640 1 --2- 172.21.15.132:0/183274478 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f647406c8f0 0x7f647406edb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f648c006a90 tx=0x7f648c006a20 comp rx=0 tx=0).stop 2024-04-16T15:52:41.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.924+0000 7f6497fd5640 1 -- 172.21.15.132:0/183274478 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f64900d3340 msgr2=0x7f64900b9290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:41.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.924+0000 7f6497fd5640 1 --2- 172.21.15.132:0/183274478 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f64900d3340 0x7f64900b9290 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f648000e860 tx=0x7f648000ed20 comp rx=0 tx=0).stop 2024-04-16T15:52:41.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.924+0000 7f6497fd5640 1 -- 172.21.15.132:0/183274478 shutdown_connections 2024-04-16T15:52:41.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.924+0000 7f6497fd5640 1 --2- 172.21.15.132:0/183274478 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f647406c8f0 0x7f647406edb0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:41.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.924+0000 7f6497fd5640 1 --2- 172.21.15.132:0/183274478 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f649015ec20 0x7f64900ace90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:41.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.924+0000 7f6497fd5640 1 --2- 172.21.15.132:0/183274478 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f64900d3340 0x7f64900b9290 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:41.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.924+0000 7f6497fd5640 1 --2- 172.21.15.132:0/183274478 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64900d1e60 0x7f649015c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:41.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.924+0000 7f6497fd5640 1 -- 172.21.15.132:0/183274478 >> 172.21.15.132:0/183274478 conn(0x7f649006d2d0 msgr2=0x7f64900b4bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:41.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.924+0000 7f6497fd5640 1 -- 172.21.15.132:0/183274478 shutdown_connections 2024-04-16T15:52:41.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:41.924+0000 7f6497fd5640 1 -- 172.21.15.132:0/183274478 wait complete. 2024-04-16T15:52:41.934 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T15:52:42.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.041+0000 7f0593f0e640 1 Processor -- start 2024-04-16T15:52:42.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.041+0000 7f0593f0e640 1 -- start start 2024-04-16T15:52:42.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.042+0000 7f0593f0e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f058c15eae0 0x7f058c0ae480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:42.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.042+0000 7f0593f0e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f058c0b6020 0x7f058c0b0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:42.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.042+0000 7f0593f0e640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f058c070eb0 0x7f058c06fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:42.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.042+0000 7f0593f0e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f058c0b0860 con 0x7f058c15eae0 2024-04-16T15:52:42.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.042+0000 7f0593f0e640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f058c0b67c0 con 0x7f058c070eb0 2024-04-16T15:52:42.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.042+0000 7f0593f0e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f058c0b4b90 con 0x7f058c0b6020 2024-04-16T15:52:42.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.042+0000 7f0591caa640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f058c15eae0 0x7f058c0ae480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:42.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.042+0000 7f0591caa640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f058c15eae0 0x7f058c0ae480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53326/0 (socket says 172.21.15.132:53326) 2024-04-16T15:52:42.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.042+0000 7f0591caa640 1 -- 172.21.15.132:0/310742626 learned_addr learned my addr 172.21.15.132:0/310742626 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:42.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.042+0000 7f05914a9640 1 --2- 172.21.15.132:0/310742626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f058c0b6020 0x7f058c0b0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:42.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.043+0000 7f0591caa640 1 -- 172.21.15.132:0/310742626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f058c0b6020 msgr2=0x7f058c0b0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:42.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.043+0000 7f05924ab640 1 --2- 172.21.15.132:0/310742626 >> v2:172.21.15.179:3300/0 conn(0x7f058c070eb0 0x7f058c06fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:42.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.043+0000 7f0591caa640 1 --2- 172.21.15.132:0/310742626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f058c0b6020 0x7f058c0b0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:42.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.043+0000 7f0591caa640 1 -- 172.21.15.132:0/310742626 >> v2:172.21.15.179:3300/0 conn(0x7f058c070eb0 msgr2=0x7f058c06fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:42.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.043+0000 7f0591caa640 1 --2- 172.21.15.132:0/310742626 >> v2:172.21.15.179:3300/0 conn(0x7f058c070eb0 0x7f058c06fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:42.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.043+0000 7f0591caa640 1 -- 172.21.15.132:0/310742626 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f058c0b64e0 con 0x7f058c15eae0 2024-04-16T15:52:42.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.043+0000 7f05914a9640 1 --2- 172.21.15.132:0/310742626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f058c0b6020 0x7f058c0b0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:52:42.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.043+0000 7f0591caa640 1 --2- 172.21.15.132:0/310742626 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f058c15eae0 0x7f058c0ae480 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f058c073440 tx=0x7f058802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50bf5736c0f1b453 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:42.047 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.043+0000 7f0590ca8640 1 -- 172.21.15.132:0/310742626 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f058802c9e0 con 0x7f058c15eae0 2024-04-16T15:52:42.047 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.044+0000 7f0590ca8640 1 -- 172.21.15.132:0/310742626 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f058802cb80 con 0x7f058c15eae0 2024-04-16T15:52:42.047 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.044+0000 7f0590ca8640 1 -- 172.21.15.132:0/310742626 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05880343f0 con 0x7f058c15eae0 2024-04-16T15:52:42.047 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.044+0000 7f0593f0e640 1 -- 172.21.15.132:0/310742626 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f058c15eae0 msgr2=0x7f058c0ae480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:42.047 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.044+0000 7f0593f0e640 1 --2- 172.21.15.132:0/310742626 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f058c15eae0 0x7f058c0ae480 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f058c073440 tx=0x7f058802be40 comp rx=0 tx=0).stop 2024-04-16T15:52:42.047 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.044+0000 7f0593f0e640 1 -- 172.21.15.132:0/310742626 shutdown_connections 2024-04-16T15:52:42.047 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.044+0000 7f0593f0e640 1 --2- 172.21.15.132:0/310742626 >> v2:172.21.15.179:3300/0 conn(0x7f058c070eb0 0x7f058c06fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:42.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.044+0000 7f0593f0e640 1 --2- 172.21.15.132:0/310742626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f058c0b6020 0x7f058c0b0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:42.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.044+0000 7f0593f0e640 1 --2- 172.21.15.132:0/310742626 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f058c15eae0 0x7f058c0ae480 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:42.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.044+0000 7f0593f0e640 1 -- 172.21.15.132:0/310742626 >> 172.21.15.132:0/310742626 conn(0x7f058c09aa30 msgr2=0x7f058c0b69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:42.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.044+0000 7f0593f0e640 1 -- 172.21.15.132:0/310742626 shutdown_connections 2024-04-16T15:52:42.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.044+0000 7f0593f0e640 1 -- 172.21.15.132:0/310742626 wait complete. 2024-04-16T15:52:42.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.045+0000 7f0593f0e640 1 Processor -- start 2024-04-16T15:52:42.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.045+0000 7f0593f0e640 1 -- start start 2024-04-16T15:52:42.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.046+0000 7f0593f0e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f058c070eb0 0x7f058c14eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:42.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.046+0000 7f0593f0e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f058c0b6020 0x7f058c152de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:42.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.046+0000 7f0593f0e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f058c153ab0 0x7f058c153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:42.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.046+0000 7f0593f0e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f058c0b0c60 con 0x7f058c070eb0 2024-04-16T15:52:42.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.046+0000 7f0593f0e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f058c0b48b0 con 0x7f058c153ab0 2024-04-16T15:52:42.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.046+0000 7f0593f0e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f058c070050 con 0x7f058c0b6020 2024-04-16T15:52:42.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.046+0000 7f0591caa640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f058c070eb0 0x7f058c14eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:42.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.046+0000 7f0591caa640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f058c070eb0 0x7f058c14eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53338/0 (socket says 172.21.15.132:53338) 2024-04-16T15:52:42.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.046+0000 7f0591caa640 1 -- 172.21.15.132:0/1035962192 learned_addr learned my addr 172.21.15.132:0/1035962192 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:42.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.046+0000 7f0591caa640 1 -- 172.21.15.132:0/1035962192 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f058c0b6020 msgr2=0x7f058c152de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:42.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.046+0000 7f0591caa640 1 --2- 172.21.15.132:0/1035962192 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f058c0b6020 0x7f058c152de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:42.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.046+0000 7f0591caa640 1 -- 172.21.15.132:0/1035962192 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f058c153ab0 msgr2=0x7f058c153f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:42.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.046+0000 7f0591caa640 1 --2- 172.21.15.132:0/1035962192 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f058c153ab0 0x7f058c153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:42.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.046+0000 7f0591caa640 1 -- 172.21.15.132:0/1035962192 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f058c152030 con 0x7f058c070eb0 2024-04-16T15:52:42.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.047+0000 7f0591caa640 1 --2- 172.21.15.132:0/1035962192 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f058c070eb0 0x7f058c14eec0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0588036040 tx=0x7f0588004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:42.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.047+0000 7f05827fc640 1 -- 172.21.15.132:0/1035962192 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0588043020 con 0x7f058c070eb0 2024-04-16T15:52:42.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.047+0000 7f05827fc640 1 -- 172.21.15.132:0/1035962192 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f058803e450 con 0x7f058c070eb0 2024-04-16T15:52:42.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.047+0000 7f0593f0e640 1 -- 172.21.15.132:0/1035962192 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f058c152310 con 0x7f058c070eb0 2024-04-16T15:52:42.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.047+0000 7f05827fc640 1 -- 172.21.15.132:0/1035962192 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f058803e840 con 0x7f058c070eb0 2024-04-16T15:52:42.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.047+0000 7f0593f0e640 1 -- 172.21.15.132:0/1035962192 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f058c1528d0 con 0x7f058c070eb0 2024-04-16T15:52:42.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.048+0000 7f0593f0e640 1 -- 172.21.15.132:0/1035962192 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f058c075510 con 0x7f058c070eb0 2024-04-16T15:52:42.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.048+0000 7f05827fc640 1 -- 172.21.15.132:0/1035962192 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0588046020 con 0x7f058c070eb0 2024-04-16T15:52:42.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.049+0000 7f05827fc640 1 --2- 172.21.15.132:0/1035962192 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f057006c8f0 0x7f057006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:42.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.049+0000 7f05827fc640 1 -- 172.21.15.132:0/1035962192 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f05880ae430 con 0x7f058c070eb0 2024-04-16T15:52:42.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.049+0000 7f05914a9640 1 --2- 172.21.15.132:0/1035962192 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f057006c8f0 0x7f057006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:42.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.049+0000 7f05914a9640 1 --2- 172.21.15.132:0/1035962192 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f057006c8f0 0x7f057006edb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f057c006fd0 tx=0x7f057c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:42.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.053+0000 7f05827fc640 1 -- 172.21.15.132:0/1035962192 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f058804d030 con 0x7f058c070eb0 2024-04-16T15:52:42.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.231+0000 7f0593f0e640 1 -- 172.21.15.132:0/1035962192 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f058c0b0620 con 0x7f058c070eb0 2024-04-16T15:52:42.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.231+0000 7f05827fc640 1 -- 172.21.15.132:0/1035962192 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f058807c8f0 con 0x7f058c070eb0 2024-04-16T15:52:42.230 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2024-04-16T15:52:42.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.233+0000 7f0593f0e640 1 -- 172.21.15.132:0/1035962192 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f057006c8f0 msgr2=0x7f057006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:42.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.233+0000 7f0593f0e640 1 --2- 172.21.15.132:0/1035962192 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f057006c8f0 0x7f057006edb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f057c006fd0 tx=0x7f057c008040 comp rx=0 tx=0).stop 2024-04-16T15:52:42.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.233+0000 7f0593f0e640 1 -- 172.21.15.132:0/1035962192 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f058c070eb0 msgr2=0x7f058c14eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:42.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.233+0000 7f0593f0e640 1 --2- 172.21.15.132:0/1035962192 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f058c070eb0 0x7f058c14eec0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0588036040 tx=0x7f0588004a40 comp rx=0 tx=0).stop 2024-04-16T15:52:42.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.233+0000 7f0593f0e640 1 -- 172.21.15.132:0/1035962192 shutdown_connections 2024-04-16T15:52:42.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.233+0000 7f0593f0e640 1 --2- 172.21.15.132:0/1035962192 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f057006c8f0 0x7f057006edb0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:42.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.233+0000 7f0593f0e640 1 --2- 172.21.15.132:0/1035962192 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f058c153ab0 0x7f058c153f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:42.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.233+0000 7f0593f0e640 1 --2- 172.21.15.132:0/1035962192 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f058c0b6020 0x7f058c152de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:42.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.233+0000 7f0593f0e640 1 --2- 172.21.15.132:0/1035962192 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f058c070eb0 0x7f058c14eec0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:42.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.233+0000 7f0593f0e640 1 -- 172.21.15.132:0/1035962192 >> 172.21.15.132:0/1035962192 conn(0x7f058c09aa30 msgr2=0x7f058c15eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:42.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.233+0000 7f0593f0e640 1 -- 172.21.15.132:0/1035962192 shutdown_connections 2024-04-16T15:52:42.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.233+0000 7f0593f0e640 1 -- 172.21.15.132:0/1035962192 wait complete. 2024-04-16T15:52:42.279 INFO:tasks.cephfs_test_runner:Starting test: test_extra_data_pool_rebuild_few_files (tasks.cephfs.test_data_scan.TestDataScan) 2024-04-16T15:52:42.280 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:52:42.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.384+0000 7fd1ec09a640 1 Processor -- start 2024-04-16T15:52:42.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.384+0000 7fd1ec09a640 1 -- start start 2024-04-16T15:52:42.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.385+0000 7fd1ec09a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1e4146290 0x7fd1e415ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:42.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.385+0000 7fd1ec09a640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1e40ae6a0 con 0x7fd1e4145eb0 2024-04-16T15:52:42.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.385+0000 7fd1ec09a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1e415d7f0 con 0x7fd1e415d200 2024-04-16T15:52:42.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.385+0000 7fd1ec09a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fd1e415dad0 con 0x7fd1e4146290 2024-04-16T15:52:42.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.385+0000 7fd1e9e36640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fd1e4145eb0 0x7fd1e40b0880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:35258/0 (socket says 172.21.15.132:35258) 2024-04-16T15:52:42.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.385+0000 7fd1e9e36640 1 -- 172.21.15.132:0/660281200 learned_addr learned my addr 172.21.15.132:0/660281200 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:42.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.386+0000 7fd1e9635640 1 --2- 172.21.15.132:0/660281200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1e4146290 0x7fd1e415ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:42.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.386+0000 7fd1e8e34640 1 -- 172.21.15.132:0/660281200 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1361208845 0 0) 0x7fd1e40ae6a0 con 0x7fd1e4145eb0 2024-04-16T15:52:42.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.386+0000 7fd1e8e34640 1 -- 172.21.15.132:0/660281200 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1d0003520 con 0x7fd1e4145eb0 2024-04-16T15:52:42.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.386+0000 7fd1e8e34640 1 -- 172.21.15.132:0/660281200 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 928882730 0 0) 0x7fd1d0003520 con 0x7fd1e4145eb0 2024-04-16T15:52:42.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.386+0000 7fd1e8e34640 1 -- 172.21.15.132:0/660281200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1e4146290 msgr2=0x7fd1e415ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:42.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.386+0000 7fd1e8e34640 1 --2- 172.21.15.132:0/660281200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1e4146290 0x7fd1e415ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:42.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.386+0000 7fd1e8e34640 1 -- 172.21.15.132:0/660281200 >> v1:172.21.15.179:6789/0 conn(0x7fd1e415d200 legacy=0x7fd1e40b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:42.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.386+0000 7fd1e8e34640 1 -- 172.21.15.132:0/660281200 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1e40b0080 con 0x7fd1e4145eb0 2024-04-16T15:52:42.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.386+0000 7fd1e8e34640 1 -- 172.21.15.132:0/660281200 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2803668828 0 0) 0x7fd1e0001690 con 0x7fd1e4145eb0 2024-04-16T15:52:42.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.386+0000 7fd1e8e34640 1 -- 172.21.15.132:0/660281200 >> v1:172.21.15.132:6789/0 conn(0x7fd1e4145eb0 legacy=0x7fd1e40b0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:42.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.386+0000 7fd1e8e34640 1 --2- 172.21.15.132:0/660281200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1e4146290 0x7fd1d00039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:42.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.386+0000 7fd1e8e34640 1 --2- 172.21.15.132:0/660281200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1d0003f20 0x7fd1d0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:42.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.386+0000 7fd1e8e34640 1 --2- 172.21.15.132:0/660281200 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1d0004d40 0x7fd1d00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:42.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.386+0000 7fd1e8e34640 1 -- 172.21.15.132:0/660281200 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e415dad0 con 0x7fd1d0003f20 2024-04-16T15:52:42.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.386+0000 7fd1e8e34640 1 -- 172.21.15.132:0/660281200 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d000bb00 con 0x7fd1d0004d40 2024-04-16T15:52:42.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.386+0000 7fd1e8e34640 1 -- 172.21.15.132:0/660281200 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fd1d000bd00 con 0x7fd1e4146290 2024-04-16T15:52:42.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.386+0000 7fd1e9635640 1 --2- 172.21.15.132:0/660281200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1d0003f20 0x7fd1d0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:42.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.386+0000 7fd1e9e36640 1 --2- 172.21.15.132:0/660281200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1e4146290 0x7fd1d00039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:42.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.386+0000 7fd1ea637640 1 --2- 172.21.15.132:0/660281200 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1d0004d40 0x7fd1d00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:42.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.386+0000 7fd1e9635640 1 -- 172.21.15.132:0/660281200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1e4146290 msgr2=0x7fd1d00039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:42.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.386+0000 7fd1e9635640 1 --2- 172.21.15.132:0/660281200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1e4146290 0x7fd1d00039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:42.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.386+0000 7fd1e9635640 1 -- 172.21.15.132:0/660281200 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1d0004d40 msgr2=0x7fd1d00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:42.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.386+0000 7fd1e9635640 1 --2- 172.21.15.132:0/660281200 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1d0004d40 0x7fd1d00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:42.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.386+0000 7fd1e9635640 1 -- 172.21.15.132:0/660281200 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1d0003520 con 0x7fd1d0003f20 2024-04-16T15:52:42.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.387+0000 7fd1e9635640 1 --2- 172.21.15.132:0/660281200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1d0003f20 0x7fd1d0004800 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4009a90 tx=0x7fd1d0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c9c5b1aa7d23a57 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:42.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.387+0000 7fd1e8e34640 1 -- 172.21.15.132:0/660281200 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1d4039070 con 0x7fd1d0003f20 2024-04-16T15:52:42.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.387+0000 7fd1e8e34640 1 -- 172.21.15.132:0/660281200 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1d402c680 con 0x7fd1d0003f20 2024-04-16T15:52:42.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.387+0000 7fd1e8e34640 1 -- 172.21.15.132:0/660281200 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1d4009690 con 0x7fd1d0003f20 2024-04-16T15:52:42.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.388+0000 7fd1ec09a640 1 -- 172.21.15.132:0/660281200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1d0003f20 msgr2=0x7fd1d0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:42.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.388+0000 7fd1ec09a640 1 --2- 172.21.15.132:0/660281200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1d0003f20 0x7fd1d0004800 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4009a90 tx=0x7fd1d0005830 comp rx=0 tx=0).stop 2024-04-16T15:52:42.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.388+0000 7fd1ea637640 1 -- 172.21.15.132:0/660281200 reap_dead start 2024-04-16T15:52:42.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.388+0000 7fd1ec09a640 1 -- 172.21.15.132:0/660281200 shutdown_connections 2024-04-16T15:52:42.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.388+0000 7fd1ec09a640 1 -- 172.21.15.132:0/660281200 >> 172.21.15.132:0/660281200 conn(0x7fd1e409aa30 msgr2=0x7fd1e40b6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:42.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.388+0000 7fd1ec09a640 1 -- 172.21.15.132:0/660281200 shutdown_connections 2024-04-16T15:52:42.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.388+0000 7fd1ec09a640 1 -- 172.21.15.132:0/660281200 wait complete. 2024-04-16T15:52:42.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.389+0000 7fd1ec09a640 1 Processor -- start 2024-04-16T15:52:42.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.389+0000 7fd1ec09a640 1 -- start start 2024-04-16T15:52:42.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.390+0000 7fd1ec09a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1d0003f20 0x7fd1e413abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:42.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.390+0000 7fd1ec09a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1e41f0e00 0x7fd1e41f1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:42.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.390+0000 7fd1ec09a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1e413c3f0 0x7fd1e413c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:42.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.390+0000 7fd1ec09a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e40b64b0 con 0x7fd1e41f0e00 2024-04-16T15:52:42.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.390+0000 7fd1ec09a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e40afd70 con 0x7fd1e413c3f0 2024-04-16T15:52:42.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.390+0000 7fd1ec09a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fd1e40b6630 con 0x7fd1d0003f20 2024-04-16T15:52:42.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.390+0000 7fd1e9635640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1e41f0e00 0x7fd1e41f1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:42.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.390+0000 7fd1e9635640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1e41f0e00 0x7fd1e41f1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53358/0 (socket says 172.21.15.132:53358) 2024-04-16T15:52:42.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.390+0000 7fd1e9635640 1 -- 172.21.15.132:0/3245963666 learned_addr learned my addr 172.21.15.132:0/3245963666 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:42.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.390+0000 7fd1e9e36640 1 --2- 172.21.15.132:0/3245963666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1d0003f20 0x7fd1e413abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:42.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.390+0000 7fd1ea637640 1 --2- 172.21.15.132:0/3245963666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1e413c3f0 0x7fd1e413c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:42.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.390+0000 7fd1e9635640 1 -- 172.21.15.132:0/3245963666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1d0003f20 msgr2=0x7fd1e413abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:42.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.390+0000 7fd1e9635640 1 --2- 172.21.15.132:0/3245963666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1d0003f20 0x7fd1e413abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:42.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.390+0000 7fd1e9635640 1 -- 172.21.15.132:0/3245963666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1e413c3f0 msgr2=0x7fd1e413c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:42.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.390+0000 7fd1e9635640 1 --2- 172.21.15.132:0/3245963666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1e413c3f0 0x7fd1e413c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:42.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.390+0000 7fd1e9635640 1 -- 172.21.15.132:0/3245963666 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1e413ceb0 con 0x7fd1e41f0e00 2024-04-16T15:52:42.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.390+0000 7fd1ea637640 1 --2- 172.21.15.132:0/3245963666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1e413c3f0 0x7fd1e413c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:42.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.390+0000 7fd1e9635640 1 --2- 172.21.15.132:0/3245963666 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1e41f0e00 0x7fd1e41f1280 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4000c00 tx=0x7fd1d4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:42.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.390+0000 7fd1da7fc640 1 -- 172.21.15.132:0/3245963666 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1d4042020 con 0x7fd1e41f0e00 2024-04-16T15:52:42.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.390+0000 7fd1da7fc640 1 -- 172.21.15.132:0/3245963666 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1d403a040 con 0x7fd1e41f0e00 2024-04-16T15:52:42.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.390+0000 7fd1ec09a640 1 -- 172.21.15.132:0/3245963666 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1e4139e60 con 0x7fd1e41f0e00 2024-04-16T15:52:42.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.390+0000 7fd1da7fc640 1 -- 172.21.15.132:0/3245963666 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1d4039070 con 0x7fd1e41f0e00 2024-04-16T15:52:42.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.390+0000 7fd1ec09a640 1 -- 172.21.15.132:0/3245963666 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1e413a3e0 con 0x7fd1e41f0e00 2024-04-16T15:52:42.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.391+0000 7fd1ec09a640 1 -- 172.21.15.132:0/3245963666 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1e4075510 con 0x7fd1e41f0e00 2024-04-16T15:52:42.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.392+0000 7fd1da7fc640 1 -- 172.21.15.132:0/3245963666 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd1d4045020 con 0x7fd1e41f0e00 2024-04-16T15:52:42.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.392+0000 7fd1da7fc640 1 --2- 172.21.15.132:0/3245963666 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fd1c806c8f0 0x7fd1c806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:42.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.392+0000 7fd1da7fc640 1 -- 172.21.15.132:0/3245963666 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd1d40ac940 con 0x7fd1e41f0e00 2024-04-16T15:52:42.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.392+0000 7fd1e9e36640 1 --2- 172.21.15.132:0/3245963666 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fd1c806c8f0 0x7fd1c806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:42.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.393+0000 7fd1e9e36640 1 --2- 172.21.15.132:0/3245963666 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fd1c806c8f0 0x7fd1c806edb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd1e4156db0 tx=0x7fd1e0000fa0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:42.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.397+0000 7fd1da7fc640 1 -- 172.21.15.132:0/3245963666 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd1d407a7b0 con 0x7fd1e41f0e00 2024-04-16T15:52:42.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.574+0000 7fd1ec09a640 1 -- 172.21.15.132:0/3245963666 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd1e413c1d0 con 0x7fd1e41f0e00 2024-04-16T15:52:42.574 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.575+0000 7fd1da7fc640 1 -- 172.21.15.132:0/3245963666 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7fd1d407eab0 con 0x7fd1e41f0e00 2024-04-16T15:52:42.574 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:52:42.575 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"6bdec5d9-f406-43ad-8584-0503b32f6f0d","created":"2024-04-16T15:51:51.073040+0000","modified":"2024-04-16T15:52:16.950186+0000","last_up_change":"2024-04-16T15:52:02.280496+0000","last_in_change":"2024-04-16T15:51:53.376468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:52:03.284927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:52:13.363758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T15:52:14.246647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d45908b-6e22-4619-b190-897af594b712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6801","nonce":1170594668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6803","nonce":1170594668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6807","nonce":1170594668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6805","nonce":1170594668}]},"public_addr":"172.21.15.132:6801/1170594668","cluster_addr":"172.21.15.132:6803/1170594668","heartbeat_back_addr":"172.21.15.132:6807/1170594668","heartbeat_front_addr":"172.21.15.132:6805/1170594668","state":["exists","up"]},{"osd":1,"uuid":"c88bf082-e51f-4ee6-815a-025f6ce0d67b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6809","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6811","nonce":2494780358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6815","nonce":2494780358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6823","nonce":2494780358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6819","nonce":2494780358}]},"public_addr":"172.21.15.132:6811/2494780358","cluster_addr":"172.21.15.132:6815/2494780358","heartbeat_back_addr":"172.21.15.132:6823/2494780358","heartbeat_front_addr":"172.21.15.132:6819/2494780358","state":["exists","up"]},{"osd":2,"uuid":"e5dbd6b4-4e7b-47e4-ad4e-35b4b81696c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6825","nonce":27655483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6827","nonce":27655483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6831","nonce":27655483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6829","nonce":27655483}]},"public_addr":"172.21.15.132:6825/27655483","cluster_addr":"172.21.15.132:6827/27655483","heartbeat_back_addr":"172.21.15.132:6831/27655483","heartbeat_front_addr":"172.21.15.132:6829/27655483","state":["exists","up"]},{"osd":3,"uuid":"9d75cd67-3b8a-4424-8884-5f3660e1f5f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6810","nonce":3100919191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6814","nonce":3100919191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6821","nonce":3100919191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6818","nonce":3100919191}]},"public_addr":"172.21.15.132:6810/3100919191","cluster_addr":"172.21.15.132:6814/3100919191","heartbeat_back_addr":"172.21.15.132:6821/3100919191","heartbeat_front_addr":"172.21.15.132:6818/3100919191","state":["exists","up"]},{"osd":4,"uuid":"83aea46a-8642-4777-912b-c130e5890da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6825","nonce":123637799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6827","nonce":123637799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6831","nonce":123637799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6829","nonce":123637799}]},"public_addr":"172.21.15.179:6825/123637799","cluster_addr":"172.21.15.179:6827/123637799","heartbeat_back_addr":"172.21.15.179:6831/123637799","heartbeat_front_addr":"172.21.15.179:6829/123637799","state":["exists","up"]},{"osd":5,"uuid":"534117c8-3317-48d6-b436-afd5709f71e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6801","nonce":2224750370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6803","nonce":2224750370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6807","nonce":2224750370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6805","nonce":2224750370}]},"public_addr":"172.21.15.179:6801/2224750370","cluster_addr":"172.21.15.179:6803/2224750370","heartbeat_back_addr":"172.21.15.179:6807/2224750370","heartbeat_front_addr":"172.21.15.179:6805/2224750370","state":["exists","up"]},{"osd":6,"uuid":"0ba363e7-fa9d-42b1-ae09-a6a0f57d41f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6809","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6811","nonce":101498164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6813","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6815","nonce":101498164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6823","nonce":101498164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6819","nonce":101498164}]},"public_addr":"172.21.15.179:6811/101498164","cluster_addr":"172.21.15.179:6815/101498164","heartbeat_back_addr":"172.21.15.179:6823/101498164","heartbeat_front_addr":"172.21.15.179:6819/101498164","state":["exists","up"]},{"osd":7,"uuid":"e6830c77-2f2d-4067-9866-ee7625afc1a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6810","nonce":872148365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6814","nonce":872148365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6822","nonce":872148365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6818","nonce":872148365}]},"public_addr":"172.21.15.179:6810/872148365","cluster_addr":"172.21.15.179:6814/872148365","heartbeat_back_addr":"172.21.15.179:6822/872148365","heartbeat_front_addr":"172.21.15.179:6818/872148365","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.535221+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.563769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.520765+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.526264+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.517058+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.500842+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.534332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.512486+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:52:42.576 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.577+0000 7fd1ec09a640 1 -- 172.21.15.132:0/3245963666 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fd1c806c8f0 msgr2=0x7fd1c806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:42.576 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.577+0000 7fd1ec09a640 1 --2- 172.21.15.132:0/3245963666 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fd1c806c8f0 0x7fd1c806edb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd1e4156db0 tx=0x7fd1e0000fa0 comp rx=0 tx=0).stop 2024-04-16T15:52:42.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.577+0000 7fd1ec09a640 1 -- 172.21.15.132:0/3245963666 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1e41f0e00 msgr2=0x7fd1e41f1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:42.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.577+0000 7fd1ec09a640 1 --2- 172.21.15.132:0/3245963666 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1e41f0e00 0x7fd1e41f1280 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4000c00 tx=0x7fd1d4004730 comp rx=0 tx=0).stop 2024-04-16T15:52:42.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.577+0000 7fd1ec09a640 1 -- 172.21.15.132:0/3245963666 shutdown_connections 2024-04-16T15:52:42.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.577+0000 7fd1ec09a640 1 --2- 172.21.15.132:0/3245963666 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fd1c806c8f0 0x7fd1c806edb0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:42.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.577+0000 7fd1ec09a640 1 --2- 172.21.15.132:0/3245963666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1e413c3f0 0x7fd1e413c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:42.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.577+0000 7fd1ec09a640 1 --2- 172.21.15.132:0/3245963666 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1e41f0e00 0x7fd1e41f1280 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:42.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.577+0000 7fd1ec09a640 1 --2- 172.21.15.132:0/3245963666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1d0003f20 0x7fd1e413abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:42.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.577+0000 7fd1ec09a640 1 -- 172.21.15.132:0/3245963666 >> 172.21.15.132:0/3245963666 conn(0x7fd1e409aa30 msgr2=0x7fd1e406f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:42.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.577+0000 7fd1ec09a640 1 -- 172.21.15.132:0/3245963666 shutdown_connections 2024-04-16T15:52:42.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.577+0000 7fd1ec09a640 1 -- 172.21.15.132:0/3245963666 wait complete. 2024-04-16T15:52:42.588 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T15:52:03.284927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T15:52:13.363758+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T15:52:14.246647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T15:52:42.589 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T15:52:42.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.696+0000 7f1b1800c640 1 Processor -- start 2024-04-16T15:52:42.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.696+0000 7f1b1800c640 1 -- start start 2024-04-16T15:52:42.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.697+0000 7f1b1800c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1b1015ea80 0x7f1b1006d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:42.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.697+0000 7f1b1800c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1b100b6410 0x7f1b100b68a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:42.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.697+0000 7f1b1800c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b101625f0 0x7f1b10162a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:42.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.697+0000 7f1b1800c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f1b100cfdb0 con 0x7f1b100b6410 2024-04-16T15:52:42.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.697+0000 7f1b1800c640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f1b100d2b90 con 0x7f1b1015ea80 2024-04-16T15:52:42.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.697+0000 7f1b1800c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1b100d2e70 con 0x7f1b101625f0 2024-04-16T15:52:42.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.697+0000 7f1b155a7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1b100b6410 0x7f1b100b68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:42.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.697+0000 7f1b155a7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1b100b6410 0x7f1b100b68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53374/0 (socket says 172.21.15.132:53374) 2024-04-16T15:52:42.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.697+0000 7f1b155a7640 1 -- 172.21.15.132:0/2255742511 learned_addr learned my addr 172.21.15.132:0/2255742511 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:42.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.697+0000 7f1b165a9640 1 --2- 172.21.15.132:0/2255742511 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b101625f0 0x7f1b10162a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:42.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.697+0000 7f1b15da8640 1 --2- 172.21.15.132:0/2255742511 >> v2:172.21.15.179:3300/0 conn(0x7f1b1015ea80 0x7f1b1006d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:42.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.697+0000 7f1b155a7640 1 -- 172.21.15.132:0/2255742511 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b101625f0 msgr2=0x7f1b10162a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:42.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.697+0000 7f1b155a7640 1 --2- 172.21.15.132:0/2255742511 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b101625f0 0x7f1b10162a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:42.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.697+0000 7f1b155a7640 1 -- 172.21.15.132:0/2255742511 >> v2:172.21.15.179:3300/0 conn(0x7f1b1015ea80 msgr2=0x7f1b1006d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:42.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.697+0000 7f1b155a7640 1 --2- 172.21.15.132:0/2255742511 >> v2:172.21.15.179:3300/0 conn(0x7f1b1015ea80 0x7f1b1006d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:42.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.698+0000 7f1b155a7640 1 -- 172.21.15.132:0/2255742511 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b100d3150 con 0x7f1b100b6410 2024-04-16T15:52:42.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.698+0000 7f1b155a7640 1 --2- 172.21.15.132:0/2255742511 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b100b6410 0x7f1b100b68a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1b100d2510 tx=0x7f1b0002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8b24de8816c3f88 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:42.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.698+0000 7f1b14da6640 1 -- 172.21.15.132:0/2255742511 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b00035020 con 0x7f1b100b6410 2024-04-16T15:52:42.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.698+0000 7f1b14da6640 1 -- 172.21.15.132:0/2255742511 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b00031870 con 0x7f1b100b6410 2024-04-16T15:52:42.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.698+0000 7f1b14da6640 1 -- 172.21.15.132:0/2255742511 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b00031c40 con 0x7f1b100b6410 2024-04-16T15:52:42.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.699+0000 7f1b1800c640 1 -- 172.21.15.132:0/2255742511 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b100b6410 msgr2=0x7f1b100b68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:42.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.699+0000 7f1b1800c640 1 --2- 172.21.15.132:0/2255742511 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b100b6410 0x7f1b100b68a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1b100d2510 tx=0x7f1b0002b910 comp rx=0 tx=0).stop 2024-04-16T15:52:42.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.699+0000 7f1b1800c640 1 -- 172.21.15.132:0/2255742511 shutdown_connections 2024-04-16T15:52:42.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.699+0000 7f1b1800c640 1 --2- 172.21.15.132:0/2255742511 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b101625f0 0x7f1b10162a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:42.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.699+0000 7f1b1800c640 1 --2- 172.21.15.132:0/2255742511 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b100b6410 0x7f1b100b68a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:42.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.699+0000 7f1b1800c640 1 --2- 172.21.15.132:0/2255742511 >> v2:172.21.15.179:3300/0 conn(0x7f1b1015ea80 0x7f1b1006d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:42.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.699+0000 7f1b1800c640 1 -- 172.21.15.132:0/2255742511 >> 172.21.15.132:0/2255742511 conn(0x7f1b100d1410 msgr2=0x7f1b100d1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:42.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.699+0000 7f1b1800c640 1 -- 172.21.15.132:0/2255742511 shutdown_connections 2024-04-16T15:52:42.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.699+0000 7f1b1800c640 1 -- 172.21.15.132:0/2255742511 wait complete. 2024-04-16T15:52:42.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.700+0000 7f1b1800c640 1 Processor -- start 2024-04-16T15:52:42.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.700+0000 7f1b1800c640 1 -- start start 2024-04-16T15:52:42.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.701+0000 7f1b1800c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b100b6410 0x7f1b1015f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:42.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.701+0000 7f1b1800c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b1015ea80 0x7f1b10152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:42.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.701+0000 7f1b1800c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b101625f0 0x7f1b10150090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:42.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.701+0000 7f1b1800c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f1b100cf9d0 con 0x7f1b101625f0 2024-04-16T15:52:42.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.701+0000 7f1b1800c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1b100d0090 con 0x7f1b1015ea80 2024-04-16T15:52:42.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.701+0000 7f1b1800c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1b100cfb50 con 0x7f1b100b6410 2024-04-16T15:52:42.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.701+0000 7f1b165a9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b101625f0 0x7f1b10150090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:42.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.701+0000 7f1b165a9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b101625f0 0x7f1b10150090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53384/0 (socket says 172.21.15.132:53384) 2024-04-16T15:52:42.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.701+0000 7f1b165a9640 1 -- 172.21.15.132:0/3320809278 learned_addr learned my addr 172.21.15.132:0/3320809278 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:42.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.701+0000 7f1b15da8640 1 --2- 172.21.15.132:0/3320809278 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b100b6410 0x7f1b1015f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:42.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.701+0000 7f1b155a7640 1 --2- 172.21.15.132:0/3320809278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b1015ea80 0x7f1b10152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:42.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.701+0000 7f1b165a9640 1 -- 172.21.15.132:0/3320809278 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b100b6410 msgr2=0x7f1b1015f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:42.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.701+0000 7f1b165a9640 1 --2- 172.21.15.132:0/3320809278 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b100b6410 0x7f1b1015f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:42.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.701+0000 7f1b165a9640 1 -- 172.21.15.132:0/3320809278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b1015ea80 msgr2=0x7f1b10152ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:42.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.701+0000 7f1b165a9640 1 --2- 172.21.15.132:0/3320809278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b1015ea80 0x7f1b10152ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:42.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.701+0000 7f1b165a9640 1 -- 172.21.15.132:0/3320809278 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b1015f700 con 0x7f1b101625f0 2024-04-16T15:52:42.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.701+0000 7f1b165a9640 1 --2- 172.21.15.132:0/3320809278 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b101625f0 0x7f1b10150090 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1b0800d800 tx=0x7f1b0800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:42.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.702+0000 7f1b067fc640 1 -- 172.21.15.132:0/3320809278 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b0800b6c0 con 0x7f1b101625f0 2024-04-16T15:52:42.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.702+0000 7f1b067fc640 1 -- 172.21.15.132:0/3320809278 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b08019070 con 0x7f1b101625f0 2024-04-16T15:52:42.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.702+0000 7f1b067fc640 1 -- 172.21.15.132:0/3320809278 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b0800bac0 con 0x7f1b101625f0 2024-04-16T15:52:42.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.702+0000 7f1b1800c640 1 -- 172.21.15.132:0/3320809278 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b1015f9e0 con 0x7f1b101625f0 2024-04-16T15:52:42.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.702+0000 7f1b1800c640 1 -- 172.21.15.132:0/3320809278 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b1015ffa0 con 0x7f1b101625f0 2024-04-16T15:52:42.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.703+0000 7f1b1800c640 1 -- 172.21.15.132:0/3320809278 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b10075510 con 0x7f1b101625f0 2024-04-16T15:52:42.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.703+0000 7f1b067fc640 1 -- 172.21.15.132:0/3320809278 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1b0800bc60 con 0x7f1b101625f0 2024-04-16T15:52:42.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.704+0000 7f1b067fc640 1 --2- 172.21.15.132:0/3320809278 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f1af406c8f0 0x7f1af406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:42.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.704+0000 7f1b067fc640 1 -- 172.21.15.132:0/3320809278 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1b0808bfc0 con 0x7f1b101625f0 2024-04-16T15:52:42.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.704+0000 7f1b15da8640 1 --2- 172.21.15.132:0/3320809278 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f1af406c8f0 0x7f1af406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:42.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.704+0000 7f1b15da8640 1 --2- 172.21.15.132:0/3320809278 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f1af406c8f0 0x7f1af406edb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c004410 tx=0x7f1b0c0039f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:42.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.708+0000 7f1b067fc640 1 -- 172.21.15.132:0/3320809278 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1b0805a3e0 con 0x7f1b101625f0 2024-04-16T15:52:42.883 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.883+0000 7f1b1800c640 1 -- 172.21.15.132:0/3320809278 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1b100b38a0 con 0x7f1b101625f0 2024-04-16T15:52:42.883 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.884+0000 7f1b067fc640 1 -- 172.21.15.132:0/3320809278 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f1b08059ce0 con 0x7f1b101625f0 2024-04-16T15:52:42.883 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2024-04-16T15:52:42.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.886+0000 7f1b1800c640 1 -- 172.21.15.132:0/3320809278 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f1af406c8f0 msgr2=0x7f1af406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:42.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.886+0000 7f1b1800c640 1 --2- 172.21.15.132:0/3320809278 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f1af406c8f0 0x7f1af406edb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c004410 tx=0x7f1b0c0039f0 comp rx=0 tx=0).stop 2024-04-16T15:52:42.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.886+0000 7f1b1800c640 1 -- 172.21.15.132:0/3320809278 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b101625f0 msgr2=0x7f1b10150090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:42.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.886+0000 7f1b1800c640 1 --2- 172.21.15.132:0/3320809278 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b101625f0 0x7f1b10150090 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1b0800d800 tx=0x7f1b0800dcc0 comp rx=0 tx=0).stop 2024-04-16T15:52:42.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.886+0000 7f1b1800c640 1 -- 172.21.15.132:0/3320809278 shutdown_connections 2024-04-16T15:52:42.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.886+0000 7f1b1800c640 1 --2- 172.21.15.132:0/3320809278 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f1af406c8f0 0x7f1af406edb0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:42.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.886+0000 7f1b1800c640 1 --2- 172.21.15.132:0/3320809278 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b101625f0 0x7f1b10150090 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:42.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.886+0000 7f1b1800c640 1 --2- 172.21.15.132:0/3320809278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b1015ea80 0x7f1b10152ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:42.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.886+0000 7f1b1800c640 1 --2- 172.21.15.132:0/3320809278 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b100b6410 0x7f1b1015f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:42.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.886+0000 7f1b1800c640 1 -- 172.21.15.132:0/3320809278 >> 172.21.15.132:0/3320809278 conn(0x7f1b100d1410 msgr2=0x7f1b100b7e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:42.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.886+0000 7f1b1800c640 1 -- 172.21.15.132:0/3320809278 shutdown_connections 2024-04-16T15:52:42.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:42.886+0000 7f1b1800c640 1 -- 172.21.15.132:0/3320809278 wait complete. 2024-04-16T15:52:42.896 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T15:52:43.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.002+0000 7f280ed67640 1 Processor -- start 2024-04-16T15:52:43.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.002+0000 7f280ed67640 1 -- start start 2024-04-16T15:52:43.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.003+0000 7f280ed67640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f28080d1920 0x7f28080d1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:43.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.003+0000 7f280ed67640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28080d3850 con 0x7f280815ec20 2024-04-16T15:52:43.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.003+0000 7f280ed67640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28080d3b30 con 0x7f28080b7bb0 2024-04-16T15:52:43.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.003+0000 7f280ed67640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f28080d22c0 con 0x7f28080d1920 2024-04-16T15:52:43.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.003+0000 7f2807fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f28080d1920 0x7f28080d1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:43.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.003+0000 7f280cb03640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f280815ec20 0x7f28080d2e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:35262/0 (socket says 172.21.15.132:35262) 2024-04-16T15:52:43.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.003+0000 7f280cb03640 1 -- 172.21.15.132:0/2570804877 learned_addr learned my addr 172.21.15.132:0/2570804877 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:43.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.003+0000 7f2807fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f28080d1920 0x7f28080d1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53398/0 (socket says 172.21.15.132:53398) 2024-04-16T15:52:43.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.004+0000 7f2807fff640 1 -- 172.21.15.132:0/2570804877 >> v1:172.21.15.179:6789/0 conn(0x7f28080b7bb0 legacy=0x7f28080b8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:43.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.004+0000 7f2807fff640 1 -- 172.21.15.132:0/2570804877 >> v1:172.21.15.132:6789/0 conn(0x7f280815ec20 legacy=0x7f28080d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:43.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.004+0000 7f2807fff640 1 -- 172.21.15.132:0/2570804877 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28080d3e10 con 0x7f28080d1920 2024-04-16T15:52:43.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.004+0000 7f2807fff640 1 --2- 172.21.15.132:0/2570804877 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f28080d1920 0x7f28080d1d80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f27fc0097a0 tx=0x7f27fc02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e8e976cccb6fab1 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:43.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.005+0000 7f28077fe640 1 -- 172.21.15.132:0/2570804877 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27fc034070 con 0x7f28080d1920 2024-04-16T15:52:43.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.005+0000 7f28077fe640 1 -- 172.21.15.132:0/2570804877 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27fc030610 con 0x7f28080d1920 2024-04-16T15:52:43.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.005+0000 7f28077fe640 1 -- 172.21.15.132:0/2570804877 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27fc0309e0 con 0x7f28080d1920 2024-04-16T15:52:43.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.005+0000 7f280ed67640 1 -- 172.21.15.132:0/2570804877 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f28080d1920 msgr2=0x7f28080d1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:43.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.005+0000 7f280ed67640 1 --2- 172.21.15.132:0/2570804877 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f28080d1920 0x7f28080d1d80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f27fc0097a0 tx=0x7f27fc02b960 comp rx=0 tx=0).stop 2024-04-16T15:52:43.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.005+0000 7f280ed67640 1 -- 172.21.15.132:0/2570804877 shutdown_connections 2024-04-16T15:52:43.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.005+0000 7f280ed67640 1 --2- 172.21.15.132:0/2570804877 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f28080d1920 0x7f28080d1d80 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:43.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.005+0000 7f280ed67640 1 -- 172.21.15.132:0/2570804877 >> 172.21.15.132:0/2570804877 conn(0x7f280806d2d0 msgr2=0x7f280806d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:43.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.005+0000 7f280ed67640 1 -- 172.21.15.132:0/2570804877 shutdown_connections 2024-04-16T15:52:43.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.005+0000 7f280ed67640 1 -- 172.21.15.132:0/2570804877 wait complete. 2024-04-16T15:52:43.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.006+0000 7f280ed67640 1 Processor -- start 2024-04-16T15:52:43.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.006+0000 7f280ed67640 1 -- start start 2024-04-16T15:52:43.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.007+0000 7f280ed67640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28080b7bb0 0x7f28080cba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:43.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.007+0000 7f280ed67640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28080d1920 0x7f28081f89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:43.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.007+0000 7f280ed67640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f280815ec20 0x7f28081529b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:43.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.007+0000 7f280ed67640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f28080d3510 con 0x7f280815ec20 2024-04-16T15:52:43.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.007+0000 7f280ed67640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f28080d43d0 con 0x7f28080b7bb0 2024-04-16T15:52:43.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.007+0000 7f280ed67640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f280815f000 con 0x7f28080d1920 2024-04-16T15:52:43.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.007+0000 7f280d304640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f280815ec20 0x7f28081529b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:43.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.007+0000 7f280d304640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f280815ec20 0x7f28081529b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53408/0 (socket says 172.21.15.132:53408) 2024-04-16T15:52:43.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.007+0000 7f280d304640 1 -- 172.21.15.132:0/111815048 learned_addr learned my addr 172.21.15.132:0/111815048 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:43.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.008+0000 7f2807fff640 1 --2- 172.21.15.132:0/111815048 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28080d1920 0x7f28081f89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:43.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.008+0000 7f280d304640 1 -- 172.21.15.132:0/111815048 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28080d1920 msgr2=0x7f28081f89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:43.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.008+0000 7f280d304640 1 --2- 172.21.15.132:0/111815048 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28080d1920 0x7f28081f89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:43.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.008+0000 7f280cb03640 1 --2- 172.21.15.132:0/111815048 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28080b7bb0 0x7f28080cba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:43.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.008+0000 7f280d304640 1 -- 172.21.15.132:0/111815048 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28080b7bb0 msgr2=0x7f28080cba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:43.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.008+0000 7f280d304640 1 --2- 172.21.15.132:0/111815048 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28080b7bb0 0x7f28080cba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:43.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.008+0000 7f280d304640 1 -- 172.21.15.132:0/111815048 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28081f4f80 con 0x7f280815ec20 2024-04-16T15:52:43.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.008+0000 7f280cb03640 1 --2- 172.21.15.132:0/111815048 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28080b7bb0 0x7f28080cba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:52:43.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.008+0000 7f280d304640 1 --2- 172.21.15.132:0/111815048 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f280815ec20 0x7f28081529b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f280000b490 tx=0x7f280000b950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:43.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.008+0000 7f28057fa640 1 -- 172.21.15.132:0/111815048 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2800015020 con 0x7f280815ec20 2024-04-16T15:52:43.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.008+0000 7f28057fa640 1 -- 172.21.15.132:0/111815048 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2800011850 con 0x7f280815ec20 2024-04-16T15:52:43.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.008+0000 7f28057fa640 1 -- 172.21.15.132:0/111815048 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2800011c40 con 0x7f280815ec20 2024-04-16T15:52:43.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.008+0000 7f280ed67640 1 -- 172.21.15.132:0/111815048 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28081f5260 con 0x7f280815ec20 2024-04-16T15:52:43.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.008+0000 7f280ed67640 1 -- 172.21.15.132:0/111815048 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28081f5820 con 0x7f280815ec20 2024-04-16T15:52:43.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.009+0000 7f280ed67640 1 -- 172.21.15.132:0/111815048 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2808075510 con 0x7f280815ec20 2024-04-16T15:52:43.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.009+0000 7f28057fa640 1 -- 172.21.15.132:0/111815048 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2800018020 con 0x7f280815ec20 2024-04-16T15:52:43.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.010+0000 7f28057fa640 1 --2- 172.21.15.132:0/111815048 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f27f406c8f0 0x7f27f406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:43.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.010+0000 7f280cb03640 1 --2- 172.21.15.132:0/111815048 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f27f406c8f0 0x7f27f406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:43.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.010+0000 7f28057fa640 1 -- 172.21.15.132:0/111815048 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f280008b9b0 con 0x7f280815ec20 2024-04-16T15:52:43.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.010+0000 7f280cb03640 1 --2- 172.21.15.132:0/111815048 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f27f406c8f0 0x7f27f406edb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f28080caf40 tx=0x7f27f8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:43.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.015+0000 7f28057fa640 1 -- 172.21.15.132:0/111815048 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f280001f020 con 0x7f280815ec20 2024-04-16T15:52:43.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.190+0000 7f280ed67640 1 -- 172.21.15.132:0/111815048 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f28080d0690 con 0x7f280815ec20 2024-04-16T15:52:43.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.190+0000 7f28057fa640 1 -- 172.21.15.132:0/111815048 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f28000172c0 con 0x7f280815ec20 2024-04-16T15:52:43.190 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2024-04-16T15:52:43.192 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.192+0000 7f280ed67640 1 -- 172.21.15.132:0/111815048 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f27f406c8f0 msgr2=0x7f27f406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:43.192 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.192+0000 7f280ed67640 1 --2- 172.21.15.132:0/111815048 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f27f406c8f0 0x7f27f406edb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f28080caf40 tx=0x7f27f8009040 comp rx=0 tx=0).stop 2024-04-16T15:52:43.192 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.192+0000 7f280ed67640 1 -- 172.21.15.132:0/111815048 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f280815ec20 msgr2=0x7f28081529b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:43.192 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.192+0000 7f280ed67640 1 --2- 172.21.15.132:0/111815048 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f280815ec20 0x7f28081529b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f280000b490 tx=0x7f280000b950 comp rx=0 tx=0).stop 2024-04-16T15:52:43.192 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.192+0000 7f280ed67640 1 -- 172.21.15.132:0/111815048 shutdown_connections 2024-04-16T15:52:43.192 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.192+0000 7f280ed67640 1 --2- 172.21.15.132:0/111815048 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f27f406c8f0 0x7f27f406edb0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:43.192 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.192+0000 7f280ed67640 1 --2- 172.21.15.132:0/111815048 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f280815ec20 0x7f28081529b0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:43.192 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.192+0000 7f280ed67640 1 --2- 172.21.15.132:0/111815048 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28080d1920 0x7f28081f89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:43.193 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.192+0000 7f280ed67640 1 --2- 172.21.15.132:0/111815048 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28080b7bb0 0x7f28080cba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:43.193 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.192+0000 7f280ed67640 1 -- 172.21.15.132:0/111815048 >> 172.21.15.132:0/111815048 conn(0x7f280806d2d0 msgr2=0x7f280806d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:43.193 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.193+0000 7f280ed67640 1 -- 172.21.15.132:0/111815048 shutdown_connections 2024-04-16T15:52:43.193 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.193+0000 7f280ed67640 1 -- 172.21.15.132:0/111815048 wait complete. 2024-04-16T15:52:43.203 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T15:52:43.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.311+0000 7f5e260d3640 1 Processor -- start 2024-04-16T15:52:43.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.311+0000 7f5e260d3640 1 -- start start 2024-04-16T15:52:43.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.311+0000 7f5e260d3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e2015b830 0x7f5e200b4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:43.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.312+0000 7f5e260d3640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5e20073590 0x7f5e20073a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:43.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.312+0000 7f5e260d3640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e200b5980 con 0x7f5e200b0df0 2024-04-16T15:52:43.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.312+0000 7f5e260d3640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f5e200b4eb0 con 0x7f5e20073590 2024-04-16T15:52:43.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.312+0000 7f5e260d3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f5e200b5190 con 0x7f5e2015b830 2024-04-16T15:52:43.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.312+0000 7f5e1ffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5e20073590 0x7f5e20073a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:43.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.312+0000 7f5e1effd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f5e200b0df0 0x7f5e200b6160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:35270/0 (socket says 172.21.15.132:35270) 2024-04-16T15:52:43.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.312+0000 7f5e1ffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5e20073590 0x7f5e20073a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53410/0 (socket says 172.21.15.132:53410) 2024-04-16T15:52:43.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.312+0000 7f5e1effd640 1 -- 172.21.15.132:0/783563094 learned_addr learned my addr 172.21.15.132:0/783563094 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:43.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.312+0000 7f5e1f7fe640 1 --2- 172.21.15.132:0/783563094 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e2015b830 0x7f5e200b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:43.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.312+0000 7f5e1ffff640 1 -- 172.21.15.132:0/783563094 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e2015b830 msgr2=0x7f5e200b4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:43.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.312+0000 7f5e1ffff640 1 --2- 172.21.15.132:0/783563094 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e2015b830 0x7f5e200b4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:43.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.312+0000 7f5e1ffff640 1 -- 172.21.15.132:0/783563094 >> v1:172.21.15.132:6789/0 conn(0x7f5e200b0df0 legacy=0x7f5e200b6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:43.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.312+0000 7f5e1e7fc640 1 -- 172.21.15.132:0/783563094 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1190561468 0 0) 0x7f5e200b5980 con 0x7f5e200b0df0 2024-04-16T15:52:43.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.312+0000 7f5e1ffff640 1 -- 172.21.15.132:0/783563094 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e200b5470 con 0x7f5e20073590 2024-04-16T15:52:43.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.312+0000 7f5e1f7fe640 1 --2- 172.21.15.132:0/783563094 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e2015b830 0x7f5e200b4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:43.313 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.313+0000 7f5e1ffff640 1 --2- 172.21.15.132:0/783563094 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5e20073590 0x7f5e20073a20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5e180097a0 tx=0x7f5e1802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4811072b8bc6096 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:43.313 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.313+0000 7f5e1e7fc640 1 -- 172.21.15.132:0/783563094 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e18035020 con 0x7f5e20073590 2024-04-16T15:52:43.313 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.313+0000 7f5e1e7fc640 1 -- 172.21.15.132:0/783563094 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e18031830 con 0x7f5e20073590 2024-04-16T15:52:43.313 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.313+0000 7f5e1e7fc640 1 -- 172.21.15.132:0/783563094 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e18031c00 con 0x7f5e20073590 2024-04-16T15:52:43.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.313+0000 7f5e260d3640 1 -- 172.21.15.132:0/783563094 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5e20073590 msgr2=0x7f5e20073a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:43.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.313+0000 7f5e260d3640 1 --2- 172.21.15.132:0/783563094 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5e20073590 0x7f5e20073a20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5e180097a0 tx=0x7f5e1802b8d0 comp rx=0 tx=0).stop 2024-04-16T15:52:43.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.313+0000 7f5e260d3640 1 -- 172.21.15.132:0/783563094 shutdown_connections 2024-04-16T15:52:43.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.313+0000 7f5e260d3640 1 --2- 172.21.15.132:0/783563094 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5e20073590 0x7f5e20073a20 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:43.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.313+0000 7f5e260d3640 1 --2- 172.21.15.132:0/783563094 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e2015b830 0x7f5e200b4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:43.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.313+0000 7f5e260d3640 1 -- 172.21.15.132:0/783563094 >> 172.21.15.132:0/783563094 conn(0x7f5e200b6b80 msgr2=0x7f5e200b6f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:43.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.314+0000 7f5e260d3640 1 -- 172.21.15.132:0/783563094 shutdown_connections 2024-04-16T15:52:43.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.314+0000 7f5e260d3640 1 -- 172.21.15.132:0/783563094 wait complete. 2024-04-16T15:52:43.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.315+0000 7f5e260d3640 1 Processor -- start 2024-04-16T15:52:43.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.315+0000 7f5e260d3640 1 -- start start 2024-04-16T15:52:43.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.315+0000 7f5e260d3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5e20073590 0x7f5e2014fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:43.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.315+0000 7f5e260d3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e200b0df0 0x7f5e2014df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:43.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.316+0000 7f5e260d3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e2015b830 0x7f5e20151660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:43.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.316+0000 7f5e260d3640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f5e200b6870 con 0x7f5e20073590 2024-04-16T15:52:43.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.316+0000 7f5e260d3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5e200b4ba0 con 0x7f5e200b0df0 2024-04-16T15:52:43.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.316+0000 7f5e260d3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f5e200cf4d0 con 0x7f5e2015b830 2024-04-16T15:52:43.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.316+0000 7f5e1f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5e20073590 0x7f5e2014fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:43.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.316+0000 7f5e1f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5e20073590 0x7f5e2014fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53426/0 (socket says 172.21.15.132:53426) 2024-04-16T15:52:43.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.316+0000 7f5e1f7fe640 1 -- 172.21.15.132:0/2746927765 learned_addr learned my addr 172.21.15.132:0/2746927765 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:43.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.316+0000 7f5e1ffff640 1 --2- 172.21.15.132:0/2746927765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e2015b830 0x7f5e20151660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:43.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.316+0000 7f5e1effd640 1 --2- 172.21.15.132:0/2746927765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e200b0df0 0x7f5e2014df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:43.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.316+0000 7f5e1f7fe640 1 -- 172.21.15.132:0/2746927765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e2015b830 msgr2=0x7f5e20151660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:43.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.316+0000 7f5e1f7fe640 1 --2- 172.21.15.132:0/2746927765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e2015b830 0x7f5e20151660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:43.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.316+0000 7f5e1f7fe640 1 -- 172.21.15.132:0/2746927765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e200b0df0 msgr2=0x7f5e2014df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:43.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.316+0000 7f5e1f7fe640 1 --2- 172.21.15.132:0/2746927765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e200b0df0 0x7f5e2014df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:43.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.316+0000 7f5e1f7fe640 1 -- 172.21.15.132:0/2746927765 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e20150120 con 0x7f5e20073590 2024-04-16T15:52:43.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.316+0000 7f5e1ffff640 1 --2- 172.21.15.132:0/2746927765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e2015b830 0x7f5e20151660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:52:43.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.316+0000 7f5e1effd640 1 --2- 172.21.15.132:0/2746927765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e200b0df0 0x7f5e2014df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:52:43.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.316+0000 7f5e1f7fe640 1 --2- 172.21.15.132:0/2746927765 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5e20073590 0x7f5e2014fbe0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5e10007ef0 tx=0x7f5e1000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:43.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.316+0000 7f5e17fff640 1 -- 172.21.15.132:0/2746927765 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e1001a070 con 0x7f5e20073590 2024-04-16T15:52:43.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.316+0000 7f5e17fff640 1 -- 172.21.15.132:0/2746927765 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e10003b90 con 0x7f5e20073590 2024-04-16T15:52:43.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.316+0000 7f5e260d3640 1 -- 172.21.15.132:0/2746927765 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e201532a0 con 0x7f5e20073590 2024-04-16T15:52:43.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.316+0000 7f5e17fff640 1 -- 172.21.15.132:0/2746927765 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e10004030 con 0x7f5e20073590 2024-04-16T15:52:43.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.316+0000 7f5e260d3640 1 -- 172.21.15.132:0/2746927765 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e2014f3e0 con 0x7f5e20073590 2024-04-16T15:52:43.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.317+0000 7f5e260d3640 1 -- 172.21.15.132:0/2746927765 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e20075510 con 0x7f5e20073590 2024-04-16T15:52:43.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.318+0000 7f5e17fff640 1 -- 172.21.15.132:0/2746927765 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5e1001d070 con 0x7f5e20073590 2024-04-16T15:52:43.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.318+0000 7f5e17fff640 1 --2- 172.21.15.132:0/2746927765 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f5e0006c8f0 0x7f5e0006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:43.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.318+0000 7f5e17fff640 1 -- 172.21.15.132:0/2746927765 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5e1008bca0 con 0x7f5e20073590 2024-04-16T15:52:43.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.318+0000 7f5e1effd640 1 --2- 172.21.15.132:0/2746927765 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f5e0006c8f0 0x7f5e0006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:43.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.319+0000 7f5e1effd640 1 --2- 172.21.15.132:0/2746927765 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f5e0006c8f0 0x7f5e0006edb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5e200732c0 tx=0x7f5e08009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:43.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.322+0000 7f5e17fff640 1 -- 172.21.15.132:0/2746927765 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5e10010070 con 0x7f5e20073590 2024-04-16T15:52:43.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.500+0000 7f5e260d3640 1 -- 172.21.15.132:0/2746927765 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f5e200ce360 con 0x7f5e20073590 2024-04-16T15:52:43.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.500+0000 7f5e17fff640 1 -- 172.21.15.132:0/2746927765 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f5e10059a80 con 0x7f5e20073590 2024-04-16T15:52:43.502 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2024-04-16T15:52:43.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.502+0000 7f5e260d3640 1 -- 172.21.15.132:0/2746927765 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f5e0006c8f0 msgr2=0x7f5e0006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:43.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.502+0000 7f5e260d3640 1 --2- 172.21.15.132:0/2746927765 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f5e0006c8f0 0x7f5e0006edb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5e200732c0 tx=0x7f5e08009040 comp rx=0 tx=0).stop 2024-04-16T15:52:43.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.502+0000 7f5e260d3640 1 -- 172.21.15.132:0/2746927765 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5e20073590 msgr2=0x7f5e2014fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:43.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.502+0000 7f5e260d3640 1 --2- 172.21.15.132:0/2746927765 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5e20073590 0x7f5e2014fbe0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5e10007ef0 tx=0x7f5e1000d4a0 comp rx=0 tx=0).stop 2024-04-16T15:52:43.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.502+0000 7f5e260d3640 1 -- 172.21.15.132:0/2746927765 shutdown_connections 2024-04-16T15:52:43.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.502+0000 7f5e260d3640 1 --2- 172.21.15.132:0/2746927765 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f5e0006c8f0 0x7f5e0006edb0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:43.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.502+0000 7f5e260d3640 1 --2- 172.21.15.132:0/2746927765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e2015b830 0x7f5e20151660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:43.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.502+0000 7f5e260d3640 1 --2- 172.21.15.132:0/2746927765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e200b0df0 0x7f5e2014df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:43.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.502+0000 7f5e260d3640 1 --2- 172.21.15.132:0/2746927765 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5e20073590 0x7f5e2014fbe0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:43.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.502+0000 7f5e260d3640 1 -- 172.21.15.132:0/2746927765 >> 172.21.15.132:0/2746927765 conn(0x7f5e200b6b80 msgr2=0x7f5e20074d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:43.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.502+0000 7f5e260d3640 1 -- 172.21.15.132:0/2746927765 shutdown_connections 2024-04-16T15:52:43.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.502+0000 7f5e260d3640 1 -- 172.21.15.132:0/2746927765 wait complete. 2024-04-16T15:52:43.512 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_data_scan.TestDataScan.test_extra_data_pool_rebuild_few_files' 2024-04-16T15:52:43.615 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.616+0000 7f766c414640 1 Processor -- start 2024-04-16T15:52:43.615 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.616+0000 7f766c414640 1 -- start start 2024-04-16T15:52:43.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.617+0000 7f766c414640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7664144f50 0x7f76640b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:43.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.617+0000 7f766c414640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76640cdd60 con 0x7f766406f4b0 2024-04-16T15:52:43.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.617+0000 7f766c414640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76640b3770 con 0x7f76640cd2a0 2024-04-16T15:52:43.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.617+0000 7f766c414640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f76640ce040 con 0x7f7664144f50 2024-04-16T15:52:43.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.617+0000 7f766a9b1640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f766406f4b0 0x7f76640b4c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:35280/0 (socket says 172.21.15.132:35280) 2024-04-16T15:52:43.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.617+0000 7f766a9b1640 1 -- 172.21.15.132:0/645297575 learned_addr learned my addr 172.21.15.132:0/645297575 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:43.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.617+0000 7f766a1b0640 1 --2- 172.21.15.132:0/645297575 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7664144f50 0x7f76640b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:43.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.617+0000 7f76691ae640 1 -- 172.21.15.132:0/645297575 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3070539637 0 0) 0x7f76640cdd60 con 0x7f766406f4b0 2024-04-16T15:52:43.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.618+0000 7f76691ae640 1 -- 172.21.15.132:0/645297575 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7650005730 con 0x7f766406f4b0 2024-04-16T15:52:43.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.618+0000 7f766a1b0640 1 -- 172.21.15.132:0/645297575 >> v1:172.21.15.179:6789/0 conn(0x7f76640cd2a0 legacy=0x7f766406eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:43.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.618+0000 7f76691ae640 1 -- 172.21.15.132:0/645297575 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2738112895 0 0) 0x7f76640b3770 con 0x7f76640cd2a0 2024-04-16T15:52:43.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.618+0000 7f766a1b0640 1 -- 172.21.15.132:0/645297575 >> v1:172.21.15.132:6789/0 conn(0x7f766406f4b0 legacy=0x7f76640b4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:43.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.618+0000 7f766a1b0640 1 -- 172.21.15.132:0/645297575 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76640b3a50 con 0x7f7664144f50 2024-04-16T15:52:43.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.618+0000 7f766a1b0640 1 --2- 172.21.15.132:0/645297575 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7664144f50 0x7f76640b4250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f76600097d0 tx=0x7f766002b690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bef6000f1526c40d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:43.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.619+0000 7f76691ae640 1 -- 172.21.15.132:0/645297575 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7660037070 con 0x7f7664144f50 2024-04-16T15:52:43.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.619+0000 7f76691ae640 1 -- 172.21.15.132:0/645297575 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7660030510 con 0x7f7664144f50 2024-04-16T15:52:43.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.619+0000 7f76691ae640 1 -- 172.21.15.132:0/645297575 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f765c001a10 con 0x7f7664144f50 2024-04-16T15:52:43.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.619+0000 7f766c414640 1 -- 172.21.15.132:0/645297575 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7664144f50 msgr2=0x7f76640b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:43.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.619+0000 7f766c414640 1 --2- 172.21.15.132:0/645297575 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7664144f50 0x7f76640b4250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f76600097d0 tx=0x7f766002b690 comp rx=0 tx=0).stop 2024-04-16T15:52:43.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.619+0000 7f766c414640 1 -- 172.21.15.132:0/645297575 shutdown_connections 2024-04-16T15:52:43.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.619+0000 7f766c414640 1 --2- 172.21.15.132:0/645297575 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7664144f50 0x7f76640b4250 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:43.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.619+0000 7f766c414640 1 -- 172.21.15.132:0/645297575 >> 172.21.15.132:0/645297575 conn(0x7f76640b2d50 msgr2=0x7f766406ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:43.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.619+0000 7f766c414640 1 -- 172.21.15.132:0/645297575 shutdown_connections 2024-04-16T15:52:43.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.619+0000 7f766c414640 1 -- 172.21.15.132:0/645297575 wait complete. 2024-04-16T15:52:43.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.620+0000 7f766c414640 1 Processor -- start 2024-04-16T15:52:43.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.621+0000 7f766c414640 1 -- start start 2024-04-16T15:52:43.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.621+0000 7f766c414640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f766406f4b0 0x7f766415ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:43.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.621+0000 7f766c414640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76640cd2a0 0x7f766413d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:43.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.621+0000 7f766c414640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7664144f50 0x7f76640aeb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:43.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.621+0000 7f766c414640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f7664145330 con 0x7f76640cd2a0 2024-04-16T15:52:43.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.621+0000 7f766c414640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f76640afda0 con 0x7f766406f4b0 2024-04-16T15:52:43.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.621+0000 7f766c414640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f76640cd700 con 0x7f7664144f50 2024-04-16T15:52:43.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.621+0000 7f76699af640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76640cd2a0 0x7f766413d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:43.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.621+0000 7f76699af640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76640cd2a0 0x7f766413d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53442/0 (socket says 172.21.15.132:53442) 2024-04-16T15:52:43.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.621+0000 7f76699af640 1 -- 172.21.15.132:0/3775040203 learned_addr learned my addr 172.21.15.132:0/3775040203 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:43.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.622+0000 7f766a9b1640 1 --2- 172.21.15.132:0/3775040203 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7664144f50 0x7f76640aeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:43.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.622+0000 7f766a1b0640 1 --2- 172.21.15.132:0/3775040203 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f766406f4b0 0x7f766415ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:43.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.622+0000 7f76699af640 1 -- 172.21.15.132:0/3775040203 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7664144f50 msgr2=0x7f76640aeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:43.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.622+0000 7f76699af640 1 --2- 172.21.15.132:0/3775040203 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7664144f50 0x7f76640aeb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:43.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.622+0000 7f76699af640 1 -- 172.21.15.132:0/3775040203 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f766406f4b0 msgr2=0x7f766415ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:43.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.622+0000 7f76699af640 1 --2- 172.21.15.132:0/3775040203 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f766406f4b0 0x7f766415ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:43.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.622+0000 7f76699af640 1 -- 172.21.15.132:0/3775040203 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f766415dbe0 con 0x7f76640cd2a0 2024-04-16T15:52:43.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.622+0000 7f766a9b1640 1 --2- 172.21.15.132:0/3775040203 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7664144f50 0x7f76640aeb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:52:43.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.622+0000 7f76699af640 1 --2- 172.21.15.132:0/3775040203 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76640cd2a0 0x7f766413d770 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f765400c4b0 tx=0x7f765400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:43.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.622+0000 7f765affd640 1 -- 172.21.15.132:0/3775040203 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7654017070 con 0x7f76640cd2a0 2024-04-16T15:52:43.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.622+0000 7f765affd640 1 -- 172.21.15.132:0/3775040203 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7654005480 con 0x7f76640cd2a0 2024-04-16T15:52:43.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.622+0000 7f766c414640 1 -- 172.21.15.132:0/3775040203 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f766415dec0 con 0x7f76640cd2a0 2024-04-16T15:52:43.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.622+0000 7f765affd640 1 -- 172.21.15.132:0/3775040203 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7654003830 con 0x7f76640cd2a0 2024-04-16T15:52:43.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.622+0000 7f766c414640 1 -- 172.21.15.132:0/3775040203 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f766415e480 con 0x7f76640cd2a0 2024-04-16T15:52:43.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.623+0000 7f766c414640 1 -- 172.21.15.132:0/3775040203 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7664075510 con 0x7f76640cd2a0 2024-04-16T15:52:43.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.623+0000 7f765affd640 1 -- 172.21.15.132:0/3775040203 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f765401a070 con 0x7f76640cd2a0 2024-04-16T15:52:43.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.624+0000 7f765affd640 1 --2- 172.21.15.132:0/3775040203 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f764806c8f0 0x7f764806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:43.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.624+0000 7f765affd640 1 -- 172.21.15.132:0/3775040203 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f765408ae60 con 0x7f76640cd2a0 2024-04-16T15:52:43.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.624+0000 7f766a1b0640 1 --2- 172.21.15.132:0/3775040203 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f764806c8f0 0x7f764806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:43.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.624+0000 7f766a1b0640 1 --2- 172.21.15.132:0/3775040203 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f764806c8f0 0x7f764806edb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7660034000 tx=0x7f7660008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:43.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.628+0000 7f765affd640 1 -- 172.21.15.132:0/3775040203 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7654059320 con 0x7f76640cd2a0 2024-04-16T15:52:43.871 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:43.872+0000 7f766c414640 1 -- 172.21.15.132:0/3775040203 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_data_scan.TestDataScan.test_extra_data_pool_rebuild_few_files"]} v 0) -- 0x7f76640b20b0 con 0x7f76640cd2a0 2024-04-16T15:52:44.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.105+0000 7f765affd640 1 -- 172.21.15.132:0/3775040203 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_data_scan.TestDataScan.test_extra_data_pool_rebuild_few_files"]}]=0 v52) ==== 161+0+0 (secure 0 0 0) 0x7f7654058c20 con 0x7f76640cd2a0 2024-04-16T15:52:44.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.107+0000 7f766c414640 1 -- 172.21.15.132:0/3775040203 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f764806c8f0 msgr2=0x7f764806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:44.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.107+0000 7f766c414640 1 --2- 172.21.15.132:0/3775040203 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f764806c8f0 0x7f764806edb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7660034000 tx=0x7f7660008030 comp rx=0 tx=0).stop 2024-04-16T15:52:44.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.107+0000 7f766c414640 1 -- 172.21.15.132:0/3775040203 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76640cd2a0 msgr2=0x7f766413d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:44.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.107+0000 7f766c414640 1 --2- 172.21.15.132:0/3775040203 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76640cd2a0 0x7f766413d770 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f765400c4b0 tx=0x7f765400c970 comp rx=0 tx=0).stop 2024-04-16T15:52:44.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.107+0000 7f766c414640 1 -- 172.21.15.132:0/3775040203 shutdown_connections 2024-04-16T15:52:44.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.107+0000 7f766c414640 1 --2- 172.21.15.132:0/3775040203 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f764806c8f0 0x7f764806edb0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:44.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.107+0000 7f766c414640 1 --2- 172.21.15.132:0/3775040203 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7664144f50 0x7f76640aeb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:44.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.107+0000 7f766c414640 1 --2- 172.21.15.132:0/3775040203 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76640cd2a0 0x7f766413d770 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:44.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.107+0000 7f766c414640 1 --2- 172.21.15.132:0/3775040203 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f766406f4b0 0x7f766415ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:44.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.107+0000 7f766c414640 1 -- 172.21.15.132:0/3775040203 >> 172.21.15.132:0/3775040203 conn(0x7f76640b2d50 msgr2=0x7f76640cf540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:44.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.107+0000 7f766c414640 1 -- 172.21.15.132:0/3775040203 shutdown_connections 2024-04-16T15:52:44.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.107+0000 7f766c414640 1 -- 172.21.15.132:0/3775040203 wait complete. 2024-04-16T15:52:44.117 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-16T15:52:44.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.224+0000 7f8d26c60640 1 Processor -- start 2024-04-16T15:52:44.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.224+0000 7f8d26c60640 1 -- start start 2024-04-16T15:52:44.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.225+0000 7f8d26c60640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d2015eda0 0x7f8d200d0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:44.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.225+0000 7f8d26c60640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8d2015f8a0 0x7f8d2009ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:44.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.225+0000 7f8d26c60640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d200d0ec0 con 0x7f8d2006d7f0 2024-04-16T15:52:44.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.225+0000 7f8d26c60640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f8d200d11a0 con 0x7f8d2015f8a0 2024-04-16T15:52:44.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.225+0000 7f8d26c60640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f8d200d1480 con 0x7f8d2015eda0 2024-04-16T15:52:44.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.225+0000 7f8d251fd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8d2015f8a0 0x7f8d2009ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:44.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.225+0000 7f8d251fd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8d2015f8a0 0x7f8d2009ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53446/0 (socket says 172.21.15.132:53446) 2024-04-16T15:52:44.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.225+0000 7f8d251fd640 1 -- 172.21.15.132:0/1178804857 learned_addr learned my addr 172.21.15.132:0/1178804857 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:44.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.225+0000 7f8d249fc640 1 --2- 172.21.15.132:0/1178804857 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d2015eda0 0x7f8d200d0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:44.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.225+0000 7f8d251fd640 1 -- 172.21.15.132:0/1178804857 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d2015eda0 msgr2=0x7f8d200d0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:44.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.226+0000 7f8d251fd640 1 --2- 172.21.15.132:0/1178804857 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d2015eda0 0x7f8d200d0840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:44.226 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.226+0000 7f8d251fd640 1 -- 172.21.15.132:0/1178804857 >> v1:172.21.15.179:6789/0 conn(0x7f8d2006d7f0 legacy=0x7f8d2015f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:44.226 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.226+0000 7f8d251fd640 1 -- 172.21.15.132:0/1178804857 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d200d1760 con 0x7f8d2015f8a0 2024-04-16T15:52:44.227 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.226+0000 7f8d251fd640 1 --2- 172.21.15.132:0/1178804857 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8d2015f8a0 0x7f8d2009ab30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8d18009e50 tx=0x7f8d1802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59a525896bf398cc server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:44.227 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.226+0000 7f8d1f7fe640 1 -- 172.21.15.132:0/1178804857 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d1802ca70 con 0x7f8d2015f8a0 2024-04-16T15:52:44.227 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.226+0000 7f8d1f7fe640 1 -- 172.21.15.132:0/1178804857 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d1802cc10 con 0x7f8d2015f8a0 2024-04-16T15:52:44.227 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.226+0000 7f8d1f7fe640 1 -- 172.21.15.132:0/1178804857 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d180343f0 con 0x7f8d2015f8a0 2024-04-16T15:52:44.227 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.227+0000 7f8d26c60640 1 -- 172.21.15.132:0/1178804857 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8d2015f8a0 msgr2=0x7f8d2009ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:44.227 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.227+0000 7f8d26c60640 1 --2- 172.21.15.132:0/1178804857 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8d2015f8a0 0x7f8d2009ab30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8d18009e50 tx=0x7f8d1802bed0 comp rx=0 tx=0).stop 2024-04-16T15:52:44.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.227+0000 7f8d26c60640 1 -- 172.21.15.132:0/1178804857 shutdown_connections 2024-04-16T15:52:44.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.227+0000 7f8d26c60640 1 --2- 172.21.15.132:0/1178804857 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8d2015f8a0 0x7f8d2009ab30 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:44.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.227+0000 7f8d26c60640 1 --2- 172.21.15.132:0/1178804857 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d2015eda0 0x7f8d200d0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:44.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.227+0000 7f8d26c60640 1 -- 172.21.15.132:0/1178804857 >> 172.21.15.132:0/1178804857 conn(0x7f8d200d26b0 msgr2=0x7f8d200d2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:44.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.227+0000 7f8d26c60640 1 -- 172.21.15.132:0/1178804857 shutdown_connections 2024-04-16T15:52:44.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.227+0000 7f8d26c60640 1 -- 172.21.15.132:0/1178804857 wait complete. 2024-04-16T15:52:44.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.228+0000 7f8d26c60640 1 Processor -- start 2024-04-16T15:52:44.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.228+0000 7f8d26c60640 1 -- start start 2024-04-16T15:52:44.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.229+0000 7f8d26c60640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8d2006d7f0 0x7f8d20152990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:44.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.229+0000 7f8d26c60640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d2015f8a0 0x7f8d200b0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:44.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.229+0000 7f8d26c60640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d200b0a70 0x7f8d200caef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:44.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.229+0000 7f8d26c60640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f8d2006ddb0 con 0x7f8d2006d7f0 2024-04-16T15:52:44.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.229+0000 7f8d26c60640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8d2006dc30 con 0x7f8d200b0a70 2024-04-16T15:52:44.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.229+0000 7f8d26c60640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f8d200b2d80 con 0x7f8d2015f8a0 2024-04-16T15:52:44.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.229+0000 7f8d249fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8d2006d7f0 0x7f8d20152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:44.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.229+0000 7f8d249fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8d2006d7f0 0x7f8d20152990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53462/0 (socket says 172.21.15.132:53462) 2024-04-16T15:52:44.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.229+0000 7f8d249fc640 1 -- 172.21.15.132:0/954503315 learned_addr learned my addr 172.21.15.132:0/954503315 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:44.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.229+0000 7f8d251fd640 1 --2- 172.21.15.132:0/954503315 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d200b0a70 0x7f8d200caef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:44.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.229+0000 7f8d1ffff640 1 --2- 172.21.15.132:0/954503315 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d2015f8a0 0x7f8d200b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:44.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.229+0000 7f8d249fc640 1 -- 172.21.15.132:0/954503315 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d2015f8a0 msgr2=0x7f8d200b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:44.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.229+0000 7f8d249fc640 1 --2- 172.21.15.132:0/954503315 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d2015f8a0 0x7f8d200b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:44.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.229+0000 7f8d249fc640 1 -- 172.21.15.132:0/954503315 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d200b0a70 msgr2=0x7f8d200caef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:44.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.229+0000 7f8d249fc640 1 --2- 172.21.15.132:0/954503315 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d200b0a70 0x7f8d200caef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:44.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.229+0000 7f8d249fc640 1 -- 172.21.15.132:0/954503315 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d20152ed0 con 0x7f8d2006d7f0 2024-04-16T15:52:44.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.229+0000 7f8d251fd640 1 --2- 172.21.15.132:0/954503315 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d200b0a70 0x7f8d200caef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:44.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.230+0000 7f8d249fc640 1 --2- 172.21.15.132:0/954503315 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8d2006d7f0 0x7f8d20152990 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8d1000c820 tx=0x7f8d1000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:44.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.230+0000 7f8d1d7fa640 1 -- 172.21.15.132:0/954503315 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d10015070 con 0x7f8d2006d7f0 2024-04-16T15:52:44.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.230+0000 7f8d1d7fa640 1 -- 172.21.15.132:0/954503315 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d10004240 con 0x7f8d2006d7f0 2024-04-16T15:52:44.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.230+0000 7f8d1d7fa640 1 -- 172.21.15.132:0/954503315 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d1000ce10 con 0x7f8d2006d7f0 2024-04-16T15:52:44.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.230+0000 7f8d26c60640 1 -- 172.21.15.132:0/954503315 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d200b1fc0 con 0x7f8d2006d7f0 2024-04-16T15:52:44.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.230+0000 7f8d26c60640 1 -- 172.21.15.132:0/954503315 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d200b2580 con 0x7f8d2006d7f0 2024-04-16T15:52:44.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.231+0000 7f8d26c60640 1 -- 172.21.15.132:0/954503315 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d20075510 con 0x7f8d2006d7f0 2024-04-16T15:52:44.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.231+0000 7f8d1d7fa640 1 -- 172.21.15.132:0/954503315 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8d10007830 con 0x7f8d2006d7f0 2024-04-16T15:52:44.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.232+0000 7f8d1d7fa640 1 --2- 172.21.15.132:0/954503315 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f8d0c06c920 0x7f8d0c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:44.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.232+0000 7f8d1d7fa640 1 -- 172.21.15.132:0/954503315 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8d1008b9a0 con 0x7f8d2006d7f0 2024-04-16T15:52:44.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.232+0000 7f8d1ffff640 1 --2- 172.21.15.132:0/954503315 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f8d0c06c920 0x7f8d0c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:44.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.232+0000 7f8d1ffff640 1 --2- 172.21.15.132:0/954503315 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f8d0c06c920 0x7f8d0c06ede0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8d14006fd0 tx=0x7f8d14008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:44.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.236+0000 7f8d1d7fa640 1 -- 172.21.15.132:0/954503315 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8d10059dd0 con 0x7f8d2006d7f0 2024-04-16T15:52:44.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.411+0000 7f8d26c60640 1 -- 172.21.15.132:0/954503315 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f8d200d21d0 con 0x7f8d2006d7f0 2024-04-16T15:52:44.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.414+0000 7f8d1d7fa640 1 -- 172.21.15.132:0/954503315 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f8d100596d0 con 0x7f8d2006d7f0 2024-04-16T15:52:44.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.417+0000 7f8d26c60640 1 -- 172.21.15.132:0/954503315 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f8d0c06c920 msgr2=0x7f8d0c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:44.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.417+0000 7f8d26c60640 1 --2- 172.21.15.132:0/954503315 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f8d0c06c920 0x7f8d0c06ede0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8d14006fd0 tx=0x7f8d14008040 comp rx=0 tx=0).stop 2024-04-16T15:52:44.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.417+0000 7f8d26c60640 1 -- 172.21.15.132:0/954503315 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8d2006d7f0 msgr2=0x7f8d20152990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:44.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.417+0000 7f8d26c60640 1 --2- 172.21.15.132:0/954503315 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8d2006d7f0 0x7f8d20152990 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8d1000c820 tx=0x7f8d1000cce0 comp rx=0 tx=0).stop 2024-04-16T15:52:44.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.417+0000 7f8d26c60640 1 -- 172.21.15.132:0/954503315 shutdown_connections 2024-04-16T15:52:44.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.417+0000 7f8d26c60640 1 --2- 172.21.15.132:0/954503315 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f8d0c06c920 0x7f8d0c06ede0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:44.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.417+0000 7f8d26c60640 1 --2- 172.21.15.132:0/954503315 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d200b0a70 0x7f8d200caef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:44.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.417+0000 7f8d26c60640 1 --2- 172.21.15.132:0/954503315 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d2015f8a0 0x7f8d200b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:44.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.417+0000 7f8d26c60640 1 --2- 172.21.15.132:0/954503315 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8d2006d7f0 0x7f8d20152990 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:44.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.417+0000 7f8d26c60640 1 -- 172.21.15.132:0/954503315 >> 172.21.15.132:0/954503315 conn(0x7f8d200d26b0 msgr2=0x7f8d200ce4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:44.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.417+0000 7f8d26c60640 1 -- 172.21.15.132:0/954503315 shutdown_connections 2024-04-16T15:52:44.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.417+0000 7f8d26c60640 1 -- 172.21.15.132:0/954503315 wait complete. 2024-04-16T15:52:44.427 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-16T15:52:44.428 DEBUG:teuthology.orchestra.run.smithi132:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-16T15:52:44.482 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-16T15:52:44.533 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-16T15:52:44.533 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-16T15:52:44.533 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T15:52:44.549 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-16T15:52:44.549 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T15:52:44.606 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:52:44.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.749+0000 7f5611477640 1 Processor -- start 2024-04-16T15:52:44.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.749+0000 7f5611477640 1 -- start start 2024-04-16T15:52:44.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.750+0000 7f5611477640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f560c0d21d0 0x7f560c0d1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:44.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.750+0000 7f5611477640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f560c0d1bb0 0x7f560c0ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:44.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.750+0000 7f5611477640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f560c06d920 con 0x7f560c1627f0 2024-04-16T15:52:44.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.750+0000 7f5611477640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f560c0d11e0 con 0x7f560c0d21d0 2024-04-16T15:52:44.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.750+0000 7f5611477640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f560c0d0b90 con 0x7f560c0d1bb0 2024-04-16T15:52:44.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.750+0000 7f560affd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f560c1627f0 0x7f560c162bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:35290/0 (socket says 172.21.15.132:35290) 2024-04-16T15:52:44.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.750+0000 7f560affd640 1 -- 172.21.15.132:0/543202100 learned_addr learned my addr 172.21.15.132:0/543202100 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:44.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.751+0000 7f5609ffb640 1 -- 172.21.15.132:0/543202100 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3726484776 0 0) 0x7f560c06d920 con 0x7f560c1627f0 2024-04-16T15:52:44.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.751+0000 7f5609ffb640 1 -- 172.21.15.132:0/543202100 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55f4003520 con 0x7f560c1627f0 2024-04-16T15:52:44.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.751+0000 7f560a7fc640 1 --2- 172.21.15.132:0/543202100 >> v2:172.21.15.179:3300/0 conn(0x7f560c0d21d0 0x7f560c0d1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:44.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.751+0000 7f560b7fe640 1 --2- 172.21.15.132:0/543202100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f560c0d1bb0 0x7f560c0ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:44.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.751+0000 7f5609ffb640 1 -- 172.21.15.132:0/543202100 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 484173709 0 0) 0x7f55f4003520 con 0x7f560c1627f0 2024-04-16T15:52:44.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.751+0000 7f5609ffb640 1 -- 172.21.15.132:0/543202100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f560c0d1bb0 msgr2=0x7f560c0ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:44.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.751+0000 7f5609ffb640 1 --2- 172.21.15.132:0/543202100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f560c0d1bb0 0x7f560c0ccfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:44.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.751+0000 7f5609ffb640 1 -- 172.21.15.132:0/543202100 >> v2:172.21.15.179:3300/0 conn(0x7f560c0d21d0 msgr2=0x7f560c0d1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:44.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.751+0000 7f5609ffb640 1 --2- 172.21.15.132:0/543202100 >> v2:172.21.15.179:3300/0 conn(0x7f560c0d21d0 0x7f560c0d1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:44.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.751+0000 7f5609ffb640 1 -- 172.21.15.132:0/543202100 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f560c0d0e70 con 0x7f560c1627f0 2024-04-16T15:52:44.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.751+0000 7f5609ffb640 1 -- 172.21.15.132:0/543202100 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2803668828 0 0) 0x7f55fc0019f0 con 0x7f560c1627f0 2024-04-16T15:52:44.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.751+0000 7f5609ffb640 1 -- 172.21.15.132:0/543202100 >> v1:172.21.15.132:6789/0 conn(0x7f560c1627f0 legacy=0x7f560c162bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:44.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.751+0000 7f5609ffb640 1 --2- 172.21.15.132:0/543202100 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55f40039b0 0x7f55f4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:44.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.751+0000 7f5609ffb640 1 --2- 172.21.15.132:0/543202100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f560c0d1bb0 0x7f55f4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:44.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.751+0000 7f5609ffb640 1 --2- 172.21.15.132:0/543202100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55f4004d40 0x7f55f40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:44.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.751+0000 7f5609ffb640 1 -- 172.21.15.132:0/543202100 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f560c0d11e0 con 0x7f55f4004d40 2024-04-16T15:52:44.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.751+0000 7f5609ffb640 1 -- 172.21.15.132:0/543202100 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f560c0d0b90 con 0x7f55f40039b0 2024-04-16T15:52:44.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.751+0000 7f5609ffb640 1 -- 172.21.15.132:0/543202100 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f55f400b9c0 con 0x7f560c0d1bb0 2024-04-16T15:52:44.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.751+0000 7f560b7fe640 1 --2- 172.21.15.132:0/543202100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55f4004d40 0x7f55f40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:44.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.751+0000 7f560affd640 1 --2- 172.21.15.132:0/543202100 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55f40039b0 0x7f55f4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:44.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.751+0000 7f560a7fc640 1 --2- 172.21.15.132:0/543202100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f560c0d1bb0 0x7f55f4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:44.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.751+0000 7f560b7fe640 1 -- 172.21.15.132:0/543202100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f560c0d1bb0 msgr2=0x7f55f4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:44.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.751+0000 7f560b7fe640 1 --2- 172.21.15.132:0/543202100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f560c0d1bb0 0x7f55f4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:44.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.751+0000 7f560b7fe640 1 -- 172.21.15.132:0/543202100 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55f40039b0 msgr2=0x7f55f4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:44.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.751+0000 7f560b7fe640 1 --2- 172.21.15.132:0/543202100 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55f40039b0 0x7f55f4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:44.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.751+0000 7f560b7fe640 1 -- 172.21.15.132:0/543202100 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55f4003520 con 0x7f55f4004d40 2024-04-16T15:52:44.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.752+0000 7f560b7fe640 1 --2- 172.21.15.132:0/543202100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55f4004d40 0x7f55f40051c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5604009a90 tx=0x7f55f4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b274f7e570d1059 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:44.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.752+0000 7f5609ffb640 1 -- 172.21.15.132:0/543202100 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5604039070 con 0x7f55f4004d40 2024-04-16T15:52:44.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.752+0000 7f5609ffb640 1 -- 172.21.15.132:0/543202100 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f560402c680 con 0x7f55f4004d40 2024-04-16T15:52:44.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.752+0000 7f5609ffb640 1 -- 172.21.15.132:0/543202100 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5604009690 con 0x7f55f4004d40 2024-04-16T15:52:44.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.753+0000 7f5611477640 1 -- 172.21.15.132:0/543202100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55f4004d40 msgr2=0x7f55f40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:44.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.753+0000 7f5611477640 1 --2- 172.21.15.132:0/543202100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55f4004d40 0x7f55f40051c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5604009a90 tx=0x7f55f4005830 comp rx=0 tx=0).stop 2024-04-16T15:52:44.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.753+0000 7f560b7fe640 1 -- 172.21.15.132:0/543202100 reap_dead start 2024-04-16T15:52:44.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.753+0000 7f5611477640 1 -- 172.21.15.132:0/543202100 shutdown_connections 2024-04-16T15:52:44.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.753+0000 7f5611477640 1 -- 172.21.15.132:0/543202100 >> 172.21.15.132:0/543202100 conn(0x7f560c0b4450 msgr2=0x7f560c0b4860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:44.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.753+0000 7f5611477640 1 -- 172.21.15.132:0/543202100 shutdown_connections 2024-04-16T15:52:44.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.753+0000 7f5611477640 1 -- 172.21.15.132:0/543202100 wait complete. 2024-04-16T15:52:44.758 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.754+0000 7f5611477640 1 Processor -- start 2024-04-16T15:52:44.758 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.754+0000 7f5611477640 1 -- start start 2024-04-16T15:52:44.758 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.755+0000 7f5611477640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f560c0b8130 0x7f560c0af660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:44.758 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.755+0000 7f5611477640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f560c14d7e0 0x7f560c0afba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:44.758 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.755+0000 7f5611477640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f560c0b00e0 0x7f560c1496a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:44.758 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.755+0000 7f5611477640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f560c163630 con 0x7f560c14d7e0 2024-04-16T15:52:44.758 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.755+0000 7f5611477640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f560c1634b0 con 0x7f560c0b8130 2024-04-16T15:52:44.758 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.755+0000 7f5611477640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f560c06dc00 con 0x7f560c0b00e0 2024-04-16T15:52:44.758 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.755+0000 7f560a7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f560c14d7e0 0x7f560c0afba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:44.759 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.755+0000 7f560a7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f560c14d7e0 0x7f560c0afba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53472/0 (socket says 172.21.15.132:53472) 2024-04-16T15:52:44.759 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.755+0000 7f560a7fc640 1 -- 172.21.15.132:0/2167867671 learned_addr learned my addr 172.21.15.132:0/2167867671 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:44.759 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.755+0000 7f560a7fc640 1 -- 172.21.15.132:0/2167867671 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f560c0b00e0 msgr2=0x7f560c1496a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:44.759 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.755+0000 7f560b7fe640 1 --2- 172.21.15.132:0/2167867671 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f560c0b00e0 0x7f560c1496a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:44.759 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.755+0000 7f560a7fc640 1 --2- 172.21.15.132:0/2167867671 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f560c0b00e0 0x7f560c1496a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:44.759 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.755+0000 7f560a7fc640 1 -- 172.21.15.132:0/2167867671 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f560c0b8130 msgr2=0x7f560c0af660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:44.759 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.755+0000 7f560affd640 1 --2- 172.21.15.132:0/2167867671 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f560c0b8130 0x7f560c0af660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:44.759 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.755+0000 7f560a7fc640 1 --2- 172.21.15.132:0/2167867671 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f560c0b8130 0x7f560c0af660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:44.759 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.755+0000 7f560a7fc640 1 -- 172.21.15.132:0/2167867671 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f560c1e8940 con 0x7f560c14d7e0 2024-04-16T15:52:44.759 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.756+0000 7f560a7fc640 1 --2- 172.21.15.132:0/2167867671 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f560c14d7e0 0x7f560c0afba0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5600011aa0 tx=0x7f5600011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:44.759 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.756+0000 7f55f37fe640 1 -- 172.21.15.132:0/2167867671 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f560000fb80 con 0x7f560c14d7e0 2024-04-16T15:52:44.759 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.756+0000 7f55f37fe640 1 -- 172.21.15.132:0/2167867671 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f560000fd20 con 0x7f560c14d7e0 2024-04-16T15:52:44.759 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.756+0000 7f5611477640 1 -- 172.21.15.132:0/2167867671 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f560c14acb0 con 0x7f560c14d7e0 2024-04-16T15:52:44.759 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.756+0000 7f55f37fe640 1 -- 172.21.15.132:0/2167867671 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5600014660 con 0x7f560c14d7e0 2024-04-16T15:52:44.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.756+0000 7f5611477640 1 -- 172.21.15.132:0/2167867671 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f560c14b270 con 0x7f560c14d7e0 2024-04-16T15:52:44.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.757+0000 7f5611477640 1 -- 172.21.15.132:0/2167867671 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f560c075510 con 0x7f560c14d7e0 2024-04-16T15:52:44.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.757+0000 7f55f37fe640 1 -- 172.21.15.132:0/2167867671 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5600012040 con 0x7f560c14d7e0 2024-04-16T15:52:44.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.758+0000 7f55f37fe640 1 --2- 172.21.15.132:0/2167867671 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f55f806c920 0x7f55f806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:44.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.758+0000 7f55f37fe640 1 -- 172.21.15.132:0/2167867671 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f560008c220 con 0x7f560c14d7e0 2024-04-16T15:52:44.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.758+0000 7f560affd640 1 --2- 172.21.15.132:0/2167867671 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f55f806c920 0x7f55f806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:44.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.758+0000 7f560affd640 1 --2- 172.21.15.132:0/2167867671 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f55f806c920 0x7f55f806ede0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f55fc004bc0 tx=0x7f55fc006040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:44.761 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.762+0000 7f55f37fe640 1 -- 172.21.15.132:0/2167867671 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5600019030 con 0x7f560c14d7e0 2024-04-16T15:52:44.799 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T15:52:44.802 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T15:52:44.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.945+0000 7f5611477640 1 -- 172.21.15.132:0/2167867671 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f560c09bae0 con 0x7f560c14d7e0 2024-04-16T15:52:44.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.947+0000 7f55f37fe640 1 -- 172.21.15.132:0/2167867671 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7f560005a650 con 0x7f560c14d7e0 2024-04-16T15:52:44.946 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:52:44.946 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"6bdec5d9-f406-43ad-8584-0503b32f6f0d","created":"2024-04-16T15:51:51.073040+0000","modified":"2024-04-16T15:52:16.950186+0000","last_up_change":"2024-04-16T15:52:02.280496+0000","last_in_change":"2024-04-16T15:51:53.376468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:52:03.284927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:52:13.363758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T15:52:14.246647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d45908b-6e22-4619-b190-897af594b712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6801","nonce":1170594668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6803","nonce":1170594668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6807","nonce":1170594668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6805","nonce":1170594668}]},"public_addr":"172.21.15.132:6801/1170594668","cluster_addr":"172.21.15.132:6803/1170594668","heartbeat_back_addr":"172.21.15.132:6807/1170594668","heartbeat_front_addr":"172.21.15.132:6805/1170594668","state":["exists","up"]},{"osd":1,"uuid":"c88bf082-e51f-4ee6-815a-025f6ce0d67b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6809","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6811","nonce":2494780358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6815","nonce":2494780358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6823","nonce":2494780358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6819","nonce":2494780358}]},"public_addr":"172.21.15.132:6811/2494780358","cluster_addr":"172.21.15.132:6815/2494780358","heartbeat_back_addr":"172.21.15.132:6823/2494780358","heartbeat_front_addr":"172.21.15.132:6819/2494780358","state":["exists","up"]},{"osd":2,"uuid":"e5dbd6b4-4e7b-47e4-ad4e-35b4b81696c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6825","nonce":27655483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6827","nonce":27655483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6831","nonce":27655483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6829","nonce":27655483}]},"public_addr":"172.21.15.132:6825/27655483","cluster_addr":"172.21.15.132:6827/27655483","heartbeat_back_addr":"172.21.15.132:6831/27655483","heartbeat_front_addr":"172.21.15.132:6829/27655483","state":["exists","up"]},{"osd":3,"uuid":"9d75cd67-3b8a-4424-8884-5f3660e1f5f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6810","nonce":3100919191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6814","nonce":3100919191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6821","nonce":3100919191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6818","nonce":3100919191}]},"public_addr":"172.21.15.132:6810/3100919191","cluster_addr":"172.21.15.132:6814/3100919191","heartbeat_back_addr":"172.21.15.132:6821/3100919191","heartbeat_front_addr":"172.21.15.132:6818/3100919191","state":["exists","up"]},{"osd":4,"uuid":"83aea46a-8642-4777-912b-c130e5890da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6825","nonce":123637799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6827","nonce":123637799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6831","nonce":123637799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6829","nonce":123637799}]},"public_addr":"172.21.15.179:6825/123637799","cluster_addr":"172.21.15.179:6827/123637799","heartbeat_back_addr":"172.21.15.179:6831/123637799","heartbeat_front_addr":"172.21.15.179:6829/123637799","state":["exists","up"]},{"osd":5,"uuid":"534117c8-3317-48d6-b436-afd5709f71e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6801","nonce":2224750370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6803","nonce":2224750370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6807","nonce":2224750370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6805","nonce":2224750370}]},"public_addr":"172.21.15.179:6801/2224750370","cluster_addr":"172.21.15.179:6803/2224750370","heartbeat_back_addr":"172.21.15.179:6807/2224750370","heartbeat_front_addr":"172.21.15.179:6805/2224750370","state":["exists","up"]},{"osd":6,"uuid":"0ba363e7-fa9d-42b1-ae09-a6a0f57d41f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6809","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6811","nonce":101498164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6813","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6815","nonce":101498164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6823","nonce":101498164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6819","nonce":101498164}]},"public_addr":"172.21.15.179:6811/101498164","cluster_addr":"172.21.15.179:6815/101498164","heartbeat_back_addr":"172.21.15.179:6823/101498164","heartbeat_front_addr":"172.21.15.179:6819/101498164","state":["exists","up"]},{"osd":7,"uuid":"e6830c77-2f2d-4067-9866-ee7625afc1a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6810","nonce":872148365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6814","nonce":872148365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6822","nonce":872148365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6818","nonce":872148365}]},"public_addr":"172.21.15.179:6810/872148365","cluster_addr":"172.21.15.179:6814/872148365","heartbeat_back_addr":"172.21.15.179:6822/872148365","heartbeat_front_addr":"172.21.15.179:6818/872148365","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.535221+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.563769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.520765+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.526264+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.517058+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.500842+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.534332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.512486+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:52:44.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.948+0000 7f5611477640 1 -- 172.21.15.132:0/2167867671 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f55f806c920 msgr2=0x7f55f806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:44.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.948+0000 7f5611477640 1 --2- 172.21.15.132:0/2167867671 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f55f806c920 0x7f55f806ede0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f55fc004bc0 tx=0x7f55fc006040 comp rx=0 tx=0).stop 2024-04-16T15:52:44.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.948+0000 7f5611477640 1 -- 172.21.15.132:0/2167867671 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f560c14d7e0 msgr2=0x7f560c0afba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:44.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.948+0000 7f5611477640 1 --2- 172.21.15.132:0/2167867671 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f560c14d7e0 0x7f560c0afba0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5600011aa0 tx=0x7f5600011f60 comp rx=0 tx=0).stop 2024-04-16T15:52:44.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.949+0000 7f5611477640 1 -- 172.21.15.132:0/2167867671 shutdown_connections 2024-04-16T15:52:44.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.949+0000 7f5611477640 1 --2- 172.21.15.132:0/2167867671 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f55f806c920 0x7f55f806ede0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:44.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.949+0000 7f5611477640 1 --2- 172.21.15.132:0/2167867671 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f560c0b00e0 0x7f560c1496a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:44.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.949+0000 7f5611477640 1 --2- 172.21.15.132:0/2167867671 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f560c14d7e0 0x7f560c0afba0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:44.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.949+0000 7f5611477640 1 --2- 172.21.15.132:0/2167867671 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f560c0b8130 0x7f560c0af660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:44.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.949+0000 7f5611477640 1 -- 172.21.15.132:0/2167867671 >> 172.21.15.132:0/2167867671 conn(0x7f560c0b4450 msgr2=0x7f560c0cce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:44.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.949+0000 7f5611477640 1 -- 172.21.15.132:0/2167867671 shutdown_connections 2024-04-16T15:52:44.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:44.949+0000 7f5611477640 1 -- 172.21.15.132:0/2167867671 wait complete. 2024-04-16T15:52:44.959 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T15:52:03.284927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T15:52:13.363758+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T15:52:14.246647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T15:52:44.959 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T15:52:45.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.066+0000 7f49aa767640 1 Processor -- start 2024-04-16T15:52:45.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.066+0000 7f49aa767640 1 -- start start 2024-04-16T15:52:45.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.067+0000 7f49aa767640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49a415ee80 0x7f49a40700f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:45.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.067+0000 7f49aa767640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49a406f050 con 0x7f49a415eaa0 2024-04-16T15:52:45.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.067+0000 7f49aa767640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49a406f330 con 0x7f49a4067a00 2024-04-16T15:52:45.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.067+0000 7f49aa767640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f49a406fc60 con 0x7f49a415ee80 2024-04-16T15:52:45.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.067+0000 7f49a3fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f49a415eaa0 0x7f49a406e870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:35294/0 (socket says 172.21.15.132:35294) 2024-04-16T15:52:45.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.067+0000 7f49a3fff640 1 -- 172.21.15.132:0/1627889696 learned_addr learned my addr 172.21.15.132:0/1627889696 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:45.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.067+0000 7f49a37fe640 1 -- 172.21.15.132:0/1627889696 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2570839443 0 0) 0x7f49a406f050 con 0x7f49a415eaa0 2024-04-16T15:52:45.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.067+0000 7f499bfff640 1 --2- 172.21.15.132:0/1627889696 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49a415ee80 0x7f49a40700f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:45.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.067+0000 7f49a37fe640 1 -- 172.21.15.132:0/1627889696 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4990003520 con 0x7f49a415eaa0 2024-04-16T15:52:45.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.068+0000 7f49a37fe640 1 -- 172.21.15.132:0/1627889696 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 315630214 0 0) 0x7f4990003520 con 0x7f49a415eaa0 2024-04-16T15:52:45.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.068+0000 7f49a37fe640 1 -- 172.21.15.132:0/1627889696 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49a415ee80 msgr2=0x7f49a40700f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:45.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.068+0000 7f49a37fe640 1 --2- 172.21.15.132:0/1627889696 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49a415ee80 0x7f49a40700f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:45.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.068+0000 7f49a37fe640 1 -- 172.21.15.132:0/1627889696 >> v1:172.21.15.179:6789/0 conn(0x7f49a4067a00 legacy=0x7f49a406ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:45.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.068+0000 7f49a37fe640 1 -- 172.21.15.132:0/1627889696 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49a406f610 con 0x7f49a415eaa0 2024-04-16T15:52:45.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.068+0000 7f49a37fe640 1 -- 172.21.15.132:0/1627889696 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2803668828 0 0) 0x7f4994001670 con 0x7f49a415eaa0 2024-04-16T15:52:45.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.068+0000 7f49a37fe640 1 -- 172.21.15.132:0/1627889696 >> v1:172.21.15.132:6789/0 conn(0x7f49a415eaa0 legacy=0x7f49a406e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:45.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.068+0000 7f49a37fe640 1 --2- 172.21.15.132:0/1627889696 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49a415ee80 0x7f49900039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:45.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.068+0000 7f49a37fe640 1 --2- 172.21.15.132:0/1627889696 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4990003f60 0x7f4990004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:45.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.068+0000 7f49a37fe640 1 --2- 172.21.15.132:0/1627889696 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4990004d40 0x7f49900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:45.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.068+0000 7f49a37fe640 1 -- 172.21.15.132:0/1627889696 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f49a406fc60 con 0x7f4990004d40 2024-04-16T15:52:45.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.068+0000 7f49a37fe640 1 -- 172.21.15.132:0/1627889696 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f499000baa0 con 0x7f4990003f60 2024-04-16T15:52:45.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.068+0000 7f49a37fe640 1 -- 172.21.15.132:0/1627889696 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f499000bca0 con 0x7f49a415ee80 2024-04-16T15:52:45.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.068+0000 7f49a3fff640 1 --2- 172.21.15.132:0/1627889696 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49a415ee80 0x7f49900039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:45.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.068+0000 7f49a8d04640 1 --2- 172.21.15.132:0/1627889696 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4990004d40 0x7f49900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:45.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.068+0000 7f499bfff640 1 --2- 172.21.15.132:0/1627889696 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4990003f60 0x7f4990004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:45.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.068+0000 7f49a8d04640 1 -- 172.21.15.132:0/1627889696 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49a415ee80 msgr2=0x7f49900039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:45.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.068+0000 7f49a8d04640 1 --2- 172.21.15.132:0/1627889696 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49a415ee80 0x7f49900039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:45.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.068+0000 7f49a8d04640 1 -- 172.21.15.132:0/1627889696 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4990003f60 msgr2=0x7f4990004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:45.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.068+0000 7f49a8d04640 1 --2- 172.21.15.132:0/1627889696 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4990003f60 0x7f4990004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:45.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.068+0000 7f49a8d04640 1 -- 172.21.15.132:0/1627889696 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4990003520 con 0x7f4990004d40 2024-04-16T15:52:45.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.069+0000 7f49a8d04640 1 --2- 172.21.15.132:0/1627889696 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4990004d40 0x7f49900051c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f499c001e50 tx=0x7f4990005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98f0d04bf0358264 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:45.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.069+0000 7f49a37fe640 1 -- 172.21.15.132:0/1627889696 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f499c001a70 con 0x7f4990004d40 2024-04-16T15:52:45.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.069+0000 7f49a37fe640 1 -- 172.21.15.132:0/1627889696 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f499c003b70 con 0x7f4990004d40 2024-04-16T15:52:45.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.069+0000 7f49a37fe640 1 -- 172.21.15.132:0/1627889696 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f499c0050d0 con 0x7f4990004d40 2024-04-16T15:52:45.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.070+0000 7f49aa767640 1 -- 172.21.15.132:0/1627889696 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4990004d40 msgr2=0x7f49900051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:45.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.070+0000 7f49aa767640 1 --2- 172.21.15.132:0/1627889696 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4990004d40 0x7f49900051c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f499c001e50 tx=0x7f4990005830 comp rx=0 tx=0).stop 2024-04-16T15:52:45.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.070+0000 7f49a8d04640 1 -- 172.21.15.132:0/1627889696 reap_dead start 2024-04-16T15:52:45.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.070+0000 7f49aa767640 1 -- 172.21.15.132:0/1627889696 shutdown_connections 2024-04-16T15:52:45.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.070+0000 7f49aa767640 1 -- 172.21.15.132:0/1627889696 >> 172.21.15.132:0/1627889696 conn(0x7f49a4072810 msgr2=0x7f49a4072c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:45.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.070+0000 7f49aa767640 1 -- 172.21.15.132:0/1627889696 shutdown_connections 2024-04-16T15:52:45.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.070+0000 7f49aa767640 1 -- 172.21.15.132:0/1627889696 wait complete. 2024-04-16T15:52:45.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.071+0000 7f49aa767640 1 Processor -- start 2024-04-16T15:52:45.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.071+0000 7f49aa767640 1 -- start start 2024-04-16T15:52:45.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.072+0000 7f49aa767640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4990004d40 0x7f49a4161f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:45.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.072+0000 7f49aa767640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49a4157110 0x7f49a4159130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:45.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.072+0000 7f49aa767640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49a40d0320 0x7f49a4159670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:45.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.072+0000 7f49aa767640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f49a406d2c0 con 0x7f4990004d40 2024-04-16T15:52:45.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.072+0000 7f49aa767640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f49a406d140 con 0x7f49a4157110 2024-04-16T15:52:45.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.072+0000 7f49aa767640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f49a40700f0 con 0x7f49a40d0320 2024-04-16T15:52:45.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.072+0000 7f49a3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4990004d40 0x7f49a4161f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:45.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.072+0000 7f49a3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4990004d40 0x7f49a4161f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53486/0 (socket says 172.21.15.132:53486) 2024-04-16T15:52:45.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.072+0000 7f49a3fff640 1 -- 172.21.15.132:0/1573770620 learned_addr learned my addr 172.21.15.132:0/1573770620 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:45.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.072+0000 7f49a8d04640 1 --2- 172.21.15.132:0/1573770620 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49a40d0320 0x7f49a4159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:45.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.072+0000 7f499bfff640 1 --2- 172.21.15.132:0/1573770620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49a4157110 0x7f49a4159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:45.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.072+0000 7f49a3fff640 1 -- 172.21.15.132:0/1573770620 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49a40d0320 msgr2=0x7f49a4159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:45.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.072+0000 7f49a3fff640 1 --2- 172.21.15.132:0/1573770620 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49a40d0320 0x7f49a4159670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:45.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.072+0000 7f49a3fff640 1 -- 172.21.15.132:0/1573770620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49a4157110 msgr2=0x7f49a4159130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:45.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.072+0000 7f49a3fff640 1 --2- 172.21.15.132:0/1573770620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49a4157110 0x7f49a4159130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:45.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.072+0000 7f49a3fff640 1 -- 172.21.15.132:0/1573770620 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49a415f5d0 con 0x7f4990004d40 2024-04-16T15:52:45.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.072+0000 7f499bfff640 1 --2- 172.21.15.132:0/1573770620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49a4157110 0x7f49a4159130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:45.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.072+0000 7f49a3fff640 1 --2- 172.21.15.132:0/1573770620 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4990004d40 0x7f49a4161f40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f49940072c0 tx=0x7f4994007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:45.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.072+0000 7f49a17fa640 1 -- 172.21.15.132:0/1573770620 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f499400f8e0 con 0x7f4990004d40 2024-04-16T15:52:45.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.072+0000 7f49a17fa640 1 -- 172.21.15.132:0/1573770620 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4994018070 con 0x7f4990004d40 2024-04-16T15:52:45.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.072+0000 7f49aa767640 1 -- 172.21.15.132:0/1573770620 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49a415f8b0 con 0x7f4990004d40 2024-04-16T15:52:45.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.072+0000 7f49a17fa640 1 -- 172.21.15.132:0/1573770620 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f499400fce0 con 0x7f4990004d40 2024-04-16T15:52:45.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.072+0000 7f49aa767640 1 -- 172.21.15.132:0/1573770620 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49a415fe70 con 0x7f4990004d40 2024-04-16T15:52:45.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.073+0000 7f49aa767640 1 -- 172.21.15.132:0/1573770620 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49a4075510 con 0x7f4990004d40 2024-04-16T15:52:45.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.074+0000 7f49a17fa640 1 -- 172.21.15.132:0/1573770620 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f499401d460 con 0x7f4990004d40 2024-04-16T15:52:45.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.074+0000 7f49a17fa640 1 --2- 172.21.15.132:0/1573770620 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f498406c920 0x7f498406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:45.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.074+0000 7f49a17fa640 1 -- 172.21.15.132:0/1573770620 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f499408bc50 con 0x7f4990004d40 2024-04-16T15:52:45.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.074+0000 7f499bfff640 1 --2- 172.21.15.132:0/1573770620 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f498406c920 0x7f498406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:45.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.075+0000 7f499bfff640 1 --2- 172.21.15.132:0/1573770620 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f498406c920 0x7f498406ede0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f49a415a010 tx=0x7f498c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:45.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.079+0000 7f49a17fa640 1 -- 172.21.15.132:0/1573770620 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4994091020 con 0x7f4990004d40 2024-04-16T15:52:45.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.254+0000 7f49aa767640 1 -- 172.21.15.132:0/1573770620 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f49a40b5810 con 0x7f4990004d40 2024-04-16T15:52:45.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.254+0000 7f49a17fa640 1 -- 172.21.15.132:0/1573770620 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f499405a080 con 0x7f4990004d40 2024-04-16T15:52:45.254 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2024-04-16T15:52:45.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.256+0000 7f49aa767640 1 -- 172.21.15.132:0/1573770620 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f498406c920 msgr2=0x7f498406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:45.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.256+0000 7f49aa767640 1 --2- 172.21.15.132:0/1573770620 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f498406c920 0x7f498406ede0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f49a415a010 tx=0x7f498c008040 comp rx=0 tx=0).stop 2024-04-16T15:52:45.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.256+0000 7f49aa767640 1 -- 172.21.15.132:0/1573770620 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4990004d40 msgr2=0x7f49a4161f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:45.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.256+0000 7f49aa767640 1 --2- 172.21.15.132:0/1573770620 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4990004d40 0x7f49a4161f40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f49940072c0 tx=0x7f4994007780 comp rx=0 tx=0).stop 2024-04-16T15:52:45.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.256+0000 7f49aa767640 1 -- 172.21.15.132:0/1573770620 shutdown_connections 2024-04-16T15:52:45.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.256+0000 7f49aa767640 1 --2- 172.21.15.132:0/1573770620 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f498406c920 0x7f498406ede0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:45.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.256+0000 7f49aa767640 1 --2- 172.21.15.132:0/1573770620 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49a40d0320 0x7f49a4159670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:45.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.256+0000 7f49aa767640 1 --2- 172.21.15.132:0/1573770620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49a4157110 0x7f49a4159130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:45.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.256+0000 7f49aa767640 1 --2- 172.21.15.132:0/1573770620 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4990004d40 0x7f49a4161f40 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:45.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.256+0000 7f49aa767640 1 -- 172.21.15.132:0/1573770620 >> 172.21.15.132:0/1573770620 conn(0x7f49a4072810 msgr2=0x7f49a415a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:45.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.256+0000 7f49aa767640 1 -- 172.21.15.132:0/1573770620 shutdown_connections 2024-04-16T15:52:45.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.256+0000 7f49aa767640 1 -- 172.21.15.132:0/1573770620 wait complete. 2024-04-16T15:52:45.267 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T15:52:45.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.378+0000 7f7f25ba8640 1 Processor -- start 2024-04-16T15:52:45.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.378+0000 7f7f25ba8640 1 -- start start 2024-04-16T15:52:45.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.378+0000 7f7f25ba8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f2015ea80 0x7f7f200d1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:45.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.378+0000 7f7f25ba8640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f2015ee60 con 0x7f7f200b4660 2024-04-16T15:52:45.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.378+0000 7f7f25ba8640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f200b4dd0 con 0x7f7f2006fb60 2024-04-16T15:52:45.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.378+0000 7f7f25ba8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f7f200b50b0 con 0x7f7f2015ea80 2024-04-16T15:52:45.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.379+0000 7f7f1effd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f7f200b4660 0x7f7f2006f450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:35306/0 (socket says 172.21.15.132:35306) 2024-04-16T15:52:45.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.379+0000 7f7f1effd640 1 -- 172.21.15.132:0/780290947 learned_addr learned my addr 172.21.15.132:0/780290947 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:45.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.379+0000 7f7f1f7fe640 1 --2- 172.21.15.132:0/780290947 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f2015ea80 0x7f7f200d1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:45.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.379+0000 7f7f1e7fc640 1 -- 172.21.15.132:0/780290947 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1240203135 0 0) 0x7f7f2015ee60 con 0x7f7f200b4660 2024-04-16T15:52:45.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.379+0000 7f7f1e7fc640 1 -- 172.21.15.132:0/780290947 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f08003520 con 0x7f7f200b4660 2024-04-16T15:52:45.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.379+0000 7f7f1e7fc640 1 -- 172.21.15.132:0/780290947 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2206535724 0 0) 0x7f7f200b4dd0 con 0x7f7f2006fb60 2024-04-16T15:52:45.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.379+0000 7f7f1e7fc640 1 -- 172.21.15.132:0/780290947 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f2015ee60 con 0x7f7f2006fb60 2024-04-16T15:52:45.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.379+0000 7f7f1e7fc640 1 -- 172.21.15.132:0/780290947 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1217333511 0 0) 0x7f7f08003520 con 0x7f7f200b4660 2024-04-16T15:52:45.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.379+0000 7f7f1e7fc640 1 -- 172.21.15.132:0/780290947 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f2015ea80 msgr2=0x7f7f200d1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:45.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.379+0000 7f7f1e7fc640 1 --2- 172.21.15.132:0/780290947 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f2015ea80 0x7f7f200d1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:45.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.379+0000 7f7f1e7fc640 1 -- 172.21.15.132:0/780290947 >> v1:172.21.15.179:6789/0 conn(0x7f7f2006fb60 legacy=0x7f7f200cafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:45.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.379+0000 7f7f1e7fc640 1 -- 172.21.15.132:0/780290947 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f200b5390 con 0x7f7f200b4660 2024-04-16T15:52:45.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.379+0000 7f7f1e7fc640 1 -- 172.21.15.132:0/780290947 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2803668828 0 0) 0x7f7f14001670 con 0x7f7f200b4660 2024-04-16T15:52:45.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.379+0000 7f7f1e7fc640 1 -- 172.21.15.132:0/780290947 >> v1:172.21.15.132:6789/0 conn(0x7f7f200b4660 legacy=0x7f7f2006f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:45.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.379+0000 7f7f1e7fc640 1 --2- 172.21.15.132:0/780290947 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f08003b70 0x7f7f08003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:45.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.379+0000 7f7f1e7fc640 1 --2- 172.21.15.132:0/780290947 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f08004800 0x7f7f08004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:45.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.379+0000 7f7f1e7fc640 1 --2- 172.21.15.132:0/780290947 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f080051c0 0x7f7f0800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:45.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.379+0000 7f7f1e7fc640 1 -- 172.21.15.132:0/780290947 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f7f200b50b0 con 0x7f7f080051c0 2024-04-16T15:52:45.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.379+0000 7f7f1e7fc640 1 -- 172.21.15.132:0/780290947 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7f0800bf30 con 0x7f7f08004800 2024-04-16T15:52:45.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.379+0000 7f7f1e7fc640 1 -- 172.21.15.132:0/780290947 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f7f0800c130 con 0x7f7f08003b70 2024-04-16T15:52:45.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.379+0000 7f7f1f7fe640 1 --2- 172.21.15.132:0/780290947 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f2015ea80 0x7f7f200d1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:52:45.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.379+0000 7f7f1ffff640 1 --2- 172.21.15.132:0/780290947 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f080051c0 0x7f7f0800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:45.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.379+0000 7f7f1effd640 1 --2- 172.21.15.132:0/780290947 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f08004800 0x7f7f08004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:45.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.380+0000 7f7f1f7fe640 1 --2- 172.21.15.132:0/780290947 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f08003b70 0x7f7f08003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:45.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.380+0000 7f7f1ffff640 1 -- 172.21.15.132:0/780290947 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f08003b70 msgr2=0x7f7f08003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:45.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.380+0000 7f7f1ffff640 1 --2- 172.21.15.132:0/780290947 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f08003b70 0x7f7f08003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:45.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.380+0000 7f7f1ffff640 1 -- 172.21.15.132:0/780290947 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f08004800 msgr2=0x7f7f08004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:45.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.380+0000 7f7f1ffff640 1 --2- 172.21.15.132:0/780290947 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f08004800 0x7f7f08004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:45.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.380+0000 7f7f1ffff640 1 -- 172.21.15.132:0/780290947 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f08003520 con 0x7f7f080051c0 2024-04-16T15:52:45.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.381+0000 7f7f1ffff640 1 --2- 172.21.15.132:0/780290947 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f080051c0 0x7f7f0800b9c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7f18001fd0 tx=0x7f7f08005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4b98ae80fba9bd0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:45.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.381+0000 7f7f1e7fc640 1 -- 172.21.15.132:0/780290947 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f18001bf0 con 0x7f7f080051c0 2024-04-16T15:52:45.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.381+0000 7f7f1e7fc640 1 -- 172.21.15.132:0/780290947 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f18003b70 con 0x7f7f080051c0 2024-04-16T15:52:45.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.381+0000 7f7f1e7fc640 1 -- 172.21.15.132:0/780290947 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f180050d0 con 0x7f7f080051c0 2024-04-16T15:52:45.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.382+0000 7f7f25ba8640 1 -- 172.21.15.132:0/780290947 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f080051c0 msgr2=0x7f7f0800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:45.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.382+0000 7f7f25ba8640 1 --2- 172.21.15.132:0/780290947 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f080051c0 0x7f7f0800b9c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7f18001fd0 tx=0x7f7f08005830 comp rx=0 tx=0).stop 2024-04-16T15:52:45.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.382+0000 7f7f1ffff640 1 -- 172.21.15.132:0/780290947 reap_dead start 2024-04-16T15:52:45.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.382+0000 7f7f25ba8640 1 -- 172.21.15.132:0/780290947 shutdown_connections 2024-04-16T15:52:45.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.382+0000 7f7f25ba8640 1 -- 172.21.15.132:0/780290947 >> 172.21.15.132:0/780290947 conn(0x7f7f200b6b80 msgr2=0x7f7f200b6f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:45.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.382+0000 7f7f25ba8640 1 -- 172.21.15.132:0/780290947 shutdown_connections 2024-04-16T15:52:45.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.382+0000 7f7f25ba8640 1 -- 172.21.15.132:0/780290947 wait complete. 2024-04-16T15:52:45.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.384+0000 7f7f25ba8640 1 Processor -- start 2024-04-16T15:52:45.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.384+0000 7f7f25ba8640 1 -- start start 2024-04-16T15:52:45.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.385+0000 7f7f25ba8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f080051c0 0x7f7f200cfd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:45.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.385+0000 7f7f25ba8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f200d1410 0x7f7f2014e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:45.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.385+0000 7f7f25ba8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f200a96c0 0x7f7f20161200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:45.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.385+0000 7f7f25ba8640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f7f200b4ac0 con 0x7f7f080051c0 2024-04-16T15:52:45.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.385+0000 7f7f25ba8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7f200caa80 con 0x7f7f200d1410 2024-04-16T15:52:45.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.385+0000 7f7f25ba8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f7f200d1d30 con 0x7f7f200a96c0 2024-04-16T15:52:45.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.385+0000 7f7f1f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f080051c0 0x7f7f200cfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:45.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.385+0000 7f7f1f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f080051c0 0x7f7f200cfd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53514/0 (socket says 172.21.15.132:53514) 2024-04-16T15:52:45.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.385+0000 7f7f1f7fe640 1 -- 172.21.15.132:0/3560951544 learned_addr learned my addr 172.21.15.132:0/3560951544 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:45.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.386+0000 7f7f1f7fe640 1 -- 172.21.15.132:0/3560951544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f200a96c0 msgr2=0x7f7f20161200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:45.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.386+0000 7f7f1f7fe640 1 --2- 172.21.15.132:0/3560951544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f200a96c0 0x7f7f20161200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:45.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.386+0000 7f7f1f7fe640 1 -- 172.21.15.132:0/3560951544 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f200d1410 msgr2=0x7f7f2014e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:45.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.386+0000 7f7f1f7fe640 1 --2- 172.21.15.132:0/3560951544 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f200d1410 0x7f7f2014e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:45.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.386+0000 7f7f1f7fe640 1 -- 172.21.15.132:0/3560951544 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f200d0370 con 0x7f7f080051c0 2024-04-16T15:52:45.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.386+0000 7f7f1f7fe640 1 --2- 172.21.15.132:0/3560951544 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f080051c0 0x7f7f200cfd90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7f10011c00 tx=0x7f7f1000f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:45.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.386+0000 7f7f07fff640 1 -- 172.21.15.132:0/3560951544 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f1000fca0 con 0x7f7f080051c0 2024-04-16T15:52:45.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.386+0000 7f7f07fff640 1 -- 172.21.15.132:0/3560951544 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f1000fe40 con 0x7f7f080051c0 2024-04-16T15:52:45.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.386+0000 7f7f07fff640 1 -- 172.21.15.132:0/3560951544 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f10014640 con 0x7f7f080051c0 2024-04-16T15:52:45.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.386+0000 7f7f25ba8640 1 -- 172.21.15.132:0/3560951544 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f200d0650 con 0x7f7f080051c0 2024-04-16T15:52:45.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.386+0000 7f7f25ba8640 1 -- 172.21.15.132:0/3560951544 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f200d0c10 con 0x7f7f080051c0 2024-04-16T15:52:45.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.387+0000 7f7f25ba8640 1 -- 172.21.15.132:0/3560951544 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f20075510 con 0x7f7f080051c0 2024-04-16T15:52:45.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.388+0000 7f7f07fff640 1 -- 172.21.15.132:0/3560951544 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7f10012040 con 0x7f7f080051c0 2024-04-16T15:52:45.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.388+0000 7f7f07fff640 1 --2- 172.21.15.132:0/3560951544 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f7f0c06c8f0 0x7f7f0c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:45.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.389+0000 7f7f07fff640 1 -- 172.21.15.132:0/3560951544 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7f1008c310 con 0x7f7f080051c0 2024-04-16T15:52:45.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.389+0000 7f7f1effd640 1 --2- 172.21.15.132:0/3560951544 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f7f0c06c8f0 0x7f7f0c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:45.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.389+0000 7f7f1effd640 1 --2- 172.21.15.132:0/3560951544 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f7f0c06c8f0 0x7f7f0c06edb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7f14001050 tx=0x7f7f14001ba0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:45.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.393+0000 7f7f07fff640 1 -- 172.21.15.132:0/3560951544 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7f10019030 con 0x7f7f080051c0 2024-04-16T15:52:45.574 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.575+0000 7f7f25ba8640 1 -- 172.21.15.132:0/3560951544 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f7f2015dfd0 con 0x7f7f080051c0 2024-04-16T15:52:45.575 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.576+0000 7f7f07fff640 1 -- 172.21.15.132:0/3560951544 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f7f1005a740 con 0x7f7f080051c0 2024-04-16T15:52:45.575 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2024-04-16T15:52:45.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.578+0000 7f7f25ba8640 1 -- 172.21.15.132:0/3560951544 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f7f0c06c8f0 msgr2=0x7f7f0c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:45.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.578+0000 7f7f25ba8640 1 --2- 172.21.15.132:0/3560951544 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f7f0c06c8f0 0x7f7f0c06edb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7f14001050 tx=0x7f7f14001ba0 comp rx=0 tx=0).stop 2024-04-16T15:52:45.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.578+0000 7f7f25ba8640 1 -- 172.21.15.132:0/3560951544 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f080051c0 msgr2=0x7f7f200cfd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:45.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.578+0000 7f7f25ba8640 1 --2- 172.21.15.132:0/3560951544 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f080051c0 0x7f7f200cfd90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7f10011c00 tx=0x7f7f1000f610 comp rx=0 tx=0).stop 2024-04-16T15:52:45.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.578+0000 7f7f25ba8640 1 -- 172.21.15.132:0/3560951544 shutdown_connections 2024-04-16T15:52:45.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.578+0000 7f7f25ba8640 1 --2- 172.21.15.132:0/3560951544 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f7f0c06c8f0 0x7f7f0c06edb0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:45.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.578+0000 7f7f25ba8640 1 --2- 172.21.15.132:0/3560951544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f200a96c0 0x7f7f20161200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:45.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.578+0000 7f7f25ba8640 1 --2- 172.21.15.132:0/3560951544 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f200d1410 0x7f7f2014e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:45.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.578+0000 7f7f25ba8640 1 --2- 172.21.15.132:0/3560951544 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f080051c0 0x7f7f200cfd90 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:45.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.578+0000 7f7f25ba8640 1 -- 172.21.15.132:0/3560951544 >> 172.21.15.132:0/3560951544 conn(0x7f7f200b6b80 msgr2=0x7f7f2006f430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:45.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.578+0000 7f7f25ba8640 1 -- 172.21.15.132:0/3560951544 shutdown_connections 2024-04-16T15:52:45.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.578+0000 7f7f25ba8640 1 -- 172.21.15.132:0/3560951544 wait complete. 2024-04-16T15:52:45.589 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T15:52:45.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.699+0000 7f89f578d640 1 Processor -- start 2024-04-16T15:52:45.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.699+0000 7f89f578d640 1 -- start start 2024-04-16T15:52:45.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.700+0000 7f89f578d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f89f00ba6d0 0x7f89f00b6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:45.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.700+0000 7f89f578d640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89f006d580 con 0x7f89f015edf0 2024-04-16T15:52:45.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.700+0000 7f89f578d640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89f006d850 con 0x7f89f015ea10 2024-04-16T15:52:45.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.700+0000 7f89f578d640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f89f00d2f70 con 0x7f89f00ba6d0 2024-04-16T15:52:45.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.700+0000 7f89ef7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f89f015edf0 0x7f89f00d3400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:35312/0 (socket says 172.21.15.132:35312) 2024-04-16T15:52:45.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.700+0000 7f89ef7fe640 1 -- 172.21.15.132:0/633784205 learned_addr learned my addr 172.21.15.132:0/633784205 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:45.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.700+0000 7f89ee7fc640 1 --2- 172.21.15.132:0/633784205 >> v2:172.21.15.179:3300/0 conn(0x7f89f00ba6d0 0x7f89f00b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:45.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.700+0000 7f89edffb640 1 -- 172.21.15.132:0/633784205 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4007014568 0 0) 0x7f89f006d580 con 0x7f89f015edf0 2024-04-16T15:52:45.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.700+0000 7f89edffb640 1 -- 172.21.15.132:0/633784205 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89dc003520 con 0x7f89f015edf0 2024-04-16T15:52:45.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.700+0000 7f89edffb640 1 -- 172.21.15.132:0/633784205 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1225978426 0 0) 0x7f89dc003520 con 0x7f89f015edf0 2024-04-16T15:52:45.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.700+0000 7f89edffb640 1 -- 172.21.15.132:0/633784205 >> v2:172.21.15.179:3300/0 conn(0x7f89f00ba6d0 msgr2=0x7f89f00b6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:45.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.700+0000 7f89edffb640 1 --2- 172.21.15.132:0/633784205 >> v2:172.21.15.179:3300/0 conn(0x7f89f00ba6d0 0x7f89f00b6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:45.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.700+0000 7f89edffb640 1 -- 172.21.15.132:0/633784205 >> v1:172.21.15.179:6789/0 conn(0x7f89f015ea10 legacy=0x7f89f006ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:45.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.700+0000 7f89edffb640 1 -- 172.21.15.132:0/633784205 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89f006db30 con 0x7f89f015edf0 2024-04-16T15:52:45.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.700+0000 7f89edffb640 1 -- 172.21.15.132:0/633784205 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2803668828 0 0) 0x7f89e80019f0 con 0x7f89f015edf0 2024-04-16T15:52:45.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.701+0000 7f89edffb640 1 -- 172.21.15.132:0/633784205 >> v1:172.21.15.132:6789/0 conn(0x7f89f015edf0 legacy=0x7f89f00d3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:45.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.701+0000 7f89edffb640 1 --2- 172.21.15.132:0/633784205 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89dc0039b0 0x7f89dc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:45.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.701+0000 7f89edffb640 1 --2- 172.21.15.132:0/633784205 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89dc004800 0x7f89dc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:45.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.701+0000 7f89edffb640 1 --2- 172.21.15.132:0/633784205 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89dc0051c0 0x7f89dc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:45.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.701+0000 7f89edffb640 1 -- 172.21.15.132:0/633784205 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f89dc00c030 con 0x7f89dc004800 2024-04-16T15:52:45.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.701+0000 7f89edffb640 1 -- 172.21.15.132:0/633784205 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f89dc00c1e0 con 0x7f89dc0039b0 2024-04-16T15:52:45.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.701+0000 7f89edffb640 1 -- 172.21.15.132:0/633784205 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f89dc00c3e0 con 0x7f89dc0051c0 2024-04-16T15:52:45.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.701+0000 7f89ee7fc640 1 --2- 172.21.15.132:0/633784205 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89dc004800 0x7f89dc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:45.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.701+0000 7f89eeffd640 1 --2- 172.21.15.132:0/633784205 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89dc0039b0 0x7f89dc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:45.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.701+0000 7f89ef7fe640 1 --2- 172.21.15.132:0/633784205 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89dc0051c0 0x7f89dc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:45.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.701+0000 7f89ee7fc640 1 -- 172.21.15.132:0/633784205 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89dc0051c0 msgr2=0x7f89dc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:45.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.701+0000 7f89ee7fc640 1 --2- 172.21.15.132:0/633784205 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89dc0051c0 0x7f89dc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:45.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.701+0000 7f89ee7fc640 1 -- 172.21.15.132:0/633784205 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89dc0039b0 msgr2=0x7f89dc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:45.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.701+0000 7f89ee7fc640 1 --2- 172.21.15.132:0/633784205 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89dc0039b0 0x7f89dc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:45.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.701+0000 7f89ee7fc640 1 -- 172.21.15.132:0/633784205 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89dc003520 con 0x7f89dc004800 2024-04-16T15:52:45.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.701+0000 7f89ef7fe640 1 -- 172.21.15.132:0/633784205 reap_dead start 2024-04-16T15:52:45.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.702+0000 7f89ee7fc640 1 --2- 172.21.15.132:0/633784205 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89dc004800 0x7f89dc004c80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f89e0009a90 tx=0x7f89dc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db25a4379bed9178 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:45.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.702+0000 7f89edffb640 1 -- 172.21.15.132:0/633784205 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e0039070 con 0x7f89dc004800 2024-04-16T15:52:45.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.702+0000 7f89edffb640 1 -- 172.21.15.132:0/633784205 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89e002c680 con 0x7f89dc004800 2024-04-16T15:52:45.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.702+0000 7f89edffb640 1 -- 172.21.15.132:0/633784205 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e0009690 con 0x7f89dc004800 2024-04-16T15:52:45.706 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.703+0000 7f89f578d640 1 -- 172.21.15.132:0/633784205 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89dc004800 msgr2=0x7f89dc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:45.706 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.703+0000 7f89f578d640 1 --2- 172.21.15.132:0/633784205 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89dc004800 0x7f89dc004c80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f89e0009a90 tx=0x7f89dc005830 comp rx=0 tx=0).stop 2024-04-16T15:52:45.706 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.703+0000 7f89f578d640 1 -- 172.21.15.132:0/633784205 shutdown_connections 2024-04-16T15:52:45.706 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.703+0000 7f89f578d640 1 --2- 172.21.15.132:0/633784205 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89dc004800 0x7f89dc004c80 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:45.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.703+0000 7f89f578d640 1 -- 172.21.15.132:0/633784205 >> 172.21.15.132:0/633784205 conn(0x7f89f00d17c0 msgr2=0x7f89f00d1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:45.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.703+0000 7f89f578d640 1 -- 172.21.15.132:0/633784205 shutdown_connections 2024-04-16T15:52:45.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.703+0000 7f89f578d640 1 -- 172.21.15.132:0/633784205 wait complete. 2024-04-16T15:52:45.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.704+0000 7f89f578d640 1 Processor -- start 2024-04-16T15:52:45.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.704+0000 7f89f578d640 1 -- start start 2024-04-16T15:52:45.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.705+0000 7f89f578d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89dc004800 0x7f89f01554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:45.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.705+0000 7f89f578d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89f01539f0 0x7f89f015fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:45.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.705+0000 7f89f578d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89f01615e0 0x7f89f0161a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:45.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.705+0000 7f89f578d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f89f006cff0 con 0x7f89f01539f0 2024-04-16T15:52:45.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.705+0000 7f89f578d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f89f006ce70 con 0x7f89f01615e0 2024-04-16T15:52:45.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.705+0000 7f89f578d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f89f006d170 con 0x7f89dc004800 2024-04-16T15:52:45.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.705+0000 7f89ee7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89f01539f0 0x7f89f015fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:45.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.705+0000 7f89ee7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89f01539f0 0x7f89f015fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53526/0 (socket says 172.21.15.132:53526) 2024-04-16T15:52:45.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.705+0000 7f89ee7fc640 1 -- 172.21.15.132:0/4005260523 learned_addr learned my addr 172.21.15.132:0/4005260523 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:45.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.705+0000 7f89ef7fe640 1 --2- 172.21.15.132:0/4005260523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89f01615e0 0x7f89f0161a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:45.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.705+0000 7f89eeffd640 1 --2- 172.21.15.132:0/4005260523 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89dc004800 0x7f89f01554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:45.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.705+0000 7f89ee7fc640 1 -- 172.21.15.132:0/4005260523 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89dc004800 msgr2=0x7f89f01554d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:45.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.705+0000 7f89ee7fc640 1 --2- 172.21.15.132:0/4005260523 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89dc004800 0x7f89f01554d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:45.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.705+0000 7f89ee7fc640 1 -- 172.21.15.132:0/4005260523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89f01615e0 msgr2=0x7f89f0161a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:45.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.705+0000 7f89ee7fc640 1 --2- 172.21.15.132:0/4005260523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89f01615e0 0x7f89f0161a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:45.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.705+0000 7f89ee7fc640 1 -- 172.21.15.132:0/4005260523 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89f015f3a0 con 0x7f89f01539f0 2024-04-16T15:52:45.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.705+0000 7f89eeffd640 1 --2- 172.21.15.132:0/4005260523 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89dc004800 0x7f89f01554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:45.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.706+0000 7f89ee7fc640 1 --2- 172.21.15.132:0/4005260523 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89f01539f0 0x7f89f015fbb0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f89e0000c00 tx=0x7f89e0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:45.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.706+0000 7f89e77fe640 1 -- 172.21.15.132:0/4005260523 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e0042020 con 0x7f89f01539f0 2024-04-16T15:52:45.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.706+0000 7f89e77fe640 1 -- 172.21.15.132:0/4005260523 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89e003a040 con 0x7f89f01539f0 2024-04-16T15:52:45.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.706+0000 7f89e77fe640 1 -- 172.21.15.132:0/4005260523 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e0039070 con 0x7f89f01539f0 2024-04-16T15:52:45.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.706+0000 7f89f578d640 1 -- 172.21.15.132:0/4005260523 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89f015f680 con 0x7f89f01539f0 2024-04-16T15:52:45.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.706+0000 7f89f578d640 1 -- 172.21.15.132:0/4005260523 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89f0161fa0 con 0x7f89f01539f0 2024-04-16T15:52:45.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.707+0000 7f89f578d640 1 -- 172.21.15.132:0/4005260523 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89f0075510 con 0x7f89f01539f0 2024-04-16T15:52:45.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.707+0000 7f89e77fe640 1 -- 172.21.15.132:0/4005260523 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f89e0045020 con 0x7f89f01539f0 2024-04-16T15:52:45.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.708+0000 7f89e77fe640 1 --2- 172.21.15.132:0/4005260523 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f89d006c920 0x7f89d006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:45.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.708+0000 7f89eeffd640 1 --2- 172.21.15.132:0/4005260523 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f89d006c920 0x7f89d006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:45.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.708+0000 7f89e77fe640 1 -- 172.21.15.132:0/4005260523 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f89e00aca90 con 0x7f89f01539f0 2024-04-16T15:52:45.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.709+0000 7f89eeffd640 1 --2- 172.21.15.132:0/4005260523 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f89d006c920 0x7f89d006ede0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f89d8000c00 tx=0x7f89d8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:45.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.712+0000 7f89e77fe640 1 -- 172.21.15.132:0/4005260523 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f89e004c020 con 0x7f89f01539f0 2024-04-16T15:52:45.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.896+0000 7f89f578d640 1 -- 172.21.15.132:0/4005260523 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f89f00d25a0 con 0x7f89f01539f0 2024-04-16T15:52:45.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.896+0000 7f89e77fe640 1 -- 172.21.15.132:0/4005260523 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f89e007a900 con 0x7f89f01539f0 2024-04-16T15:52:45.896 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2024-04-16T15:52:45.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.898+0000 7f89f578d640 1 -- 172.21.15.132:0/4005260523 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f89d006c920 msgr2=0x7f89d006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:45.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.898+0000 7f89f578d640 1 --2- 172.21.15.132:0/4005260523 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f89d006c920 0x7f89d006ede0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f89d8000c00 tx=0x7f89d8009040 comp rx=0 tx=0).stop 2024-04-16T15:52:45.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.898+0000 7f89f578d640 1 -- 172.21.15.132:0/4005260523 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89f01539f0 msgr2=0x7f89f015fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:45.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.898+0000 7f89f578d640 1 --2- 172.21.15.132:0/4005260523 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89f01539f0 0x7f89f015fbb0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f89e0000c00 tx=0x7f89e0004730 comp rx=0 tx=0).stop 2024-04-16T15:52:45.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.898+0000 7f89f578d640 1 -- 172.21.15.132:0/4005260523 shutdown_connections 2024-04-16T15:52:45.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.898+0000 7f89f578d640 1 --2- 172.21.15.132:0/4005260523 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f89d006c920 0x7f89d006ede0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:45.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.898+0000 7f89f578d640 1 --2- 172.21.15.132:0/4005260523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89f01615e0 0x7f89f0161a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:45.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.898+0000 7f89f578d640 1 --2- 172.21.15.132:0/4005260523 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89f01539f0 0x7f89f015fbb0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:45.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.898+0000 7f89f578d640 1 --2- 172.21.15.132:0/4005260523 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89dc004800 0x7f89f01554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:45.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.898+0000 7f89f578d640 1 -- 172.21.15.132:0/4005260523 >> 172.21.15.132:0/4005260523 conn(0x7f89f00d17c0 msgr2=0x7f89f00d3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:45.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.898+0000 7f89f578d640 1 -- 172.21.15.132:0/4005260523 shutdown_connections 2024-04-16T15:52:45.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:45.898+0000 7f89f578d640 1 -- 172.21.15.132:0/4005260523 wait complete. 2024-04-16T15:52:45.909 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-16T15:52:46.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.016+0000 7fa11a888640 1 Processor -- start 2024-04-16T15:52:46.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.016+0000 7fa11a888640 1 -- start start 2024-04-16T15:52:46.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.016+0000 7fa11a888640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa11406c130 0x7fa1140b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:46.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.016+0000 7fa11a888640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa1141462e0 0x7fa1140cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:46.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.016+0000 7fa11a888640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa114160480 con 0x7fa114145f00 2024-04-16T15:52:46.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.016+0000 7fa11a888640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fa114160760 con 0x7fa1141462e0 2024-04-16T15:52:46.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.016+0000 7fa11a888640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fa114160a40 con 0x7fa11406c130 2024-04-16T15:52:46.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.017+0000 7fa118e25640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa1141462e0 0x7fa1140cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:46.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.017+0000 7fa118e25640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa1141462e0 0x7fa1140cf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53532/0 (socket says 172.21.15.132:53532) 2024-04-16T15:52:46.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.017+0000 7fa118e25640 1 -- 172.21.15.132:0/479512223 learned_addr learned my addr 172.21.15.132:0/479512223 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:46.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.017+0000 7fa10bfff640 1 --2- 172.21.15.132:0/479512223 >> v2:172.21.15.179:3300/0 conn(0x7fa11406c130 0x7fa1140b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:46.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.017+0000 7fa118e25640 1 -- 172.21.15.132:0/479512223 >> v2:172.21.15.179:3300/0 conn(0x7fa11406c130 msgr2=0x7fa1140b3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:46.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.017+0000 7fa118e25640 1 --2- 172.21.15.132:0/479512223 >> v2:172.21.15.179:3300/0 conn(0x7fa11406c130 0x7fa1140b3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:46.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.017+0000 7fa118e25640 1 -- 172.21.15.132:0/479512223 >> v1:172.21.15.179:6789/0 conn(0x7fa114145f00 legacy=0x7fa11406ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:46.018 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.017+0000 7fa118e25640 1 -- 172.21.15.132:0/479512223 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa114160d20 con 0x7fa1141462e0 2024-04-16T15:52:46.018 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.018+0000 7fa118e25640 1 --2- 172.21.15.132:0/479512223 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1141462e0 0x7fa1140cf720 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa11406caa0 tx=0x7fa10c02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10a0e97a25fd3df9 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:46.018 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.018+0000 7fa1137fe640 1 -- 172.21.15.132:0/479512223 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa10c02cb20 con 0x7fa1141462e0 2024-04-16T15:52:46.018 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.018+0000 7fa1137fe640 1 -- 172.21.15.132:0/479512223 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa10c02ccc0 con 0x7fa1141462e0 2024-04-16T15:52:46.018 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.018+0000 7fa1137fe640 1 -- 172.21.15.132:0/479512223 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa10c034610 con 0x7fa1141462e0 2024-04-16T15:52:46.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.019+0000 7fa11a888640 1 -- 172.21.15.132:0/479512223 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1141462e0 msgr2=0x7fa1140cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:46.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.019+0000 7fa11a888640 1 --2- 172.21.15.132:0/479512223 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1141462e0 0x7fa1140cf720 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa11406caa0 tx=0x7fa10c02bf80 comp rx=0 tx=0).stop 2024-04-16T15:52:46.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.019+0000 7fa11a888640 1 -- 172.21.15.132:0/479512223 shutdown_connections 2024-04-16T15:52:46.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.019+0000 7fa11a888640 1 --2- 172.21.15.132:0/479512223 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1141462e0 0x7fa1140cf720 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:46.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.019+0000 7fa11a888640 1 --2- 172.21.15.132:0/479512223 >> v2:172.21.15.179:3300/0 conn(0x7fa11406c130 0x7fa1140b3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:46.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.019+0000 7fa11a888640 1 -- 172.21.15.132:0/479512223 >> 172.21.15.132:0/479512223 conn(0x7fa114067ff0 msgr2=0x7fa1140b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:46.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.019+0000 7fa11a888640 1 -- 172.21.15.132:0/479512223 shutdown_connections 2024-04-16T15:52:46.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.019+0000 7fa11a888640 1 -- 172.21.15.132:0/479512223 wait complete. 2024-04-16T15:52:46.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.020+0000 7fa11a888640 1 Processor -- start 2024-04-16T15:52:46.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.020+0000 7fa11a888640 1 -- start start 2024-04-16T15:52:46.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.021+0000 7fa11a888640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa11406c130 0x7fa11415c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:46.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.021+0000 7fa11a888640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa114145f00 0x7fa1140b4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:46.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.021+0000 7fa11a888640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1141462e0 0x7fa1140b4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:46.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.021+0000 7fa11a888640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fa1140cfde0 con 0x7fa11406c130 2024-04-16T15:52:46.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.021+0000 7fa11a888640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa1140cfc60 con 0x7fa114145f00 2024-04-16T15:52:46.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.021+0000 7fa11a888640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fa1140cff60 con 0x7fa1141462e0 2024-04-16T15:52:46.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.021+0000 7fa113fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa11406c130 0x7fa11415c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:46.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.021+0000 7fa113fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa11406c130 0x7fa11415c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53536/0 (socket says 172.21.15.132:53536) 2024-04-16T15:52:46.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.021+0000 7fa113fff640 1 -- 172.21.15.132:0/4259961838 learned_addr learned my addr 172.21.15.132:0/4259961838 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:46.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.021+0000 7fa10bfff640 1 --2- 172.21.15.132:0/4259961838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa114145f00 0x7fa1140b4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:46.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.021+0000 7fa118e25640 1 --2- 172.21.15.132:0/4259961838 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1141462e0 0x7fa1140b4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:46.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.021+0000 7fa113fff640 1 -- 172.21.15.132:0/4259961838 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1141462e0 msgr2=0x7fa1140b4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:46.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.021+0000 7fa113fff640 1 --2- 172.21.15.132:0/4259961838 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1141462e0 0x7fa1140b4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:46.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.021+0000 7fa113fff640 1 -- 172.21.15.132:0/4259961838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa114145f00 msgr2=0x7fa1140b4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:46.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.021+0000 7fa113fff640 1 --2- 172.21.15.132:0/4259961838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa114145f00 0x7fa1140b4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:46.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.021+0000 7fa113fff640 1 -- 172.21.15.132:0/4259961838 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1141f8b00 con 0x7fa11406c130 2024-04-16T15:52:46.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.021+0000 7fa118e25640 1 --2- 172.21.15.132:0/4259961838 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1141462e0 0x7fa1140b4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:46.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.021+0000 7fa10bfff640 1 --2- 172.21.15.132:0/4259961838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa114145f00 0x7fa1140b4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:46.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.021+0000 7fa113fff640 1 --2- 172.21.15.132:0/4259961838 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa11406c130 0x7fa11415c070 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa10400c400 tx=0x7fa10400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:46.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.021+0000 7fa1117fa640 1 -- 172.21.15.132:0/4259961838 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1040052d0 con 0x7fa11406c130 2024-04-16T15:52:46.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.022+0000 7fa1117fa640 1 -- 172.21.15.132:0/4259961838 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa104005490 con 0x7fa11406c130 2024-04-16T15:52:46.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.022+0000 7fa11a888640 1 -- 172.21.15.132:0/4259961838 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa114134fb0 con 0x7fa11406c130 2024-04-16T15:52:46.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.022+0000 7fa1117fa640 1 -- 172.21.15.132:0/4259961838 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa104007260 con 0x7fa11406c130 2024-04-16T15:52:46.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.022+0000 7fa11a888640 1 -- 172.21.15.132:0/4259961838 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa114135570 con 0x7fa11406c130 2024-04-16T15:52:46.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.023+0000 7fa11a888640 1 -- 172.21.15.132:0/4259961838 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1140cea90 con 0x7fa11406c130 2024-04-16T15:52:46.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.023+0000 7fa1117fa640 1 -- 172.21.15.132:0/4259961838 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa104007400 con 0x7fa11406c130 2024-04-16T15:52:46.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.024+0000 7fa1117fa640 1 --2- 172.21.15.132:0/4259961838 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fa0f406c8f0 0x7fa0f406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:46.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.024+0000 7fa10bfff640 1 --2- 172.21.15.132:0/4259961838 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fa0f406c8f0 0x7fa0f406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:46.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.024+0000 7fa1117fa640 1 -- 172.21.15.132:0/4259961838 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa10408b0e0 con 0x7fa11406c130 2024-04-16T15:52:46.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.024+0000 7fa10bfff640 1 --2- 172.21.15.132:0/4259961838 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fa0f406c8f0 0x7fa0f406edb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa114132c50 tx=0x7fa0fc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:46.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.028+0000 7fa1117fa640 1 -- 172.21.15.132:0/4259961838 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa1140cea90 con 0x7fa11406c130 2024-04-16T15:52:46.218 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.219+0000 7fa11a888640 1 -- 172.21.15.132:0/4259961838 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa114075510 con 0x7fa11406c130 2024-04-16T15:52:46.218 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.219+0000 7fa1117fa640 1 -- 172.21.15.132:0/4259961838 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7fa104059510 con 0x7fa11406c130 2024-04-16T15:52:46.218 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2024-04-16T15:52:46.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.221+0000 7fa11a888640 1 -- 172.21.15.132:0/4259961838 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fa0f406c8f0 msgr2=0x7fa0f406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:46.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.221+0000 7fa11a888640 1 --2- 172.21.15.132:0/4259961838 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fa0f406c8f0 0x7fa0f406edb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa114132c50 tx=0x7fa0fc008040 comp rx=0 tx=0).stop 2024-04-16T15:52:46.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.221+0000 7fa11a888640 1 -- 172.21.15.132:0/4259961838 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa11406c130 msgr2=0x7fa11415c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:46.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.221+0000 7fa11a888640 1 --2- 172.21.15.132:0/4259961838 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa11406c130 0x7fa11415c070 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa10400c400 tx=0x7fa10400c8c0 comp rx=0 tx=0).stop 2024-04-16T15:52:46.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.221+0000 7fa11a888640 1 -- 172.21.15.132:0/4259961838 shutdown_connections 2024-04-16T15:52:46.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.221+0000 7fa11a888640 1 --2- 172.21.15.132:0/4259961838 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fa0f406c8f0 0x7fa0f406edb0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:46.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.221+0000 7fa11a888640 1 --2- 172.21.15.132:0/4259961838 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1141462e0 0x7fa1140b4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:46.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.221+0000 7fa11a888640 1 --2- 172.21.15.132:0/4259961838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa114145f00 0x7fa1140b4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:46.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.221+0000 7fa11a888640 1 --2- 172.21.15.132:0/4259961838 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa11406c130 0x7fa11415c070 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:46.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.221+0000 7fa11a888640 1 -- 172.21.15.132:0/4259961838 >> 172.21.15.132:0/4259961838 conn(0x7fa114067ff0 msgr2=0x7fa114143e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:46.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.221+0000 7fa11a888640 1 -- 172.21.15.132:0/4259961838 shutdown_connections 2024-04-16T15:52:46.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.221+0000 7fa11a888640 1 -- 172.21.15.132:0/4259961838 wait complete. 2024-04-16T15:52:46.232 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-16T15:52:46.232 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T15:52:46.247 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:52:46.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.393+0000 7fac8ea9a640 1 Processor -- start 2024-04-16T15:52:46.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.393+0000 7fac8ea9a640 1 -- start start 2024-04-16T15:52:46.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.394+0000 7fac8ea9a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fac8809ab80 0x7fac880d1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:46.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.394+0000 7fac8ea9a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac880b3060 0x7fac880b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:46.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.394+0000 7fac8ea9a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac880d1730 con 0x7fac8809af60 2024-04-16T15:52:46.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.394+0000 7fac8ea9a640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fac880b2bd0 con 0x7fac8809ab80 2024-04-16T15:52:46.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.394+0000 7fac8ea9a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fac880b22a0 con 0x7fac880b3060 2024-04-16T15:52:46.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.394+0000 7fac8c836640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fac8809ab80 0x7fac880d1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:46.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.394+0000 7fac8d037640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac880b3060 0x7fac880b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:46.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.394+0000 7fac87fff640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fac8809af60 0x7fac880cd290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.132:53256/0 (socket says 172.21.15.132:53256) 2024-04-16T15:52:46.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.394+0000 7fac8c836640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fac8809ab80 0x7fac880d1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.132:47870/0 (socket says 172.21.15.132:47870) 2024-04-16T15:52:46.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.394+0000 7fac87fff640 1 -- 172.21.15.132:0/170671584 learned_addr learned my addr 172.21.15.132:0/170671584 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:46.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.394+0000 7fac8d037640 1 --2- 172.21.15.132:0/170671584 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac880b3060 0x7fac880b34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.132:59382/0 (socket says 172.21.15.132:59382) 2024-04-16T15:52:46.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.395+0000 7fac8c836640 1 -- 172.21.15.132:0/170671584 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac880b3060 msgr2=0x7fac880b34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:46.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.395+0000 7fac8c836640 1 --2- 172.21.15.132:0/170671584 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac880b3060 0x7fac880b34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:46.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.395+0000 7fac8c836640 1 -- 172.21.15.132:0/170671584 >> v1:172.21.15.179:6789/0 conn(0x7fac8809af60 legacy=0x7fac880cd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:46.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.395+0000 7fac8c836640 1 -- 172.21.15.132:0/170671584 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac880b2580 con 0x7fac8809ab80 2024-04-16T15:52:46.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.395+0000 7fac877fe640 1 -- 172.21.15.132:0/170671584 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 946200723 0 0) 0x7fac880d1730 con 0x7fac8809af60 2024-04-16T15:52:46.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.395+0000 7fac8d037640 1 --2- 172.21.15.132:0/170671584 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac880b3060 0x7fac880b34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:52:46.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.395+0000 7fac8c836640 1 --2- 172.21.15.132:0/170671584 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac8809ab80 0x7fac880d1150 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fac880b2d50 tx=0x7fac7c02b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94e5cdc4a2bb6c93 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:46.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.396+0000 7fac877fe640 1 -- 172.21.15.132:0/170671584 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7c035020 con 0x7fac8809ab80 2024-04-16T15:52:46.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.396+0000 7fac877fe640 1 -- 172.21.15.132:0/170671584 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac7c031800 con 0x7fac8809ab80 2024-04-16T15:52:46.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.396+0000 7fac877fe640 1 -- 172.21.15.132:0/170671584 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7c031bd0 con 0x7fac8809ab80 2024-04-16T15:52:46.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.396+0000 7fac8ea9a640 1 -- 172.21.15.132:0/170671584 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac8809ab80 msgr2=0x7fac880d1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:46.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.396+0000 7fac8ea9a640 1 --2- 172.21.15.132:0/170671584 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac8809ab80 0x7fac880d1150 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fac880b2d50 tx=0x7fac7c02b8a0 comp rx=0 tx=0).stop 2024-04-16T15:52:46.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.396+0000 7fac8ea9a640 1 -- 172.21.15.132:0/170671584 shutdown_connections 2024-04-16T15:52:46.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.396+0000 7fac8ea9a640 1 --2- 172.21.15.132:0/170671584 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac880b3060 0x7fac880b34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:46.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.396+0000 7fac8ea9a640 1 --2- 172.21.15.132:0/170671584 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac8809ab80 0x7fac880d1150 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:46.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.396+0000 7fac8ea9a640 1 -- 172.21.15.132:0/170671584 >> 172.21.15.132:0/170671584 conn(0x7fac880b4450 msgr2=0x7fac880b4860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:46.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.396+0000 7fac8ea9a640 1 -- 172.21.15.132:0/170671584 shutdown_connections 2024-04-16T15:52:46.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.396+0000 7fac8ea9a640 1 -- 172.21.15.132:0/170671584 wait complete. 2024-04-16T15:52:46.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.397+0000 7fac8ea9a640 1 Processor -- start 2024-04-16T15:52:46.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.397+0000 7fac8ea9a640 1 -- start start 2024-04-16T15:52:46.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.398+0000 7fac8ea9a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac8809ab80 0x7fac880cc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:46.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.398+0000 7fac8ea9a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac8809af60 0x7fac880b6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:46.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.398+0000 7fac8ea9a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac880b3060 0x7fac8814daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:46.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.398+0000 7fac8ea9a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fac880b1a80 con 0x7fac8809ab80 2024-04-16T15:52:46.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.398+0000 7fac8ea9a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fac880cd9a0 con 0x7fac880b3060 2024-04-16T15:52:46.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.398+0000 7fac8ea9a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fac8809b3e0 con 0x7fac8809af60 2024-04-16T15:52:46.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.398+0000 7fac8c836640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac8809ab80 0x7fac880cc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:46.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.398+0000 7fac8c836640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac8809ab80 0x7fac880cc8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53550/0 (socket says 172.21.15.132:53550) 2024-04-16T15:52:46.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.398+0000 7fac8c836640 1 -- 172.21.15.132:0/3616845109 learned_addr learned my addr 172.21.15.132:0/3616845109 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:46.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.399+0000 7fac8d037640 1 --2- 172.21.15.132:0/3616845109 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac880b3060 0x7fac8814daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:46.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.399+0000 7fac87fff640 1 --2- 172.21.15.132:0/3616845109 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac8809af60 0x7fac880b6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:46.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.399+0000 7fac8c836640 1 -- 172.21.15.132:0/3616845109 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac8809af60 msgr2=0x7fac880b6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:46.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.399+0000 7fac8c836640 1 --2- 172.21.15.132:0/3616845109 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac8809af60 0x7fac880b6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:46.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.399+0000 7fac8c836640 1 -- 172.21.15.132:0/3616845109 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac880b3060 msgr2=0x7fac8814daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:46.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.399+0000 7fac8c836640 1 --2- 172.21.15.132:0/3616845109 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac880b3060 0x7fac8814daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:46.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.399+0000 7fac8c836640 1 -- 172.21.15.132:0/3616845109 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac880b7530 con 0x7fac8809ab80 2024-04-16T15:52:46.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.399+0000 7fac87fff640 1 --2- 172.21.15.132:0/3616845109 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac8809af60 0x7fac880b6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:46.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.399+0000 7fac8c836640 1 --2- 172.21.15.132:0/3616845109 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac8809ab80 0x7fac880cc8a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fac7c009890 tx=0x7fac7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:46.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.399+0000 7fac857fa640 1 -- 172.21.15.132:0/3616845109 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7c035050 con 0x7fac8809ab80 2024-04-16T15:52:46.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.399+0000 7fac857fa640 1 -- 172.21.15.132:0/3616845109 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac7c03bd70 con 0x7fac8809ab80 2024-04-16T15:52:46.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.399+0000 7fac8ea9a640 1 -- 172.21.15.132:0/3616845109 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac880b7810 con 0x7fac8809ab80 2024-04-16T15:52:46.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.399+0000 7fac857fa640 1 -- 172.21.15.132:0/3616845109 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7c006e10 con 0x7fac8809ab80 2024-04-16T15:52:46.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.399+0000 7fac8ea9a640 1 -- 172.21.15.132:0/3616845109 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac880b7dd0 con 0x7fac8809ab80 2024-04-16T15:52:46.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.400+0000 7fac8ea9a640 1 -- 172.21.15.132:0/3616845109 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac88075510 con 0x7fac8809ab80 2024-04-16T15:52:46.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.401+0000 7fac857fa640 1 -- 172.21.15.132:0/3616845109 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fac7c038020 con 0x7fac8809ab80 2024-04-16T15:52:46.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.401+0000 7fac857fa640 1 --2- 172.21.15.132:0/3616845109 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fac6c06c8f0 0x7fac6c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:46.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.402+0000 7fac857fa640 1 -- 172.21.15.132:0/3616845109 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fac7c0ad920 con 0x7fac8809ab80 2024-04-16T15:52:46.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.402+0000 7fac87fff640 1 --2- 172.21.15.132:0/3616845109 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fac6c06c8f0 0x7fac6c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:46.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.402+0000 7fac87fff640 1 --2- 172.21.15.132:0/3616845109 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fac6c06c8f0 0x7fac6c06edb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fac880b2270 tx=0x7fac74007c10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:46.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.406+0000 7fac857fa640 1 -- 172.21.15.132:0/3616845109 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fac7c040070 con 0x7fac8809ab80 2024-04-16T15:52:46.584 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.585+0000 7fac8ea9a640 1 -- 172.21.15.132:0/3616845109 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fac880b88e0 con 0x7fac8809ab80 2024-04-16T15:52:46.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.586+0000 7fac857fa640 1 -- 172.21.15.132:0/3616845109 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7fac7c07bde0 con 0x7fac8809ab80 2024-04-16T15:52:46.586 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:52:46.586 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"6bdec5d9-f406-43ad-8584-0503b32f6f0d","created":"2024-04-16T15:51:51.073040+0000","modified":"2024-04-16T15:52:16.950186+0000","last_up_change":"2024-04-16T15:52:02.280496+0000","last_in_change":"2024-04-16T15:51:53.376468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:52:03.284927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:52:13.363758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T15:52:14.246647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d45908b-6e22-4619-b190-897af594b712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6801","nonce":1170594668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6803","nonce":1170594668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6807","nonce":1170594668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6805","nonce":1170594668}]},"public_addr":"172.21.15.132:6801/1170594668","cluster_addr":"172.21.15.132:6803/1170594668","heartbeat_back_addr":"172.21.15.132:6807/1170594668","heartbeat_front_addr":"172.21.15.132:6805/1170594668","state":["exists","up"]},{"osd":1,"uuid":"c88bf082-e51f-4ee6-815a-025f6ce0d67b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6809","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6811","nonce":2494780358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6815","nonce":2494780358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6823","nonce":2494780358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6819","nonce":2494780358}]},"public_addr":"172.21.15.132:6811/2494780358","cluster_addr":"172.21.15.132:6815/2494780358","heartbeat_back_addr":"172.21.15.132:6823/2494780358","heartbeat_front_addr":"172.21.15.132:6819/2494780358","state":["exists","up"]},{"osd":2,"uuid":"e5dbd6b4-4e7b-47e4-ad4e-35b4b81696c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6825","nonce":27655483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6827","nonce":27655483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6831","nonce":27655483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6829","nonce":27655483}]},"public_addr":"172.21.15.132:6825/27655483","cluster_addr":"172.21.15.132:6827/27655483","heartbeat_back_addr":"172.21.15.132:6831/27655483","heartbeat_front_addr":"172.21.15.132:6829/27655483","state":["exists","up"]},{"osd":3,"uuid":"9d75cd67-3b8a-4424-8884-5f3660e1f5f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6810","nonce":3100919191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6814","nonce":3100919191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6821","nonce":3100919191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6818","nonce":3100919191}]},"public_addr":"172.21.15.132:6810/3100919191","cluster_addr":"172.21.15.132:6814/3100919191","heartbeat_back_addr":"172.21.15.132:6821/3100919191","heartbeat_front_addr":"172.21.15.132:6818/3100919191","state":["exists","up"]},{"osd":4,"uuid":"83aea46a-8642-4777-912b-c130e5890da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6825","nonce":123637799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6827","nonce":123637799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6831","nonce":123637799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6829","nonce":123637799}]},"public_addr":"172.21.15.179:6825/123637799","cluster_addr":"172.21.15.179:6827/123637799","heartbeat_back_addr":"172.21.15.179:6831/123637799","heartbeat_front_addr":"172.21.15.179:6829/123637799","state":["exists","up"]},{"osd":5,"uuid":"534117c8-3317-48d6-b436-afd5709f71e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6801","nonce":2224750370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6803","nonce":2224750370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6807","nonce":2224750370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6805","nonce":2224750370}]},"public_addr":"172.21.15.179:6801/2224750370","cluster_addr":"172.21.15.179:6803/2224750370","heartbeat_back_addr":"172.21.15.179:6807/2224750370","heartbeat_front_addr":"172.21.15.179:6805/2224750370","state":["exists","up"]},{"osd":6,"uuid":"0ba363e7-fa9d-42b1-ae09-a6a0f57d41f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6809","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6811","nonce":101498164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6813","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6815","nonce":101498164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6823","nonce":101498164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6819","nonce":101498164}]},"public_addr":"172.21.15.179:6811/101498164","cluster_addr":"172.21.15.179:6815/101498164","heartbeat_back_addr":"172.21.15.179:6823/101498164","heartbeat_front_addr":"172.21.15.179:6819/101498164","state":["exists","up"]},{"osd":7,"uuid":"e6830c77-2f2d-4067-9866-ee7625afc1a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6810","nonce":872148365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6814","nonce":872148365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6822","nonce":872148365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6818","nonce":872148365}]},"public_addr":"172.21.15.179:6810/872148365","cluster_addr":"172.21.15.179:6814/872148365","heartbeat_back_addr":"172.21.15.179:6822/872148365","heartbeat_front_addr":"172.21.15.179:6818/872148365","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.535221+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.563769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.520765+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.526264+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.517058+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.500842+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.534332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.512486+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:52:46.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.588+0000 7fac8ea9a640 1 -- 172.21.15.132:0/3616845109 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fac6c06c8f0 msgr2=0x7fac6c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:46.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.588+0000 7fac8ea9a640 1 --2- 172.21.15.132:0/3616845109 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fac6c06c8f0 0x7fac6c06edb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fac880b2270 tx=0x7fac74007c10 comp rx=0 tx=0).stop 2024-04-16T15:52:46.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.588+0000 7fac8ea9a640 1 -- 172.21.15.132:0/3616845109 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac8809ab80 msgr2=0x7fac880cc8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:46.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.588+0000 7fac8ea9a640 1 --2- 172.21.15.132:0/3616845109 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac8809ab80 0x7fac880cc8a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fac7c009890 tx=0x7fac7c0046c0 comp rx=0 tx=0).stop 2024-04-16T15:52:46.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.588+0000 7fac8ea9a640 1 -- 172.21.15.132:0/3616845109 shutdown_connections 2024-04-16T15:52:46.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.588+0000 7fac8ea9a640 1 --2- 172.21.15.132:0/3616845109 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fac6c06c8f0 0x7fac6c06edb0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:46.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.588+0000 7fac8ea9a640 1 --2- 172.21.15.132:0/3616845109 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac880b3060 0x7fac8814daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:46.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.588+0000 7fac8ea9a640 1 --2- 172.21.15.132:0/3616845109 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac8809af60 0x7fac880b6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:46.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.588+0000 7fac8ea9a640 1 --2- 172.21.15.132:0/3616845109 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac8809ab80 0x7fac880cc8a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:46.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.588+0000 7fac8ea9a640 1 -- 172.21.15.132:0/3616845109 >> 172.21.15.132:0/3616845109 conn(0x7fac880b4450 msgr2=0x7fac881602f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:46.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.589+0000 7fac8ea9a640 1 -- 172.21.15.132:0/3616845109 shutdown_connections 2024-04-16T15:52:46.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.589+0000 7fac8ea9a640 1 -- 172.21.15.132:0/3616845109 wait complete. 2024-04-16T15:52:46.599 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T15:52:03.284927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T15:52:13.363758+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T15:52:14.246647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T15:52:46.599 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T15:52:46.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.706+0000 7f30b9338640 1 Processor -- start 2024-04-16T15:52:46.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.706+0000 7f30b9338640 1 -- start start 2024-04-16T15:52:46.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.707+0000 7f30b9338640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f30b415ec20 0x7f30b40d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:46.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.707+0000 7f30b9338640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f30b40d3340 0x7f30b40d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:46.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.707+0000 7f30b9338640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30b40d3850 con 0x7f30b40d1e60 2024-04-16T15:52:46.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.707+0000 7f30b9338640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f30b40d22b0 con 0x7f30b40d3340 2024-04-16T15:52:46.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.707+0000 7f30b9338640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f30b40d3b30 con 0x7f30b415ec20 2024-04-16T15:52:46.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.707+0000 7f30b27fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f30b40d3340 0x7f30b40d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:46.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.707+0000 7f30b27fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f30b40d3340 0x7f30b40d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53554/0 (socket says 172.21.15.132:53554) 2024-04-16T15:52:46.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.707+0000 7f30b27fc640 1 -- 172.21.15.132:0/649720197 learned_addr learned my addr 172.21.15.132:0/649720197 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:46.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.707+0000 7f30b2ffd640 1 --2- 172.21.15.132:0/649720197 >> v2:172.21.15.179:3300/0 conn(0x7f30b415ec20 0x7f30b40d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:46.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.707+0000 7f30b27fc640 1 -- 172.21.15.132:0/649720197 >> v2:172.21.15.179:3300/0 conn(0x7f30b415ec20 msgr2=0x7f30b40d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:46.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.707+0000 7f30b27fc640 1 --2- 172.21.15.132:0/649720197 >> v2:172.21.15.179:3300/0 conn(0x7f30b415ec20 0x7f30b40d2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:46.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.707+0000 7f30b27fc640 1 -- 172.21.15.132:0/649720197 >> v1:172.21.15.179:6789/0 conn(0x7f30b40d1e60 legacy=0x7f30b40b6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:46.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.707+0000 7f30b27fc640 1 -- 172.21.15.132:0/649720197 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30b40d3e10 con 0x7f30b40d3340 2024-04-16T15:52:46.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.708+0000 7f30b27fc640 1 --2- 172.21.15.132:0/649720197 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30b40d3340 0x7f30b40d1920 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f30b40d59d0 tx=0x7f30a802ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee1987b063d450e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:46.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.708+0000 7f30b1ffb640 1 -- 172.21.15.132:0/649720197 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a802f850 con 0x7f30b40d3340 2024-04-16T15:52:46.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.708+0000 7f30b1ffb640 1 -- 172.21.15.132:0/649720197 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30a802f9f0 con 0x7f30b40d3340 2024-04-16T15:52:46.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.708+0000 7f30b1ffb640 1 -- 172.21.15.132:0/649720197 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a802fdc0 con 0x7f30b40d3340 2024-04-16T15:52:46.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.709+0000 7f30b9338640 1 -- 172.21.15.132:0/649720197 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30b40d3340 msgr2=0x7f30b40d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:46.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.709+0000 7f30b9338640 1 --2- 172.21.15.132:0/649720197 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30b40d3340 0x7f30b40d1920 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f30b40d59d0 tx=0x7f30a802ba30 comp rx=0 tx=0).stop 2024-04-16T15:52:46.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.709+0000 7f30b9338640 1 -- 172.21.15.132:0/649720197 shutdown_connections 2024-04-16T15:52:46.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.709+0000 7f30b9338640 1 --2- 172.21.15.132:0/649720197 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30b40d3340 0x7f30b40d1920 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:46.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.709+0000 7f30b9338640 1 --2- 172.21.15.132:0/649720197 >> v2:172.21.15.179:3300/0 conn(0x7f30b415ec20 0x7f30b40d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:46.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.709+0000 7f30b9338640 1 -- 172.21.15.132:0/649720197 >> 172.21.15.132:0/649720197 conn(0x7f30b406d2d0 msgr2=0x7f30b406d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:46.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.709+0000 7f30b9338640 1 -- 172.21.15.132:0/649720197 shutdown_connections 2024-04-16T15:52:46.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.709+0000 7f30b9338640 1 -- 172.21.15.132:0/649720197 wait complete. 2024-04-16T15:52:46.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.710+0000 7f30b9338640 1 Processor -- start 2024-04-16T15:52:46.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.710+0000 7f30b9338640 1 -- start start 2024-04-16T15:52:46.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.711+0000 7f30b9338640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30b40d1e60 0x7f30b4149580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:46.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.711+0000 7f30b9338640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30b40d3340 0x7f30b415bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:46.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.711+0000 7f30b9338640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f30b415ec20 0x7f30b40ca3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:46.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.711+0000 7f30b9338640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f30b415f000 con 0x7f30b40d3340 2024-04-16T15:52:46.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.711+0000 7f30b9338640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f30b40d43d0 con 0x7f30b415ec20 2024-04-16T15:52:46.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.711+0000 7f30b9338640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f30b40cf3a0 con 0x7f30b40d1e60 2024-04-16T15:52:46.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.711+0000 7f30b27fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30b40d3340 0x7f30b415bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:46.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.711+0000 7f30b27fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30b40d3340 0x7f30b415bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53558/0 (socket says 172.21.15.132:53558) 2024-04-16T15:52:46.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.711+0000 7f30b27fc640 1 -- 172.21.15.132:0/3224593170 learned_addr learned my addr 172.21.15.132:0/3224593170 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:46.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.711+0000 7f30b27fc640 1 -- 172.21.15.132:0/3224593170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30b40d1e60 msgr2=0x7f30b4149580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:46.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.711+0000 7f30b27fc640 1 --2- 172.21.15.132:0/3224593170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30b40d1e60 0x7f30b4149580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:46.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.711+0000 7f30b27fc640 1 -- 172.21.15.132:0/3224593170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f30b415ec20 msgr2=0x7f30b40ca3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:46.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.711+0000 7f30b37fe640 1 --2- 172.21.15.132:0/3224593170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f30b415ec20 0x7f30b40ca3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:46.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.711+0000 7f30b27fc640 1 --2- 172.21.15.132:0/3224593170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f30b415ec20 0x7f30b40ca3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:46.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.711+0000 7f30b27fc640 1 -- 172.21.15.132:0/3224593170 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30b415c2f0 con 0x7f30b40d3340 2024-04-16T15:52:46.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.711+0000 7f30b37fe640 1 --2- 172.21.15.132:0/3224593170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f30b415ec20 0x7f30b40ca3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:52:46.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.711+0000 7f30b27fc640 1 --2- 172.21.15.132:0/3224593170 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30b40d3340 0x7f30b415bdb0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f30a802ba70 tx=0x7f30a8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:46.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.712+0000 7f309b7fe640 1 -- 172.21.15.132:0/3224593170 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a8037c90 con 0x7f30b40d3340 2024-04-16T15:52:46.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.712+0000 7f309b7fe640 1 -- 172.21.15.132:0/3224593170 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30a8046070 con 0x7f30b40d3340 2024-04-16T15:52:46.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.712+0000 7f309b7fe640 1 -- 172.21.15.132:0/3224593170 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a8041640 con 0x7f30b40d3340 2024-04-16T15:52:46.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.712+0000 7f30b9338640 1 -- 172.21.15.132:0/3224593170 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30b41593a0 con 0x7f30b40d3340 2024-04-16T15:52:46.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.712+0000 7f30b9338640 1 -- 172.21.15.132:0/3224593170 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30b40cd6b0 con 0x7f30b40d3340 2024-04-16T15:52:46.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.713+0000 7f30b9338640 1 -- 172.21.15.132:0/3224593170 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30b4075510 con 0x7f30b40d3340 2024-04-16T15:52:46.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.713+0000 7f309b7fe640 1 -- 172.21.15.132:0/3224593170 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f30a8040070 con 0x7f30b40d3340 2024-04-16T15:52:46.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.714+0000 7f309b7fe640 1 --2- 172.21.15.132:0/3224593170 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f30a006c8f0 0x7f30a006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:46.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.714+0000 7f309b7fe640 1 -- 172.21.15.132:0/3224593170 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f30a80ae380 con 0x7f30b40d3340 2024-04-16T15:52:46.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.714+0000 7f30b2ffd640 1 --2- 172.21.15.132:0/3224593170 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f30a006c8f0 0x7f30a006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:46.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.714+0000 7f30b2ffd640 1 --2- 172.21.15.132:0/3224593170 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f30a006c8f0 0x7f30a006edb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f30a40070b0 tx=0x7f30a4007040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:46.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.718+0000 7f309b7fe640 1 -- 172.21.15.132:0/3224593170 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f30a8033030 con 0x7f30b40d3340 2024-04-16T15:52:46.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.893+0000 7f30b9338640 1 -- 172.21.15.132:0/3224593170 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f30b40b6db0 con 0x7f30b40d3340 2024-04-16T15:52:46.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.894+0000 7f309b7fe640 1 -- 172.21.15.132:0/3224593170 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f30a807c720 con 0x7f30b40d3340 2024-04-16T15:52:46.893 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2024-04-16T15:52:46.897 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.896+0000 7f30b9338640 1 -- 172.21.15.132:0/3224593170 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f30a006c8f0 msgr2=0x7f30a006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:46.897 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.896+0000 7f30b9338640 1 --2- 172.21.15.132:0/3224593170 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f30a006c8f0 0x7f30a006edb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f30a40070b0 tx=0x7f30a4007040 comp rx=0 tx=0).stop 2024-04-16T15:52:46.897 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.896+0000 7f30b9338640 1 -- 172.21.15.132:0/3224593170 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30b40d3340 msgr2=0x7f30b415bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:46.897 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.896+0000 7f30b9338640 1 --2- 172.21.15.132:0/3224593170 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30b40d3340 0x7f30b415bdb0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f30a802ba70 tx=0x7f30a8004730 comp rx=0 tx=0).stop 2024-04-16T15:52:46.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.896+0000 7f30b9338640 1 -- 172.21.15.132:0/3224593170 shutdown_connections 2024-04-16T15:52:46.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.896+0000 7f30b9338640 1 --2- 172.21.15.132:0/3224593170 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f30a006c8f0 0x7f30a006edb0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:46.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.896+0000 7f30b9338640 1 --2- 172.21.15.132:0/3224593170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f30b415ec20 0x7f30b40ca3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:46.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.896+0000 7f30b9338640 1 --2- 172.21.15.132:0/3224593170 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30b40d3340 0x7f30b415bdb0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:46.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.896+0000 7f30b9338640 1 --2- 172.21.15.132:0/3224593170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30b40d1e60 0x7f30b4149580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:46.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.896+0000 7f30b9338640 1 -- 172.21.15.132:0/3224593170 >> 172.21.15.132:0/3224593170 conn(0x7f30b406d2d0 msgr2=0x7f30b40b6150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:46.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.896+0000 7f30b9338640 1 -- 172.21.15.132:0/3224593170 shutdown_connections 2024-04-16T15:52:46.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:46.896+0000 7f30b9338640 1 -- 172.21.15.132:0/3224593170 wait complete. 2024-04-16T15:52:46.910 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T15:52:47.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.022+0000 7f057f022640 1 Processor -- start 2024-04-16T15:52:47.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.022+0000 7f057f022640 1 -- start start 2024-04-16T15:52:47.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.023+0000 7f057f022640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05780b4bb0 0x7f057806f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:47.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.023+0000 7f057f022640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f057806dfb0 con 0x7f057815b840 2024-04-16T15:52:47.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.023+0000 7f057f022640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f057806e290 con 0x7f05780b4750 2024-04-16T15:52:47.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.023+0000 7f057f022640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f057806e570 con 0x7f05780b4bb0 2024-04-16T15:52:47.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.023+0000 7f057cdbe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f057815b840 0x7f05780cef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:35324/0 (socket says 172.21.15.132:35324) 2024-04-16T15:52:47.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.023+0000 7f057cdbe640 1 -- 172.21.15.132:0/2183881284 learned_addr learned my addr 172.21.15.132:0/2183881284 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:47.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.023+0000 7f057d5bf640 1 --2- 172.21.15.132:0/2183881284 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05780b4bb0 0x7f057806f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:47.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.023+0000 7f05777fe640 1 -- 172.21.15.132:0/2183881284 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2071637255 0 0) 0x7f057806dfb0 con 0x7f057815b840 2024-04-16T15:52:47.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.024+0000 7f05777fe640 1 -- 172.21.15.132:0/2183881284 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0564003520 con 0x7f057815b840 2024-04-16T15:52:47.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.024+0000 7f05777fe640 1 -- 172.21.15.132:0/2183881284 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4162449993 0 0) 0x7f057806e290 con 0x7f05780b4750 2024-04-16T15:52:47.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.024+0000 7f05777fe640 1 -- 172.21.15.132:0/2183881284 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f057806dfb0 con 0x7f05780b4750 2024-04-16T15:52:47.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.024+0000 7f05777fe640 1 -- 172.21.15.132:0/2183881284 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3979378801 0 0) 0x7f0564003520 con 0x7f057815b840 2024-04-16T15:52:47.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.024+0000 7f057d5bf640 1 -- 172.21.15.132:0/2183881284 >> v1:172.21.15.179:6789/0 conn(0x7f05780b4750 legacy=0x7f057806f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:47.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.024+0000 7f057d5bf640 1 -- 172.21.15.132:0/2183881284 >> v1:172.21.15.132:6789/0 conn(0x7f057815b840 legacy=0x7f05780cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:47.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.024+0000 7f057d5bf640 1 -- 172.21.15.132:0/2183881284 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f057806e850 con 0x7f05780b4bb0 2024-04-16T15:52:47.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.025+0000 7f057d5bf640 1 --2- 172.21.15.132:0/2183881284 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05780b4bb0 0x7f057806f760 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f05700097d0 tx=0x7f057002b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=152cbb3302b98d1d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:47.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.025+0000 7f05777fe640 1 -- 172.21.15.132:0/2183881284 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0570037070 con 0x7f05780b4bb0 2024-04-16T15:52:47.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.025+0000 7f05777fe640 1 -- 172.21.15.132:0/2183881284 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0570030510 con 0x7f05780b4bb0 2024-04-16T15:52:47.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.025+0000 7f05777fe640 1 -- 172.21.15.132:0/2183881284 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0568001670 con 0x7f05780b4bb0 2024-04-16T15:52:47.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.025+0000 7f057f022640 1 -- 172.21.15.132:0/2183881284 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05780b4bb0 msgr2=0x7f057806f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:47.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.025+0000 7f057f022640 1 --2- 172.21.15.132:0/2183881284 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05780b4bb0 0x7f057806f760 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f05700097d0 tx=0x7f057002b800 comp rx=0 tx=0).stop 2024-04-16T15:52:47.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.025+0000 7f057f022640 1 -- 172.21.15.132:0/2183881284 shutdown_connections 2024-04-16T15:52:47.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.025+0000 7f057f022640 1 --2- 172.21.15.132:0/2183881284 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05780b4bb0 0x7f057806f760 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:47.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.025+0000 7f057f022640 1 -- 172.21.15.132:0/2183881284 >> 172.21.15.132:0/2183881284 conn(0x7f05780d0490 msgr2=0x7f05780d08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:47.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.025+0000 7f057f022640 1 -- 172.21.15.132:0/2183881284 shutdown_connections 2024-04-16T15:52:47.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.025+0000 7f057f022640 1 -- 172.21.15.132:0/2183881284 wait complete. 2024-04-16T15:52:47.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.026+0000 7f057f022640 1 Processor -- start 2024-04-16T15:52:47.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.027+0000 7f057f022640 1 -- start start 2024-04-16T15:52:47.029 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.027+0000 7f057f022640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05780b4750 0x7f057814cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:47.029 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.027+0000 7f057f022640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05780b4bb0 0x7f0578159360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:47.029 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.027+0000 7f057f022640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f057815b840 0x7f057815a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:47.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.027+0000 7f057f022640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f05780b5740 con 0x7f05780b4750 2024-04-16T15:52:47.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.027+0000 7f057f022640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f05780b5040 con 0x7f05780b4bb0 2024-04-16T15:52:47.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.027+0000 7f057f022640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f057815bc20 con 0x7f057815b840 2024-04-16T15:52:47.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.027+0000 7f057cdbe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05780b4750 0x7f057814cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:47.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.027+0000 7f057cdbe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05780b4750 0x7f057814cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53562/0 (socket says 172.21.15.132:53562) 2024-04-16T15:52:47.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.027+0000 7f057cdbe640 1 -- 172.21.15.132:0/3600191149 learned_addr learned my addr 172.21.15.132:0/3600191149 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:47.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.028+0000 7f057d5bf640 1 --2- 172.21.15.132:0/3600191149 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f057815b840 0x7f057815a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:47.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.028+0000 7f0577fff640 1 --2- 172.21.15.132:0/3600191149 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05780b4bb0 0x7f0578159360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:47.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.028+0000 7f057cdbe640 1 -- 172.21.15.132:0/3600191149 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f057815b840 msgr2=0x7f057815a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:47.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.028+0000 7f057cdbe640 1 --2- 172.21.15.132:0/3600191149 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f057815b840 0x7f057815a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:47.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.028+0000 7f057cdbe640 1 -- 172.21.15.132:0/3600191149 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05780b4bb0 msgr2=0x7f0578159360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:47.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.028+0000 7f057cdbe640 1 --2- 172.21.15.132:0/3600191149 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05780b4bb0 0x7f0578159360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:47.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.028+0000 7f057cdbe640 1 -- 172.21.15.132:0/3600191149 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0578151430 con 0x7f05780b4750 2024-04-16T15:52:47.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.028+0000 7f0577fff640 1 --2- 172.21.15.132:0/3600191149 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05780b4bb0 0x7f0578159360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:47.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.028+0000 7f057cdbe640 1 --2- 172.21.15.132:0/3600191149 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05780b4750 0x7f057814cff0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f056800c520 tx=0x7f056800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:47.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.028+0000 7f05757fa640 1 -- 172.21.15.132:0/3600191149 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0568017070 con 0x7f05780b4750 2024-04-16T15:52:47.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.028+0000 7f05757fa640 1 -- 172.21.15.132:0/3600191149 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0568005d00 con 0x7f05780b4750 2024-04-16T15:52:47.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.028+0000 7f057f022640 1 -- 172.21.15.132:0/3600191149 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0578151710 con 0x7f05780b4750 2024-04-16T15:52:47.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.028+0000 7f05757fa640 1 -- 172.21.15.132:0/3600191149 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05680072b0 con 0x7f05780b4750 2024-04-16T15:52:47.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.028+0000 7f057f022640 1 -- 172.21.15.132:0/3600191149 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0578151cd0 con 0x7f05780b4750 2024-04-16T15:52:47.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.029+0000 7f057f022640 1 -- 172.21.15.132:0/3600191149 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0578075510 con 0x7f05780b4750 2024-04-16T15:52:47.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.030+0000 7f05757fa640 1 -- 172.21.15.132:0/3600191149 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f056801a070 con 0x7f05780b4750 2024-04-16T15:52:47.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.030+0000 7f05757fa640 1 --2- 172.21.15.132:0/3600191149 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f055806c8f0 0x7f055806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:47.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.030+0000 7f05757fa640 1 -- 172.21.15.132:0/3600191149 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f056808af30 con 0x7f05780b4750 2024-04-16T15:52:47.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.030+0000 7f0577fff640 1 --2- 172.21.15.132:0/3600191149 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f055806c8f0 0x7f055806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:47.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.030+0000 7f0577fff640 1 --2- 172.21.15.132:0/3600191149 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f055806c8f0 0x7f055806edb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f05781545d0 tx=0x7f0560009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:47.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.034+0000 7f05757fa640 1 -- 172.21.15.132:0/3600191149 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0568058da0 con 0x7f05780b4750 2024-04-16T15:52:47.209 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.210+0000 7f057f022640 1 -- 172.21.15.132:0/3600191149 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f05780cfeb0 con 0x7f05780b4750 2024-04-16T15:52:47.209 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.210+0000 7f05757fa640 1 -- 172.21.15.132:0/3600191149 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f056805d0a0 con 0x7f05780b4750 2024-04-16T15:52:47.210 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2024-04-16T15:52:47.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.212+0000 7f057f022640 1 -- 172.21.15.132:0/3600191149 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f055806c8f0 msgr2=0x7f055806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:47.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.212+0000 7f057f022640 1 --2- 172.21.15.132:0/3600191149 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f055806c8f0 0x7f055806edb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f05781545d0 tx=0x7f0560009040 comp rx=0 tx=0).stop 2024-04-16T15:52:47.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.212+0000 7f057f022640 1 -- 172.21.15.132:0/3600191149 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05780b4750 msgr2=0x7f057814cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:47.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.212+0000 7f057f022640 1 --2- 172.21.15.132:0/3600191149 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05780b4750 0x7f057814cff0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f056800c520 tx=0x7f056800c9e0 comp rx=0 tx=0).stop 2024-04-16T15:52:47.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.212+0000 7f057f022640 1 -- 172.21.15.132:0/3600191149 shutdown_connections 2024-04-16T15:52:47.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.212+0000 7f057f022640 1 --2- 172.21.15.132:0/3600191149 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f055806c8f0 0x7f055806edb0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:47.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.212+0000 7f057f022640 1 --2- 172.21.15.132:0/3600191149 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f057815b840 0x7f057815a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:47.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.212+0000 7f057f022640 1 --2- 172.21.15.132:0/3600191149 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05780b4bb0 0x7f0578159360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:47.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.212+0000 7f057f022640 1 --2- 172.21.15.132:0/3600191149 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05780b4750 0x7f057814cff0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:47.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.212+0000 7f057f022640 1 -- 172.21.15.132:0/3600191149 >> 172.21.15.132:0/3600191149 conn(0x7f05780d0490 msgr2=0x7f05780d0870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:47.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.212+0000 7f057f022640 1 -- 172.21.15.132:0/3600191149 shutdown_connections 2024-04-16T15:52:47.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.213+0000 7f057f022640 1 -- 172.21.15.132:0/3600191149 wait complete. 2024-04-16T15:52:47.223 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T15:52:47.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.330+0000 7fee18d04640 1 Processor -- start 2024-04-16T15:52:47.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.330+0000 7fee18d04640 1 -- start start 2024-04-16T15:52:47.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.331+0000 7fee18d04640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fee1415ec20 0x7fee140d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:47.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.331+0000 7fee18d04640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee140d3340 0x7fee140d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:47.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.331+0000 7fee18d04640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fee140d1e60 0x7fee140b6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:47.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.331+0000 7fee18d04640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fee140d3850 con 0x7fee140d1e60 2024-04-16T15:52:47.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.331+0000 7fee18d04640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fee140d3b30 con 0x7fee1415ec20 2024-04-16T15:52:47.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.331+0000 7fee18d04640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fee140d3e10 con 0x7fee140d3340 2024-04-16T15:52:47.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.332+0000 7fee12d9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fee140d1e60 0x7fee140b6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:47.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.332+0000 7fee12d9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fee140d1e60 0x7fee140b6400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53578/0 (socket says 172.21.15.132:53578) 2024-04-16T15:52:47.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.332+0000 7fee12d9d640 1 -- 172.21.15.132:0/4063339797 learned_addr learned my addr 172.21.15.132:0/4063339797 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:47.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.332+0000 7fee1259c640 1 --2- 172.21.15.132:0/4063339797 >> v2:172.21.15.179:3300/0 conn(0x7fee1415ec20 0x7fee140d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:47.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.332+0000 7fee11d9b640 1 --2- 172.21.15.132:0/4063339797 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee140d3340 0x7fee140d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:47.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.332+0000 7fee12d9d640 1 -- 172.21.15.132:0/4063339797 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee140d3340 msgr2=0x7fee140d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:47.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.332+0000 7fee12d9d640 1 --2- 172.21.15.132:0/4063339797 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee140d3340 0x7fee140d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:47.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.332+0000 7fee12d9d640 1 -- 172.21.15.132:0/4063339797 >> v2:172.21.15.179:3300/0 conn(0x7fee1415ec20 msgr2=0x7fee140d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:47.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.332+0000 7fee12d9d640 1 --2- 172.21.15.132:0/4063339797 >> v2:172.21.15.179:3300/0 conn(0x7fee1415ec20 0x7fee140d2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:47.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.332+0000 7fee12d9d640 1 -- 172.21.15.132:0/4063339797 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee140d40f0 con 0x7fee140d1e60 2024-04-16T15:52:47.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.333+0000 7fee12d9d640 1 --2- 172.21.15.132:0/4063339797 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fee140d1e60 0x7fee140b6400 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fee140d59d0 tx=0x7fee0c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cd06b775b42239 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:47.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.333+0000 7fee1159a640 1 -- 172.21.15.132:0/4063339797 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee0c034070 con 0x7fee140d1e60 2024-04-16T15:52:47.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.333+0000 7fee1159a640 1 -- 172.21.15.132:0/4063339797 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee0c030860 con 0x7fee140d1e60 2024-04-16T15:52:47.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.333+0000 7fee1159a640 1 -- 172.21.15.132:0/4063339797 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee0c030c30 con 0x7fee140d1e60 2024-04-16T15:52:47.334 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.333+0000 7fee18d04640 1 -- 172.21.15.132:0/4063339797 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fee140d1e60 msgr2=0x7fee140b6400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:47.334 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.333+0000 7fee18d04640 1 --2- 172.21.15.132:0/4063339797 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fee140d1e60 0x7fee140b6400 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fee140d59d0 tx=0x7fee0c02b9a0 comp rx=0 tx=0).stop 2024-04-16T15:52:47.334 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.333+0000 7fee18d04640 1 -- 172.21.15.132:0/4063339797 shutdown_connections 2024-04-16T15:52:47.334 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.333+0000 7fee18d04640 1 --2- 172.21.15.132:0/4063339797 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fee140d1e60 0x7fee140b6400 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:47.334 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.333+0000 7fee18d04640 1 --2- 172.21.15.132:0/4063339797 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee140d3340 0x7fee140d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:47.334 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.333+0000 7fee18d04640 1 --2- 172.21.15.132:0/4063339797 >> v2:172.21.15.179:3300/0 conn(0x7fee1415ec20 0x7fee140d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:47.334 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.333+0000 7fee18d04640 1 -- 172.21.15.132:0/4063339797 >> 172.21.15.132:0/4063339797 conn(0x7fee1406d2d0 msgr2=0x7fee1406d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:47.334 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.334+0000 7fee18d04640 1 -- 172.21.15.132:0/4063339797 shutdown_connections 2024-04-16T15:52:47.334 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.334+0000 7fee18d04640 1 -- 172.21.15.132:0/4063339797 wait complete. 2024-04-16T15:52:47.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.335+0000 7fee18d04640 1 Processor -- start 2024-04-16T15:52:47.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.335+0000 7fee18d04640 1 -- start start 2024-04-16T15:52:47.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.335+0000 7fee18d04640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee140d1e60 0x7fee1415d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:47.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.335+0000 7fee18d04640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fee140d3340 0x7fee140b5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:47.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.336+0000 7fee18d04640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee1415ec20 0x7fee140cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:47.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.336+0000 7fee18d04640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fee140cf3a0 con 0x7fee140d3340 2024-04-16T15:52:47.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.336+0000 7fee18d04640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fee1415f000 con 0x7fee1415ec20 2024-04-16T15:52:47.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.336+0000 7fee18d04640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fee140cf520 con 0x7fee140d1e60 2024-04-16T15:52:47.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.336+0000 7fee11d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fee140d3340 0x7fee140b5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:47.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.336+0000 7fee11d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fee140d3340 0x7fee140b5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53584/0 (socket says 172.21.15.132:53584) 2024-04-16T15:52:47.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.336+0000 7fee11d9b640 1 -- 172.21.15.132:0/3173260611 learned_addr learned my addr 172.21.15.132:0/3173260611 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:47.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.336+0000 7fee12d9d640 1 --2- 172.21.15.132:0/3173260611 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee1415ec20 0x7fee140cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:47.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.336+0000 7fee1259c640 1 --2- 172.21.15.132:0/3173260611 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee140d1e60 0x7fee1415d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:47.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.336+0000 7fee11d9b640 1 -- 172.21.15.132:0/3173260611 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee140d1e60 msgr2=0x7fee1415d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:47.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.336+0000 7fee11d9b640 1 --2- 172.21.15.132:0/3173260611 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee140d1e60 0x7fee1415d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:47.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.336+0000 7fee11d9b640 1 -- 172.21.15.132:0/3173260611 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee1415ec20 msgr2=0x7fee140cdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:47.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.336+0000 7fee11d9b640 1 --2- 172.21.15.132:0/3173260611 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee1415ec20 0x7fee140cdc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:47.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.336+0000 7fee11d9b640 1 -- 172.21.15.132:0/3173260611 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee141f66d0 con 0x7fee140d3340 2024-04-16T15:52:47.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.336+0000 7fee11d9b640 1 --2- 172.21.15.132:0/3173260611 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fee140d3340 0x7fee140b5070 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fedfc00d7d0 tx=0x7fedfc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:47.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.336+0000 7fee0affd640 1 -- 172.21.15.132:0/3173260611 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedfc0096a0 con 0x7fee140d3340 2024-04-16T15:52:47.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.336+0000 7fee0affd640 1 -- 172.21.15.132:0/3173260611 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedfc019070 con 0x7fee140d3340 2024-04-16T15:52:47.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.336+0000 7fee0affd640 1 -- 172.21.15.132:0/3173260611 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedfc009a60 con 0x7fee140d3340 2024-04-16T15:52:47.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.336+0000 7fee18d04640 1 -- 172.21.15.132:0/3173260611 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee141f69b0 con 0x7fee140d3340 2024-04-16T15:52:47.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.336+0000 7fee18d04640 1 -- 172.21.15.132:0/3173260611 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee141f6f70 con 0x7fee140d3340 2024-04-16T15:52:47.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.337+0000 7fee18d04640 1 -- 172.21.15.132:0/3173260611 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee140d5780 con 0x7fee140d3340 2024-04-16T15:52:47.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.338+0000 7fee0affd640 1 -- 172.21.15.132:0/3173260611 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fedfc009c00 con 0x7fee140d3340 2024-04-16T15:52:47.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.338+0000 7fee0affd640 1 --2- 172.21.15.132:0/3173260611 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fedf406c8f0 0x7fedf406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:47.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.338+0000 7fee0affd640 1 -- 172.21.15.132:0/3173260611 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fedfc08bf60 con 0x7fee140d3340 2024-04-16T15:52:47.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.338+0000 7fee1259c640 1 --2- 172.21.15.132:0/3173260611 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fedf406c8f0 0x7fedf406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:47.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.338+0000 7fee1259c640 1 --2- 172.21.15.132:0/3173260611 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fedf406c8f0 0x7fedf406edb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fee040099c0 tx=0x7fee04003990 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:47.341 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.342+0000 7fee0affd640 1 -- 172.21.15.132:0/3173260611 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fee140d5780 con 0x7fee140d3340 2024-04-16T15:52:47.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.520+0000 7fee18d04640 1 -- 172.21.15.132:0/3173260611 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fee14075510 con 0x7fee140d3340 2024-04-16T15:52:47.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.520+0000 7fee0affd640 1 -- 172.21.15.132:0/3173260611 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fedfc05a390 con 0x7fee140d3340 2024-04-16T15:52:47.520 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2024-04-16T15:52:47.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.522+0000 7fee18d04640 1 -- 172.21.15.132:0/3173260611 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fedf406c8f0 msgr2=0x7fedf406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:47.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.522+0000 7fee18d04640 1 --2- 172.21.15.132:0/3173260611 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fedf406c8f0 0x7fedf406edb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fee040099c0 tx=0x7fee04003990 comp rx=0 tx=0).stop 2024-04-16T15:52:47.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.522+0000 7fee18d04640 1 -- 172.21.15.132:0/3173260611 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fee140d3340 msgr2=0x7fee140b5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:47.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.522+0000 7fee18d04640 1 --2- 172.21.15.132:0/3173260611 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fee140d3340 0x7fee140b5070 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fedfc00d7d0 tx=0x7fedfc00dc90 comp rx=0 tx=0).stop 2024-04-16T15:52:47.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.522+0000 7fee18d04640 1 -- 172.21.15.132:0/3173260611 shutdown_connections 2024-04-16T15:52:47.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.522+0000 7fee18d04640 1 --2- 172.21.15.132:0/3173260611 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fedf406c8f0 0x7fedf406edb0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:47.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.522+0000 7fee18d04640 1 --2- 172.21.15.132:0/3173260611 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee1415ec20 0x7fee140cdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:47.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.522+0000 7fee18d04640 1 --2- 172.21.15.132:0/3173260611 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fee140d3340 0x7fee140b5070 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:47.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.522+0000 7fee18d04640 1 --2- 172.21.15.132:0/3173260611 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee140d1e60 0x7fee1415d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:47.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.522+0000 7fee18d04640 1 -- 172.21.15.132:0/3173260611 >> 172.21.15.132:0/3173260611 conn(0x7fee1406d2d0 msgr2=0x7fee1415def0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:47.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.522+0000 7fee18d04640 1 -- 172.21.15.132:0/3173260611 shutdown_connections 2024-04-16T15:52:47.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.522+0000 7fee18d04640 1 -- 172.21.15.132:0/3173260611 wait complete. 2024-04-16T15:52:47.534 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-16T15:52:47.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.639+0000 7f894f814640 1 Processor -- start 2024-04-16T15:52:47.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.639+0000 7f894f814640 1 -- start start 2024-04-16T15:52:47.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.640+0000 7f894f814640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8948162050 0x7f894806d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:47.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.640+0000 7f894f814640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89480b1540 0x7f894806d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:47.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.640+0000 7f894f814640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f894806ccd0 con 0x7f894806dbe0 2024-04-16T15:52:47.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.640+0000 7f894f814640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f89480d16c0 con 0x7f8948162050 2024-04-16T15:52:47.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.640+0000 7f894f814640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f89480d19a0 con 0x7f89480b1540 2024-04-16T15:52:47.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.640+0000 7f894d5b0640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8948162050 0x7f894806d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:47.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.640+0000 7f894cdaf640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89480b1540 0x7f894806d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:47.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.640+0000 7f894ddb1640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f894806dbe0 0x7f894809aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.132:53286/0 (socket says 172.21.15.132:53286) 2024-04-16T15:52:47.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.640+0000 7f894ddb1640 1 -- 172.21.15.132:0/3834087058 learned_addr learned my addr 172.21.15.132:0/3834087058 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:47.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.641+0000 7f894d5b0640 1 -- 172.21.15.132:0/3834087058 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89480b1540 msgr2=0x7f894806d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:47.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.641+0000 7f894d5b0640 1 --2- 172.21.15.132:0/3834087058 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89480b1540 0x7f894806d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:47.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.641+0000 7f894d5b0640 1 -- 172.21.15.132:0/3834087058 >> v1:172.21.15.179:6789/0 conn(0x7f894806dbe0 legacy=0x7f894809aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:47.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.641+0000 7f894d5b0640 1 -- 172.21.15.132:0/3834087058 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89480d1c80 con 0x7f8948162050 2024-04-16T15:52:47.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.641+0000 7f893ffff640 1 -- 172.21.15.132:0/3834087058 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 518767861 0 0) 0x7f894806ccd0 con 0x7f894806dbe0 2024-04-16T15:52:47.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.641+0000 7f894cdaf640 1 --2- 172.21.15.132:0/3834087058 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89480b1540 0x7f894806d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:52:47.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.642+0000 7f894d5b0640 1 --2- 172.21.15.132:0/3834087058 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8948162050 0x7f894806d160 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f89440097a0 tx=0x7f894402b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb994abbcb90ee07 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:47.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.642+0000 7f893ffff640 1 -- 172.21.15.132:0/3834087058 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89440315a0 con 0x7f8948162050 2024-04-16T15:52:47.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.642+0000 7f893ffff640 1 -- 172.21.15.132:0/3834087058 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8944037070 con 0x7f8948162050 2024-04-16T15:52:47.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.642+0000 7f893ffff640 1 -- 172.21.15.132:0/3834087058 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8944031960 con 0x7f8948162050 2024-04-16T15:52:47.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.642+0000 7f894f814640 1 -- 172.21.15.132:0/3834087058 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8948162050 msgr2=0x7f894806d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:47.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.642+0000 7f894f814640 1 --2- 172.21.15.132:0/3834087058 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8948162050 0x7f894806d160 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f89440097a0 tx=0x7f894402b840 comp rx=0 tx=0).stop 2024-04-16T15:52:47.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.642+0000 7f894f814640 1 -- 172.21.15.132:0/3834087058 shutdown_connections 2024-04-16T15:52:47.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.642+0000 7f894f814640 1 --2- 172.21.15.132:0/3834087058 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89480b1540 0x7f894806d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:47.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.642+0000 7f894f814640 1 --2- 172.21.15.132:0/3834087058 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8948162050 0x7f894806d160 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:47.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.642+0000 7f894f814640 1 -- 172.21.15.132:0/3834087058 >> 172.21.15.132:0/3834087058 conn(0x7f89480b4190 msgr2=0x7f89480b45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:47.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.642+0000 7f894f814640 1 -- 172.21.15.132:0/3834087058 shutdown_connections 2024-04-16T15:52:47.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.642+0000 7f894f814640 1 -- 172.21.15.132:0/3834087058 wait complete. 2024-04-16T15:52:47.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.644+0000 7f894f814640 1 Processor -- start 2024-04-16T15:52:47.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.644+0000 7f894f814640 1 -- start start 2024-04-16T15:52:47.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.644+0000 7f894f814640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f894806dbe0 0x7f8948160a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:47.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.644+0000 7f894f814640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89480b1540 0x7f8948158120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:47.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.644+0000 7f894f814640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8948162050 0x7f8948154710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:47.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.644+0000 7f894f814640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f89480cde80 con 0x7f894806dbe0 2024-04-16T15:52:47.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.644+0000 7f894f814640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f89480cdd00 con 0x7f89480b1540 2024-04-16T15:52:47.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.644+0000 7f894f814640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f894809b140 con 0x7f8948162050 2024-04-16T15:52:47.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.644+0000 7f894d5b0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f894806dbe0 0x7f8948160a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:47.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.644+0000 7f894d5b0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f894806dbe0 0x7f8948160a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53590/0 (socket says 172.21.15.132:53590) 2024-04-16T15:52:47.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.644+0000 7f894d5b0640 1 -- 172.21.15.132:0/965975120 learned_addr learned my addr 172.21.15.132:0/965975120 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:47.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.645+0000 7f894cdaf640 1 --2- 172.21.15.132:0/965975120 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89480b1540 0x7f8948158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:47.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.645+0000 7f894ddb1640 1 --2- 172.21.15.132:0/965975120 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8948162050 0x7f8948154710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:47.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.645+0000 7f894d5b0640 1 -- 172.21.15.132:0/965975120 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8948162050 msgr2=0x7f8948154710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:47.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.645+0000 7f894d5b0640 1 --2- 172.21.15.132:0/965975120 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8948162050 0x7f8948154710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:47.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.645+0000 7f894d5b0640 1 -- 172.21.15.132:0/965975120 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89480b1540 msgr2=0x7f8948158120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:47.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.645+0000 7f894d5b0640 1 --2- 172.21.15.132:0/965975120 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89480b1540 0x7f8948158120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:47.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.645+0000 7f894d5b0640 1 -- 172.21.15.132:0/965975120 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89481615a0 con 0x7f894806dbe0 2024-04-16T15:52:47.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.645+0000 7f894cdaf640 1 --2- 172.21.15.132:0/965975120 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89480b1540 0x7f8948158120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:47.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.645+0000 7f894ddb1640 1 --2- 172.21.15.132:0/965975120 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8948162050 0x7f8948154710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:47.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.645+0000 7f894d5b0640 1 --2- 172.21.15.132:0/965975120 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f894806dbe0 0x7f8948160a00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f89440097a0 tx=0x7f89440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:47.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.645+0000 7f893dffb640 1 -- 172.21.15.132:0/965975120 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8944004230 con 0x7f894806dbe0 2024-04-16T15:52:47.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.645+0000 7f893dffb640 1 -- 172.21.15.132:0/965975120 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89440043f0 con 0x7f894806dbe0 2024-04-16T15:52:47.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.645+0000 7f894f814640 1 -- 172.21.15.132:0/965975120 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8948160fe0 con 0x7f894806dbe0 2024-04-16T15:52:47.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.645+0000 7f893dffb640 1 -- 172.21.15.132:0/965975120 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8944003850 con 0x7f894806dbe0 2024-04-16T15:52:47.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.645+0000 7f894f814640 1 -- 172.21.15.132:0/965975120 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89480b4e70 con 0x7f894806dbe0 2024-04-16T15:52:47.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.646+0000 7f894f814640 1 -- 172.21.15.132:0/965975120 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89480b52a0 con 0x7f894806dbe0 2024-04-16T15:52:47.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.647+0000 7f893dffb640 1 -- 172.21.15.132:0/965975120 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f89440039f0 con 0x7f894806dbe0 2024-04-16T15:52:47.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.647+0000 7f893dffb640 1 --2- 172.21.15.132:0/965975120 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f892c06c8f0 0x7f892c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:47.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.647+0000 7f893dffb640 1 -- 172.21.15.132:0/965975120 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f894402f030 con 0x7f894806dbe0 2024-04-16T15:52:47.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.647+0000 7f894cdaf640 1 --2- 172.21.15.132:0/965975120 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f892c06c8f0 0x7f892c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:47.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.648+0000 7f894cdaf640 1 --2- 172.21.15.132:0/965975120 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f892c06c8f0 0x7f892c06edb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8948157c70 tx=0x7f8938008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:47.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.652+0000 7f893dffb640 1 -- 172.21.15.132:0/965975120 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8944041070 con 0x7f894806dbe0 2024-04-16T15:52:47.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.840+0000 7f894f814640 1 -- 172.21.15.132:0/965975120 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8948075510 con 0x7f894806dbe0 2024-04-16T15:52:47.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.840+0000 7f893dffb640 1 -- 172.21.15.132:0/965975120 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7f894407bf00 con 0x7f894806dbe0 2024-04-16T15:52:47.840 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2024-04-16T15:52:47.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.843+0000 7f894f814640 1 -- 172.21.15.132:0/965975120 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f892c06c8f0 msgr2=0x7f892c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:47.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.843+0000 7f894f814640 1 --2- 172.21.15.132:0/965975120 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f892c06c8f0 0x7f892c06edb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8948157c70 tx=0x7f8938008040 comp rx=0 tx=0).stop 2024-04-16T15:52:47.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.843+0000 7f894f814640 1 -- 172.21.15.132:0/965975120 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f894806dbe0 msgr2=0x7f8948160a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:47.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.843+0000 7f894f814640 1 --2- 172.21.15.132:0/965975120 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f894806dbe0 0x7f8948160a00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f89440097a0 tx=0x7f89440046c0 comp rx=0 tx=0).stop 2024-04-16T15:52:47.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.843+0000 7f894f814640 1 -- 172.21.15.132:0/965975120 shutdown_connections 2024-04-16T15:52:47.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.843+0000 7f894f814640 1 --2- 172.21.15.132:0/965975120 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f892c06c8f0 0x7f892c06edb0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:47.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.843+0000 7f894f814640 1 --2- 172.21.15.132:0/965975120 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8948162050 0x7f8948154710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:47.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.843+0000 7f894f814640 1 --2- 172.21.15.132:0/965975120 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89480b1540 0x7f8948158120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:47.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.843+0000 7f894f814640 1 --2- 172.21.15.132:0/965975120 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f894806dbe0 0x7f8948160a00 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:47.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.843+0000 7f894f814640 1 -- 172.21.15.132:0/965975120 >> 172.21.15.132:0/965975120 conn(0x7f89480b4190 msgr2=0x7f89480d09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:47.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.843+0000 7f894f814640 1 -- 172.21.15.132:0/965975120 shutdown_connections 2024-04-16T15:52:47.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:47.843+0000 7f894f814640 1 -- 172.21.15.132:0/965975120 wait complete. 2024-04-16T15:52:47.853 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi132.front.sepia.ceph.com... 2024-04-16T15:52:47.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:52:47.853 DEBUG:teuthology.orchestra.run.smithi132:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-16T15:52:47.882 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T15:52:47.882 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi132.front.sepia.ceph.com 2024-04-16T15:52:47.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:52:47.882 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-16T15:52:47.951 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-16T15:52:47.951 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T15:52:47.972 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-16T15:52:47.973 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T15:52:48.032 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:52:48.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.138+0000 7f0adf53f640 1 Processor -- start 2024-04-16T15:52:48.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.139+0000 7f0adf53f640 1 -- start start 2024-04-16T15:52:48.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.139+0000 7f0adf53f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0ad80b5cc0 0x7f0ad80b6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:48.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.139+0000 7f0adf53f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ad80cec90 con 0x7f0ad806dc90 2024-04-16T15:52:48.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.139+0000 7f0adf53f640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ad80cef10 con 0x7f0ad8151e90 2024-04-16T15:52:48.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.139+0000 7f0adf53f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f0ad80d00e0 con 0x7f0ad80b5cc0 2024-04-16T15:52:48.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.140+0000 7f0adcada640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0ad80b5cc0 0x7f0ad80b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:48.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.140+0000 7f0addadc640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f0ad806dc90 0x7f0ad806e0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:35334/0 (socket says 172.21.15.132:35334) 2024-04-16T15:52:48.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.140+0000 7f0addadc640 1 -- 172.21.15.132:0/1926176735 learned_addr learned my addr 172.21.15.132:0/1926176735 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:48.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.140+0000 7f0adcada640 1 -- 172.21.15.132:0/1926176735 >> v1:172.21.15.179:6789/0 conn(0x7f0ad8151e90 legacy=0x7f0ad80cf9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:48.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.140+0000 7f0adcada640 1 -- 172.21.15.132:0/1926176735 >> v1:172.21.15.132:6789/0 conn(0x7f0ad806dc90 legacy=0x7f0ad806e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:48.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.140+0000 7f0acffff640 1 -- 172.21.15.132:0/1926176735 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 708958779 0 0) 0x7f0ad0001490 con 0x7f0ad806dc90 2024-04-16T15:52:48.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.140+0000 7f0adcada640 1 -- 172.21.15.132:0/1926176735 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ad8152270 con 0x7f0ad80b5cc0 2024-04-16T15:52:48.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.141+0000 7f0adcada640 1 --2- 172.21.15.132:0/1926176735 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ad80b5cc0 0x7f0ad80b6150 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0ac800a940 tx=0x7f0ac802de90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8ad1886959948b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:48.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.141+0000 7f0acffff640 1 -- 172.21.15.132:0/1926176735 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ac803b070 con 0x7f0ad80b5cc0 2024-04-16T15:52:48.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.141+0000 7f0acffff640 1 -- 172.21.15.132:0/1926176735 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ac802ec40 con 0x7f0ad80b5cc0 2024-04-16T15:52:48.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.141+0000 7f0acffff640 1 -- 172.21.15.132:0/1926176735 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ac800b040 con 0x7f0ad80b5cc0 2024-04-16T15:52:48.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.141+0000 7f0adf53f640 1 -- 172.21.15.132:0/1926176735 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ad80b5cc0 msgr2=0x7f0ad80b6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:48.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.141+0000 7f0adf53f640 1 --2- 172.21.15.132:0/1926176735 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ad80b5cc0 0x7f0ad80b6150 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0ac800a940 tx=0x7f0ac802de90 comp rx=0 tx=0).stop 2024-04-16T15:52:48.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.141+0000 7f0adf53f640 1 -- 172.21.15.132:0/1926176735 shutdown_connections 2024-04-16T15:52:48.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.141+0000 7f0adf53f640 1 --2- 172.21.15.132:0/1926176735 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ad80b5cc0 0x7f0ad80b6150 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:48.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.141+0000 7f0adf53f640 1 -- 172.21.15.132:0/1926176735 >> 172.21.15.132:0/1926176735 conn(0x7f0ad80b2d50 msgr2=0x7f0ad806ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:48.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.141+0000 7f0adf53f640 1 -- 172.21.15.132:0/1926176735 shutdown_connections 2024-04-16T15:52:48.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.141+0000 7f0adf53f640 1 -- 172.21.15.132:0/1926176735 wait complete. 2024-04-16T15:52:48.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.143+0000 7f0adf53f640 1 Processor -- start 2024-04-16T15:52:48.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.143+0000 7f0adf53f640 1 -- start start 2024-04-16T15:52:48.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.143+0000 7f0adf53f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ad806dc90 0x7f0ad8159690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:48.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.143+0000 7f0adf53f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ad80b5cc0 0x7f0ad8155a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:48.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.143+0000 7f0adf53f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ad8151e90 0x7f0ad814fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:48.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.143+0000 7f0adf53f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad80cf1d0 con 0x7f0ad8151e90 2024-04-16T15:52:48.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.143+0000 7f0adf53f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad80cf540 con 0x7f0ad80b5cc0 2024-04-16T15:52:48.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.143+0000 7f0adf53f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f0ad806c130 con 0x7f0ad806dc90 2024-04-16T15:52:48.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.143+0000 7f0addadc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ad8151e90 0x7f0ad814fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:48.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.143+0000 7f0addadc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ad8151e90 0x7f0ad814fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53596/0 (socket says 172.21.15.132:53596) 2024-04-16T15:52:48.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.143+0000 7f0addadc640 1 -- 172.21.15.132:0/402516120 learned_addr learned my addr 172.21.15.132:0/402516120 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:48.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.144+0000 7f0addadc640 1 -- 172.21.15.132:0/402516120 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ad806dc90 msgr2=0x7f0ad8159690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:48.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.144+0000 7f0addadc640 1 --2- 172.21.15.132:0/402516120 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ad806dc90 0x7f0ad8159690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:48.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.144+0000 7f0addadc640 1 -- 172.21.15.132:0/402516120 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ad80b5cc0 msgr2=0x7f0ad8155a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:48.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.144+0000 7f0addadc640 1 --2- 172.21.15.132:0/402516120 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ad80b5cc0 0x7f0ad8155a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:48.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.144+0000 7f0addadc640 1 -- 172.21.15.132:0/402516120 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ad8150280 con 0x7f0ad8151e90 2024-04-16T15:52:48.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.144+0000 7f0addadc640 1 --2- 172.21.15.132:0/402516120 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ad8151e90 0x7f0ad814fd40 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0ad000c7f0 tx=0x7f0ad000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:48.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.144+0000 7f0acdffb640 1 -- 172.21.15.132:0/402516120 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad0018070 con 0x7f0ad8151e90 2024-04-16T15:52:48.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.144+0000 7f0acdffb640 1 -- 172.21.15.132:0/402516120 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ad000a5e0 con 0x7f0ad8151e90 2024-04-16T15:52:48.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.144+0000 7f0adf53f640 1 -- 172.21.15.132:0/402516120 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ad81560c0 con 0x7f0ad8151e90 2024-04-16T15:52:48.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.144+0000 7f0acdffb640 1 -- 172.21.15.132:0/402516120 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad000aa10 con 0x7f0ad8151e90 2024-04-16T15:52:48.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.144+0000 7f0adf53f640 1 -- 172.21.15.132:0/402516120 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ad8156680 con 0x7f0ad8151e90 2024-04-16T15:52:48.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.145+0000 7f0adf53f640 1 -- 172.21.15.132:0/402516120 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ad80d02f0 con 0x7f0ad8151e90 2024-04-16T15:52:48.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.146+0000 7f0acdffb640 1 -- 172.21.15.132:0/402516120 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0ad001b070 con 0x7f0ad8151e90 2024-04-16T15:52:48.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.146+0000 7f0acdffb640 1 --2- 172.21.15.132:0/402516120 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f0abc06c920 0x7f0abc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:48.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.146+0000 7f0acdffb640 1 -- 172.21.15.132:0/402516120 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0ad008b0d0 con 0x7f0ad8151e90 2024-04-16T15:52:48.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.146+0000 7f0add2db640 1 --2- 172.21.15.132:0/402516120 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f0abc06c920 0x7f0abc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:48.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.147+0000 7f0add2db640 1 --2- 172.21.15.132:0/402516120 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f0abc06c920 0x7f0abc06ede0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0ad4006fd0 tx=0x7f0ad4006bc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:48.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.151+0000 7f0acdffb640 1 -- 172.21.15.132:0/402516120 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0ad80d02f0 con 0x7f0ad8151e90 2024-04-16T15:52:48.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.326+0000 7f0adf53f640 1 -- 172.21.15.132:0/402516120 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0ad80b3d50 con 0x7f0ad8151e90 2024-04-16T15:52:48.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.327+0000 7f0acdffb640 1 -- 172.21.15.132:0/402516120 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7f0ad80cec90 con 0x7f0ad8151e90 2024-04-16T15:52:48.327 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:52:48.327 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"6bdec5d9-f406-43ad-8584-0503b32f6f0d","created":"2024-04-16T15:51:51.073040+0000","modified":"2024-04-16T15:52:16.950186+0000","last_up_change":"2024-04-16T15:52:02.280496+0000","last_in_change":"2024-04-16T15:51:53.376468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:52:03.284927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:52:13.363758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T15:52:14.246647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d45908b-6e22-4619-b190-897af594b712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6801","nonce":1170594668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6803","nonce":1170594668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6807","nonce":1170594668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6805","nonce":1170594668}]},"public_addr":"172.21.15.132:6801/1170594668","cluster_addr":"172.21.15.132:6803/1170594668","heartbeat_back_addr":"172.21.15.132:6807/1170594668","heartbeat_front_addr":"172.21.15.132:6805/1170594668","state":["exists","up"]},{"osd":1,"uuid":"c88bf082-e51f-4ee6-815a-025f6ce0d67b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6809","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6811","nonce":2494780358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6815","nonce":2494780358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6823","nonce":2494780358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6819","nonce":2494780358}]},"public_addr":"172.21.15.132:6811/2494780358","cluster_addr":"172.21.15.132:6815/2494780358","heartbeat_back_addr":"172.21.15.132:6823/2494780358","heartbeat_front_addr":"172.21.15.132:6819/2494780358","state":["exists","up"]},{"osd":2,"uuid":"e5dbd6b4-4e7b-47e4-ad4e-35b4b81696c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6825","nonce":27655483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6827","nonce":27655483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6831","nonce":27655483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6829","nonce":27655483}]},"public_addr":"172.21.15.132:6825/27655483","cluster_addr":"172.21.15.132:6827/27655483","heartbeat_back_addr":"172.21.15.132:6831/27655483","heartbeat_front_addr":"172.21.15.132:6829/27655483","state":["exists","up"]},{"osd":3,"uuid":"9d75cd67-3b8a-4424-8884-5f3660e1f5f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6810","nonce":3100919191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6814","nonce":3100919191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6821","nonce":3100919191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6818","nonce":3100919191}]},"public_addr":"172.21.15.132:6810/3100919191","cluster_addr":"172.21.15.132:6814/3100919191","heartbeat_back_addr":"172.21.15.132:6821/3100919191","heartbeat_front_addr":"172.21.15.132:6818/3100919191","state":["exists","up"]},{"osd":4,"uuid":"83aea46a-8642-4777-912b-c130e5890da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6825","nonce":123637799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6827","nonce":123637799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6831","nonce":123637799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6829","nonce":123637799}]},"public_addr":"172.21.15.179:6825/123637799","cluster_addr":"172.21.15.179:6827/123637799","heartbeat_back_addr":"172.21.15.179:6831/123637799","heartbeat_front_addr":"172.21.15.179:6829/123637799","state":["exists","up"]},{"osd":5,"uuid":"534117c8-3317-48d6-b436-afd5709f71e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6801","nonce":2224750370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6803","nonce":2224750370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6807","nonce":2224750370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6805","nonce":2224750370}]},"public_addr":"172.21.15.179:6801/2224750370","cluster_addr":"172.21.15.179:6803/2224750370","heartbeat_back_addr":"172.21.15.179:6807/2224750370","heartbeat_front_addr":"172.21.15.179:6805/2224750370","state":["exists","up"]},{"osd":6,"uuid":"0ba363e7-fa9d-42b1-ae09-a6a0f57d41f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6809","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6811","nonce":101498164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6813","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6815","nonce":101498164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6823","nonce":101498164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6819","nonce":101498164}]},"public_addr":"172.21.15.179:6811/101498164","cluster_addr":"172.21.15.179:6815/101498164","heartbeat_back_addr":"172.21.15.179:6823/101498164","heartbeat_front_addr":"172.21.15.179:6819/101498164","state":["exists","up"]},{"osd":7,"uuid":"e6830c77-2f2d-4067-9866-ee7625afc1a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6810","nonce":872148365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6814","nonce":872148365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6822","nonce":872148365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6818","nonce":872148365}]},"public_addr":"172.21.15.179:6810/872148365","cluster_addr":"172.21.15.179:6814/872148365","heartbeat_back_addr":"172.21.15.179:6822/872148365","heartbeat_front_addr":"172.21.15.179:6818/872148365","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.535221+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.563769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.520765+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.526264+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.517058+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.500842+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.534332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.512486+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:52:48.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.329+0000 7f0adf53f640 1 -- 172.21.15.132:0/402516120 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f0abc06c920 msgr2=0x7f0abc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:48.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.329+0000 7f0adf53f640 1 --2- 172.21.15.132:0/402516120 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f0abc06c920 0x7f0abc06ede0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0ad4006fd0 tx=0x7f0ad4006bc0 comp rx=0 tx=0).stop 2024-04-16T15:52:48.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.329+0000 7f0adf53f640 1 -- 172.21.15.132:0/402516120 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ad8151e90 msgr2=0x7f0ad814fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:48.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.329+0000 7f0adf53f640 1 --2- 172.21.15.132:0/402516120 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ad8151e90 0x7f0ad814fd40 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0ad000c7f0 tx=0x7f0ad000ccb0 comp rx=0 tx=0).stop 2024-04-16T15:52:48.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.329+0000 7f0adf53f640 1 -- 172.21.15.132:0/402516120 shutdown_connections 2024-04-16T15:52:48.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.329+0000 7f0adf53f640 1 --2- 172.21.15.132:0/402516120 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f0abc06c920 0x7f0abc06ede0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:48.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.329+0000 7f0adf53f640 1 --2- 172.21.15.132:0/402516120 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ad8151e90 0x7f0ad814fd40 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:48.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.329+0000 7f0adf53f640 1 --2- 172.21.15.132:0/402516120 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ad80b5cc0 0x7f0ad8155a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:48.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.329+0000 7f0adf53f640 1 --2- 172.21.15.132:0/402516120 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ad806dc90 0x7f0ad8159690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:48.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.329+0000 7f0adf53f640 1 -- 172.21.15.132:0/402516120 >> 172.21.15.132:0/402516120 conn(0x7f0ad80b2d50 msgr2=0x7f0ad806e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:48.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.330+0000 7f0adf53f640 1 -- 172.21.15.132:0/402516120 shutdown_connections 2024-04-16T15:52:48.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.330+0000 7f0adf53f640 1 -- 172.21.15.132:0/402516120 wait complete. 2024-04-16T15:52:48.340 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T15:52:03.284927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T15:52:13.363758+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T15:52:14.246647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T15:52:48.340 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T15:52:48.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.447+0000 7f14f6814640 1 Processor -- start 2024-04-16T15:52:48.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.447+0000 7f14f6814640 1 -- start start 2024-04-16T15:52:48.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.448+0000 7f14f6814640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f14f015eae0 0x7f14f00ae480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:48.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.448+0000 7f14f6814640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f14f00b6020 0x7f14f00b0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:48.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.448+0000 7f14f6814640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14f00b67c0 con 0x7f14f0070eb0 2024-04-16T15:52:48.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.448+0000 7f14f6814640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f14f00b0860 con 0x7f14f00b6020 2024-04-16T15:52:48.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.448+0000 7f14f6814640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f14f00b4b90 con 0x7f14f015eae0 2024-04-16T15:52:48.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.448+0000 7f14ef7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f14f00b6020 0x7f14f00b0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:48.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.448+0000 7f14f4db1640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f14f0070eb0 0x7f14f006fb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:35346/0 (socket says 172.21.15.132:35346) 2024-04-16T15:52:48.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.448+0000 7f14f4db1640 1 -- 172.21.15.132:0/108369165 learned_addr learned my addr 172.21.15.132:0/108369165 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:48.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.448+0000 7f14ef7fe640 1 -- 172.21.15.132:0/108369165 >> v2:172.21.15.179:3300/0 conn(0x7f14f015eae0 msgr2=0x7f14f00ae480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:48.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.448+0000 7f14effff640 1 --2- 172.21.15.132:0/108369165 >> v2:172.21.15.179:3300/0 conn(0x7f14f015eae0 0x7f14f00ae480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:48.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.448+0000 7f14eeffd640 1 -- 172.21.15.132:0/108369165 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1856563489 0 0) 0x7f14e8001490 con 0x7f14f0070eb0 2024-04-16T15:52:48.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.448+0000 7f14ef7fe640 1 --2- 172.21.15.132:0/108369165 >> v2:172.21.15.179:3300/0 conn(0x7f14f015eae0 0x7f14f00ae480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:48.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.448+0000 7f14ef7fe640 1 -- 172.21.15.132:0/108369165 >> v1:172.21.15.132:6789/0 conn(0x7f14f0070eb0 legacy=0x7f14f006fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:48.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.448+0000 7f14ef7fe640 1 -- 172.21.15.132:0/108369165 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14f00b64e0 con 0x7f14f00b6020 2024-04-16T15:52:48.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.448+0000 7f14effff640 1 --2- 172.21.15.132:0/108369165 >> v2:172.21.15.179:3300/0 conn(0x7f14f015eae0 0x7f14f00ae480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:52:48.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.449+0000 7f14ef7fe640 1 --2- 172.21.15.132:0/108369165 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14f00b6020 0x7f14f00b0320 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f14f00d25d0 tx=0x7f14d802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11bc455ff7ec8198 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:48.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.449+0000 7f14eeffd640 1 -- 172.21.15.132:0/108369165 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d80315a0 con 0x7f14f00b6020 2024-04-16T15:52:48.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.449+0000 7f14eeffd640 1 -- 172.21.15.132:0/108369165 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14d8037070 con 0x7f14f00b6020 2024-04-16T15:52:48.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.449+0000 7f14eeffd640 1 -- 172.21.15.132:0/108369165 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d8031960 con 0x7f14f00b6020 2024-04-16T15:52:48.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.450+0000 7f14f6814640 1 -- 172.21.15.132:0/108369165 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14f00b6020 msgr2=0x7f14f00b0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:48.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.450+0000 7f14f6814640 1 --2- 172.21.15.132:0/108369165 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14f00b6020 0x7f14f00b0320 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f14f00d25d0 tx=0x7f14d802b840 comp rx=0 tx=0).stop 2024-04-16T15:52:48.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.450+0000 7f14f6814640 1 -- 172.21.15.132:0/108369165 shutdown_connections 2024-04-16T15:52:48.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.450+0000 7f14f6814640 1 --2- 172.21.15.132:0/108369165 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14f00b6020 0x7f14f00b0320 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:48.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.450+0000 7f14f6814640 1 --2- 172.21.15.132:0/108369165 >> v2:172.21.15.179:3300/0 conn(0x7f14f015eae0 0x7f14f00ae480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:48.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.450+0000 7f14f6814640 1 -- 172.21.15.132:0/108369165 >> 172.21.15.132:0/108369165 conn(0x7f14f009aa30 msgr2=0x7f14f00b69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:48.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.450+0000 7f14f6814640 1 -- 172.21.15.132:0/108369165 shutdown_connections 2024-04-16T15:52:48.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.450+0000 7f14f6814640 1 -- 172.21.15.132:0/108369165 wait complete. 2024-04-16T15:52:48.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.451+0000 7f14f6814640 1 Processor -- start 2024-04-16T15:52:48.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.451+0000 7f14f6814640 1 -- start start 2024-04-16T15:52:48.453 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.452+0000 7f14f6814640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14f0070eb0 0x7f14f015b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:48.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.452+0000 7f14f6814640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14f00b6020 0x7f14f0146980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:48.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.452+0000 7f14f6814640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14f0160040 0x7f14f01604f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:48.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.452+0000 7f14f6814640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f14f00b0c60 con 0x7f14f00b6020 2024-04-16T15:52:48.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.452+0000 7f14f6814640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f14f00b48b0 con 0x7f14f0070eb0 2024-04-16T15:52:48.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.452+0000 7f14f6814640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f14f0070220 con 0x7f14f0160040 2024-04-16T15:52:48.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.452+0000 7f14ef7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14f00b6020 0x7f14f0146980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:48.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.452+0000 7f14ef7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14f00b6020 0x7f14f0146980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53618/0 (socket says 172.21.15.132:53618) 2024-04-16T15:52:48.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.452+0000 7f14ef7fe640 1 -- 172.21.15.132:0/2223469832 learned_addr learned my addr 172.21.15.132:0/2223469832 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:48.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.452+0000 7f14f4db1640 1 --2- 172.21.15.132:0/2223469832 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14f0160040 0x7f14f01604f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:48.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.452+0000 7f14effff640 1 --2- 172.21.15.132:0/2223469832 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14f0070eb0 0x7f14f015b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:48.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.452+0000 7f14ef7fe640 1 -- 172.21.15.132:0/2223469832 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14f0160040 msgr2=0x7f14f01604f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:48.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.452+0000 7f14ef7fe640 1 --2- 172.21.15.132:0/2223469832 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14f0160040 0x7f14f01604f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:48.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.452+0000 7f14ef7fe640 1 -- 172.21.15.132:0/2223469832 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14f0070eb0 msgr2=0x7f14f015b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:48.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.452+0000 7f14ef7fe640 1 --2- 172.21.15.132:0/2223469832 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14f0070eb0 0x7f14f015b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:48.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.452+0000 7f14ef7fe640 1 -- 172.21.15.132:0/2223469832 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14f0147450 con 0x7f14f00b6020 2024-04-16T15:52:48.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.452+0000 7f14ef7fe640 1 --2- 172.21.15.132:0/2223469832 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14f00b6020 0x7f14f0146980 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f14d8009890 tx=0x7f14d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:48.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.452+0000 7f14ecff9640 1 -- 172.21.15.132:0/2223469832 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d8032840 con 0x7f14f00b6020 2024-04-16T15:52:48.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.452+0000 7f14ecff9640 1 -- 172.21.15.132:0/2223469832 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14d8032a00 con 0x7f14f00b6020 2024-04-16T15:52:48.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.452+0000 7f14f6814640 1 -- 172.21.15.132:0/2223469832 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14f015a210 con 0x7f14f00b6020 2024-04-16T15:52:48.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.452+0000 7f14ecff9640 1 -- 172.21.15.132:0/2223469832 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d8032df0 con 0x7f14f00b6020 2024-04-16T15:52:48.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.452+0000 7f14f6814640 1 -- 172.21.15.132:0/2223469832 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14f015a7d0 con 0x7f14f00b6020 2024-04-16T15:52:48.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.453+0000 7f14f6814640 1 -- 172.21.15.132:0/2223469832 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14f0075510 con 0x7f14f00b6020 2024-04-16T15:52:48.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.454+0000 7f14ecff9640 1 -- 172.21.15.132:0/2223469832 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f14d804c020 con 0x7f14f00b6020 2024-04-16T15:52:48.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.454+0000 7f14ecff9640 1 --2- 172.21.15.132:0/2223469832 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f14d006c8f0 0x7f14d006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:48.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.454+0000 7f14ecff9640 1 -- 172.21.15.132:0/2223469832 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f14d802f020 con 0x7f14f00b6020 2024-04-16T15:52:48.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.454+0000 7f14effff640 1 --2- 172.21.15.132:0/2223469832 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f14d006c8f0 0x7f14d006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:48.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.455+0000 7f14effff640 1 --2- 172.21.15.132:0/2223469832 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f14d006c8f0 0x7f14d006edb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f14e000a990 tx=0x7f14e0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:48.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.459+0000 7f14ecff9640 1 -- 172.21.15.132:0/2223469832 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f14d8040070 con 0x7f14f00b6020 2024-04-16T15:52:48.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.633+0000 7f14f6814640 1 -- 172.21.15.132:0/2223469832 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f14f00b05c0 con 0x7f14f00b6020 2024-04-16T15:52:48.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.634+0000 7f14ecff9640 1 -- 172.21.15.132:0/2223469832 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f14d807b780 con 0x7f14f00b6020 2024-04-16T15:52:48.633 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2024-04-16T15:52:48.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.636+0000 7f14f6814640 1 -- 172.21.15.132:0/2223469832 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f14d006c8f0 msgr2=0x7f14d006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:48.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.636+0000 7f14f6814640 1 --2- 172.21.15.132:0/2223469832 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f14d006c8f0 0x7f14d006edb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f14e000a990 tx=0x7f14e0008040 comp rx=0 tx=0).stop 2024-04-16T15:52:48.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.636+0000 7f14f6814640 1 -- 172.21.15.132:0/2223469832 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14f00b6020 msgr2=0x7f14f0146980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:48.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.636+0000 7f14f6814640 1 --2- 172.21.15.132:0/2223469832 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14f00b6020 0x7f14f0146980 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f14d8009890 tx=0x7f14d80046c0 comp rx=0 tx=0).stop 2024-04-16T15:52:48.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.636+0000 7f14f6814640 1 -- 172.21.15.132:0/2223469832 shutdown_connections 2024-04-16T15:52:48.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.636+0000 7f14f6814640 1 --2- 172.21.15.132:0/2223469832 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f14d006c8f0 0x7f14d006edb0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:48.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.636+0000 7f14f6814640 1 --2- 172.21.15.132:0/2223469832 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14f0160040 0x7f14f01604f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:48.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.636+0000 7f14f6814640 1 --2- 172.21.15.132:0/2223469832 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14f00b6020 0x7f14f0146980 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:48.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.636+0000 7f14f6814640 1 --2- 172.21.15.132:0/2223469832 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14f0070eb0 0x7f14f015b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:48.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.636+0000 7f14f6814640 1 -- 172.21.15.132:0/2223469832 >> 172.21.15.132:0/2223469832 conn(0x7f14f009aa30 msgr2=0x7f14f01583b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:48.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.636+0000 7f14f6814640 1 -- 172.21.15.132:0/2223469832 shutdown_connections 2024-04-16T15:52:48.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.636+0000 7f14f6814640 1 -- 172.21.15.132:0/2223469832 wait complete. 2024-04-16T15:52:48.646 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T15:52:48.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.753+0000 7f8f25442640 1 Processor -- start 2024-04-16T15:52:48.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.753+0000 7f8f25442640 1 -- start start 2024-04-16T15:52:48.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.754+0000 7f8f25442640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8f2015cc10 0x7f8f200b3540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:48.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.754+0000 7f8f25442640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f200ccf00 0x7f8f200b3a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:48.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.754+0000 7f8f25442640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f20072b00 con 0x7f8f2015c830 2024-04-16T15:52:48.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.754+0000 7f8f25442640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f8f200cda60 con 0x7f8f2015cc10 2024-04-16T15:52:48.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.754+0000 7f8f25442640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f8f200b4bb0 con 0x7f8f200ccf00 2024-04-16T15:52:48.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.754+0000 7f8f1effd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f8f2015c830 0x7f8f200cf5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:35362/0 (socket says 172.21.15.132:35362) 2024-04-16T15:52:48.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.754+0000 7f8f1effd640 1 -- 172.21.15.132:0/4105235424 learned_addr learned my addr 172.21.15.132:0/4105235424 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:48.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.754+0000 7f8f1e7fc640 1 --2- 172.21.15.132:0/4105235424 >> v2:172.21.15.179:3300/0 conn(0x7f8f2015cc10 0x7f8f200b3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:48.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.754+0000 7f8f1dffb640 1 -- 172.21.15.132:0/4105235424 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2456309243 0 0) 0x7f8f20072b00 con 0x7f8f2015c830 2024-04-16T15:52:48.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.754+0000 7f8f1f7fe640 1 --2- 172.21.15.132:0/4105235424 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f200ccf00 0x7f8f200b3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:48.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.754+0000 7f8f1dffb640 1 -- 172.21.15.132:0/4105235424 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f0c003520 con 0x7f8f2015c830 2024-04-16T15:52:48.757 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.755+0000 7f8f1dffb640 1 -- 172.21.15.132:0/4105235424 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3158217339 0 0) 0x7f8f0c003520 con 0x7f8f2015c830 2024-04-16T15:52:48.757 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.755+0000 7f8f1dffb640 1 -- 172.21.15.132:0/4105235424 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f200ccf00 msgr2=0x7f8f200b3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:48.757 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.755+0000 7f8f1dffb640 1 --2- 172.21.15.132:0/4105235424 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f200ccf00 0x7f8f200b3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:48.757 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.755+0000 7f8f1dffb640 1 -- 172.21.15.132:0/4105235424 >> v2:172.21.15.179:3300/0 conn(0x7f8f2015cc10 msgr2=0x7f8f200b3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:48.757 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.755+0000 7f8f1dffb640 1 --2- 172.21.15.132:0/4105235424 >> v2:172.21.15.179:3300/0 conn(0x7f8f2015cc10 0x7f8f200b3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:48.757 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.755+0000 7f8f1dffb640 1 -- 172.21.15.132:0/4105235424 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f200b4e90 con 0x7f8f2015c830 2024-04-16T15:52:48.757 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.755+0000 7f8f1dffb640 1 -- 172.21.15.132:0/4105235424 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2803668828 0 0) 0x7f8f100019f0 con 0x7f8f2015c830 2024-04-16T15:52:48.757 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.755+0000 7f8f1dffb640 1 -- 172.21.15.132:0/4105235424 >> v1:172.21.15.132:6789/0 conn(0x7f8f2015c830 legacy=0x7f8f200cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:48.757 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.755+0000 7f8f1dffb640 1 --2- 172.21.15.132:0/4105235424 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8f0c0039b0 0x7f8f0c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:48.757 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.755+0000 7f8f1dffb640 1 --2- 172.21.15.132:0/4105235424 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f200ccf00 0x7f8f0c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:48.757 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.755+0000 7f8f1dffb640 1 --2- 172.21.15.132:0/4105235424 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f0c0099b0 0x7f8f0c004d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:48.758 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.755+0000 7f8f1dffb640 1 -- 172.21.15.132:0/4105235424 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f8f200cda60 con 0x7f8f0c0039b0 2024-04-16T15:52:48.758 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.755+0000 7f8f1dffb640 1 -- 172.21.15.132:0/4105235424 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8f200b4bb0 con 0x7f8f0c0099b0 2024-04-16T15:52:48.758 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.755+0000 7f8f1dffb640 1 -- 172.21.15.132:0/4105235424 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f8f0c0054e0 con 0x7f8f200ccf00 2024-04-16T15:52:48.758 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.755+0000 7f8f1effd640 1 --2- 172.21.15.132:0/4105235424 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8f0c0039b0 0x7f8f0c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:48.758 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.755+0000 7f8f1e7fc640 1 --2- 172.21.15.132:0/4105235424 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f200ccf00 0x7f8f0c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:48.758 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.755+0000 7f8f1f7fe640 1 --2- 172.21.15.132:0/4105235424 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f0c0099b0 0x7f8f0c004d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:48.758 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.755+0000 7f8f1effd640 1 -- 172.21.15.132:0/4105235424 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f200ccf00 msgr2=0x7f8f0c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:48.758 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.755+0000 7f8f1effd640 1 --2- 172.21.15.132:0/4105235424 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f200ccf00 0x7f8f0c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:48.758 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.755+0000 7f8f1effd640 1 -- 172.21.15.132:0/4105235424 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f0c0099b0 msgr2=0x7f8f0c004d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:48.758 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.755+0000 7f8f1effd640 1 --2- 172.21.15.132:0/4105235424 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f0c0099b0 0x7f8f0c004d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:48.758 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.755+0000 7f8f1effd640 1 -- 172.21.15.132:0/4105235424 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f0c003520 con 0x7f8f0c0039b0 2024-04-16T15:52:48.758 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.755+0000 7f8f1f7fe640 1 --2- 172.21.15.132:0/4105235424 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f0c0099b0 0x7f8f0c004d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:48.758 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.756+0000 7f8f1effd640 1 --2- 172.21.15.132:0/4105235424 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8f0c0039b0 0x7f8f0c003dd0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8f1000a880 tx=0x7f8f0c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5955a916a88709a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:48.758 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.756+0000 7f8f1dffb640 1 -- 172.21.15.132:0/4105235424 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f1000a4a0 con 0x7f8f0c0039b0 2024-04-16T15:52:48.759 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.756+0000 7f8f1dffb640 1 -- 172.21.15.132:0/4105235424 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f10034650 con 0x7f8f0c0039b0 2024-04-16T15:52:48.759 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.756+0000 7f8f1dffb640 1 -- 172.21.15.132:0/4105235424 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f10034a40 con 0x7f8f0c0039b0 2024-04-16T15:52:48.759 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.756+0000 7f8f25442640 1 -- 172.21.15.132:0/4105235424 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8f0c0039b0 msgr2=0x7f8f0c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:48.759 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.756+0000 7f8f25442640 1 --2- 172.21.15.132:0/4105235424 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8f0c0039b0 0x7f8f0c003dd0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8f1000a880 tx=0x7f8f0c005830 comp rx=0 tx=0).stop 2024-04-16T15:52:48.759 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.756+0000 7f8f1f7fe640 1 -- 172.21.15.132:0/4105235424 reap_dead start 2024-04-16T15:52:48.759 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.757+0000 7f8f25442640 1 -- 172.21.15.132:0/4105235424 shutdown_connections 2024-04-16T15:52:48.759 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.757+0000 7f8f25442640 1 -- 172.21.15.132:0/4105235424 >> 172.21.15.132:0/4105235424 conn(0x7f8f200d0490 msgr2=0x7f8f200d08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:48.759 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.757+0000 7f8f25442640 1 -- 172.21.15.132:0/4105235424 shutdown_connections 2024-04-16T15:52:48.759 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.757+0000 7f8f25442640 1 -- 172.21.15.132:0/4105235424 wait complete. 2024-04-16T15:52:48.762 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.758+0000 7f8f25442640 1 Processor -- start 2024-04-16T15:52:48.762 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.758+0000 7f8f25442640 1 -- start start 2024-04-16T15:52:48.762 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.759+0000 7f8f25442640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f0c0039b0 0x7f8f201f3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:48.762 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.759+0000 7f8f25442640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f20156080 0x7f8f201522e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:48.762 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.759+0000 7f8f25442640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8f20152820 0x7f8f20147620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:48.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.759+0000 7f8f25442640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f8f200cdef0 con 0x7f8f20152820 2024-04-16T15:52:48.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.759+0000 7f8f25442640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8f200b5480 con 0x7f8f20156080 2024-04-16T15:52:48.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.759+0000 7f8f25442640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f8f20158880 con 0x7f8f0c0039b0 2024-04-16T15:52:48.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.759+0000 7f8f1f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8f20152820 0x7f8f20147620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:48.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.759+0000 7f8f1f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8f20152820 0x7f8f20147620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53626/0 (socket says 172.21.15.132:53626) 2024-04-16T15:52:48.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.759+0000 7f8f1f7fe640 1 -- 172.21.15.132:0/1941119081 learned_addr learned my addr 172.21.15.132:0/1941119081 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:48.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.759+0000 7f8f1e7fc640 1 --2- 172.21.15.132:0/1941119081 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f20156080 0x7f8f201522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:48.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.759+0000 7f8f1effd640 1 --2- 172.21.15.132:0/1941119081 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f0c0039b0 0x7f8f201f3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:48.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.759+0000 7f8f1f7fe640 1 -- 172.21.15.132:0/1941119081 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f0c0039b0 msgr2=0x7f8f201f3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:48.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.759+0000 7f8f1f7fe640 1 --2- 172.21.15.132:0/1941119081 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f0c0039b0 0x7f8f201f3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:48.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.759+0000 7f8f1f7fe640 1 -- 172.21.15.132:0/1941119081 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f20156080 msgr2=0x7f8f201522e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:48.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.759+0000 7f8f1f7fe640 1 --2- 172.21.15.132:0/1941119081 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f20156080 0x7f8f201522e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:48.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.759+0000 7f8f1f7fe640 1 -- 172.21.15.132:0/1941119081 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f20158ad0 con 0x7f8f20152820 2024-04-16T15:52:48.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.759+0000 7f8f1f7fe640 1 --2- 172.21.15.132:0/1941119081 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8f20152820 0x7f8f20147620 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8f200503f0 tx=0x7f8f18011860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:48.764 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.759+0000 7f8f177fe640 1 -- 172.21.15.132:0/1941119081 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f18019020 con 0x7f8f20152820 2024-04-16T15:52:48.764 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.759+0000 7f8f177fe640 1 -- 172.21.15.132:0/1941119081 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f18004460 con 0x7f8f20152820 2024-04-16T15:52:48.764 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.759+0000 7f8f25442640 1 -- 172.21.15.132:0/1941119081 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f20158db0 con 0x7f8f20152820 2024-04-16T15:52:48.764 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.759+0000 7f8f177fe640 1 -- 172.21.15.132:0/1941119081 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f18003850 con 0x7f8f20152820 2024-04-16T15:52:48.764 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.759+0000 7f8f25442640 1 -- 172.21.15.132:0/1941119081 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f20159370 con 0x7f8f20152820 2024-04-16T15:52:48.764 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.760+0000 7f8f25442640 1 -- 172.21.15.132:0/1941119081 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f20152ca0 con 0x7f8f20152820 2024-04-16T15:52:48.764 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.761+0000 7f8f177fe640 1 -- 172.21.15.132:0/1941119081 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8f1801c020 con 0x7f8f20152820 2024-04-16T15:52:48.764 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.761+0000 7f8f177fe640 1 --2- 172.21.15.132:0/1941119081 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f8f0006c8f0 0x7f8f0006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:48.764 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.761+0000 7f8f177fe640 1 -- 172.21.15.132:0/1941119081 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8f1808bb20 con 0x7f8f20152820 2024-04-16T15:52:48.764 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.761+0000 7f8f1effd640 1 --2- 172.21.15.132:0/1941119081 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f8f0006c8f0 0x7f8f0006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:48.764 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.762+0000 7f8f1effd640 1 --2- 172.21.15.132:0/1941119081 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f8f0006c8f0 0x7f8f0006edb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8f10034000 tx=0x7f8f10009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:48.765 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.766+0000 7f8f177fe640 1 -- 172.21.15.132:0/1941119081 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8f18023030 con 0x7f8f20152820 2024-04-16T15:52:48.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.942+0000 7f8f25442640 1 -- 172.21.15.132:0/1941119081 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f8f200ce070 con 0x7f8f20152820 2024-04-16T15:52:48.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.942+0000 7f8f177fe640 1 -- 172.21.15.132:0/1941119081 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f8f1805ee20 con 0x7f8f20152820 2024-04-16T15:52:48.941 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2024-04-16T15:52:48.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.944+0000 7f8f25442640 1 -- 172.21.15.132:0/1941119081 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f8f0006c8f0 msgr2=0x7f8f0006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:48.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.944+0000 7f8f25442640 1 --2- 172.21.15.132:0/1941119081 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f8f0006c8f0 0x7f8f0006edb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8f10034000 tx=0x7f8f10009030 comp rx=0 tx=0).stop 2024-04-16T15:52:48.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.944+0000 7f8f25442640 1 -- 172.21.15.132:0/1941119081 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8f20152820 msgr2=0x7f8f20147620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:48.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.944+0000 7f8f25442640 1 --2- 172.21.15.132:0/1941119081 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8f20152820 0x7f8f20147620 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8f200503f0 tx=0x7f8f18011860 comp rx=0 tx=0).stop 2024-04-16T15:52:48.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.944+0000 7f8f25442640 1 -- 172.21.15.132:0/1941119081 shutdown_connections 2024-04-16T15:52:48.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.944+0000 7f8f25442640 1 --2- 172.21.15.132:0/1941119081 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f8f0006c8f0 0x7f8f0006edb0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:48.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.944+0000 7f8f25442640 1 --2- 172.21.15.132:0/1941119081 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8f20152820 0x7f8f20147620 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:48.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.944+0000 7f8f25442640 1 --2- 172.21.15.132:0/1941119081 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f20156080 0x7f8f201522e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:48.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.944+0000 7f8f25442640 1 --2- 172.21.15.132:0/1941119081 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f0c0039b0 0x7f8f201f3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:48.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.944+0000 7f8f25442640 1 -- 172.21.15.132:0/1941119081 >> 172.21.15.132:0/1941119081 conn(0x7f8f200d0490 msgr2=0x7f8f2006e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:48.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.944+0000 7f8f25442640 1 -- 172.21.15.132:0/1941119081 shutdown_connections 2024-04-16T15:52:48.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:48.944+0000 7f8f25442640 1 -- 172.21.15.132:0/1941119081 wait complete. 2024-04-16T15:52:48.955 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T15:52:49.062 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.063+0000 7effba6d9640 1 Processor -- start 2024-04-16T15:52:49.062 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.063+0000 7effba6d9640 1 -- start start 2024-04-16T15:52:49.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.064+0000 7effba6d9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effb415eae0 0x7effb40ae480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:49.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.064+0000 7effba6d9640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7effb4070eb0 0x7effb40b0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:49.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.064+0000 7effba6d9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effb40b67c0 con 0x7effb40b6020 2024-04-16T15:52:49.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.064+0000 7effba6d9640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7effb40b0860 con 0x7effb4070eb0 2024-04-16T15:52:49.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.064+0000 7effba6d9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7effb40b4b90 con 0x7effb415eae0 2024-04-16T15:52:49.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.064+0000 7effb37fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7effb40b6020 0x7effb406fb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:35374/0 (socket says 172.21.15.132:35374) 2024-04-16T15:52:49.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.064+0000 7effb37fe640 1 -- 172.21.15.132:0/511566844 learned_addr learned my addr 172.21.15.132:0/511566844 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:49.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.064+0000 7effb8c76640 1 --2- 172.21.15.132:0/511566844 >> v2:172.21.15.179:3300/0 conn(0x7effb4070eb0 0x7effb40b0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:49.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.064+0000 7effb3fff640 1 --2- 172.21.15.132:0/511566844 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effb415eae0 0x7effb40ae480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:49.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.064+0000 7effb2ffd640 1 -- 172.21.15.132:0/511566844 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 429743673 0 0) 0x7effa8001110 con 0x7effb40b6020 2024-04-16T15:52:49.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.064+0000 7effb2ffd640 1 -- 172.21.15.132:0/511566844 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff9c003520 con 0x7effb40b6020 2024-04-16T15:52:49.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.064+0000 7effb2ffd640 1 -- 172.21.15.132:0/511566844 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4032842311 0 0) 0x7eff9c003520 con 0x7effb40b6020 2024-04-16T15:52:49.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.064+0000 7effb2ffd640 1 -- 172.21.15.132:0/511566844 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effb415eae0 msgr2=0x7effb40ae480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:49.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.064+0000 7effb2ffd640 1 --2- 172.21.15.132:0/511566844 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effb415eae0 0x7effb40ae480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:49.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.064+0000 7effb2ffd640 1 -- 172.21.15.132:0/511566844 >> v2:172.21.15.179:3300/0 conn(0x7effb4070eb0 msgr2=0x7effb40b0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:49.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.064+0000 7effb2ffd640 1 --2- 172.21.15.132:0/511566844 >> v2:172.21.15.179:3300/0 conn(0x7effb4070eb0 0x7effb40b0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:49.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.064+0000 7effb2ffd640 1 -- 172.21.15.132:0/511566844 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effb40b64e0 con 0x7effb40b6020 2024-04-16T15:52:49.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.064+0000 7effb2ffd640 1 -- 172.21.15.132:0/511566844 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2803668828 0 0) 0x7effa8001840 con 0x7effb40b6020 2024-04-16T15:52:49.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.064+0000 7effb8c76640 1 --2- 172.21.15.132:0/511566844 >> v2:172.21.15.179:3300/0 conn(0x7effb4070eb0 0x7effb40b0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:52:49.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.064+0000 7effb2ffd640 1 -- 172.21.15.132:0/511566844 >> v1:172.21.15.132:6789/0 conn(0x7effb40b6020 legacy=0x7effb406fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:49.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.064+0000 7effb2ffd640 1 --2- 172.21.15.132:0/511566844 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff9c0039b0 0x7eff9c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:49.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.064+0000 7effb2ffd640 1 --2- 172.21.15.132:0/511566844 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff9c004800 0x7eff9c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:49.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.064+0000 7effb2ffd640 1 --2- 172.21.15.132:0/511566844 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff9c0051c0 0x7eff9c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:49.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.064+0000 7effb2ffd640 1 -- 172.21.15.132:0/511566844 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7effb40b0860 con 0x7eff9c004800 2024-04-16T15:52:49.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.064+0000 7effb2ffd640 1 -- 172.21.15.132:0/511566844 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7effb40b4b90 con 0x7eff9c0039b0 2024-04-16T15:52:49.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.064+0000 7effb2ffd640 1 -- 172.21.15.132:0/511566844 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7eff9c00bf00 con 0x7eff9c0051c0 2024-04-16T15:52:49.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.064+0000 7effb37fe640 1 --2- 172.21.15.132:0/511566844 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff9c004800 0x7eff9c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:49.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.065+0000 7effb3fff640 1 --2- 172.21.15.132:0/511566844 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff9c0039b0 0x7eff9c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:49.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.065+0000 7effb8c76640 1 --2- 172.21.15.132:0/511566844 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff9c0051c0 0x7eff9c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:49.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.065+0000 7effb37fe640 1 -- 172.21.15.132:0/511566844 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff9c0051c0 msgr2=0x7eff9c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:49.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.065+0000 7effb37fe640 1 --2- 172.21.15.132:0/511566844 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff9c0051c0 0x7eff9c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:49.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.065+0000 7effb37fe640 1 -- 172.21.15.132:0/511566844 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff9c0039b0 msgr2=0x7eff9c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:49.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.065+0000 7effb37fe640 1 --2- 172.21.15.132:0/511566844 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff9c0039b0 0x7eff9c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:49.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.065+0000 7effb37fe640 1 -- 172.21.15.132:0/511566844 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff9c003520 con 0x7eff9c004800 2024-04-16T15:52:49.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.065+0000 7effb37fe640 1 --2- 172.21.15.132:0/511566844 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff9c004800 0x7eff9c004c80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7effa800c3e0 tx=0x7eff9c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2290e62fa3ad7efc server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:49.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.066+0000 7effb2ffd640 1 -- 172.21.15.132:0/511566844 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa800c0e0 con 0x7eff9c004800 2024-04-16T15:52:49.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.066+0000 7effb2ffd640 1 -- 172.21.15.132:0/511566844 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effa8030070 con 0x7eff9c004800 2024-04-16T15:52:49.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.066+0000 7effb2ffd640 1 -- 172.21.15.132:0/511566844 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa80058d0 con 0x7eff9c004800 2024-04-16T15:52:49.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.066+0000 7effba6d9640 1 -- 172.21.15.132:0/511566844 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff9c004800 msgr2=0x7eff9c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:49.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.066+0000 7effba6d9640 1 --2- 172.21.15.132:0/511566844 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff9c004800 0x7eff9c004c80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7effa800c3e0 tx=0x7eff9c005830 comp rx=0 tx=0).stop 2024-04-16T15:52:49.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.066+0000 7effb8c76640 1 -- 172.21.15.132:0/511566844 reap_dead start 2024-04-16T15:52:49.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.066+0000 7effba6d9640 1 -- 172.21.15.132:0/511566844 shutdown_connections 2024-04-16T15:52:49.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.066+0000 7effba6d9640 1 -- 172.21.15.132:0/511566844 >> 172.21.15.132:0/511566844 conn(0x7effb409aa30 msgr2=0x7effb40b69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:49.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.066+0000 7effba6d9640 1 -- 172.21.15.132:0/511566844 shutdown_connections 2024-04-16T15:52:49.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.066+0000 7effba6d9640 1 -- 172.21.15.132:0/511566844 wait complete. 2024-04-16T15:52:49.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.067+0000 7effba6d9640 1 Processor -- start 2024-04-16T15:52:49.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.068+0000 7effba6d9640 1 -- start start 2024-04-16T15:52:49.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.068+0000 7effba6d9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff9c004800 0x7effb4152ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:49.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.068+0000 7effba6d9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7effb4140c50 0x7effb41410b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:49.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.068+0000 7effba6d9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effb40b2160 0x7effb40b25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:49.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.068+0000 7effba6d9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7effb40b0c60 con 0x7effb4140c50 2024-04-16T15:52:49.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.068+0000 7effba6d9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7effb40b48b0 con 0x7eff9c004800 2024-04-16T15:52:49.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.068+0000 7effba6d9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7effb4070220 con 0x7effb40b2160 2024-04-16T15:52:49.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.068+0000 7effb37fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7effb4140c50 0x7effb41410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:49.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.068+0000 7effb37fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7effb4140c50 0x7effb41410b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53652/0 (socket says 172.21.15.132:53652) 2024-04-16T15:52:49.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.068+0000 7effb37fe640 1 -- 172.21.15.132:0/872827111 learned_addr learned my addr 172.21.15.132:0/872827111 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:49.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.068+0000 7effb3fff640 1 --2- 172.21.15.132:0/872827111 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff9c004800 0x7effb4152ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:49.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.068+0000 7effb8c76640 1 --2- 172.21.15.132:0/872827111 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effb40b2160 0x7effb40b25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:49.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.069+0000 7effb37fe640 1 -- 172.21.15.132:0/872827111 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effb40b2160 msgr2=0x7effb40b25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:49.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.069+0000 7effb37fe640 1 --2- 172.21.15.132:0/872827111 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effb40b2160 0x7effb40b25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:49.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.069+0000 7effb37fe640 1 -- 172.21.15.132:0/872827111 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff9c004800 msgr2=0x7effb4152ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:49.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.069+0000 7effb37fe640 1 --2- 172.21.15.132:0/872827111 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff9c004800 0x7effb4152ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:49.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.069+0000 7effb37fe640 1 -- 172.21.15.132:0/872827111 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effb41415f0 con 0x7effb4140c50 2024-04-16T15:52:49.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.069+0000 7effb37fe640 1 --2- 172.21.15.132:0/872827111 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7effb4140c50 0x7effb41410b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7effa800c500 tx=0x7effa8001c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:49.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.069+0000 7effb0ff9640 1 -- 172.21.15.132:0/872827111 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa8004bf0 con 0x7effb4140c50 2024-04-16T15:52:49.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.069+0000 7effb0ff9640 1 -- 172.21.15.132:0/872827111 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effa8004d90 con 0x7effb4140c50 2024-04-16T15:52:49.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.069+0000 7effba6d9640 1 -- 172.21.15.132:0/872827111 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effb40b2e70 con 0x7effb4140c50 2024-04-16T15:52:49.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.069+0000 7effb0ff9640 1 -- 172.21.15.132:0/872827111 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa80072b0 con 0x7effb4140c50 2024-04-16T15:52:49.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.069+0000 7effba6d9640 1 -- 172.21.15.132:0/872827111 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effb40b3430 con 0x7effb4140c50 2024-04-16T15:52:49.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.070+0000 7effba6d9640 1 -- 172.21.15.132:0/872827111 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effb4075510 con 0x7effb4140c50 2024-04-16T15:52:49.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.071+0000 7effb0ff9640 1 -- 172.21.15.132:0/872827111 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7effa8007450 con 0x7effb4140c50 2024-04-16T15:52:49.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.071+0000 7effb0ff9640 1 --2- 172.21.15.132:0/872827111 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7effa006c8f0 0x7effa006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:49.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.071+0000 7effb0ff9640 1 -- 172.21.15.132:0/872827111 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7effa80ad680 con 0x7effb4140c50 2024-04-16T15:52:49.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.071+0000 7effb3fff640 1 --2- 172.21.15.132:0/872827111 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7effa006c8f0 0x7effa006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:49.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.071+0000 7effb3fff640 1 --2- 172.21.15.132:0/872827111 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7effa006c8f0 0x7effa006edb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7effa4009a60 tx=0x7effa4009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:49.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.075+0000 7effb0ff9640 1 -- 172.21.15.132:0/872827111 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7effb40b67c0 con 0x7effb4140c50 2024-04-16T15:52:49.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.251+0000 7effba6d9640 1 -- 172.21.15.132:0/872827111 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7effb414f820 con 0x7effb4140c50 2024-04-16T15:52:49.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.252+0000 7effb0ff9640 1 -- 172.21.15.132:0/872827111 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7effa807bb70 con 0x7effb4140c50 2024-04-16T15:52:49.252 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2024-04-16T15:52:49.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.254+0000 7effba6d9640 1 -- 172.21.15.132:0/872827111 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7effa006c8f0 msgr2=0x7effa006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:49.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.254+0000 7effba6d9640 1 --2- 172.21.15.132:0/872827111 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7effa006c8f0 0x7effa006edb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7effa4009a60 tx=0x7effa4009190 comp rx=0 tx=0).stop 2024-04-16T15:52:49.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.254+0000 7effba6d9640 1 -- 172.21.15.132:0/872827111 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7effb4140c50 msgr2=0x7effb41410b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:49.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.254+0000 7effba6d9640 1 --2- 172.21.15.132:0/872827111 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7effb4140c50 0x7effb41410b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7effa800c500 tx=0x7effa8001c10 comp rx=0 tx=0).stop 2024-04-16T15:52:49.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.254+0000 7effba6d9640 1 -- 172.21.15.132:0/872827111 shutdown_connections 2024-04-16T15:52:49.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.254+0000 7effba6d9640 1 --2- 172.21.15.132:0/872827111 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7effa006c8f0 0x7effa006edb0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:49.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.254+0000 7effba6d9640 1 --2- 172.21.15.132:0/872827111 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effb40b2160 0x7effb40b25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:49.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.254+0000 7effba6d9640 1 --2- 172.21.15.132:0/872827111 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7effb4140c50 0x7effb41410b0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:49.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.254+0000 7effba6d9640 1 --2- 172.21.15.132:0/872827111 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff9c004800 0x7effb4152ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:49.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.254+0000 7effba6d9640 1 -- 172.21.15.132:0/872827111 >> 172.21.15.132:0/872827111 conn(0x7effb409aa30 msgr2=0x7effb4160b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:49.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.254+0000 7effba6d9640 1 -- 172.21.15.132:0/872827111 shutdown_connections 2024-04-16T15:52:49.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.254+0000 7effba6d9640 1 -- 172.21.15.132:0/872827111 wait complete. 2024-04-16T15:52:49.264 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-16T15:52:49.369 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.370+0000 7ff38540d640 1 Processor -- start 2024-04-16T15:52:49.369 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.370+0000 7ff38540d640 1 -- start start 2024-04-16T15:52:49.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.370+0000 7ff38540d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff3800cfdf0 0x7ff3800d1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:49.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.370+0000 7ff38540d640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff380162780 con 0x7ff3800ba2a0 2024-04-16T15:52:49.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.370+0000 7ff38540d640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff380162a60 con 0x7ff380162080 2024-04-16T15:52:49.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.370+0000 7ff38540d640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7ff380162d40 con 0x7ff3800cfdf0 2024-04-16T15:52:49.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.371+0000 7ff37f7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7ff3800ba2a0 0x7ff3800d2fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:35380/0 (socket says 172.21.15.132:35380) 2024-04-16T15:52:49.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.371+0000 7ff37f7fe640 1 -- 172.21.15.132:0/4294475401 learned_addr learned my addr 172.21.15.132:0/4294475401 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:49.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.371+0000 7ff37dffb640 1 -- 172.21.15.132:0/4294475401 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2487777031 0 0) 0x7ff380162780 con 0x7ff3800ba2a0 2024-04-16T15:52:49.374 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.371+0000 7ff37dffb640 1 -- 172.21.15.132:0/4294475401 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff36c003520 con 0x7ff3800ba2a0 2024-04-16T15:52:49.374 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.371+0000 7ff37e7fc640 1 --2- 172.21.15.132:0/4294475401 >> v2:172.21.15.179:3300/0 conn(0x7ff3800cfdf0 0x7ff3800d1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:49.374 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.371+0000 7ff37dffb640 1 -- 172.21.15.132:0/4294475401 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1657873922 0 0) 0x7ff36c003520 con 0x7ff3800ba2a0 2024-04-16T15:52:49.374 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.371+0000 7ff37dffb640 1 -- 172.21.15.132:0/4294475401 >> v2:172.21.15.179:3300/0 conn(0x7ff3800cfdf0 msgr2=0x7ff3800d1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:49.374 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.371+0000 7ff37dffb640 1 --2- 172.21.15.132:0/4294475401 >> v2:172.21.15.179:3300/0 conn(0x7ff3800cfdf0 0x7ff3800d1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:49.374 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.371+0000 7ff37dffb640 1 -- 172.21.15.132:0/4294475401 >> v1:172.21.15.179:6789/0 conn(0x7ff380162080 legacy=0x7ff3800cf6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:49.374 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.371+0000 7ff37dffb640 1 -- 172.21.15.132:0/4294475401 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff380163020 con 0x7ff3800ba2a0 2024-04-16T15:52:49.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.371+0000 7ff37dffb640 1 -- 172.21.15.132:0/4294475401 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2803668828 0 0) 0x7ff3700019f0 con 0x7ff3800ba2a0 2024-04-16T15:52:49.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.371+0000 7ff37dffb640 1 -- 172.21.15.132:0/4294475401 >> v1:172.21.15.132:6789/0 conn(0x7ff3800ba2a0 legacy=0x7ff3800d2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:49.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.371+0000 7ff37dffb640 1 --2- 172.21.15.132:0/4294475401 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff36c0039b0 0x7ff36c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:49.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.371+0000 7ff37dffb640 1 --2- 172.21.15.132:0/4294475401 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff36c004800 0x7ff36c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:49.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.371+0000 7ff37dffb640 1 --2- 172.21.15.132:0/4294475401 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff36c0051c0 0x7ff36c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:49.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.371+0000 7ff37dffb640 1 -- 172.21.15.132:0/4294475401 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff380162d40 con 0x7ff36c004800 2024-04-16T15:52:49.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.371+0000 7ff37dffb640 1 -- 172.21.15.132:0/4294475401 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff36c00c060 con 0x7ff36c0039b0 2024-04-16T15:52:49.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.371+0000 7ff37dffb640 1 -- 172.21.15.132:0/4294475401 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff36c00c260 con 0x7ff36c0051c0 2024-04-16T15:52:49.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.371+0000 7ff37e7fc640 1 --2- 172.21.15.132:0/4294475401 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff36c004800 0x7ff36c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:49.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.371+0000 7ff37effd640 1 --2- 172.21.15.132:0/4294475401 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff36c0039b0 0x7ff36c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:49.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.371+0000 7ff37f7fe640 1 --2- 172.21.15.132:0/4294475401 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff36c0051c0 0x7ff36c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:49.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.372+0000 7ff37e7fc640 1 -- 172.21.15.132:0/4294475401 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff36c0051c0 msgr2=0x7ff36c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:49.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.372+0000 7ff37e7fc640 1 --2- 172.21.15.132:0/4294475401 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff36c0051c0 0x7ff36c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:49.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.372+0000 7ff37e7fc640 1 -- 172.21.15.132:0/4294475401 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff36c0039b0 msgr2=0x7ff36c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:49.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.372+0000 7ff37e7fc640 1 --2- 172.21.15.132:0/4294475401 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff36c0039b0 0x7ff36c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:49.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.372+0000 7ff37e7fc640 1 -- 172.21.15.132:0/4294475401 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff36c003520 con 0x7ff36c004800 2024-04-16T15:52:49.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.372+0000 7ff37f7fe640 1 --2- 172.21.15.132:0/4294475401 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff36c0051c0 0x7ff36c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:52:49.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.372+0000 7ff37f7fe640 1 -- 172.21.15.132:0/4294475401 reap_dead start 2024-04-16T15:52:49.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.372+0000 7ff37e7fc640 1 --2- 172.21.15.132:0/4294475401 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff36c004800 0x7ff36c004c80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff368009ac0 tx=0x7ff36c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72c6f0c97aba74b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:49.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.372+0000 7ff37dffb640 1 -- 172.21.15.132:0/4294475401 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff368039070 con 0x7ff36c004800 2024-04-16T15:52:49.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.372+0000 7ff37dffb640 1 -- 172.21.15.132:0/4294475401 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff36802c6b0 con 0x7ff36c004800 2024-04-16T15:52:49.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.372+0000 7ff37dffb640 1 -- 172.21.15.132:0/4294475401 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff368009690 con 0x7ff36c004800 2024-04-16T15:52:49.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.373+0000 7ff38540d640 1 -- 172.21.15.132:0/4294475401 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff36c004800 msgr2=0x7ff36c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:49.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.373+0000 7ff38540d640 1 --2- 172.21.15.132:0/4294475401 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff36c004800 0x7ff36c004c80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff368009ac0 tx=0x7ff36c005830 comp rx=0 tx=0).stop 2024-04-16T15:52:49.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.373+0000 7ff38540d640 1 -- 172.21.15.132:0/4294475401 shutdown_connections 2024-04-16T15:52:49.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.373+0000 7ff38540d640 1 --2- 172.21.15.132:0/4294475401 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff36c004800 0x7ff36c004c80 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:49.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.373+0000 7ff38540d640 1 -- 172.21.15.132:0/4294475401 >> 172.21.15.132:0/4294475401 conn(0x7ff38006cea0 msgr2=0x7ff38006d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:49.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.373+0000 7ff38540d640 1 -- 172.21.15.132:0/4294475401 shutdown_connections 2024-04-16T15:52:49.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.373+0000 7ff38540d640 1 -- 172.21.15.132:0/4294475401 wait complete. 2024-04-16T15:52:49.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.374+0000 7ff38540d640 1 Processor -- start 2024-04-16T15:52:49.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.374+0000 7ff38540d640 1 -- start start 2024-04-16T15:52:49.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.375+0000 7ff38540d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff36c004800 0x7ff38015dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:49.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.375+0000 7ff38540d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff380153e30 0x7ff380159530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:49.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.375+0000 7ff38540d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff380159a70 0x7ff38015a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:49.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.375+0000 7ff38540d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff3800b7ab0 con 0x7ff380153e30 2024-04-16T15:52:49.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.375+0000 7ff38540d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff3801635e0 con 0x7ff36c004800 2024-04-16T15:52:49.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.375+0000 7ff38540d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff380162460 con 0x7ff380159a70 2024-04-16T15:52:49.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.375+0000 7ff37e7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff380153e30 0x7ff380159530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:49.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.375+0000 7ff37e7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff380153e30 0x7ff380159530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53674/0 (socket says 172.21.15.132:53674) 2024-04-16T15:52:49.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.375+0000 7ff37e7fc640 1 -- 172.21.15.132:0/4169477724 learned_addr learned my addr 172.21.15.132:0/4169477724 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:49.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.375+0000 7ff37f7fe640 1 --2- 172.21.15.132:0/4169477724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff380159a70 0x7ff38015a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:49.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.375+0000 7ff37effd640 1 --2- 172.21.15.132:0/4169477724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff36c004800 0x7ff38015dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:49.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.375+0000 7ff37e7fc640 1 -- 172.21.15.132:0/4169477724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff380159a70 msgr2=0x7ff38015a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:49.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.375+0000 7ff37e7fc640 1 --2- 172.21.15.132:0/4169477724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff380159a70 0x7ff38015a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:49.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.375+0000 7ff37e7fc640 1 -- 172.21.15.132:0/4169477724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff36c004800 msgr2=0x7ff38015dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:49.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.375+0000 7ff37e7fc640 1 --2- 172.21.15.132:0/4169477724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff36c004800 0x7ff38015dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:49.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.375+0000 7ff37e7fc640 1 -- 172.21.15.132:0/4169477724 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff38015cba0 con 0x7ff380153e30 2024-04-16T15:52:49.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.376+0000 7ff37e7fc640 1 --2- 172.21.15.132:0/4169477724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff380153e30 0x7ff380159530 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff368000c00 tx=0x7ff368004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:49.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.376+0000 7ff3777fe640 1 -- 172.21.15.132:0/4169477724 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff368042020 con 0x7ff380153e30 2024-04-16T15:52:49.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.376+0000 7ff3777fe640 1 -- 172.21.15.132:0/4169477724 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff36803a040 con 0x7ff380153e30 2024-04-16T15:52:49.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.376+0000 7ff3777fe640 1 -- 172.21.15.132:0/4169477724 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff368039070 con 0x7ff380153e30 2024-04-16T15:52:49.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.376+0000 7ff38540d640 1 -- 172.21.15.132:0/4169477724 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff38015ce40 con 0x7ff380153e30 2024-04-16T15:52:49.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.376+0000 7ff38540d640 1 -- 172.21.15.132:0/4169477724 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff38015d400 con 0x7ff380153e30 2024-04-16T15:52:49.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.377+0000 7ff38540d640 1 -- 172.21.15.132:0/4169477724 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff380075510 con 0x7ff380153e30 2024-04-16T15:52:49.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.377+0000 7ff3777fe640 1 -- 172.21.15.132:0/4169477724 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff368045020 con 0x7ff380153e30 2024-04-16T15:52:49.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.378+0000 7ff3777fe640 1 --2- 172.21.15.132:0/4169477724 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7ff36006c8f0 0x7ff36006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:49.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.378+0000 7ff3777fe640 1 -- 172.21.15.132:0/4169477724 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff3680ad000 con 0x7ff380153e30 2024-04-16T15:52:49.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.378+0000 7ff37effd640 1 --2- 172.21.15.132:0/4169477724 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7ff36006c8f0 0x7ff36006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:49.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.378+0000 7ff37effd640 1 --2- 172.21.15.132:0/4169477724 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7ff36006c8f0 0x7ff36006edb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff378000c00 tx=0x7ff378009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:49.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.382+0000 7ff3777fe640 1 -- 172.21.15.132:0/4169477724 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff36804c070 con 0x7ff380153e30 2024-04-16T15:52:49.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.567+0000 7ff38540d640 1 -- 172.21.15.132:0/4169477724 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff3800d25b0 con 0x7ff380153e30 2024-04-16T15:52:49.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.567+0000 7ff3777fe640 1 -- 172.21.15.132:0/4169477724 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7ff36807b430 con 0x7ff380153e30 2024-04-16T15:52:49.566 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2024-04-16T15:52:49.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.569+0000 7ff38540d640 1 -- 172.21.15.132:0/4169477724 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7ff36006c8f0 msgr2=0x7ff36006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:49.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.569+0000 7ff38540d640 1 --2- 172.21.15.132:0/4169477724 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7ff36006c8f0 0x7ff36006edb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff378000c00 tx=0x7ff378009040 comp rx=0 tx=0).stop 2024-04-16T15:52:49.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.569+0000 7ff38540d640 1 -- 172.21.15.132:0/4169477724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff380153e30 msgr2=0x7ff380159530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:49.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.569+0000 7ff38540d640 1 --2- 172.21.15.132:0/4169477724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff380153e30 0x7ff380159530 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff368000c00 tx=0x7ff368004730 comp rx=0 tx=0).stop 2024-04-16T15:52:49.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.569+0000 7ff38540d640 1 -- 172.21.15.132:0/4169477724 shutdown_connections 2024-04-16T15:52:49.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.569+0000 7ff38540d640 1 --2- 172.21.15.132:0/4169477724 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7ff36006c8f0 0x7ff36006edb0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:49.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.569+0000 7ff38540d640 1 --2- 172.21.15.132:0/4169477724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff380159a70 0x7ff38015a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:49.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.569+0000 7ff38540d640 1 --2- 172.21.15.132:0/4169477724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff380153e30 0x7ff380159530 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:49.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.569+0000 7ff38540d640 1 --2- 172.21.15.132:0/4169477724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff36c004800 0x7ff38015dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:49.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.569+0000 7ff38540d640 1 -- 172.21.15.132:0/4169477724 >> 172.21.15.132:0/4169477724 conn(0x7ff38006cea0 msgr2=0x7ff3801583e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:49.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.569+0000 7ff38540d640 1 -- 172.21.15.132:0/4169477724 shutdown_connections 2024-04-16T15:52:49.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.570+0000 7ff38540d640 1 -- 172.21.15.132:0/4169477724 wait complete. 2024-04-16T15:52:49.580 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-16T15:52:49.580 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T15:52:49.600 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:52:49.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.704+0000 7f0acee1b640 1 Processor -- start 2024-04-16T15:52:49.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.704+0000 7f0acee1b640 1 -- start start 2024-04-16T15:52:49.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.705+0000 7f0acee1b640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0ac80cdd10 0x7f0ac809aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:49.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.705+0000 7f0acee1b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ac809af70 0x7f0ac80c6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:49.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.705+0000 7f0acee1b640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ac80ce1f0 con 0x7f0ac815ca70 2024-04-16T15:52:49.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.705+0000 7f0acee1b640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f0ac80ce4d0 con 0x7f0ac80cdd10 2024-04-16T15:52:49.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.705+0000 7f0acee1b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f0ac80c63e0 con 0x7f0ac809af70 2024-04-16T15:52:49.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.705+0000 7f0accbb7640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f0ac815ca70 0x7f0ac809b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:35392/0 (socket says 172.21.15.132:35392) 2024-04-16T15:52:49.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.705+0000 7f0accbb7640 1 -- 172.21.15.132:0/2771489659 learned_addr learned my addr 172.21.15.132:0/2771489659 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:49.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.705+0000 7f0acd3b8640 1 --2- 172.21.15.132:0/2771489659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ac809af70 0x7f0ac80c6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:49.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.705+0000 7f0abffff640 1 --2- 172.21.15.132:0/2771489659 >> v2:172.21.15.179:3300/0 conn(0x7f0ac80cdd10 0x7f0ac809aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:49.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.705+0000 7f0abf7fe640 1 -- 172.21.15.132:0/2771489659 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3926000347 0 0) 0x7f0ac80ce1f0 con 0x7f0ac815ca70 2024-04-16T15:52:49.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.705+0000 7f0abf7fe640 1 -- 172.21.15.132:0/2771489659 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ab0003520 con 0x7f0ac815ca70 2024-04-16T15:52:49.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.705+0000 7f0abffff640 1 -- 172.21.15.132:0/2771489659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ac809af70 msgr2=0x7f0ac80c6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:49.706 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.705+0000 7f0abf7fe640 1 -- 172.21.15.132:0/2771489659 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3848808053 0 0) 0x7f0ab0003520 con 0x7f0ac815ca70 2024-04-16T15:52:49.706 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.705+0000 7f0abffff640 1 --2- 172.21.15.132:0/2771489659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ac809af70 0x7f0ac80c6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:49.706 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.705+0000 7f0abffff640 1 -- 172.21.15.132:0/2771489659 >> v1:172.21.15.132:6789/0 conn(0x7f0ac815ca70 legacy=0x7f0ac809b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:49.706 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.705+0000 7f0abffff640 1 -- 172.21.15.132:0/2771489659 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ac80c66c0 con 0x7f0ac80cdd10 2024-04-16T15:52:49.706 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.705+0000 7f0acd3b8640 1 --2- 172.21.15.132:0/2771489659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ac809af70 0x7f0ac80c6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:52:49.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.706+0000 7f0abffff640 1 --2- 172.21.15.132:0/2771489659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ac80cdd10 0x7f0ac809aa30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0ab80097a0 tx=0x7f0ab802b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ff10a8ad414ff5 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:49.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.707+0000 7f0abf7fe640 1 -- 172.21.15.132:0/2771489659 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab8037070 con 0x7f0ac80cdd10 2024-04-16T15:52:49.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.707+0000 7f0abf7fe640 1 -- 172.21.15.132:0/2771489659 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ab8030510 con 0x7f0ac80cdd10 2024-04-16T15:52:49.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.707+0000 7f0abf7fe640 1 -- 172.21.15.132:0/2771489659 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ac4001670 con 0x7f0ac80cdd10 2024-04-16T15:52:49.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.707+0000 7f0acee1b640 1 -- 172.21.15.132:0/2771489659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ac80cdd10 msgr2=0x7f0ac809aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:49.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.707+0000 7f0acee1b640 1 --2- 172.21.15.132:0/2771489659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ac80cdd10 0x7f0ac809aa30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0ab80097a0 tx=0x7f0ab802b790 comp rx=0 tx=0).stop 2024-04-16T15:52:49.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.707+0000 7f0acee1b640 1 -- 172.21.15.132:0/2771489659 shutdown_connections 2024-04-16T15:52:49.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.707+0000 7f0acee1b640 1 --2- 172.21.15.132:0/2771489659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ac809af70 0x7f0ac80c6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:49.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.707+0000 7f0acee1b640 1 --2- 172.21.15.132:0/2771489659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ac80cdd10 0x7f0ac809aa30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:49.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.707+0000 7f0acee1b640 1 -- 172.21.15.132:0/2771489659 >> 172.21.15.132:0/2771489659 conn(0x7f0ac80b41e0 msgr2=0x7f0ac80b45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:49.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.707+0000 7f0acee1b640 1 -- 172.21.15.132:0/2771489659 shutdown_connections 2024-04-16T15:52:49.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.707+0000 7f0acee1b640 1 -- 172.21.15.132:0/2771489659 wait complete. 2024-04-16T15:52:49.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.708+0000 7f0acee1b640 1 Processor -- start 2024-04-16T15:52:49.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.708+0000 7f0acee1b640 1 -- start start 2024-04-16T15:52:49.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.709+0000 7f0acee1b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ac809af70 0x7f0ac80b6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:49.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.709+0000 7f0acee1b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ac80cdd10 0x7f0ac80cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:49.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.709+0000 7f0acee1b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ac815ca70 0x7f0ac80ca1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:49.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.709+0000 7f0acee1b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f0ac80c72a0 con 0x7f0ac80cdd10 2024-04-16T15:52:49.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.709+0000 7f0acee1b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0ac80c7120 con 0x7f0ac815ca70 2024-04-16T15:52:49.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.709+0000 7f0acee1b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f0ac80c7420 con 0x7f0ac809af70 2024-04-16T15:52:49.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.709+0000 7f0abffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ac80cdd10 0x7f0ac80cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:49.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.709+0000 7f0abffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ac80cdd10 0x7f0ac80cbfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53678/0 (socket says 172.21.15.132:53678) 2024-04-16T15:52:49.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.709+0000 7f0abffff640 1 -- 172.21.15.132:0/1748379279 learned_addr learned my addr 172.21.15.132:0/1748379279 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:49.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.710+0000 7f0accbb7640 1 --2- 172.21.15.132:0/1748379279 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ac809af70 0x7f0ac80b6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:49.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.710+0000 7f0acd3b8640 1 --2- 172.21.15.132:0/1748379279 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ac815ca70 0x7f0ac80ca1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:49.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.710+0000 7f0abffff640 1 -- 172.21.15.132:0/1748379279 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ac809af70 msgr2=0x7f0ac80b6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:49.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.710+0000 7f0abffff640 1 --2- 172.21.15.132:0/1748379279 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ac809af70 0x7f0ac80b6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:49.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.710+0000 7f0abffff640 1 -- 172.21.15.132:0/1748379279 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ac815ca70 msgr2=0x7f0ac80ca1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:49.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.710+0000 7f0abffff640 1 --2- 172.21.15.132:0/1748379279 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ac815ca70 0x7f0ac80ca1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:49.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.710+0000 7f0abffff640 1 -- 172.21.15.132:0/1748379279 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ac80b6d10 con 0x7f0ac80cdd10 2024-04-16T15:52:49.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.710+0000 7f0abffff640 1 --2- 172.21.15.132:0/1748379279 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ac80cdd10 0x7f0ac80cbfb0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0ab802b7d0 tx=0x7f0ab80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:49.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.710+0000 7f0abd7fa640 1 -- 172.21.15.132:0/1748379279 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab8040020 con 0x7f0ac80cdd10 2024-04-16T15:52:49.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.710+0000 7f0abd7fa640 1 -- 172.21.15.132:0/1748379279 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ab8038040 con 0x7f0ac80cdd10 2024-04-16T15:52:49.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.710+0000 7f0acee1b640 1 -- 172.21.15.132:0/1748379279 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ac80b6ff0 con 0x7f0ac80cdd10 2024-04-16T15:52:49.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.710+0000 7f0abd7fa640 1 -- 172.21.15.132:0/1748379279 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab8037070 con 0x7f0ac80cdd10 2024-04-16T15:52:49.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.710+0000 7f0acee1b640 1 -- 172.21.15.132:0/1748379279 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ac80b7890 con 0x7f0ac80cdd10 2024-04-16T15:52:49.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.711+0000 7f0acee1b640 1 -- 172.21.15.132:0/1748379279 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ac80b73e0 con 0x7f0ac80cdd10 2024-04-16T15:52:49.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.711+0000 7f0abd7fa640 1 -- 172.21.15.132:0/1748379279 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0ab8043020 con 0x7f0ac80cdd10 2024-04-16T15:52:49.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.712+0000 7f0abd7fa640 1 --2- 172.21.15.132:0/1748379279 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f0ab406c8f0 0x7f0ab406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:49.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.712+0000 7f0abd7fa640 1 -- 172.21.15.132:0/1748379279 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0ab80ad0a0 con 0x7f0ac80cdd10 2024-04-16T15:52:49.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.712+0000 7f0accbb7640 1 --2- 172.21.15.132:0/1748379279 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f0ab406c8f0 0x7f0ab406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:49.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.712+0000 7f0accbb7640 1 --2- 172.21.15.132:0/1748379279 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f0ab406c8f0 0x7f0ab406edb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0ac4007940 tx=0x7f0ac4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:49.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.716+0000 7f0abd7fa640 1 -- 172.21.15.132:0/1748379279 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0ab804a030 con 0x7f0ac80cdd10 2024-04-16T15:52:49.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.892+0000 7f0acee1b640 1 -- 172.21.15.132:0/1748379279 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0ac8075510 con 0x7f0ac80cdd10 2024-04-16T15:52:49.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.893+0000 7f0abd7fa640 1 -- 172.21.15.132:0/1748379279 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7f0ab807b440 con 0x7f0ac80cdd10 2024-04-16T15:52:49.892 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:52:49.892 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"6bdec5d9-f406-43ad-8584-0503b32f6f0d","created":"2024-04-16T15:51:51.073040+0000","modified":"2024-04-16T15:52:16.950186+0000","last_up_change":"2024-04-16T15:52:02.280496+0000","last_in_change":"2024-04-16T15:51:53.376468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:52:03.284927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:52:13.363758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T15:52:14.246647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d45908b-6e22-4619-b190-897af594b712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6801","nonce":1170594668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6803","nonce":1170594668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6807","nonce":1170594668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6805","nonce":1170594668}]},"public_addr":"172.21.15.132:6801/1170594668","cluster_addr":"172.21.15.132:6803/1170594668","heartbeat_back_addr":"172.21.15.132:6807/1170594668","heartbeat_front_addr":"172.21.15.132:6805/1170594668","state":["exists","up"]},{"osd":1,"uuid":"c88bf082-e51f-4ee6-815a-025f6ce0d67b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6809","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6811","nonce":2494780358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6815","nonce":2494780358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6823","nonce":2494780358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6819","nonce":2494780358}]},"public_addr":"172.21.15.132:6811/2494780358","cluster_addr":"172.21.15.132:6815/2494780358","heartbeat_back_addr":"172.21.15.132:6823/2494780358","heartbeat_front_addr":"172.21.15.132:6819/2494780358","state":["exists","up"]},{"osd":2,"uuid":"e5dbd6b4-4e7b-47e4-ad4e-35b4b81696c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6825","nonce":27655483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6827","nonce":27655483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6831","nonce":27655483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6829","nonce":27655483}]},"public_addr":"172.21.15.132:6825/27655483","cluster_addr":"172.21.15.132:6827/27655483","heartbeat_back_addr":"172.21.15.132:6831/27655483","heartbeat_front_addr":"172.21.15.132:6829/27655483","state":["exists","up"]},{"osd":3,"uuid":"9d75cd67-3b8a-4424-8884-5f3660e1f5f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6810","nonce":3100919191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6814","nonce":3100919191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6821","nonce":3100919191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6818","nonce":3100919191}]},"public_addr":"172.21.15.132:6810/3100919191","cluster_addr":"172.21.15.132:6814/3100919191","heartbeat_back_addr":"172.21.15.132:6821/3100919191","heartbeat_front_addr":"172.21.15.132:6818/3100919191","state":["exists","up"]},{"osd":4,"uuid":"83aea46a-8642-4777-912b-c130e5890da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6825","nonce":123637799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6827","nonce":123637799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6831","nonce":123637799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6829","nonce":123637799}]},"public_addr":"172.21.15.179:6825/123637799","cluster_addr":"172.21.15.179:6827/123637799","heartbeat_back_addr":"172.21.15.179:6831/123637799","heartbeat_front_addr":"172.21.15.179:6829/123637799","state":["exists","up"]},{"osd":5,"uuid":"534117c8-3317-48d6-b436-afd5709f71e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6801","nonce":2224750370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6803","nonce":2224750370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6807","nonce":2224750370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6805","nonce":2224750370}]},"public_addr":"172.21.15.179:6801/2224750370","cluster_addr":"172.21.15.179:6803/2224750370","heartbeat_back_addr":"172.21.15.179:6807/2224750370","heartbeat_front_addr":"172.21.15.179:6805/2224750370","state":["exists","up"]},{"osd":6,"uuid":"0ba363e7-fa9d-42b1-ae09-a6a0f57d41f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6809","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6811","nonce":101498164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6813","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6815","nonce":101498164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6823","nonce":101498164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6819","nonce":101498164}]},"public_addr":"172.21.15.179:6811/101498164","cluster_addr":"172.21.15.179:6815/101498164","heartbeat_back_addr":"172.21.15.179:6823/101498164","heartbeat_front_addr":"172.21.15.179:6819/101498164","state":["exists","up"]},{"osd":7,"uuid":"e6830c77-2f2d-4067-9866-ee7625afc1a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6810","nonce":872148365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6814","nonce":872148365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6822","nonce":872148365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6818","nonce":872148365}]},"public_addr":"172.21.15.179:6810/872148365","cluster_addr":"172.21.15.179:6814/872148365","heartbeat_back_addr":"172.21.15.179:6822/872148365","heartbeat_front_addr":"172.21.15.179:6818/872148365","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.535221+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.563769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.520765+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.526264+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.517058+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.500842+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.534332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.512486+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:52:49.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.895+0000 7f0acee1b640 1 -- 172.21.15.132:0/1748379279 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f0ab406c8f0 msgr2=0x7f0ab406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:49.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.895+0000 7f0acee1b640 1 --2- 172.21.15.132:0/1748379279 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f0ab406c8f0 0x7f0ab406edb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0ac4007940 tx=0x7f0ac4009040 comp rx=0 tx=0).stop 2024-04-16T15:52:49.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.895+0000 7f0acee1b640 1 -- 172.21.15.132:0/1748379279 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ac80cdd10 msgr2=0x7f0ac80cbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:49.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.895+0000 7f0acee1b640 1 --2- 172.21.15.132:0/1748379279 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ac80cdd10 0x7f0ac80cbfb0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0ab802b7d0 tx=0x7f0ab80046c0 comp rx=0 tx=0).stop 2024-04-16T15:52:49.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.895+0000 7f0acee1b640 1 -- 172.21.15.132:0/1748379279 shutdown_connections 2024-04-16T15:52:49.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.895+0000 7f0acee1b640 1 --2- 172.21.15.132:0/1748379279 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f0ab406c8f0 0x7f0ab406edb0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:49.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.895+0000 7f0acee1b640 1 --2- 172.21.15.132:0/1748379279 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ac815ca70 0x7f0ac80ca1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:49.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.895+0000 7f0acee1b640 1 --2- 172.21.15.132:0/1748379279 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ac80cdd10 0x7f0ac80cbfb0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:49.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.895+0000 7f0acee1b640 1 --2- 172.21.15.132:0/1748379279 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ac809af70 0x7f0ac80b6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:49.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.895+0000 7f0acee1b640 1 -- 172.21.15.132:0/1748379279 >> 172.21.15.132:0/1748379279 conn(0x7f0ac80b41e0 msgr2=0x7f0ac809b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:49.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.895+0000 7f0acee1b640 1 -- 172.21.15.132:0/1748379279 shutdown_connections 2024-04-16T15:52:49.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:49.895+0000 7f0acee1b640 1 -- 172.21.15.132:0/1748379279 wait complete. 2024-04-16T15:52:49.905 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T15:52:03.284927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T15:52:13.363758+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T15:52:14.246647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T15:52:49.906 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T15:52:50.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.012+0000 7f5a76dcd640 1 Processor -- start 2024-04-16T15:52:50.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.012+0000 7f5a76dcd640 1 -- start start 2024-04-16T15:52:50.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.012+0000 7f5a76dcd640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5a7009aa30 0x7f5a7009ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:50.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.012+0000 7f5a76dcd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a7009b680 0x7f5a7015eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:50.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.012+0000 7f5a76dcd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5a70162710 0x7f5a70162b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:50.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.012+0000 7f5a76dcd640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f5a7009b350 con 0x7f5a70162710 2024-04-16T15:52:50.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.012+0000 7f5a76dcd640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f5a7006cf10 con 0x7f5a7009aa30 2024-04-16T15:52:50.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.012+0000 7f5a76dcd640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f5a7006d1f0 con 0x7f5a7009b680 2024-04-16T15:52:50.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.013+0000 7f5a7536a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5a70162710 0x7f5a70162b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:50.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.013+0000 7f5a7536a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5a70162710 0x7f5a70162b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53688/0 (socket says 172.21.15.132:53688) 2024-04-16T15:52:50.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.013+0000 7f5a7536a640 1 -- 172.21.15.132:0/464863051 learned_addr learned my addr 172.21.15.132:0/464863051 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:50.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.013+0000 7f5a6ffff640 1 --2- 172.21.15.132:0/464863051 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a7009b680 0x7f5a7015eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:50.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.013+0000 7f5a74b69640 1 --2- 172.21.15.132:0/464863051 >> v2:172.21.15.179:3300/0 conn(0x7f5a7009aa30 0x7f5a7009ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:50.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.013+0000 7f5a7536a640 1 -- 172.21.15.132:0/464863051 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a7009b680 msgr2=0x7f5a7015eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:50.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.013+0000 7f5a7536a640 1 --2- 172.21.15.132:0/464863051 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a7009b680 0x7f5a7015eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:50.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.013+0000 7f5a7536a640 1 -- 172.21.15.132:0/464863051 >> v2:172.21.15.179:3300/0 conn(0x7f5a7009aa30 msgr2=0x7f5a7009ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:50.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.013+0000 7f5a7536a640 1 --2- 172.21.15.132:0/464863051 >> v2:172.21.15.179:3300/0 conn(0x7f5a7009aa30 0x7f5a7009ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:50.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.013+0000 7f5a7536a640 1 -- 172.21.15.132:0/464863051 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a7006d4d0 con 0x7f5a70162710 2024-04-16T15:52:50.014 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.014+0000 7f5a7536a640 1 --2- 172.21.15.132:0/464863051 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a70162710 0x7f5a70162b80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5a70073200 tx=0x7f5a6802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4a4675338680d10 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:50.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.014+0000 7f5a6f7fe640 1 -- 172.21.15.132:0/464863051 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6802e070 con 0x7f5a70162710 2024-04-16T15:52:50.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.014+0000 7f5a6f7fe640 1 -- 172.21.15.132:0/464863051 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a68037070 con 0x7f5a70162710 2024-04-16T15:52:50.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.014+0000 7f5a6f7fe640 1 -- 172.21.15.132:0/464863051 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a68031a00 con 0x7f5a70162710 2024-04-16T15:52:50.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.014+0000 7f5a76dcd640 1 -- 172.21.15.132:0/464863051 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a70162710 msgr2=0x7f5a70162b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:50.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.014+0000 7f5a76dcd640 1 --2- 172.21.15.132:0/464863051 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a70162710 0x7f5a70162b80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5a70073200 tx=0x7f5a6802b880 comp rx=0 tx=0).stop 2024-04-16T15:52:50.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.014+0000 7f5a76dcd640 1 -- 172.21.15.132:0/464863051 shutdown_connections 2024-04-16T15:52:50.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.014+0000 7f5a76dcd640 1 --2- 172.21.15.132:0/464863051 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a70162710 0x7f5a70162b80 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:50.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.014+0000 7f5a76dcd640 1 --2- 172.21.15.132:0/464863051 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a7009b680 0x7f5a7015eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:50.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.014+0000 7f5a76dcd640 1 --2- 172.21.15.132:0/464863051 >> v2:172.21.15.179:3300/0 conn(0x7f5a7009aa30 0x7f5a7009ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:50.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.014+0000 7f5a76dcd640 1 -- 172.21.15.132:0/464863051 >> 172.21.15.132:0/464863051 conn(0x7f5a700b41b0 msgr2=0x7f5a700b45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:50.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.014+0000 7f5a76dcd640 1 -- 172.21.15.132:0/464863051 shutdown_connections 2024-04-16T15:52:50.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.014+0000 7f5a76dcd640 1 -- 172.21.15.132:0/464863051 wait complete. 2024-04-16T15:52:50.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.016+0000 7f5a76dcd640 1 Processor -- start 2024-04-16T15:52:50.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.016+0000 7f5a76dcd640 1 -- start start 2024-04-16T15:52:50.018 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.016+0000 7f5a76dcd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a7009aa30 0x7f5a700c7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:50.018 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.016+0000 7f5a76dcd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a7009b680 0x7f5a700af470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:50.018 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.016+0000 7f5a76dcd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a70162710 0x7f5a700b7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:50.018 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.016+0000 7f5a76dcd640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7015f410 con 0x7f5a7009b680 2024-04-16T15:52:50.018 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.016+0000 7f5a76dcd640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7006da90 con 0x7f5a70162710 2024-04-16T15:52:50.018 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.016+0000 7f5a76dcd640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f5a7006cb30 con 0x7f5a7009aa30 2024-04-16T15:52:50.018 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.017+0000 7f5a6ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a7009b680 0x7f5a700af470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:50.018 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.017+0000 7f5a6ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a7009b680 0x7f5a700af470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53692/0 (socket says 172.21.15.132:53692) 2024-04-16T15:52:50.018 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.017+0000 7f5a6ffff640 1 -- 172.21.15.132:0/1919397758 learned_addr learned my addr 172.21.15.132:0/1919397758 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:50.018 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.017+0000 7f5a74b69640 1 --2- 172.21.15.132:0/1919397758 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a7009aa30 0x7f5a700c7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:50.018 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.017+0000 7f5a7536a640 1 --2- 172.21.15.132:0/1919397758 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a70162710 0x7f5a700b7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:50.018 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.017+0000 7f5a6ffff640 1 -- 172.21.15.132:0/1919397758 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a7009aa30 msgr2=0x7f5a700c7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:50.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.017+0000 7f5a6ffff640 1 --2- 172.21.15.132:0/1919397758 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a7009aa30 0x7f5a700c7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:50.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.017+0000 7f5a6ffff640 1 -- 172.21.15.132:0/1919397758 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a70162710 msgr2=0x7f5a700b7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:50.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.017+0000 7f5a6ffff640 1 --2- 172.21.15.132:0/1919397758 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a70162710 0x7f5a700b7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:50.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.017+0000 7f5a6ffff640 1 -- 172.21.15.132:0/1919397758 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a700c89d0 con 0x7f5a7009b680 2024-04-16T15:52:50.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.017+0000 7f5a74b69640 1 --2- 172.21.15.132:0/1919397758 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a7009aa30 0x7f5a700c7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:50.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.017+0000 7f5a7536a640 1 --2- 172.21.15.132:0/1919397758 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a70162710 0x7f5a700b7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:50.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.017+0000 7f5a6ffff640 1 --2- 172.21.15.132:0/1919397758 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a7009b680 0x7f5a700af470 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f5a5800d7d0 tx=0x7f5a5800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:50.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.017+0000 7f5a6d7fa640 1 -- 172.21.15.132:0/1919397758 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a5800b6c0 con 0x7f5a7009b680 2024-04-16T15:52:50.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.017+0000 7f5a6d7fa640 1 -- 172.21.15.132:0/1919397758 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a58019070 con 0x7f5a7009b680 2024-04-16T15:52:50.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.017+0000 7f5a76dcd640 1 -- 172.21.15.132:0/1919397758 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a700c8cb0 con 0x7f5a7009b680 2024-04-16T15:52:50.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.017+0000 7f5a6d7fa640 1 -- 172.21.15.132:0/1919397758 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a5800ba80 con 0x7f5a7009b680 2024-04-16T15:52:50.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.017+0000 7f5a76dcd640 1 -- 172.21.15.132:0/1919397758 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a700b6d50 con 0x7f5a7009b680 2024-04-16T15:52:50.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.018+0000 7f5a76dcd640 1 -- 172.21.15.132:0/1919397758 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a70075510 con 0x7f5a7009b680 2024-04-16T15:52:50.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.019+0000 7f5a6d7fa640 1 -- 172.21.15.132:0/1919397758 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5a5800bc20 con 0x7f5a7009b680 2024-04-16T15:52:50.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.019+0000 7f5a6d7fa640 1 --2- 172.21.15.132:0/1919397758 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f5a5006c8f0 0x7f5a5006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:50.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.019+0000 7f5a6d7fa640 1 -- 172.21.15.132:0/1919397758 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5a5808bf10 con 0x7f5a7009b680 2024-04-16T15:52:50.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.019+0000 7f5a74b69640 1 --2- 172.21.15.132:0/1919397758 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f5a5006c8f0 0x7f5a5006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:50.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.020+0000 7f5a74b69640 1 --2- 172.21.15.132:0/1919397758 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f5a5006c8f0 0x7f5a5006edb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5a60009b20 tx=0x7f5a600039d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:50.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.023+0000 7f5a6d7fa640 1 -- 172.21.15.132:0/1919397758 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5a5805a340 con 0x7f5a7009b680 2024-04-16T15:52:50.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.199+0000 7f5a76dcd640 1 -- 172.21.15.132:0/1919397758 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5a700c6a10 con 0x7f5a7009b680 2024-04-16T15:52:50.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.199+0000 7f5a6d7fa640 1 -- 172.21.15.132:0/1919397758 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f5a58059c40 con 0x7f5a7009b680 2024-04-16T15:52:50.198 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2024-04-16T15:52:50.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.201+0000 7f5a76dcd640 1 -- 172.21.15.132:0/1919397758 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f5a5006c8f0 msgr2=0x7f5a5006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:50.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.201+0000 7f5a76dcd640 1 --2- 172.21.15.132:0/1919397758 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f5a5006c8f0 0x7f5a5006edb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5a60009b20 tx=0x7f5a600039d0 comp rx=0 tx=0).stop 2024-04-16T15:52:50.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.201+0000 7f5a76dcd640 1 -- 172.21.15.132:0/1919397758 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a7009b680 msgr2=0x7f5a700af470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:50.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.201+0000 7f5a76dcd640 1 --2- 172.21.15.132:0/1919397758 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a7009b680 0x7f5a700af470 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f5a5800d7d0 tx=0x7f5a5800dc90 comp rx=0 tx=0).stop 2024-04-16T15:52:50.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.201+0000 7f5a76dcd640 1 -- 172.21.15.132:0/1919397758 shutdown_connections 2024-04-16T15:52:50.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.201+0000 7f5a76dcd640 1 --2- 172.21.15.132:0/1919397758 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f5a5006c8f0 0x7f5a5006edb0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:50.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.201+0000 7f5a76dcd640 1 --2- 172.21.15.132:0/1919397758 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a70162710 0x7f5a700b7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:50.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.201+0000 7f5a76dcd640 1 --2- 172.21.15.132:0/1919397758 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a7009b680 0x7f5a700af470 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:50.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.201+0000 7f5a76dcd640 1 --2- 172.21.15.132:0/1919397758 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a7009aa30 0x7f5a700c7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:50.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.201+0000 7f5a76dcd640 1 -- 172.21.15.132:0/1919397758 >> 172.21.15.132:0/1919397758 conn(0x7f5a700b41b0 msgr2=0x7f5a70162b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:50.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.201+0000 7f5a76dcd640 1 -- 172.21.15.132:0/1919397758 shutdown_connections 2024-04-16T15:52:50.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.201+0000 7f5a76dcd640 1 -- 172.21.15.132:0/1919397758 wait complete. 2024-04-16T15:52:50.211 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T15:52:50.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.319+0000 7fa2924c5640 1 Processor -- start 2024-04-16T15:52:50.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.319+0000 7fa2924c5640 1 -- start start 2024-04-16T15:52:50.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.320+0000 7fa2924c5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa28c15ea80 0x7fa28c0b3540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:50.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.320+0000 7fa2924c5640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa28c0727e0 0x7fa28c072c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:50.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.320+0000 7fa2924c5640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa28c0b3e40 con 0x7fa28c15ad10 2024-04-16T15:52:50.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.320+0000 7fa2924c5640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fa28c0b4120 con 0x7fa28c0727e0 2024-04-16T15:52:50.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.320+0000 7fa2924c5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fa28c0b4400 con 0x7fa28c15ea80 2024-04-16T15:52:50.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.320+0000 7fa28b7fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa28c15ea80 0x7fa28c0b3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:50.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.320+0000 7fa290a62640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa28c0727e0 0x7fa28c072c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:50.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.320+0000 7fa28b7fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa28c15ea80 0x7fa28c0b3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.132:59560/0 (socket says 172.21.15.132:59560) 2024-04-16T15:52:50.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.320+0000 7fa28b7fe640 1 -- 172.21.15.132:0/987570059 learned_addr learned my addr 172.21.15.132:0/987570059 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:50.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.321+0000 7fa28b7fe640 1 -- 172.21.15.132:0/987570059 >> v2:172.21.15.179:3300/0 conn(0x7fa28c0727e0 msgr2=0x7fa28c072c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:50.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.321+0000 7fa28b7fe640 1 --2- 172.21.15.132:0/987570059 >> v2:172.21.15.179:3300/0 conn(0x7fa28c0727e0 0x7fa28c072c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:50.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.321+0000 7fa28b7fe640 1 -- 172.21.15.132:0/987570059 >> v1:172.21.15.179:6789/0 conn(0x7fa28c15ad10 legacy=0x7fa28c0b4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:50.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.321+0000 7fa28b7fe640 1 -- 172.21.15.132:0/987570059 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa28c0b46e0 con 0x7fa28c15ea80 2024-04-16T15:52:50.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.321+0000 7fa290a62640 1 --2- 172.21.15.132:0/987570059 >> v2:172.21.15.179:3300/0 conn(0x7fa28c0727e0 0x7fa28c072c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:52:50.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.321+0000 7fa28b7fe640 1 --2- 172.21.15.132:0/987570059 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa28c15ea80 0x7fa28c0b3540 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa280009870 tx=0x7fa28002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4261f5475110816 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:50.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.322+0000 7fa28affd640 1 -- 172.21.15.132:0/987570059 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa280034070 con 0x7fa28c15ea80 2024-04-16T15:52:50.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.322+0000 7fa28affd640 1 -- 172.21.15.132:0/987570059 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa280030840 con 0x7fa28c15ea80 2024-04-16T15:52:50.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.322+0000 7fa28affd640 1 -- 172.21.15.132:0/987570059 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa280030c10 con 0x7fa28c15ea80 2024-04-16T15:52:50.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.322+0000 7fa2924c5640 1 -- 172.21.15.132:0/987570059 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa28c15ea80 msgr2=0x7fa28c0b3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:50.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.322+0000 7fa2924c5640 1 --2- 172.21.15.132:0/987570059 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa28c15ea80 0x7fa28c0b3540 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa280009870 tx=0x7fa28002b980 comp rx=0 tx=0).stop 2024-04-16T15:52:50.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.322+0000 7fa2924c5640 1 -- 172.21.15.132:0/987570059 shutdown_connections 2024-04-16T15:52:50.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.322+0000 7fa2924c5640 1 --2- 172.21.15.132:0/987570059 >> v2:172.21.15.179:3300/0 conn(0x7fa28c0727e0 0x7fa28c072c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:50.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.322+0000 7fa2924c5640 1 --2- 172.21.15.132:0/987570059 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa28c15ea80 0x7fa28c0b3540 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:50.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.322+0000 7fa2924c5640 1 -- 172.21.15.132:0/987570059 >> 172.21.15.132:0/987570059 conn(0x7fa28c0d0490 msgr2=0x7fa28c0d08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:50.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.322+0000 7fa2924c5640 1 -- 172.21.15.132:0/987570059 shutdown_connections 2024-04-16T15:52:50.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.322+0000 7fa2924c5640 1 -- 172.21.15.132:0/987570059 wait complete. 2024-04-16T15:52:50.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.323+0000 7fa2924c5640 1 Processor -- start 2024-04-16T15:52:50.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.324+0000 7fa2924c5640 1 -- start start 2024-04-16T15:52:50.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.324+0000 7fa2924c5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa28c0727e0 0x7fa28c0abc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:50.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.324+0000 7fa2924c5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa28c15ad10 0x7fa28c0ca030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:50.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.324+0000 7fa2924c5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa28c15ea80 0x7fa28c1f2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:50.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.324+0000 7fa2924c5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fa28c0b3c00 con 0x7fa28c0727e0 2024-04-16T15:52:50.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.324+0000 7fa2924c5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa28c0b3a80 con 0x7fa28c15ea80 2024-04-16T15:52:50.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.324+0000 7fa2924c5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fa28c15b0f0 con 0x7fa28c15ad10 2024-04-16T15:52:50.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.324+0000 7fa28bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa28c0727e0 0x7fa28c0abc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:50.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.324+0000 7fa28bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa28c0727e0 0x7fa28c0abc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53702/0 (socket says 172.21.15.132:53702) 2024-04-16T15:52:50.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.324+0000 7fa28bfff640 1 -- 172.21.15.132:0/2382960233 learned_addr learned my addr 172.21.15.132:0/2382960233 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:50.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.325+0000 7fa28b7fe640 1 --2- 172.21.15.132:0/2382960233 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa28c15ad10 0x7fa28c0ca030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:50.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.325+0000 7fa290a62640 1 --2- 172.21.15.132:0/2382960233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa28c15ea80 0x7fa28c1f2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:50.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.325+0000 7fa28bfff640 1 -- 172.21.15.132:0/2382960233 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa28c15ad10 msgr2=0x7fa28c0ca030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:50.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.325+0000 7fa28bfff640 1 --2- 172.21.15.132:0/2382960233 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa28c15ad10 0x7fa28c0ca030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:50.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.325+0000 7fa28bfff640 1 -- 172.21.15.132:0/2382960233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa28c15ea80 msgr2=0x7fa28c1f2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:50.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.325+0000 7fa28bfff640 1 --2- 172.21.15.132:0/2382960233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa28c15ea80 0x7fa28c1f2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:50.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.325+0000 7fa28bfff640 1 -- 172.21.15.132:0/2382960233 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa28c1f3080 con 0x7fa28c0727e0 2024-04-16T15:52:50.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.325+0000 7fa28bfff640 1 --2- 172.21.15.132:0/2382960233 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa28c0727e0 0x7fa28c0abc40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa27c00c400 tx=0x7fa27c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:50.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.325+0000 7fa288ff9640 1 -- 172.21.15.132:0/2382960233 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa27c0052d0 con 0x7fa28c0727e0 2024-04-16T15:52:50.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.325+0000 7fa288ff9640 1 -- 172.21.15.132:0/2382960233 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa27c005490 con 0x7fa28c0727e0 2024-04-16T15:52:50.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.325+0000 7fa288ff9640 1 -- 172.21.15.132:0/2382960233 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa27c007260 con 0x7fa28c0727e0 2024-04-16T15:52:50.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.325+0000 7fa2924c5640 1 -- 172.21.15.132:0/2382960233 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa28c1f3360 con 0x7fa28c0727e0 2024-04-16T15:52:50.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.325+0000 7fa2924c5640 1 -- 172.21.15.132:0/2382960233 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa28c0c9b10 con 0x7fa28c0727e0 2024-04-16T15:52:50.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.326+0000 7fa2924c5640 1 -- 172.21.15.132:0/2382960233 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa28c075510 con 0x7fa28c0727e0 2024-04-16T15:52:50.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.327+0000 7fa288ff9640 1 -- 172.21.15.132:0/2382960233 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa27c007400 con 0x7fa28c0727e0 2024-04-16T15:52:50.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.327+0000 7fa288ff9640 1 --2- 172.21.15.132:0/2382960233 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fa27806c8f0 0x7fa27806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:50.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.327+0000 7fa288ff9640 1 -- 172.21.15.132:0/2382960233 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa27c08b000 con 0x7fa28c0727e0 2024-04-16T15:52:50.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.327+0000 7fa28b7fe640 1 --2- 172.21.15.132:0/2382960233 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fa27806c8f0 0x7fa27806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:50.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.328+0000 7fa28b7fe640 1 --2- 172.21.15.132:0/2382960233 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fa27806c8f0 0x7fa27806edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa280036000 tx=0x7fa28003b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:50.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.331+0000 7fa288ff9640 1 -- 172.21.15.132:0/2382960233 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa27c058df0 con 0x7fa28c0727e0 2024-04-16T15:52:50.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.504+0000 7fa2924c5640 1 -- 172.21.15.132:0/2382960233 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa28c0c9ce0 con 0x7fa28c0727e0 2024-04-16T15:52:50.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.505+0000 7fa288ff9640 1 -- 172.21.15.132:0/2382960233 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7fa27c05d0f0 con 0x7fa28c0727e0 2024-04-16T15:52:50.504 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2024-04-16T15:52:50.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.507+0000 7fa2924c5640 1 -- 172.21.15.132:0/2382960233 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fa27806c8f0 msgr2=0x7fa27806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:50.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.507+0000 7fa2924c5640 1 --2- 172.21.15.132:0/2382960233 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fa27806c8f0 0x7fa27806edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa280036000 tx=0x7fa28003b040 comp rx=0 tx=0).stop 2024-04-16T15:52:50.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.507+0000 7fa2924c5640 1 -- 172.21.15.132:0/2382960233 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa28c0727e0 msgr2=0x7fa28c0abc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:50.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.507+0000 7fa2924c5640 1 --2- 172.21.15.132:0/2382960233 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa28c0727e0 0x7fa28c0abc40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa27c00c400 tx=0x7fa27c00c8c0 comp rx=0 tx=0).stop 2024-04-16T15:52:50.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.507+0000 7fa2924c5640 1 -- 172.21.15.132:0/2382960233 shutdown_connections 2024-04-16T15:52:50.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.507+0000 7fa2924c5640 1 --2- 172.21.15.132:0/2382960233 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fa27806c8f0 0x7fa27806edb0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:50.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.507+0000 7fa2924c5640 1 --2- 172.21.15.132:0/2382960233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa28c15ea80 0x7fa28c1f2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:50.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.507+0000 7fa2924c5640 1 --2- 172.21.15.132:0/2382960233 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa28c15ad10 0x7fa28c0ca030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:50.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.507+0000 7fa2924c5640 1 --2- 172.21.15.132:0/2382960233 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa28c0727e0 0x7fa28c0abc40 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:50.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.507+0000 7fa2924c5640 1 -- 172.21.15.132:0/2382960233 >> 172.21.15.132:0/2382960233 conn(0x7fa28c0d0490 msgr2=0x7fa28c15a050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:50.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.507+0000 7fa2924c5640 1 -- 172.21.15.132:0/2382960233 shutdown_connections 2024-04-16T15:52:50.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.507+0000 7fa2924c5640 1 -- 172.21.15.132:0/2382960233 wait complete. 2024-04-16T15:52:50.517 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T15:52:50.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.624+0000 7fba5511c640 1 Processor -- start 2024-04-16T15:52:50.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.624+0000 7fba5511c640 1 -- start start 2024-04-16T15:52:50.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.624+0000 7fba5511c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba5015b840 0x7fba500cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:50.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.624+0000 7fba5511c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fba500b4e60 0x7fba5006f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:50.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.624+0000 7fba5511c640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba5006dfb0 con 0x7fba500cf470 2024-04-16T15:52:50.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.624+0000 7fba5511c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fba5006e290 con 0x7fba500b4e60 2024-04-16T15:52:50.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.624+0000 7fba5511c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fba5006e570 con 0x7fba5015b840 2024-04-16T15:52:50.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.625+0000 7fba4f59e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fba500b4e60 0x7fba5006f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:50.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.625+0000 7fba4f59e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fba500b4e60 0x7fba5006f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53716/0 (socket says 172.21.15.132:53716) 2024-04-16T15:52:50.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.625+0000 7fba4f59e640 1 -- 172.21.15.132:0/2225043105 learned_addr learned my addr 172.21.15.132:0/2225043105 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:50.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.625+0000 7fba4f59e640 1 -- 172.21.15.132:0/2225043105 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba5015b840 msgr2=0x7fba500cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:50.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.625+0000 7fba4f59e640 1 --2- 172.21.15.132:0/2225043105 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba5015b840 0x7fba500cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:50.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.625+0000 7fba4f59e640 1 -- 172.21.15.132:0/2225043105 >> v1:172.21.15.179:6789/0 conn(0x7fba500cf470 legacy=0x7fba500b4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:50.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.625+0000 7fba4f59e640 1 -- 172.21.15.132:0/2225043105 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba5006e850 con 0x7fba500b4e60 2024-04-16T15:52:50.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.626+0000 7fba4f59e640 1 --2- 172.21.15.132:0/2225043105 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba500b4e60 0x7fba5006f050 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fba48009e50 tx=0x7fba4802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de28f0442acbf5ac server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:50.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.626+0000 7fba4dd9b640 1 -- 172.21.15.132:0/2225043105 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4802ca70 con 0x7fba500b4e60 2024-04-16T15:52:50.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.626+0000 7fba4dd9b640 1 -- 172.21.15.132:0/2225043105 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba4802cc10 con 0x7fba500b4e60 2024-04-16T15:52:50.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.626+0000 7fba4dd9b640 1 -- 172.21.15.132:0/2225043105 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba480343f0 con 0x7fba500b4e60 2024-04-16T15:52:50.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.626+0000 7fba5511c640 1 -- 172.21.15.132:0/2225043105 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba500b4e60 msgr2=0x7fba5006f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:50.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.626+0000 7fba5511c640 1 --2- 172.21.15.132:0/2225043105 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba500b4e60 0x7fba5006f050 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fba48009e50 tx=0x7fba4802bed0 comp rx=0 tx=0).stop 2024-04-16T15:52:50.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.626+0000 7fba5511c640 1 -- 172.21.15.132:0/2225043105 shutdown_connections 2024-04-16T15:52:50.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.626+0000 7fba5511c640 1 --2- 172.21.15.132:0/2225043105 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba500b4e60 0x7fba5006f050 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:50.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.626+0000 7fba5511c640 1 --2- 172.21.15.132:0/2225043105 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba5015b840 0x7fba500cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:50.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.626+0000 7fba5511c640 1 -- 172.21.15.132:0/2225043105 >> 172.21.15.132:0/2225043105 conn(0x7fba500d0490 msgr2=0x7fba500d08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:50.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.626+0000 7fba5511c640 1 -- 172.21.15.132:0/2225043105 shutdown_connections 2024-04-16T15:52:50.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.626+0000 7fba5511c640 1 -- 172.21.15.132:0/2225043105 wait complete. 2024-04-16T15:52:50.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.628+0000 7fba5511c640 1 Processor -- start 2024-04-16T15:52:50.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.628+0000 7fba5511c640 1 -- start start 2024-04-16T15:52:50.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.629+0000 7fba5511c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba500b4e60 0x7fba5014c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:50.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.629+0000 7fba5511c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba500cf470 0x7fba50157d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:50.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.629+0000 7fba5511c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba5015b840 0x7fba500b3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:50.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.629+0000 7fba5511c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fba5015bc20 con 0x7fba500b4e60 2024-04-16T15:52:50.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.629+0000 7fba5511c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fba500b5740 con 0x7fba5015b840 2024-04-16T15:52:50.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.629+0000 7fba5511c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fba500ad950 con 0x7fba500cf470 2024-04-16T15:52:50.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.629+0000 7fba4ed9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba500b4e60 0x7fba5014c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:50.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.629+0000 7fba4ed9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba500b4e60 0x7fba5014c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53720/0 (socket says 172.21.15.132:53720) 2024-04-16T15:52:50.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.629+0000 7fba4ed9d640 1 -- 172.21.15.132:0/1541313909 learned_addr learned my addr 172.21.15.132:0/1541313909 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:50.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.629+0000 7fba4e59c640 1 --2- 172.21.15.132:0/1541313909 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba500cf470 0x7fba50157d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:50.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.629+0000 7fba4f59e640 1 --2- 172.21.15.132:0/1541313909 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba5015b840 0x7fba500b3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:50.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.629+0000 7fba4ed9d640 1 -- 172.21.15.132:0/1541313909 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba500cf470 msgr2=0x7fba50157d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:50.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.629+0000 7fba4ed9d640 1 --2- 172.21.15.132:0/1541313909 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba500cf470 0x7fba50157d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:50.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.629+0000 7fba4ed9d640 1 -- 172.21.15.132:0/1541313909 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba5015b840 msgr2=0x7fba500b3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:50.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.629+0000 7fba4ed9d640 1 --2- 172.21.15.132:0/1541313909 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba5015b840 0x7fba500b3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:50.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.629+0000 7fba4ed9d640 1 -- 172.21.15.132:0/1541313909 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba501586e0 con 0x7fba500b4e60 2024-04-16T15:52:50.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.629+0000 7fba4f59e640 1 --2- 172.21.15.132:0/1541313909 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba5015b840 0x7fba500b3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:50.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.629+0000 7fba4ed9d640 1 --2- 172.21.15.132:0/1541313909 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba500b4e60 0x7fba5014c200 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fba4000b410 tx=0x7fba4000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:50.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.629+0000 7fba377fe640 1 -- 172.21.15.132:0/1541313909 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba40015020 con 0x7fba500b4e60 2024-04-16T15:52:50.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.629+0000 7fba377fe640 1 -- 172.21.15.132:0/1541313909 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba40011850 con 0x7fba500b4e60 2024-04-16T15:52:50.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.629+0000 7fba5511c640 1 -- 172.21.15.132:0/1541313909 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba501589c0 con 0x7fba500b4e60 2024-04-16T15:52:50.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.629+0000 7fba377fe640 1 -- 172.21.15.132:0/1541313909 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba40011c40 con 0x7fba500b4e60 2024-04-16T15:52:50.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.629+0000 7fba5511c640 1 -- 172.21.15.132:0/1541313909 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba5014c740 con 0x7fba500b4e60 2024-04-16T15:52:50.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.630+0000 7fba5511c640 1 -- 172.21.15.132:0/1541313909 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba50075510 con 0x7fba500b4e60 2024-04-16T15:52:50.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.631+0000 7fba377fe640 1 -- 172.21.15.132:0/1541313909 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fba40018020 con 0x7fba500b4e60 2024-04-16T15:52:50.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.631+0000 7fba377fe640 1 --2- 172.21.15.132:0/1541313909 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fba3c06c8f0 0x7fba3c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:50.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.631+0000 7fba377fe640 1 -- 172.21.15.132:0/1541313909 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fba4008b9b0 con 0x7fba500b4e60 2024-04-16T15:52:50.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.631+0000 7fba4e59c640 1 --2- 172.21.15.132:0/1541313909 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fba3c06c8f0 0x7fba3c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:50.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.632+0000 7fba4e59c640 1 --2- 172.21.15.132:0/1541313909 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fba3c06c8f0 0x7fba3c06edb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fba44004f60 tx=0x7fba44007e30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:50.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.636+0000 7fba377fe640 1 -- 172.21.15.132:0/1541313909 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fba4001f020 con 0x7fba500b4e60 2024-04-16T15:52:50.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.809+0000 7fba5511c640 1 -- 172.21.15.132:0/1541313909 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fba500cfeb0 con 0x7fba500b4e60 2024-04-16T15:52:50.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.809+0000 7fba377fe640 1 -- 172.21.15.132:0/1541313909 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fba40059e70 con 0x7fba500b4e60 2024-04-16T15:52:50.809 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2024-04-16T15:52:50.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.811+0000 7fba5511c640 1 -- 172.21.15.132:0/1541313909 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fba3c06c8f0 msgr2=0x7fba3c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:50.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.811+0000 7fba5511c640 1 --2- 172.21.15.132:0/1541313909 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fba3c06c8f0 0x7fba3c06edb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fba44004f60 tx=0x7fba44007e30 comp rx=0 tx=0).stop 2024-04-16T15:52:50.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.811+0000 7fba5511c640 1 -- 172.21.15.132:0/1541313909 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba500b4e60 msgr2=0x7fba5014c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:50.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.811+0000 7fba5511c640 1 --2- 172.21.15.132:0/1541313909 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba500b4e60 0x7fba5014c200 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fba4000b410 tx=0x7fba4000b8d0 comp rx=0 tx=0).stop 2024-04-16T15:52:50.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.811+0000 7fba5511c640 1 -- 172.21.15.132:0/1541313909 shutdown_connections 2024-04-16T15:52:50.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.811+0000 7fba5511c640 1 --2- 172.21.15.132:0/1541313909 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fba3c06c8f0 0x7fba3c06edb0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:50.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.811+0000 7fba5511c640 1 --2- 172.21.15.132:0/1541313909 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba5015b840 0x7fba500b3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:50.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.811+0000 7fba5511c640 1 --2- 172.21.15.132:0/1541313909 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba500cf470 0x7fba50157d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:50.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.811+0000 7fba5511c640 1 --2- 172.21.15.132:0/1541313909 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba500b4e60 0x7fba5014c200 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:50.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.811+0000 7fba5511c640 1 -- 172.21.15.132:0/1541313909 >> 172.21.15.132:0/1541313909 conn(0x7fba500d0490 msgr2=0x7fba500b0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:50.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.811+0000 7fba5511c640 1 -- 172.21.15.132:0/1541313909 shutdown_connections 2024-04-16T15:52:50.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.811+0000 7fba5511c640 1 -- 172.21.15.132:0/1541313909 wait complete. 2024-04-16T15:52:50.822 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-16T15:52:50.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.926+0000 7fe2ad73f640 1 Processor -- start 2024-04-16T15:52:50.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.926+0000 7fe2ad73f640 1 -- start start 2024-04-16T15:52:50.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.927+0000 7fe2ad73f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2a815eb70 0x7fe2a806cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:50.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.927+0000 7fe2ad73f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe2a80b6e40 0x7fe2a80d33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:50.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.927+0000 7fe2ad73f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2a806d730 con 0x7fe2a80ba6b0 2024-04-16T15:52:50.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.927+0000 7fe2ad73f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fe2a806dcf0 con 0x7fe2a80b6e40 2024-04-16T15:52:50.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.927+0000 7fe2ad73f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe2a80d2f10 con 0x7fe2a815eb70 2024-04-16T15:52:50.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.927+0000 7fe2a77fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe2a80b6e40 0x7fe2a80d33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:50.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.927+0000 7fe2a67fc640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fe2a80ba6b0 0x7fe2a80b6730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:35400/0 (socket says 172.21.15.132:35400) 2024-04-16T15:52:50.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.927+0000 7fe2a67fc640 1 -- 172.21.15.132:0/1301926562 learned_addr learned my addr 172.21.15.132:0/1301926562 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:50.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.927+0000 7fe2a6ffd640 1 --2- 172.21.15.132:0/1301926562 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2a815eb70 0x7fe2a806cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:50.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.927+0000 7fe2a77fe640 1 -- 172.21.15.132:0/1301926562 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2a815eb70 msgr2=0x7fe2a806cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:50.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.927+0000 7fe2a77fe640 1 --2- 172.21.15.132:0/1301926562 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2a815eb70 0x7fe2a806cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:50.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.927+0000 7fe2a77fe640 1 -- 172.21.15.132:0/1301926562 >> v1:172.21.15.132:6789/0 conn(0x7fe2a80ba6b0 legacy=0x7fe2a80b6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:50.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.927+0000 7fe2a5ffb640 1 -- 172.21.15.132:0/1301926562 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3905171385 0 0) 0x7fe2a806d730 con 0x7fe2a80ba6b0 2024-04-16T15:52:50.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.927+0000 7fe2a77fe640 1 -- 172.21.15.132:0/1301926562 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2a806da10 con 0x7fe2a80b6e40 2024-04-16T15:52:50.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.928+0000 7fe2a77fe640 1 --2- 172.21.15.132:0/1301926562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2a80b6e40 0x7fe2a80d33a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe2a00097a0 tx=0x7fe2a002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d442acdb79bd729 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:50.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.928+0000 7fe2a5ffb640 1 -- 172.21.15.132:0/1301926562 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a00315a0 con 0x7fe2a80b6e40 2024-04-16T15:52:50.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.928+0000 7fe2a5ffb640 1 -- 172.21.15.132:0/1301926562 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2a0037070 con 0x7fe2a80b6e40 2024-04-16T15:52:50.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.928+0000 7fe2a5ffb640 1 -- 172.21.15.132:0/1301926562 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a0031960 con 0x7fe2a80b6e40 2024-04-16T15:52:50.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.929+0000 7fe2ad73f640 1 -- 172.21.15.132:0/1301926562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2a80b6e40 msgr2=0x7fe2a80d33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:50.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.929+0000 7fe2ad73f640 1 --2- 172.21.15.132:0/1301926562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2a80b6e40 0x7fe2a80d33a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe2a00097a0 tx=0x7fe2a002b840 comp rx=0 tx=0).stop 2024-04-16T15:52:50.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.929+0000 7fe2ad73f640 1 -- 172.21.15.132:0/1301926562 shutdown_connections 2024-04-16T15:52:50.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.929+0000 7fe2ad73f640 1 --2- 172.21.15.132:0/1301926562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2a80b6e40 0x7fe2a80d33a0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:50.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.929+0000 7fe2ad73f640 1 --2- 172.21.15.132:0/1301926562 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2a815eb70 0x7fe2a806cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:50.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.929+0000 7fe2ad73f640 1 -- 172.21.15.132:0/1301926562 >> 172.21.15.132:0/1301926562 conn(0x7fe2a80d1800 msgr2=0x7fe2a80d1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:50.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.929+0000 7fe2ad73f640 1 -- 172.21.15.132:0/1301926562 shutdown_connections 2024-04-16T15:52:50.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.929+0000 7fe2ad73f640 1 -- 172.21.15.132:0/1301926562 wait complete. 2024-04-16T15:52:50.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.930+0000 7fe2ad73f640 1 Processor -- start 2024-04-16T15:52:50.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.930+0000 7fe2ad73f640 1 -- start start 2024-04-16T15:52:50.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.931+0000 7fe2ad73f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2a80b6e40 0x7fe2a80c9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:50.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.931+0000 7fe2ad73f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2a80ba6b0 0x7fe2a814a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:50.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.931+0000 7fe2ad73f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2a815eb70 0x7fe2a80c7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:50.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.931+0000 7fe2ad73f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a815f0d0 con 0x7fe2a815eb70 2024-04-16T15:52:50.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.931+0000 7fe2ad73f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a815ef50 con 0x7fe2a80b6e40 2024-04-16T15:52:50.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.931+0000 7fe2ad73f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe2a806d300 con 0x7fe2a80ba6b0 2024-04-16T15:52:50.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.931+0000 7fe2a77fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2a815eb70 0x7fe2a80c7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:50.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.931+0000 7fe2a77fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2a815eb70 0x7fe2a80c7bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53736/0 (socket says 172.21.15.132:53736) 2024-04-16T15:52:50.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.931+0000 7fe2a77fe640 1 -- 172.21.15.132:0/3917631153 learned_addr learned my addr 172.21.15.132:0/3917631153 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:50.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.931+0000 7fe2a6ffd640 1 --2- 172.21.15.132:0/3917631153 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2a80b6e40 0x7fe2a80c9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:50.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.931+0000 7fe2a67fc640 1 --2- 172.21.15.132:0/3917631153 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2a80ba6b0 0x7fe2a814a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:50.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.931+0000 7fe2a77fe640 1 -- 172.21.15.132:0/3917631153 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2a80ba6b0 msgr2=0x7fe2a814a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:50.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.931+0000 7fe2a77fe640 1 --2- 172.21.15.132:0/3917631153 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2a80ba6b0 0x7fe2a814a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:50.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.931+0000 7fe2a77fe640 1 -- 172.21.15.132:0/3917631153 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2a80b6e40 msgr2=0x7fe2a80c9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:50.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.931+0000 7fe2a77fe640 1 --2- 172.21.15.132:0/3917631153 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2a80b6e40 0x7fe2a80c9b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:50.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.931+0000 7fe2a77fe640 1 -- 172.21.15.132:0/3917631153 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2a80ca090 con 0x7fe2a815eb70 2024-04-16T15:52:50.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.931+0000 7fe2a6ffd640 1 --2- 172.21.15.132:0/3917631153 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2a80b6e40 0x7fe2a80c9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:52:50.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.932+0000 7fe2a77fe640 1 --2- 172.21.15.132:0/3917631153 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2a815eb70 0x7fe2a80c7bd0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe2a0034040 tx=0x7fe2a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:50.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.932+0000 7fe29f7fe640 1 -- 172.21.15.132:0/3917631153 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a0004230 con 0x7fe2a815eb70 2024-04-16T15:52:50.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.932+0000 7fe29f7fe640 1 -- 172.21.15.132:0/3917631153 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2a00043d0 con 0x7fe2a815eb70 2024-04-16T15:52:50.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.932+0000 7fe29f7fe640 1 -- 172.21.15.132:0/3917631153 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a0003850 con 0x7fe2a815eb70 2024-04-16T15:52:50.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.932+0000 7fe2ad73f640 1 -- 172.21.15.132:0/3917631153 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2a81f7bb0 con 0x7fe2a815eb70 2024-04-16T15:52:50.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.932+0000 7fe2ad73f640 1 -- 172.21.15.132:0/3917631153 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2a81f8170 con 0x7fe2a815eb70 2024-04-16T15:52:50.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.933+0000 7fe2ad73f640 1 -- 172.21.15.132:0/3917631153 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2a8075510 con 0x7fe2a815eb70 2024-04-16T15:52:50.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.933+0000 7fe29f7fe640 1 -- 172.21.15.132:0/3917631153 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe2a00039f0 con 0x7fe2a815eb70 2024-04-16T15:52:50.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.934+0000 7fe29f7fe640 1 --2- 172.21.15.132:0/3917631153 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fe28806c8f0 0x7fe28806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:50.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.934+0000 7fe29f7fe640 1 -- 172.21.15.132:0/3917631153 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe2a002f030 con 0x7fe2a815eb70 2024-04-16T15:52:50.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.934+0000 7fe2a6ffd640 1 --2- 172.21.15.132:0/3917631153 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fe28806c8f0 0x7fe28806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:50.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.934+0000 7fe2a6ffd640 1 --2- 172.21.15.132:0/3917631153 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fe28806c8f0 0x7fe28806edb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8148650 tx=0x7fe29800b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:50.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:50.938+0000 7fe29f7fe640 1 -- 172.21.15.132:0/3917631153 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe2a0041070 con 0x7fe2a815eb70 2024-04-16T15:52:51.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.127+0000 7fe2ad73f640 1 -- 172.21.15.132:0/3917631153 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe2a80d25c0 con 0x7fe2a815eb70 2024-04-16T15:52:51.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.127+0000 7fe29f7fe640 1 -- 172.21.15.132:0/3917631153 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7fe2a0044340 con 0x7fe2a815eb70 2024-04-16T15:52:51.146 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2024-04-16T15:52:51.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.129+0000 7fe2ad73f640 1 -- 172.21.15.132:0/3917631153 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fe28806c8f0 msgr2=0x7fe28806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:51.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.129+0000 7fe2ad73f640 1 --2- 172.21.15.132:0/3917631153 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fe28806c8f0 0x7fe28806edb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8148650 tx=0x7fe29800b040 comp rx=0 tx=0).stop 2024-04-16T15:52:51.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.129+0000 7fe2ad73f640 1 -- 172.21.15.132:0/3917631153 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2a815eb70 msgr2=0x7fe2a80c7bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:51.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.129+0000 7fe2ad73f640 1 --2- 172.21.15.132:0/3917631153 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2a815eb70 0x7fe2a80c7bd0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe2a0034040 tx=0x7fe2a00046c0 comp rx=0 tx=0).stop 2024-04-16T15:52:51.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.129+0000 7fe2ad73f640 1 -- 172.21.15.132:0/3917631153 shutdown_connections 2024-04-16T15:52:51.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.129+0000 7fe2ad73f640 1 --2- 172.21.15.132:0/3917631153 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fe28806c8f0 0x7fe28806edb0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:51.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.129+0000 7fe2ad73f640 1 --2- 172.21.15.132:0/3917631153 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2a815eb70 0x7fe2a80c7bd0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:51.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.129+0000 7fe2ad73f640 1 --2- 172.21.15.132:0/3917631153 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2a80ba6b0 0x7fe2a814a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:51.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.129+0000 7fe2ad73f640 1 --2- 172.21.15.132:0/3917631153 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2a80b6e40 0x7fe2a80c9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:51.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.129+0000 7fe2ad73f640 1 -- 172.21.15.132:0/3917631153 >> 172.21.15.132:0/3917631153 conn(0x7fe2a80d1800 msgr2=0x7fe2a80d3c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:51.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.130+0000 7fe2ad73f640 1 -- 172.21.15.132:0/3917631153 shutdown_connections 2024-04-16T15:52:51.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.130+0000 7fe2ad73f640 1 -- 172.21.15.132:0/3917631153 wait complete. 2024-04-16T15:52:51.149 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi179.front.sepia.ceph.com... 2024-04-16T15:52:51.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:52:51.149 DEBUG:teuthology.orchestra.run.smithi179:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-04-16T15:52:51.190 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T15:52:51.190 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi179.front.sepia.ceph.com 2024-04-16T15:52:51.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:52:51.190 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-16T15:52:51.267 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-16T15:52:51.267 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T15:52:51.285 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-16T15:52:51.286 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T15:52:51.347 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:52:51.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.495+0000 7f01e3fa8640 1 Processor -- start 2024-04-16T15:52:51.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.496+0000 7f01e3fa8640 1 -- start start 2024-04-16T15:52:51.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.497+0000 7f01e3fa8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01dc0b4250 0x7f01dc06eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:51.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.497+0000 7f01e3fa8640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f01dc06f2e0 0x7f01dc0b4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:51.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.497+0000 7f01e3fa8640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01dc0b46b0 con 0x7f01dc144f50 2024-04-16T15:52:51.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.497+0000 7f01e3fa8640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f01dc0ce040 con 0x7f01dc06f2e0 2024-04-16T15:52:51.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.497+0000 7f01e3fa8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f01dc06f710 con 0x7f01dc0b4250 2024-04-16T15:52:51.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.497+0000 7f01e2545640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f01dc06f2e0 0x7f01dc0b4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:51.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.497+0000 7f01e1543640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01dc0b4250 0x7f01dc06eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:51.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.497+0000 7f01e1d44640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f01dc144f50 0x7f01dc0cd2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.132:41994/0 (socket says 172.21.15.132:41994) 2024-04-16T15:52:51.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.497+0000 7f01e1d44640 1 -- 172.21.15.132:0/2630097880 learned_addr learned my addr 172.21.15.132:0/2630097880 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:51.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.497+0000 7f01e2545640 1 -- 172.21.15.132:0/2630097880 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01dc0b4250 msgr2=0x7f01dc06eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:51.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.497+0000 7f01e2545640 1 --2- 172.21.15.132:0/2630097880 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01dc0b4250 0x7f01dc06eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:51.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.497+0000 7f01e2545640 1 -- 172.21.15.132:0/2630097880 >> v1:172.21.15.179:6789/0 conn(0x7f01dc144f50 legacy=0x7f01dc0cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:51.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.497+0000 7f01e2545640 1 -- 172.21.15.132:0/2630097880 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01dc0cdd60 con 0x7f01dc06f2e0 2024-04-16T15:52:51.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.497+0000 7f01e1543640 1 --2- 172.21.15.132:0/2630097880 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01dc0b4250 0x7f01dc06eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:52:51.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.498+0000 7f01e2545640 1 --2- 172.21.15.132:0/2630097880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01dc06f2e0 0x7f01dc0b4c60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f01d4009d90 tx=0x7f01d402be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3e66f652ba04c0a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:51.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.498+0000 7f01e0d42640 1 -- 172.21.15.132:0/2630097880 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d4039070 con 0x7f01dc06f2e0 2024-04-16T15:52:51.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.498+0000 7f01e0d42640 1 -- 172.21.15.132:0/2630097880 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01d402cbc0 con 0x7f01dc06f2e0 2024-04-16T15:52:51.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.498+0000 7f01e0d42640 1 -- 172.21.15.132:0/2630097880 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d4034440 con 0x7f01dc06f2e0 2024-04-16T15:52:51.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.499+0000 7f01e3fa8640 1 -- 172.21.15.132:0/2630097880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01dc06f2e0 msgr2=0x7f01dc0b4c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:51.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.499+0000 7f01e3fa8640 1 --2- 172.21.15.132:0/2630097880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01dc06f2e0 0x7f01dc0b4c60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f01d4009d90 tx=0x7f01d402be10 comp rx=0 tx=0).stop 2024-04-16T15:52:51.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.499+0000 7f01e3fa8640 1 -- 172.21.15.132:0/2630097880 shutdown_connections 2024-04-16T15:52:51.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.499+0000 7f01e3fa8640 1 --2- 172.21.15.132:0/2630097880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01dc06f2e0 0x7f01dc0b4c60 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:51.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.499+0000 7f01e3fa8640 1 --2- 172.21.15.132:0/2630097880 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01dc0b4250 0x7f01dc06eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:51.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.499+0000 7f01e3fa8640 1 -- 172.21.15.132:0/2630097880 >> 172.21.15.132:0/2630097880 conn(0x7f01dc0b2d50 msgr2=0x7f01dc06ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:51.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.499+0000 7f01e3fa8640 1 -- 172.21.15.132:0/2630097880 shutdown_connections 2024-04-16T15:52:51.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.499+0000 7f01e3fa8640 1 -- 172.21.15.132:0/2630097880 wait complete. 2024-04-16T15:52:51.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.500+0000 7f01e3fa8640 1 Processor -- start 2024-04-16T15:52:51.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.500+0000 7f01e3fa8640 1 -- start start 2024-04-16T15:52:51.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.501+0000 7f01e3fa8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01dc06f2e0 0x7f01dc139cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:51.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.501+0000 7f01e3fa8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01dc0b4250 0x7f01dc1e3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:51.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.501+0000 7f01e3fa8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01dc144f50 0x7f01dc1e4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:51.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.501+0000 7f01e3fa8640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f01dc0b3d30 con 0x7f01dc06f2e0 2024-04-16T15:52:51.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.501+0000 7f01e3fa8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f01dc0b3a50 con 0x7f01dc144f50 2024-04-16T15:52:51.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.501+0000 7f01e3fa8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f01dc0afda0 con 0x7f01dc0b4250 2024-04-16T15:52:51.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.501+0000 7f01e1d44640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01dc06f2e0 0x7f01dc139cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:51.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.501+0000 7f01e1d44640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01dc06f2e0 0x7f01dc139cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60230/0 (socket says 172.21.15.132:60230) 2024-04-16T15:52:51.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.501+0000 7f01e1d44640 1 -- 172.21.15.132:0/1698151350 learned_addr learned my addr 172.21.15.132:0/1698151350 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:51.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.501+0000 7f01e1543640 1 --2- 172.21.15.132:0/1698151350 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01dc0b4250 0x7f01dc1e3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:51.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.501+0000 7f01e2545640 1 --2- 172.21.15.132:0/1698151350 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01dc144f50 0x7f01dc1e4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:51.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.501+0000 7f01e1d44640 1 -- 172.21.15.132:0/1698151350 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01dc0b4250 msgr2=0x7f01dc1e3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:51.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.501+0000 7f01e1d44640 1 --2- 172.21.15.132:0/1698151350 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01dc0b4250 0x7f01dc1e3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:51.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.501+0000 7f01e1d44640 1 -- 172.21.15.132:0/1698151350 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01dc144f50 msgr2=0x7f01dc1e4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:51.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.501+0000 7f01e1d44640 1 --2- 172.21.15.132:0/1698151350 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01dc144f50 0x7f01dc1e4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:51.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.501+0000 7f01e1d44640 1 -- 172.21.15.132:0/1698151350 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01dc13f4d0 con 0x7f01dc06f2e0 2024-04-16T15:52:51.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.501+0000 7f01e2545640 1 --2- 172.21.15.132:0/1698151350 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01dc144f50 0x7f01dc1e4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:51.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.501+0000 7f01e1d44640 1 --2- 172.21.15.132:0/1698151350 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01dc06f2e0 0x7f01dc139cc0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f01d000c400 tx=0x7f01d000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:51.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.501+0000 7f01ce7fc640 1 -- 172.21.15.132:0/1698151350 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d0017070 con 0x7f01dc06f2e0 2024-04-16T15:52:51.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.502+0000 7f01ce7fc640 1 -- 172.21.15.132:0/1698151350 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01d0005ce0 con 0x7f01dc06f2e0 2024-04-16T15:52:51.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.502+0000 7f01e3fa8640 1 -- 172.21.15.132:0/1698151350 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01dc13f7b0 con 0x7f01dc06f2e0 2024-04-16T15:52:51.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.502+0000 7f01ce7fc640 1 -- 172.21.15.132:0/1698151350 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d00072f0 con 0x7f01dc06f2e0 2024-04-16T15:52:51.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.502+0000 7f01e3fa8640 1 -- 172.21.15.132:0/1698151350 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01dc13fd70 con 0x7f01dc06f2e0 2024-04-16T15:52:51.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.503+0000 7f01e3fa8640 1 -- 172.21.15.132:0/1698151350 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01dc075510 con 0x7f01dc06f2e0 2024-04-16T15:52:51.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.503+0000 7f01ce7fc640 1 -- 172.21.15.132:0/1698151350 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f01d001a070 con 0x7f01dc06f2e0 2024-04-16T15:52:51.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.504+0000 7f01ce7fc640 1 --2- 172.21.15.132:0/1698151350 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f01c006c920 0x7f01c006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:51.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.504+0000 7f01ce7fc640 1 -- 172.21.15.132:0/1698151350 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f01d008ae30 con 0x7f01dc06f2e0 2024-04-16T15:52:51.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.504+0000 7f01e1543640 1 --2- 172.21.15.132:0/1698151350 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f01c006c920 0x7f01c006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:51.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.504+0000 7f01e1543640 1 --2- 172.21.15.132:0/1698151350 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f01c006c920 0x7f01c006ede0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f01d8009560 tx=0x7f01d8009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:51.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.508+0000 7f01ce7fc640 1 -- 172.21.15.132:0/1698151350 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f01dc0b46b0 con 0x7f01dc06f2e0 2024-04-16T15:52:51.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.686+0000 7f01e3fa8640 1 -- 172.21.15.132:0/1698151350 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f01dc15b730 con 0x7f01dc06f2e0 2024-04-16T15:52:51.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.687+0000 7f01ce7fc640 1 -- 172.21.15.132:0/1698151350 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7f01d0058ca0 con 0x7f01dc06f2e0 2024-04-16T15:52:51.687 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:52:51.687 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"6bdec5d9-f406-43ad-8584-0503b32f6f0d","created":"2024-04-16T15:51:51.073040+0000","modified":"2024-04-16T15:52:16.950186+0000","last_up_change":"2024-04-16T15:52:02.280496+0000","last_in_change":"2024-04-16T15:51:53.376468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:52:03.284927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:52:13.363758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T15:52:14.246647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d45908b-6e22-4619-b190-897af594b712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6801","nonce":1170594668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6803","nonce":1170594668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6807","nonce":1170594668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6805","nonce":1170594668}]},"public_addr":"172.21.15.132:6801/1170594668","cluster_addr":"172.21.15.132:6803/1170594668","heartbeat_back_addr":"172.21.15.132:6807/1170594668","heartbeat_front_addr":"172.21.15.132:6805/1170594668","state":["exists","up"]},{"osd":1,"uuid":"c88bf082-e51f-4ee6-815a-025f6ce0d67b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6809","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6811","nonce":2494780358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6815","nonce":2494780358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6823","nonce":2494780358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6819","nonce":2494780358}]},"public_addr":"172.21.15.132:6811/2494780358","cluster_addr":"172.21.15.132:6815/2494780358","heartbeat_back_addr":"172.21.15.132:6823/2494780358","heartbeat_front_addr":"172.21.15.132:6819/2494780358","state":["exists","up"]},{"osd":2,"uuid":"e5dbd6b4-4e7b-47e4-ad4e-35b4b81696c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6825","nonce":27655483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6827","nonce":27655483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6831","nonce":27655483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6829","nonce":27655483}]},"public_addr":"172.21.15.132:6825/27655483","cluster_addr":"172.21.15.132:6827/27655483","heartbeat_back_addr":"172.21.15.132:6831/27655483","heartbeat_front_addr":"172.21.15.132:6829/27655483","state":["exists","up"]},{"osd":3,"uuid":"9d75cd67-3b8a-4424-8884-5f3660e1f5f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6810","nonce":3100919191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6814","nonce":3100919191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6821","nonce":3100919191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6818","nonce":3100919191}]},"public_addr":"172.21.15.132:6810/3100919191","cluster_addr":"172.21.15.132:6814/3100919191","heartbeat_back_addr":"172.21.15.132:6821/3100919191","heartbeat_front_addr":"172.21.15.132:6818/3100919191","state":["exists","up"]},{"osd":4,"uuid":"83aea46a-8642-4777-912b-c130e5890da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6825","nonce":123637799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6827","nonce":123637799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6831","nonce":123637799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6829","nonce":123637799}]},"public_addr":"172.21.15.179:6825/123637799","cluster_addr":"172.21.15.179:6827/123637799","heartbeat_back_addr":"172.21.15.179:6831/123637799","heartbeat_front_addr":"172.21.15.179:6829/123637799","state":["exists","up"]},{"osd":5,"uuid":"534117c8-3317-48d6-b436-afd5709f71e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6801","nonce":2224750370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6803","nonce":2224750370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6807","nonce":2224750370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6805","nonce":2224750370}]},"public_addr":"172.21.15.179:6801/2224750370","cluster_addr":"172.21.15.179:6803/2224750370","heartbeat_back_addr":"172.21.15.179:6807/2224750370","heartbeat_front_addr":"172.21.15.179:6805/2224750370","state":["exists","up"]},{"osd":6,"uuid":"0ba363e7-fa9d-42b1-ae09-a6a0f57d41f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6809","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6811","nonce":101498164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6813","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6815","nonce":101498164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6823","nonce":101498164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6819","nonce":101498164}]},"public_addr":"172.21.15.179:6811/101498164","cluster_addr":"172.21.15.179:6815/101498164","heartbeat_back_addr":"172.21.15.179:6823/101498164","heartbeat_front_addr":"172.21.15.179:6819/101498164","state":["exists","up"]},{"osd":7,"uuid":"e6830c77-2f2d-4067-9866-ee7625afc1a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6810","nonce":872148365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6814","nonce":872148365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6822","nonce":872148365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6818","nonce":872148365}]},"public_addr":"172.21.15.179:6810/872148365","cluster_addr":"172.21.15.179:6814/872148365","heartbeat_back_addr":"172.21.15.179:6822/872148365","heartbeat_front_addr":"172.21.15.179:6818/872148365","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.535221+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.563769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.520765+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.526264+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.517058+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.500842+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.534332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.512486+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:52:51.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.690+0000 7f01e3fa8640 1 -- 172.21.15.132:0/1698151350 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f01c006c920 msgr2=0x7f01c006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:51.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.690+0000 7f01e3fa8640 1 --2- 172.21.15.132:0/1698151350 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f01c006c920 0x7f01c006ede0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f01d8009560 tx=0x7f01d8009190 comp rx=0 tx=0).stop 2024-04-16T15:52:51.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.690+0000 7f01e3fa8640 1 -- 172.21.15.132:0/1698151350 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01dc06f2e0 msgr2=0x7f01dc139cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:51.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.690+0000 7f01e3fa8640 1 --2- 172.21.15.132:0/1698151350 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01dc06f2e0 0x7f01dc139cc0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f01d000c400 tx=0x7f01d000c8c0 comp rx=0 tx=0).stop 2024-04-16T15:52:51.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.690+0000 7f01e3fa8640 1 -- 172.21.15.132:0/1698151350 shutdown_connections 2024-04-16T15:52:51.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.690+0000 7f01e3fa8640 1 --2- 172.21.15.132:0/1698151350 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f01c006c920 0x7f01c006ede0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:51.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.690+0000 7f01e3fa8640 1 --2- 172.21.15.132:0/1698151350 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01dc144f50 0x7f01dc1e4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:51.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.690+0000 7f01e3fa8640 1 --2- 172.21.15.132:0/1698151350 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01dc0b4250 0x7f01dc1e3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:51.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.690+0000 7f01e3fa8640 1 --2- 172.21.15.132:0/1698151350 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01dc06f2e0 0x7f01dc139cc0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:51.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.690+0000 7f01e3fa8640 1 -- 172.21.15.132:0/1698151350 >> 172.21.15.132:0/1698151350 conn(0x7f01dc0b2d50 msgr2=0x7f01dc15da40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:51.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.690+0000 7f01e3fa8640 1 -- 172.21.15.132:0/1698151350 shutdown_connections 2024-04-16T15:52:51.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.690+0000 7f01e3fa8640 1 -- 172.21.15.132:0/1698151350 wait complete. 2024-04-16T15:52:51.700 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T15:52:03.284927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T15:52:13.363758+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T15:52:14.246647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T15:52:51.701 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T15:52:51.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.809+0000 7f5167352640 1 Processor -- start 2024-04-16T15:52:51.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.809+0000 7f5167352640 1 -- start start 2024-04-16T15:52:51.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.809+0000 7f5167352640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f516015eaa0 0x7f516006e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:51.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.809+0000 7f5167352640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f516015ee80 0x7f51600700f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:51.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.809+0000 7f5167352640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5160067a00 0x7f516006ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:51.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.809+0000 7f5167352640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f516006fc60 con 0x7f5160067a00 2024-04-16T15:52:51.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.809+0000 7f5167352640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f516006edb0 con 0x7f516015eaa0 2024-04-16T15:52:51.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.809+0000 7f5167352640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f516006f050 con 0x7f516015ee80 2024-04-16T15:52:51.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.809+0000 7f51658ef640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5160067a00 0x7f516006ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:51.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.809+0000 7f51658ef640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5160067a00 0x7f516006ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60244/0 (socket says 172.21.15.132:60244) 2024-04-16T15:52:51.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.809+0000 7f51658ef640 1 -- 172.21.15.132:0/1039490558 learned_addr learned my addr 172.21.15.132:0/1039490558 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:51.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.809+0000 7f51648ed640 1 --2- 172.21.15.132:0/1039490558 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f516015ee80 0x7f51600700f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:51.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.809+0000 7f51650ee640 1 --2- 172.21.15.132:0/1039490558 >> v2:172.21.15.179:3300/0 conn(0x7f516015eaa0 0x7f516006e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:51.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.809+0000 7f51658ef640 1 -- 172.21.15.132:0/1039490558 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f516015ee80 msgr2=0x7f51600700f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:51.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.809+0000 7f51658ef640 1 --2- 172.21.15.132:0/1039490558 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f516015ee80 0x7f51600700f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:51.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.809+0000 7f51658ef640 1 -- 172.21.15.132:0/1039490558 >> v2:172.21.15.179:3300/0 conn(0x7f516015eaa0 msgr2=0x7f516006e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:51.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.809+0000 7f51658ef640 1 --2- 172.21.15.132:0/1039490558 >> v2:172.21.15.179:3300/0 conn(0x7f516015eaa0 0x7f516006e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:51.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.809+0000 7f51658ef640 1 -- 172.21.15.132:0/1039490558 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f516006f330 con 0x7f5160067a00 2024-04-16T15:52:51.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.809+0000 7f51648ed640 1 --2- 172.21.15.132:0/1039490558 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f516015ee80 0x7f51600700f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:51.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.810+0000 7f51658ef640 1 --2- 172.21.15.132:0/1039490558 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5160067a00 0x7f516006ca30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f516009f0c0 tx=0x7f515802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d864e6b02f42e56 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:51.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.810+0000 7f5157fff640 1 -- 172.21.15.132:0/1039490558 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f515802ca70 con 0x7f5160067a00 2024-04-16T15:52:51.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.810+0000 7f5157fff640 1 -- 172.21.15.132:0/1039490558 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f515802cc10 con 0x7f5160067a00 2024-04-16T15:52:51.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.810+0000 7f5157fff640 1 -- 172.21.15.132:0/1039490558 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51580343f0 con 0x7f5160067a00 2024-04-16T15:52:51.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.811+0000 7f5167352640 1 -- 172.21.15.132:0/1039490558 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5160067a00 msgr2=0x7f516006ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:51.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.811+0000 7f5167352640 1 --2- 172.21.15.132:0/1039490558 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5160067a00 0x7f516006ca30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f516009f0c0 tx=0x7f515802bed0 comp rx=0 tx=0).stop 2024-04-16T15:52:51.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.811+0000 7f5167352640 1 -- 172.21.15.132:0/1039490558 shutdown_connections 2024-04-16T15:52:51.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.811+0000 7f5167352640 1 --2- 172.21.15.132:0/1039490558 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5160067a00 0x7f516006ca30 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:51.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.811+0000 7f5167352640 1 --2- 172.21.15.132:0/1039490558 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f516015ee80 0x7f51600700f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:51.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.811+0000 7f5167352640 1 --2- 172.21.15.132:0/1039490558 >> v2:172.21.15.179:3300/0 conn(0x7f516015eaa0 0x7f516006e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:51.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.811+0000 7f5167352640 1 -- 172.21.15.132:0/1039490558 >> 172.21.15.132:0/1039490558 conn(0x7f5160072810 msgr2=0x7f5160072c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:51.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.811+0000 7f5167352640 1 -- 172.21.15.132:0/1039490558 shutdown_connections 2024-04-16T15:52:51.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.811+0000 7f5167352640 1 -- 172.21.15.132:0/1039490558 wait complete. 2024-04-16T15:52:51.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.812+0000 7f5167352640 1 Processor -- start 2024-04-16T15:52:51.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.812+0000 7f5167352640 1 -- start start 2024-04-16T15:52:51.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.813+0000 7f5167352640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5160067a00 0x7f5160157330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:51.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.813+0000 7f5167352640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f516015eaa0 0x7f516015f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:51.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.813+0000 7f5167352640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f516015ee80 0x7f51600cfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:51.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.813+0000 7f5167352640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f5160070630 con 0x7f516015eaa0 2024-04-16T15:52:51.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.813+0000 7f5167352640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f516006f8f0 con 0x7f5160067a00 2024-04-16T15:52:51.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.813+0000 7f5167352640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f516006cf70 con 0x7f516015ee80 2024-04-16T15:52:51.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.813+0000 7f51648ed640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f516015eaa0 0x7f516015f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:51.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.813+0000 7f51648ed640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f516015eaa0 0x7f516015f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60260/0 (socket says 172.21.15.132:60260) 2024-04-16T15:52:51.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.813+0000 7f51648ed640 1 -- 172.21.15.132:0/2568040361 learned_addr learned my addr 172.21.15.132:0/2568040361 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:51.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.813+0000 7f51658ef640 1 --2- 172.21.15.132:0/2568040361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f516015ee80 0x7f51600cfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:51.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.813+0000 7f51650ee640 1 --2- 172.21.15.132:0/2568040361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5160067a00 0x7f5160157330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:51.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.813+0000 7f51648ed640 1 -- 172.21.15.132:0/2568040361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f516015ee80 msgr2=0x7f51600cfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:51.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.813+0000 7f51648ed640 1 --2- 172.21.15.132:0/2568040361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f516015ee80 0x7f51600cfeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:51.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.813+0000 7f51648ed640 1 -- 172.21.15.132:0/2568040361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5160067a00 msgr2=0x7f5160157330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:51.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.813+0000 7f51648ed640 1 --2- 172.21.15.132:0/2568040361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5160067a00 0x7f5160157330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:51.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.813+0000 7f51648ed640 1 -- 172.21.15.132:0/2568040361 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51600d0800 con 0x7f516015eaa0 2024-04-16T15:52:51.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.813+0000 7f51658ef640 1 --2- 172.21.15.132:0/2568040361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f516015ee80 0x7f51600cfeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:51.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.813+0000 7f51648ed640 1 --2- 172.21.15.132:0/2568040361 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f516015eaa0 0x7f516015f260 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f515000d7d0 tx=0x7f515000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:51.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.813+0000 7f5155ffb640 1 -- 172.21.15.132:0/2568040361 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5150004030 con 0x7f516015eaa0 2024-04-16T15:52:51.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.814+0000 7f5155ffb640 1 -- 172.21.15.132:0/2568040361 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51500041d0 con 0x7f516015eaa0 2024-04-16T15:52:51.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.814+0000 7f5155ffb640 1 -- 172.21.15.132:0/2568040361 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f515000b6c0 con 0x7f516015eaa0 2024-04-16T15:52:51.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.814+0000 7f5167352640 1 -- 172.21.15.132:0/2568040361 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5160155470 con 0x7f516015eaa0 2024-04-16T15:52:51.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.814+0000 7f5167352640 1 -- 172.21.15.132:0/2568040361 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f516015f7a0 con 0x7f516015eaa0 2024-04-16T15:52:51.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.815+0000 7f5167352640 1 -- 172.21.15.132:0/2568040361 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5160075510 con 0x7f516015eaa0 2024-04-16T15:52:51.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.815+0000 7f5155ffb640 1 -- 172.21.15.132:0/2568040361 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f515000b860 con 0x7f516015eaa0 2024-04-16T15:52:51.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.815+0000 7f5155ffb640 1 --2- 172.21.15.132:0/2568040361 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f514406c8f0 0x7f514406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:51.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.816+0000 7f5155ffb640 1 -- 172.21.15.132:0/2568040361 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f515008bd10 con 0x7f516015eaa0 2024-04-16T15:52:51.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.816+0000 7f51650ee640 1 --2- 172.21.15.132:0/2568040361 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f514406c8f0 0x7f514406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:51.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.816+0000 7f51650ee640 1 --2- 172.21.15.132:0/2568040361 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f514406c8f0 0x7f514406edb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f515c006fd0 tx=0x7f515c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:51.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.821+0000 7f5155ffb640 1 -- 172.21.15.132:0/2568040361 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f515005a1d0 con 0x7f516015eaa0 2024-04-16T15:52:51.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.993+0000 7f5167352640 1 -- 172.21.15.132:0/2568040361 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5160073400 con 0x7f516015eaa0 2024-04-16T15:52:51.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.993+0000 7f5155ffb640 1 -- 172.21.15.132:0/2568040361 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f5150059ad0 con 0x7f516015eaa0 2024-04-16T15:52:51.993 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2024-04-16T15:52:51.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.996+0000 7f5167352640 1 -- 172.21.15.132:0/2568040361 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f514406c8f0 msgr2=0x7f514406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:51.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.996+0000 7f5167352640 1 --2- 172.21.15.132:0/2568040361 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f514406c8f0 0x7f514406edb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f515c006fd0 tx=0x7f515c008040 comp rx=0 tx=0).stop 2024-04-16T15:52:51.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.996+0000 7f5167352640 1 -- 172.21.15.132:0/2568040361 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f516015eaa0 msgr2=0x7f516015f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:51.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.996+0000 7f5167352640 1 --2- 172.21.15.132:0/2568040361 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f516015eaa0 0x7f516015f260 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f515000d7d0 tx=0x7f515000dc90 comp rx=0 tx=0).stop 2024-04-16T15:52:51.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.996+0000 7f5167352640 1 -- 172.21.15.132:0/2568040361 shutdown_connections 2024-04-16T15:52:51.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.996+0000 7f5167352640 1 --2- 172.21.15.132:0/2568040361 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f514406c8f0 0x7f514406edb0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:51.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.996+0000 7f5167352640 1 --2- 172.21.15.132:0/2568040361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f516015ee80 0x7f51600cfeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:51.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.996+0000 7f5167352640 1 --2- 172.21.15.132:0/2568040361 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f516015eaa0 0x7f516015f260 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:51.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.996+0000 7f5167352640 1 --2- 172.21.15.132:0/2568040361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5160067a00 0x7f5160157330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:51.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.996+0000 7f5167352640 1 -- 172.21.15.132:0/2568040361 >> 172.21.15.132:0/2568040361 conn(0x7f5160072810 msgr2=0x7f516006ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:51.996 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.996+0000 7f5167352640 1 -- 172.21.15.132:0/2568040361 shutdown_connections 2024-04-16T15:52:51.996 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:51.996+0000 7f5167352640 1 -- 172.21.15.132:0/2568040361 wait complete. 2024-04-16T15:52:52.006 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T15:52:52.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.114+0000 7f51853e2640 1 Processor -- start 2024-04-16T15:52:52.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.114+0000 7f51853e2640 1 -- start start 2024-04-16T15:52:52.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.114+0000 7f51853e2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f518015ec20 0x7f51800d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:52.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.114+0000 7f51853e2640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f51800d2030 0x7f51800b7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:52.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.114+0000 7f51853e2640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51800d3850 con 0x7f51800d3340 2024-04-16T15:52:52.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.114+0000 7f51853e2640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f51800d3b30 con 0x7f51800d2030 2024-04-16T15:52:52.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.114+0000 7f51853e2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f51800d3e10 con 0x7f518015ec20 2024-04-16T15:52:52.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.114+0000 7f517e7fc640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f51800d3340 0x7f51800d1920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:46858/0 (socket says 172.21.15.132:46858) 2024-04-16T15:52:52.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.114+0000 7f517e7fc640 1 -- 172.21.15.132:0/3083761427 learned_addr learned my addr 172.21.15.132:0/3083761427 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:52.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.114+0000 7f517f7fe640 1 --2- 172.21.15.132:0/3083761427 >> v2:172.21.15.179:3300/0 conn(0x7f51800d2030 0x7f51800b7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:52.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.114+0000 7f517effd640 1 --2- 172.21.15.132:0/3083761427 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f518015ec20 0x7f51800d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:52.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.114+0000 7f517dffb640 1 -- 172.21.15.132:0/3083761427 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 970599709 0 0) 0x7f51800d3850 con 0x7f51800d3340 2024-04-16T15:52:52.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.114+0000 7f517dffb640 1 -- 172.21.15.132:0/3083761427 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5168003520 con 0x7f51800d3340 2024-04-16T15:52:52.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.115+0000 7f517f7fe640 1 -- 172.21.15.132:0/3083761427 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f518015ec20 msgr2=0x7f51800d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:52.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.115+0000 7f517f7fe640 1 --2- 172.21.15.132:0/3083761427 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f518015ec20 0x7f51800d2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:52.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.115+0000 7f517f7fe640 1 -- 172.21.15.132:0/3083761427 >> v1:172.21.15.132:6789/0 conn(0x7f51800d3340 legacy=0x7f51800d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:52.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.115+0000 7f517f7fe640 1 -- 172.21.15.132:0/3083761427 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51800d40f0 con 0x7f51800d2030 2024-04-16T15:52:52.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.115+0000 7f517effd640 1 --2- 172.21.15.132:0/3083761427 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f518015ec20 0x7f51800d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:52:52.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.115+0000 7f517f7fe640 1 --2- 172.21.15.132:0/3083761427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51800d2030 0x7f51800b7bb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5178009d90 tx=0x7f517802bf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=570a763c838882de server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:52.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.115+0000 7f517dffb640 1 -- 172.21.15.132:0/3083761427 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5178039070 con 0x7f51800d2030 2024-04-16T15:52:52.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.116+0000 7f517dffb640 1 -- 172.21.15.132:0/3083761427 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f517802cce0 con 0x7f51800d2030 2024-04-16T15:52:52.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.116+0000 7f517dffb640 1 -- 172.21.15.132:0/3083761427 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5178034640 con 0x7f51800d2030 2024-04-16T15:52:52.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.116+0000 7f51853e2640 1 -- 172.21.15.132:0/3083761427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51800d2030 msgr2=0x7f51800b7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:52.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.116+0000 7f51853e2640 1 --2- 172.21.15.132:0/3083761427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51800d2030 0x7f51800b7bb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5178009d90 tx=0x7f517802bf30 comp rx=0 tx=0).stop 2024-04-16T15:52:52.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.116+0000 7f51853e2640 1 -- 172.21.15.132:0/3083761427 shutdown_connections 2024-04-16T15:52:52.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.116+0000 7f51853e2640 1 --2- 172.21.15.132:0/3083761427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51800d2030 0x7f51800b7bb0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:52.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.116+0000 7f51853e2640 1 --2- 172.21.15.132:0/3083761427 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f518015ec20 0x7f51800d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:52.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.116+0000 7f51853e2640 1 -- 172.21.15.132:0/3083761427 >> 172.21.15.132:0/3083761427 conn(0x7f518006d2d0 msgr2=0x7f518006d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:52.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.116+0000 7f51853e2640 1 -- 172.21.15.132:0/3083761427 shutdown_connections 2024-04-16T15:52:52.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.116+0000 7f51853e2640 1 -- 172.21.15.132:0/3083761427 wait complete. 2024-04-16T15:52:52.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.117+0000 7f51853e2640 1 Processor -- start 2024-04-16T15:52:52.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.117+0000 7f51853e2640 1 -- start start 2024-04-16T15:52:52.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.118+0000 7f51853e2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51800d2030 0x7f51800b2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:52.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.118+0000 7f51853e2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51800d3340 0x7f51801e7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:52.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.118+0000 7f51853e2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f518015ec20 0x7f51801f4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:52.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.118+0000 7f51853e2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f51800cf3a0 con 0x7f518015ec20 2024-04-16T15:52:52.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.118+0000 7f51853e2640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f518015f000 con 0x7f51800d3340 2024-04-16T15:52:52.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.118+0000 7f51853e2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f51800cf520 con 0x7f51800d2030 2024-04-16T15:52:52.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.118+0000 7f517f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f518015ec20 0x7f51801f4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:52.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.118+0000 7f517f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f518015ec20 0x7f51801f4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60274/0 (socket says 172.21.15.132:60274) 2024-04-16T15:52:52.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.118+0000 7f517f7fe640 1 -- 172.21.15.132:0/2859832295 learned_addr learned my addr 172.21.15.132:0/2859832295 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:52.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.119+0000 7f517effd640 1 --2- 172.21.15.132:0/2859832295 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51800d2030 0x7f51800b2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:52.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.119+0000 7f517e7fc640 1 --2- 172.21.15.132:0/2859832295 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51800d3340 0x7f51801e7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:52.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.119+0000 7f517f7fe640 1 -- 172.21.15.132:0/2859832295 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51800d2030 msgr2=0x7f51800b2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:52.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.119+0000 7f517f7fe640 1 --2- 172.21.15.132:0/2859832295 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51800d2030 0x7f51800b2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:52.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.119+0000 7f517f7fe640 1 -- 172.21.15.132:0/2859832295 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51800d3340 msgr2=0x7f51801e7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:52.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.119+0000 7f517f7fe640 1 --2- 172.21.15.132:0/2859832295 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51800d3340 0x7f51801e7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:52.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.119+0000 7f517f7fe640 1 -- 172.21.15.132:0/2859832295 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51800b2bc0 con 0x7f518015ec20 2024-04-16T15:52:52.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.119+0000 7f517effd640 1 --2- 172.21.15.132:0/2859832295 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51800d2030 0x7f51800b2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:52:52.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.119+0000 7f517e7fc640 1 --2- 172.21.15.132:0/2859832295 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51800d3340 0x7f51801e7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:52:52.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.119+0000 7f517f7fe640 1 --2- 172.21.15.132:0/2859832295 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f518015ec20 0x7f51801f4770 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5178009eb0 tx=0x7f5178004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:52.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.119+0000 7f51677fe640 1 -- 172.21.15.132:0/2859832295 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5178039050 con 0x7f518015ec20 2024-04-16T15:52:52.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.119+0000 7f51677fe640 1 -- 172.21.15.132:0/2859832295 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5178045070 con 0x7f518015ec20 2024-04-16T15:52:52.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.119+0000 7f51853e2640 1 -- 172.21.15.132:0/2859832295 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51801e87d0 con 0x7f518015ec20 2024-04-16T15:52:52.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.119+0000 7f51677fe640 1 -- 172.21.15.132:0/2859832295 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5178009450 con 0x7f518015ec20 2024-04-16T15:52:52.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.119+0000 7f51853e2640 1 -- 172.21.15.132:0/2859832295 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51801e8d90 con 0x7f518015ec20 2024-04-16T15:52:52.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.120+0000 7f51853e2640 1 -- 172.21.15.132:0/2859832295 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5180075510 con 0x7f518015ec20 2024-04-16T15:52:52.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.120+0000 7f51677fe640 1 -- 172.21.15.132:0/2859832295 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f517803e830 con 0x7f518015ec20 2024-04-16T15:52:52.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.121+0000 7f51677fe640 1 --2- 172.21.15.132:0/2859832295 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f516c06c8f0 0x7f516c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:52.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.121+0000 7f51677fe640 1 -- 172.21.15.132:0/2859832295 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f51780ae7b0 con 0x7f518015ec20 2024-04-16T15:52:52.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.121+0000 7f517effd640 1 --2- 172.21.15.132:0/2859832295 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f516c06c8f0 0x7f516c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:52.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.121+0000 7f517effd640 1 --2- 172.21.15.132:0/2859832295 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f516c06c8f0 0x7f516c06edb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5170009a20 tx=0x7f5170008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:52.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.125+0000 7f51677fe640 1 -- 172.21.15.132:0/2859832295 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f51800b2bc0 con 0x7f518015ec20 2024-04-16T15:52:52.300 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.301+0000 7f51853e2640 1 -- 172.21.15.132:0/2859832295 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f51800cf180 con 0x7f518015ec20 2024-04-16T15:52:52.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.302+0000 7f51677fe640 1 -- 172.21.15.132:0/2859832295 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f5178032e20 con 0x7f518015ec20 2024-04-16T15:52:52.301 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2024-04-16T15:52:52.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.304+0000 7f51853e2640 1 -- 172.21.15.132:0/2859832295 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f516c06c8f0 msgr2=0x7f516c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:52.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.304+0000 7f51853e2640 1 --2- 172.21.15.132:0/2859832295 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f516c06c8f0 0x7f516c06edb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5170009a20 tx=0x7f5170008040 comp rx=0 tx=0).stop 2024-04-16T15:52:52.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.304+0000 7f51853e2640 1 -- 172.21.15.132:0/2859832295 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f518015ec20 msgr2=0x7f51801f4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:52.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.304+0000 7f51853e2640 1 --2- 172.21.15.132:0/2859832295 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f518015ec20 0x7f51801f4770 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5178009eb0 tx=0x7f5178004a40 comp rx=0 tx=0).stop 2024-04-16T15:52:52.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.304+0000 7f51853e2640 1 -- 172.21.15.132:0/2859832295 shutdown_connections 2024-04-16T15:52:52.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.304+0000 7f51853e2640 1 --2- 172.21.15.132:0/2859832295 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f516c06c8f0 0x7f516c06edb0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:52.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.304+0000 7f51853e2640 1 --2- 172.21.15.132:0/2859832295 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f518015ec20 0x7f51801f4770 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:52.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.304+0000 7f51853e2640 1 --2- 172.21.15.132:0/2859832295 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51800d3340 0x7f51801e7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:52.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.304+0000 7f51853e2640 1 --2- 172.21.15.132:0/2859832295 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51800d2030 0x7f51800b2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:52.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.304+0000 7f51853e2640 1 -- 172.21.15.132:0/2859832295 >> 172.21.15.132:0/2859832295 conn(0x7f518006d2d0 msgr2=0x7f51800b4b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:52.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.304+0000 7f51853e2640 1 -- 172.21.15.132:0/2859832295 shutdown_connections 2024-04-16T15:52:52.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.304+0000 7f51853e2640 1 -- 172.21.15.132:0/2859832295 wait complete. 2024-04-16T15:52:52.314 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T15:52:52.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.420+0000 7fd62c688640 1 Processor -- start 2024-04-16T15:52:52.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.420+0000 7fd62c688640 1 -- start start 2024-04-16T15:52:52.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.421+0000 7fd62c688640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd62415cc10 0x7fd6240b3540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:52.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.421+0000 7fd62c688640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd624072b00 con 0x7fd6240ccf00 2024-04-16T15:52:52.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.421+0000 7fd62c688640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6240b4bb0 con 0x7fd62415c830 2024-04-16T15:52:52.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.421+0000 7fd62c688640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fd6240cda60 con 0x7fd62415cc10 2024-04-16T15:52:52.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.421+0000 7fd629c23640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd62415cc10 0x7fd6240b3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:52.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.421+0000 7fd62ac25640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fd6240ccf00 0x7fd6240b3a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:46872/0 (socket says 172.21.15.132:46872) 2024-04-16T15:52:52.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.421+0000 7fd62ac25640 1 -- 172.21.15.132:0/3637028533 learned_addr learned my addr 172.21.15.132:0/3637028533 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:52.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.422+0000 7fd629c23640 1 -- 172.21.15.132:0/3637028533 >> v1:172.21.15.179:6789/0 conn(0x7fd62415c830 legacy=0x7fd6240cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:52.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.422+0000 7fd629c23640 1 -- 172.21.15.132:0/3637028533 >> v1:172.21.15.132:6789/0 conn(0x7fd6240ccf00 legacy=0x7fd6240b3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:52.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.422+0000 7fd629c23640 1 -- 172.21.15.132:0/3637028533 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6240b4e90 con 0x7fd62415cc10 2024-04-16T15:52:52.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.422+0000 7fd629422640 1 -- 172.21.15.132:0/3637028533 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3785660014 0 0) 0x7fd624072b00 con 0x7fd6240ccf00 2024-04-16T15:52:52.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.422+0000 7fd629c23640 1 --2- 172.21.15.132:0/3637028533 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd62415cc10 0x7fd6240b3540 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd6140097a0 tx=0x7fd61402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fce5fd134afff7af server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:52.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.422+0000 7fd629422640 1 -- 172.21.15.132:0/3637028533 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6140315a0 con 0x7fd62415cc10 2024-04-16T15:52:52.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.422+0000 7fd629422640 1 -- 172.21.15.132:0/3637028533 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd614037070 con 0x7fd62415cc10 2024-04-16T15:52:52.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.423+0000 7fd629422640 1 -- 172.21.15.132:0/3637028533 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd614031960 con 0x7fd62415cc10 2024-04-16T15:52:52.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.423+0000 7fd62c688640 1 -- 172.21.15.132:0/3637028533 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd62415cc10 msgr2=0x7fd6240b3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:52.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.423+0000 7fd62c688640 1 --2- 172.21.15.132:0/3637028533 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd62415cc10 0x7fd6240b3540 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd6140097a0 tx=0x7fd61402b840 comp rx=0 tx=0).stop 2024-04-16T15:52:52.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.423+0000 7fd62c688640 1 -- 172.21.15.132:0/3637028533 shutdown_connections 2024-04-16T15:52:52.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.423+0000 7fd62c688640 1 --2- 172.21.15.132:0/3637028533 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd62415cc10 0x7fd6240b3540 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:52.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.423+0000 7fd62c688640 1 -- 172.21.15.132:0/3637028533 >> 172.21.15.132:0/3637028533 conn(0x7fd6240d0490 msgr2=0x7fd6240d08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:52.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.423+0000 7fd62c688640 1 -- 172.21.15.132:0/3637028533 shutdown_connections 2024-04-16T15:52:52.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.423+0000 7fd62c688640 1 -- 172.21.15.132:0/3637028533 wait complete. 2024-04-16T15:52:52.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.424+0000 7fd62c688640 1 Processor -- start 2024-04-16T15:52:52.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.424+0000 7fd62c688640 1 -- start start 2024-04-16T15:52:52.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.425+0000 7fd62c688640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd6240ccf00 0x7fd624148cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:52.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.425+0000 7fd62c688640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd62415c830 0x7fd6240acc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:52.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.425+0000 7fd62c688640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd62415cc10 0x7fd6240ab0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:52.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.425+0000 7fd62c688640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fd6240cdef0 con 0x7fd62415c830 2024-04-16T15:52:52.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.425+0000 7fd62c688640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd6240b5480 con 0x7fd6240ccf00 2024-04-16T15:52:52.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.425+0000 7fd62c688640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fd624149640 con 0x7fd62415cc10 2024-04-16T15:52:52.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.425+0000 7fd629c23640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd62415c830 0x7fd6240acc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:52.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.425+0000 7fd629c23640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd62415c830 0x7fd6240acc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60294/0 (socket says 172.21.15.132:60294) 2024-04-16T15:52:52.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.425+0000 7fd629c23640 1 -- 172.21.15.132:0/2664059446 learned_addr learned my addr 172.21.15.132:0/2664059446 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:52.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.425+0000 7fd629c23640 1 -- 172.21.15.132:0/2664059446 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd62415cc10 msgr2=0x7fd6240ab0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:52.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.425+0000 7fd629c23640 1 --2- 172.21.15.132:0/2664059446 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd62415cc10 0x7fd6240ab0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:52.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.425+0000 7fd629c23640 1 -- 172.21.15.132:0/2664059446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd6240ccf00 msgr2=0x7fd624148cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:52.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.425+0000 7fd629c23640 1 --2- 172.21.15.132:0/2664059446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd6240ccf00 0x7fd624148cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:52.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.425+0000 7fd629c23640 1 -- 172.21.15.132:0/2664059446 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd624149920 con 0x7fd62415c830 2024-04-16T15:52:52.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.426+0000 7fd629c23640 1 --2- 172.21.15.132:0/2664059446 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd62415c830 0x7fd6240acc50 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd614034040 tx=0x7fd6140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:52.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.426+0000 7fd61affd640 1 -- 172.21.15.132:0/2664059446 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd614049070 con 0x7fd62415c830 2024-04-16T15:52:52.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.426+0000 7fd61affd640 1 -- 172.21.15.132:0/2664059446 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd614032640 con 0x7fd62415c830 2024-04-16T15:52:52.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.426+0000 7fd62c688640 1 -- 172.21.15.132:0/2664059446 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd624149c00 con 0x7fd62415c830 2024-04-16T15:52:52.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.426+0000 7fd61affd640 1 -- 172.21.15.132:0/2664059446 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd614032a50 con 0x7fd62415c830 2024-04-16T15:52:52.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.426+0000 7fd62c688640 1 -- 172.21.15.132:0/2664059446 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd62414a1c0 con 0x7fd62415c830 2024-04-16T15:52:52.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.427+0000 7fd62c688640 1 -- 172.21.15.132:0/2664059446 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd624075510 con 0x7fd62415c830 2024-04-16T15:52:52.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.427+0000 7fd61affd640 1 -- 172.21.15.132:0/2664059446 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd614032bf0 con 0x7fd62415c830 2024-04-16T15:52:52.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.428+0000 7fd61affd640 1 --2- 172.21.15.132:0/2664059446 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fd60806c8f0 0x7fd60806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:52.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.428+0000 7fd61affd640 1 -- 172.21.15.132:0/2664059446 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd61402f020 con 0x7fd62415c830 2024-04-16T15:52:52.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.428+0000 7fd62a424640 1 --2- 172.21.15.132:0/2664059446 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fd60806c8f0 0x7fd60806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:52.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.428+0000 7fd62a424640 1 --2- 172.21.15.132:0/2664059446 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fd60806c8f0 0x7fd60806edb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd6200043c0 tx=0x7fd620007d30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:52.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.433+0000 7fd61affd640 1 -- 172.21.15.132:0/2664059446 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd61407b810 con 0x7fd62415c830 2024-04-16T15:52:52.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.607+0000 7fd62c688640 1 -- 172.21.15.132:0/2664059446 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd6240d0fb0 con 0x7fd62415c830 2024-04-16T15:52:52.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.607+0000 7fd61affd640 1 -- 172.21.15.132:0/2664059446 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fd61407b110 con 0x7fd62415c830 2024-04-16T15:52:52.607 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2024-04-16T15:52:52.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.609+0000 7fd62c688640 1 -- 172.21.15.132:0/2664059446 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fd60806c8f0 msgr2=0x7fd60806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:52.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.609+0000 7fd62c688640 1 --2- 172.21.15.132:0/2664059446 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fd60806c8f0 0x7fd60806edb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd6200043c0 tx=0x7fd620007d30 comp rx=0 tx=0).stop 2024-04-16T15:52:52.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.609+0000 7fd62c688640 1 -- 172.21.15.132:0/2664059446 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd62415c830 msgr2=0x7fd6240acc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:52.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.609+0000 7fd62c688640 1 --2- 172.21.15.132:0/2664059446 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd62415c830 0x7fd6240acc50 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd614034040 tx=0x7fd6140046c0 comp rx=0 tx=0).stop 2024-04-16T15:52:52.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.609+0000 7fd62c688640 1 -- 172.21.15.132:0/2664059446 shutdown_connections 2024-04-16T15:52:52.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.609+0000 7fd62c688640 1 --2- 172.21.15.132:0/2664059446 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fd60806c8f0 0x7fd60806edb0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:52.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.609+0000 7fd62c688640 1 --2- 172.21.15.132:0/2664059446 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd62415cc10 0x7fd6240ab0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:52.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.609+0000 7fd62c688640 1 --2- 172.21.15.132:0/2664059446 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd62415c830 0x7fd6240acc50 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:52.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.609+0000 7fd62c688640 1 --2- 172.21.15.132:0/2664059446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd6240ccf00 0x7fd624148cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:52.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.609+0000 7fd62c688640 1 -- 172.21.15.132:0/2664059446 >> 172.21.15.132:0/2664059446 conn(0x7fd6240d0490 msgr2=0x7fd624158c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:52.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.609+0000 7fd62c688640 1 -- 172.21.15.132:0/2664059446 shutdown_connections 2024-04-16T15:52:52.610 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.609+0000 7fd62c688640 1 -- 172.21.15.132:0/2664059446 wait complete. 2024-04-16T15:52:52.620 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-16T15:52:52.725 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.726+0000 7f456bef8640 1 Processor -- start 2024-04-16T15:52:52.725 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.726+0000 7f456bef8640 1 -- start start 2024-04-16T15:52:52.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.727+0000 7f456bef8640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4564155f90 0x7f456415ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:52.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.727+0000 7f456bef8640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45640701a0 con 0x7f4564155bb0 2024-04-16T15:52:52.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.727+0000 7f456bef8640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f456406eea0 con 0x7f456406c130 2024-04-16T15:52:52.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.727+0000 7f456bef8640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f456406e600 con 0x7f4564155f90 2024-04-16T15:52:52.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.727+0000 7f4569c94640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f4564155bb0 0x7f456406ba20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:46876/0 (socket says 172.21.15.132:46876) 2024-04-16T15:52:52.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.727+0000 7f4569c94640 1 -- 172.21.15.132:0/984746987 learned_addr learned my addr 172.21.15.132:0/984746987 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:52.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.727+0000 7f4569493640 1 --2- 172.21.15.132:0/984746987 >> v2:172.21.15.179:3300/0 conn(0x7f4564155f90 0x7f456415ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:52.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.727+0000 7f4568c92640 1 -- 172.21.15.132:0/984746987 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3316551973 0 0) 0x7f45640701a0 con 0x7f4564155bb0 2024-04-16T15:52:52.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.727+0000 7f4568c92640 1 -- 172.21.15.132:0/984746987 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4550003520 con 0x7f4564155bb0 2024-04-16T15:52:52.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.727+0000 7f4568c92640 1 -- 172.21.15.132:0/984746987 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2161711187 0 0) 0x7f4550003520 con 0x7f4564155bb0 2024-04-16T15:52:52.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.727+0000 7f4568c92640 1 -- 172.21.15.132:0/984746987 >> v2:172.21.15.179:3300/0 conn(0x7f4564155f90 msgr2=0x7f456415ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:52.730 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.727+0000 7f4568c92640 1 --2- 172.21.15.132:0/984746987 >> v2:172.21.15.179:3300/0 conn(0x7f4564155f90 0x7f456415ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:52.730 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.727+0000 7f4568c92640 1 -- 172.21.15.132:0/984746987 >> v1:172.21.15.179:6789/0 conn(0x7f456406c130 legacy=0x7f456415e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:52.730 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.727+0000 7f4568c92640 1 -- 172.21.15.132:0/984746987 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f456406e8e0 con 0x7f4564155bb0 2024-04-16T15:52:52.730 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.727+0000 7f4568c92640 1 -- 172.21.15.132:0/984746987 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2803668828 0 0) 0x7f4560001670 con 0x7f4564155bb0 2024-04-16T15:52:52.730 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.727+0000 7f4568c92640 1 -- 172.21.15.132:0/984746987 >> v1:172.21.15.132:6789/0 conn(0x7f4564155bb0 legacy=0x7f456406ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:52.730 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.727+0000 7f4568c92640 1 --2- 172.21.15.132:0/984746987 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45500039b0 0x7f4550003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:52.730 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.727+0000 7f4568c92640 1 --2- 172.21.15.132:0/984746987 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4550004800 0x7f4550004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:52.730 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.727+0000 7f4568c92640 1 --2- 172.21.15.132:0/984746987 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45500051c0 0x7f455000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:52.730 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.727+0000 7f4568c92640 1 -- 172.21.15.132:0/984746987 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f456406e600 con 0x7f4550004800 2024-04-16T15:52:52.730 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.727+0000 7f4568c92640 1 -- 172.21.15.132:0/984746987 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f455000c060 con 0x7f45500051c0 2024-04-16T15:52:52.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.727+0000 7f4568c92640 1 -- 172.21.15.132:0/984746987 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f455000c260 con 0x7f45500039b0 2024-04-16T15:52:52.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.728+0000 7f4569493640 1 --2- 172.21.15.132:0/984746987 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4550004800 0x7f4550004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:52.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.728+0000 7f4569c94640 1 --2- 172.21.15.132:0/984746987 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45500039b0 0x7f4550003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:52.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.728+0000 7f456a495640 1 --2- 172.21.15.132:0/984746987 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45500051c0 0x7f455000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:52.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.728+0000 7f4569493640 1 -- 172.21.15.132:0/984746987 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45500039b0 msgr2=0x7f4550003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:52.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.728+0000 7f4569493640 1 --2- 172.21.15.132:0/984746987 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45500039b0 0x7f4550003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:52.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.728+0000 7f4569493640 1 -- 172.21.15.132:0/984746987 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45500051c0 msgr2=0x7f455000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:52.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.728+0000 7f4569493640 1 --2- 172.21.15.132:0/984746987 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45500051c0 0x7f455000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:52.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.728+0000 7f4569493640 1 -- 172.21.15.132:0/984746987 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4550003520 con 0x7f4550004800 2024-04-16T15:52:52.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.728+0000 7f4569c94640 1 --2- 172.21.15.132:0/984746987 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45500039b0 0x7f4550003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:52.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.728+0000 7f456a495640 1 --2- 172.21.15.132:0/984746987 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45500051c0 0x7f455000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:52.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.728+0000 7f456a495640 1 -- 172.21.15.132:0/984746987 reap_dead start 2024-04-16T15:52:52.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.728+0000 7f4569493640 1 --2- 172.21.15.132:0/984746987 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4550004800 0x7f4550004c80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4554009ac0 tx=0x7f4550005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6281d1dae818cb6 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:52.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.729+0000 7f4568c92640 1 -- 172.21.15.132:0/984746987 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4554039070 con 0x7f4550004800 2024-04-16T15:52:52.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.729+0000 7f4568c92640 1 -- 172.21.15.132:0/984746987 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f455402c6b0 con 0x7f4550004800 2024-04-16T15:52:52.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.729+0000 7f4568c92640 1 -- 172.21.15.132:0/984746987 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4554009690 con 0x7f4550004800 2024-04-16T15:52:52.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.729+0000 7f456bef8640 1 -- 172.21.15.132:0/984746987 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4550004800 msgr2=0x7f4550004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:52.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.729+0000 7f456bef8640 1 --2- 172.21.15.132:0/984746987 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4550004800 0x7f4550004c80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4554009ac0 tx=0x7f4550005830 comp rx=0 tx=0).stop 2024-04-16T15:52:52.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.729+0000 7f456bef8640 1 -- 172.21.15.132:0/984746987 shutdown_connections 2024-04-16T15:52:52.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.729+0000 7f456bef8640 1 --2- 172.21.15.132:0/984746987 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4550004800 0x7f4550004c80 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:52.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.729+0000 7f456bef8640 1 -- 172.21.15.132:0/984746987 >> 172.21.15.132:0/984746987 conn(0x7f4564067ff0 msgr2=0x7f45640b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:52.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.729+0000 7f456bef8640 1 -- 172.21.15.132:0/984746987 shutdown_connections 2024-04-16T15:52:52.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.729+0000 7f456bef8640 1 -- 172.21.15.132:0/984746987 wait complete. 2024-04-16T15:52:52.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.730+0000 7f456bef8640 1 Processor -- start 2024-04-16T15:52:52.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.730+0000 7f456bef8640 1 -- start start 2024-04-16T15:52:52.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.731+0000 7f456bef8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4550004800 0x7f4564140dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:52.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.731+0000 7f456bef8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45641590e0 0x7f4564159560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:52.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.731+0000 7f456bef8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45640b4ea0 0x7f45640b5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:52.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.731+0000 7f456bef8640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f456415ce90 con 0x7f45640b4ea0 2024-04-16T15:52:52.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.731+0000 7f456bef8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f45640ce4e0 con 0x7f4550004800 2024-04-16T15:52:52.737 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.731+0000 7f456bef8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f456415d010 con 0x7f45641590e0 2024-04-16T15:52:52.737 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.731+0000 7f456a495640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45640b4ea0 0x7f45640b5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:52.737 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.731+0000 7f456a495640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45640b4ea0 0x7f45640b5320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60324/0 (socket says 172.21.15.132:60324) 2024-04-16T15:52:52.737 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.731+0000 7f456a495640 1 -- 172.21.15.132:0/3992368091 learned_addr learned my addr 172.21.15.132:0/3992368091 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:52.737 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.731+0000 7f4569493640 1 --2- 172.21.15.132:0/3992368091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45641590e0 0x7f4564159560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:52.737 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.731+0000 7f4569c94640 1 --2- 172.21.15.132:0/3992368091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4550004800 0x7f4564140dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:52.737 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.732+0000 7f456a495640 1 -- 172.21.15.132:0/3992368091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45641590e0 msgr2=0x7f4564159560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:52.737 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.732+0000 7f456a495640 1 --2- 172.21.15.132:0/3992368091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45641590e0 0x7f4564159560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:52.737 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.732+0000 7f456a495640 1 -- 172.21.15.132:0/3992368091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4550004800 msgr2=0x7f4564140dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:52.737 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.732+0000 7f456a495640 1 --2- 172.21.15.132:0/3992368091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4550004800 0x7f4564140dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:52.737 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.732+0000 7f456a495640 1 -- 172.21.15.132:0/3992368091 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45641f48c0 con 0x7f45640b4ea0 2024-04-16T15:52:52.737 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.732+0000 7f4569493640 1 --2- 172.21.15.132:0/3992368091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45641590e0 0x7f4564159560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:52:52.737 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.732+0000 7f4569c94640 1 --2- 172.21.15.132:0/3992368091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4550004800 0x7f4564140dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:52:52.738 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.732+0000 7f456a495640 1 --2- 172.21.15.132:0/3992368091 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45640b4ea0 0x7f45640b5320 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f45640b2e50 tx=0x7f455c010b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:52.738 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.732+0000 7f455a7fc640 1 -- 172.21.15.132:0/3992368091 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f455c003b70 con 0x7f45640b4ea0 2024-04-16T15:52:52.738 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.732+0000 7f455a7fc640 1 -- 172.21.15.132:0/3992368091 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f455c003d10 con 0x7f45640b4ea0 2024-04-16T15:52:52.738 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.732+0000 7f455a7fc640 1 -- 172.21.15.132:0/3992368091 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f455c00ea60 con 0x7f45640b4ea0 2024-04-16T15:52:52.738 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.732+0000 7f456bef8640 1 -- 172.21.15.132:0/3992368091 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45641f4ba0 con 0x7f45640b4ea0 2024-04-16T15:52:52.738 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.732+0000 7f456bef8640 1 -- 172.21.15.132:0/3992368091 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45641f5160 con 0x7f45640b4ea0 2024-04-16T15:52:52.738 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.733+0000 7f456bef8640 1 -- 172.21.15.132:0/3992368091 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4564075510 con 0x7f45640b4ea0 2024-04-16T15:52:52.738 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.734+0000 7f455a7fc640 1 -- 172.21.15.132:0/3992368091 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f455c00ec00 con 0x7f45640b4ea0 2024-04-16T15:52:52.738 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.734+0000 7f455a7fc640 1 --2- 172.21.15.132:0/3992368091 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f454806c920 0x7f454806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:52.738 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.734+0000 7f455a7fc640 1 -- 172.21.15.132:0/3992368091 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f455c08dc80 con 0x7f45640b4ea0 2024-04-16T15:52:52.738 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.734+0000 7f4569c94640 1 --2- 172.21.15.132:0/3992368091 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f454806c920 0x7f454806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:52.738 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.734+0000 7f4569c94640 1 --2- 172.21.15.132:0/3992368091 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f454806c920 0x7f454806ede0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4560001eb0 tx=0x7f4560000ed0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:52.739 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.738+0000 7f455a7fc640 1 -- 172.21.15.132:0/3992368091 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f455c016030 con 0x7f45640b4ea0 2024-04-16T15:52:52.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.923+0000 7f456bef8640 1 -- 172.21.15.132:0/3992368091 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f456406f580 con 0x7f45640b4ea0 2024-04-16T15:52:52.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.923+0000 7f455a7fc640 1 -- 172.21.15.132:0/3992368091 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7f455c05c140 con 0x7f45640b4ea0 2024-04-16T15:52:52.922 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2024-04-16T15:52:52.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.925+0000 7f456bef8640 1 -- 172.21.15.132:0/3992368091 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f454806c920 msgr2=0x7f454806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:52.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.925+0000 7f456bef8640 1 --2- 172.21.15.132:0/3992368091 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f454806c920 0x7f454806ede0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4560001eb0 tx=0x7f4560000ed0 comp rx=0 tx=0).stop 2024-04-16T15:52:52.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.925+0000 7f456bef8640 1 -- 172.21.15.132:0/3992368091 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45640b4ea0 msgr2=0x7f45640b5320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:52.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.925+0000 7f456bef8640 1 --2- 172.21.15.132:0/3992368091 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45640b4ea0 0x7f45640b5320 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f45640b2e50 tx=0x7f455c010b70 comp rx=0 tx=0).stop 2024-04-16T15:52:52.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.925+0000 7f456bef8640 1 -- 172.21.15.132:0/3992368091 shutdown_connections 2024-04-16T15:52:52.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.925+0000 7f456bef8640 1 --2- 172.21.15.132:0/3992368091 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f454806c920 0x7f454806ede0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:52.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.925+0000 7f456bef8640 1 --2- 172.21.15.132:0/3992368091 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45640b4ea0 0x7f45640b5320 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:52.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.925+0000 7f456bef8640 1 --2- 172.21.15.132:0/3992368091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45641590e0 0x7f4564159560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:52.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.925+0000 7f456bef8640 1 --2- 172.21.15.132:0/3992368091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4550004800 0x7f4564140dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:52.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.925+0000 7f456bef8640 1 -- 172.21.15.132:0/3992368091 >> 172.21.15.132:0/3992368091 conn(0x7f4564067ff0 msgr2=0x7f4564154790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:52.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.925+0000 7f456bef8640 1 -- 172.21.15.132:0/3992368091 shutdown_connections 2024-04-16T15:52:52.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:52.925+0000 7f456bef8640 1 -- 172.21.15.132:0/3992368091 wait complete. 2024-04-16T15:52:52.935 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-16T15:52:52.935 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T15:52:52.952 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:52:53.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.097+0000 7fe42f274640 1 Processor -- start 2024-04-16T15:52:53.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.097+0000 7fe42f274640 1 -- start start 2024-04-16T15:52:53.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.098+0000 7fe42f274640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe42813f7f0 0x7fe4280b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:53.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.098+0000 7fe42f274640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4280cec80 0x7fe4281602b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:53.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.098+0000 7fe42f274640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe428142070 con 0x7fe4280b5e90 2024-04-16T15:52:53.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.098+0000 7fe42f274640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fe428142350 con 0x7fe42813f7f0 2024-04-16T15:52:53.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.098+0000 7fe42f274640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe428142630 con 0x7fe4280cec80 2024-04-16T15:52:53.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.098+0000 7fe42d010640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe42813f7f0 0x7fe4280b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:53.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.098+0000 7fe42c80f640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fe4280b5e90 0x7fe4280ce570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:46878/0 (socket says 172.21.15.132:46878) 2024-04-16T15:52:53.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.098+0000 7fe42c80f640 1 -- 172.21.15.132:0/985744628 learned_addr learned my addr 172.21.15.132:0/985744628 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:53.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.098+0000 7fe42d010640 1 -- 172.21.15.132:0/985744628 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4280cec80 msgr2=0x7fe4281602b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:53.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.099+0000 7fe42d811640 1 --2- 172.21.15.132:0/985744628 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4280cec80 0x7fe4281602b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:53.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.099+0000 7fe42d010640 1 --2- 172.21.15.132:0/985744628 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4280cec80 0x7fe4281602b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:53.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.099+0000 7fe42d010640 1 -- 172.21.15.132:0/985744628 >> v1:172.21.15.132:6789/0 conn(0x7fe4280b5e90 legacy=0x7fe4280ce570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:53.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.099+0000 7fe427fff640 1 -- 172.21.15.132:0/985744628 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 819107098 0 0) 0x7fe428142070 con 0x7fe4280b5e90 2024-04-16T15:52:53.100 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.099+0000 7fe42d010640 1 -- 172.21.15.132:0/985744628 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe42815ccc0 con 0x7fe42813f7f0 2024-04-16T15:52:53.100 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.099+0000 7fe42d811640 1 --2- 172.21.15.132:0/985744628 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4280cec80 0x7fe4281602b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:52:53.100 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.099+0000 7fe42d010640 1 --2- 172.21.15.132:0/985744628 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe42813f7f0 0x7fe4280b5950 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe418009d90 tx=0x7fe41802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b12e8e480a49cf9 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:53.100 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.099+0000 7fe427fff640 1 -- 172.21.15.132:0/985744628 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe418039070 con 0x7fe42813f7f0 2024-04-16T15:52:53.100 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.099+0000 7fe427fff640 1 -- 172.21.15.132:0/985744628 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe41802cc50 con 0x7fe42813f7f0 2024-04-16T15:52:53.100 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.099+0000 7fe427fff640 1 -- 172.21.15.132:0/985744628 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe418034440 con 0x7fe42813f7f0 2024-04-16T15:52:53.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.100+0000 7fe42f274640 1 -- 172.21.15.132:0/985744628 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe42813f7f0 msgr2=0x7fe4280b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:53.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.100+0000 7fe42f274640 1 --2- 172.21.15.132:0/985744628 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe42813f7f0 0x7fe4280b5950 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe418009d90 tx=0x7fe41802bea0 comp rx=0 tx=0).stop 2024-04-16T15:52:53.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.100+0000 7fe42f274640 1 -- 172.21.15.132:0/985744628 shutdown_connections 2024-04-16T15:52:53.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.100+0000 7fe42f274640 1 --2- 172.21.15.132:0/985744628 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4280cec80 0x7fe4281602b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:53.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.100+0000 7fe42f274640 1 --2- 172.21.15.132:0/985744628 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe42813f7f0 0x7fe4280b5950 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:53.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.100+0000 7fe42f274640 1 -- 172.21.15.132:0/985744628 >> 172.21.15.132:0/985744628 conn(0x7fe4280b2d50 msgr2=0x7fe42806ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:53.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.100+0000 7fe42f274640 1 -- 172.21.15.132:0/985744628 shutdown_connections 2024-04-16T15:52:53.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.100+0000 7fe42f274640 1 -- 172.21.15.132:0/985744628 wait complete. 2024-04-16T15:52:53.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.101+0000 7fe42f274640 1 Processor -- start 2024-04-16T15:52:53.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.101+0000 7fe42f274640 1 -- start start 2024-04-16T15:52:53.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.102+0000 7fe42f274640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4280b5e90 0x7fe4281f50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:53.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.102+0000 7fe42f274640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4280cec80 0x7fe428158070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:53.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.102+0000 7fe42f274640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe42813f7f0 0x7fe428141900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:53.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.102+0000 7fe42f274640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe428160c00 con 0x7fe4280b5e90 2024-04-16T15:52:53.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.102+0000 7fe42f274640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe428160a80 con 0x7fe42813f7f0 2024-04-16T15:52:53.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.102+0000 7fe42f274640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe428160d80 con 0x7fe4280cec80 2024-04-16T15:52:53.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.102+0000 7fe42d010640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4280b5e90 0x7fe4281f50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:53.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.102+0000 7fe42d010640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4280b5e90 0x7fe4281f50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60346/0 (socket says 172.21.15.132:60346) 2024-04-16T15:52:53.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.102+0000 7fe42d010640 1 -- 172.21.15.132:0/3572314712 learned_addr learned my addr 172.21.15.132:0/3572314712 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:53.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.102+0000 7fe42d010640 1 -- 172.21.15.132:0/3572314712 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4280cec80 msgr2=0x7fe428158070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:53.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.102+0000 7fe42d010640 1 --2- 172.21.15.132:0/3572314712 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4280cec80 0x7fe428158070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:53.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.102+0000 7fe42d010640 1 -- 172.21.15.132:0/3572314712 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe42813f7f0 msgr2=0x7fe428141900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:53.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.102+0000 7fe42d010640 1 --2- 172.21.15.132:0/3572314712 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe42813f7f0 0x7fe428141900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:53.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.102+0000 7fe42d010640 1 -- 172.21.15.132:0/3572314712 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4281f4020 con 0x7fe4280b5e90 2024-04-16T15:52:53.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.102+0000 7fe42d010640 1 --2- 172.21.15.132:0/3572314712 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4280b5e90 0x7fe4281f50c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe418009d90 tx=0x7fe418004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:53.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.103+0000 7fe425ffb640 1 -- 172.21.15.132:0/3572314712 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe418039050 con 0x7fe4280b5e90 2024-04-16T15:52:53.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.103+0000 7fe425ffb640 1 -- 172.21.15.132:0/3572314712 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe418045070 con 0x7fe4280b5e90 2024-04-16T15:52:53.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.103+0000 7fe42f274640 1 -- 172.21.15.132:0/3572314712 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4281f4300 con 0x7fe4280b5e90 2024-04-16T15:52:53.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.103+0000 7fe425ffb640 1 -- 172.21.15.132:0/3572314712 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe41803e850 con 0x7fe4280b5e90 2024-04-16T15:52:53.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.103+0000 7fe42f274640 1 -- 172.21.15.132:0/3572314712 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4281f48c0 con 0x7fe4280b5e90 2024-04-16T15:52:53.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.104+0000 7fe42f274640 1 -- 172.21.15.132:0/3572314712 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe428075510 con 0x7fe4280b5e90 2024-04-16T15:52:53.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.104+0000 7fe425ffb640 1 -- 172.21.15.132:0/3572314712 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe41802cad0 con 0x7fe4280b5e90 2024-04-16T15:52:53.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.105+0000 7fe425ffb640 1 --2- 172.21.15.132:0/3572314712 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fe41406c8f0 0x7fe41406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:53.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.105+0000 7fe425ffb640 1 -- 172.21.15.132:0/3572314712 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe4180ae8b0 con 0x7fe4280b5e90 2024-04-16T15:52:53.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.105+0000 7fe42c80f640 1 --2- 172.21.15.132:0/3572314712 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fe41406c8f0 0x7fe41406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:53.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.105+0000 7fe42c80f640 1 --2- 172.21.15.132:0/3572314712 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fe41406c8f0 0x7fe41406edb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe41c007fd0 tx=0x7fe41c007920 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:53.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.109+0000 7fe425ffb640 1 -- 172.21.15.132:0/3572314712 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe41807cd70 con 0x7fe4280b5e90 2024-04-16T15:52:53.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.289+0000 7fe42f274640 1 -- 172.21.15.132:0/3572314712 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe42806ed00 con 0x7fe4280b5e90 2024-04-16T15:52:53.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.290+0000 7fe425ffb640 1 -- 172.21.15.132:0/3572314712 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7fe41807c670 con 0x7fe4280b5e90 2024-04-16T15:52:53.289 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:52:53.289 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"6bdec5d9-f406-43ad-8584-0503b32f6f0d","created":"2024-04-16T15:51:51.073040+0000","modified":"2024-04-16T15:52:16.950186+0000","last_up_change":"2024-04-16T15:52:02.280496+0000","last_in_change":"2024-04-16T15:51:53.376468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:52:03.284927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:52:13.363758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T15:52:14.246647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d45908b-6e22-4619-b190-897af594b712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6801","nonce":1170594668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6803","nonce":1170594668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6807","nonce":1170594668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6805","nonce":1170594668}]},"public_addr":"172.21.15.132:6801/1170594668","cluster_addr":"172.21.15.132:6803/1170594668","heartbeat_back_addr":"172.21.15.132:6807/1170594668","heartbeat_front_addr":"172.21.15.132:6805/1170594668","state":["exists","up"]},{"osd":1,"uuid":"c88bf082-e51f-4ee6-815a-025f6ce0d67b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6809","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6811","nonce":2494780358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6815","nonce":2494780358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6823","nonce":2494780358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6819","nonce":2494780358}]},"public_addr":"172.21.15.132:6811/2494780358","cluster_addr":"172.21.15.132:6815/2494780358","heartbeat_back_addr":"172.21.15.132:6823/2494780358","heartbeat_front_addr":"172.21.15.132:6819/2494780358","state":["exists","up"]},{"osd":2,"uuid":"e5dbd6b4-4e7b-47e4-ad4e-35b4b81696c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6825","nonce":27655483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6827","nonce":27655483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6831","nonce":27655483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6829","nonce":27655483}]},"public_addr":"172.21.15.132:6825/27655483","cluster_addr":"172.21.15.132:6827/27655483","heartbeat_back_addr":"172.21.15.132:6831/27655483","heartbeat_front_addr":"172.21.15.132:6829/27655483","state":["exists","up"]},{"osd":3,"uuid":"9d75cd67-3b8a-4424-8884-5f3660e1f5f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6810","nonce":3100919191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6814","nonce":3100919191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6821","nonce":3100919191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6818","nonce":3100919191}]},"public_addr":"172.21.15.132:6810/3100919191","cluster_addr":"172.21.15.132:6814/3100919191","heartbeat_back_addr":"172.21.15.132:6821/3100919191","heartbeat_front_addr":"172.21.15.132:6818/3100919191","state":["exists","up"]},{"osd":4,"uuid":"83aea46a-8642-4777-912b-c130e5890da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6825","nonce":123637799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6827","nonce":123637799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6831","nonce":123637799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6829","nonce":123637799}]},"public_addr":"172.21.15.179:6825/123637799","cluster_addr":"172.21.15.179:6827/123637799","heartbeat_back_addr":"172.21.15.179:6831/123637799","heartbeat_front_addr":"172.21.15.179:6829/123637799","state":["exists","up"]},{"osd":5,"uuid":"534117c8-3317-48d6-b436-afd5709f71e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6801","nonce":2224750370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6803","nonce":2224750370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6807","nonce":2224750370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6805","nonce":2224750370}]},"public_addr":"172.21.15.179:6801/2224750370","cluster_addr":"172.21.15.179:6803/2224750370","heartbeat_back_addr":"172.21.15.179:6807/2224750370","heartbeat_front_addr":"172.21.15.179:6805/2224750370","state":["exists","up"]},{"osd":6,"uuid":"0ba363e7-fa9d-42b1-ae09-a6a0f57d41f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6809","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6811","nonce":101498164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6813","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6815","nonce":101498164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6823","nonce":101498164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6819","nonce":101498164}]},"public_addr":"172.21.15.179:6811/101498164","cluster_addr":"172.21.15.179:6815/101498164","heartbeat_back_addr":"172.21.15.179:6823/101498164","heartbeat_front_addr":"172.21.15.179:6819/101498164","state":["exists","up"]},{"osd":7,"uuid":"e6830c77-2f2d-4067-9866-ee7625afc1a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6810","nonce":872148365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6814","nonce":872148365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6822","nonce":872148365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6818","nonce":872148365}]},"public_addr":"172.21.15.179:6810/872148365","cluster_addr":"172.21.15.179:6814/872148365","heartbeat_back_addr":"172.21.15.179:6822/872148365","heartbeat_front_addr":"172.21.15.179:6818/872148365","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.535221+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.563769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.520765+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.526264+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.517058+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.500842+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.534332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.512486+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:52:53.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.292+0000 7fe42f274640 1 -- 172.21.15.132:0/3572314712 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fe41406c8f0 msgr2=0x7fe41406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:53.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.292+0000 7fe42f274640 1 --2- 172.21.15.132:0/3572314712 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fe41406c8f0 0x7fe41406edb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe41c007fd0 tx=0x7fe41c007920 comp rx=0 tx=0).stop 2024-04-16T15:52:53.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.292+0000 7fe42f274640 1 -- 172.21.15.132:0/3572314712 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4280b5e90 msgr2=0x7fe4281f50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:53.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.292+0000 7fe42f274640 1 --2- 172.21.15.132:0/3572314712 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4280b5e90 0x7fe4281f50c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe418009d90 tx=0x7fe418004a40 comp rx=0 tx=0).stop 2024-04-16T15:52:53.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.292+0000 7fe42f274640 1 -- 172.21.15.132:0/3572314712 shutdown_connections 2024-04-16T15:52:53.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.292+0000 7fe42f274640 1 --2- 172.21.15.132:0/3572314712 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fe41406c8f0 0x7fe41406edb0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:53.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.292+0000 7fe42f274640 1 --2- 172.21.15.132:0/3572314712 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe42813f7f0 0x7fe428141900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:53.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.292+0000 7fe42f274640 1 --2- 172.21.15.132:0/3572314712 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4280cec80 0x7fe428158070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:53.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.292+0000 7fe42f274640 1 --2- 172.21.15.132:0/3572314712 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4280b5e90 0x7fe4281f50c0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:53.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.292+0000 7fe42f274640 1 -- 172.21.15.132:0/3572314712 >> 172.21.15.132:0/3572314712 conn(0x7fe4280b2d50 msgr2=0x7fe4280b18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:53.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.292+0000 7fe42f274640 1 -- 172.21.15.132:0/3572314712 shutdown_connections 2024-04-16T15:52:53.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.292+0000 7fe42f274640 1 -- 172.21.15.132:0/3572314712 wait complete. 2024-04-16T15:52:53.303 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T15:52:03.284927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T15:52:13.363758+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T15:52:14.246647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T15:52:53.303 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T15:52:53.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.416+0000 7f9a2b669640 1 Processor -- start 2024-04-16T15:52:53.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.417+0000 7f9a2b669640 1 -- start start 2024-04-16T15:52:53.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.417+0000 7f9a2b669640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9a240d1920 0x7f9a240d1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:53.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.418+0000 7f9a2b669640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a240d3850 con 0x7f9a2415ec20 2024-04-16T15:52:53.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.418+0000 7f9a2b669640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a240d3b30 con 0x7f9a240b7bb0 2024-04-16T15:52:53.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.418+0000 7f9a2b669640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f9a240d22c0 con 0x7f9a240d1920 2024-04-16T15:52:53.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.418+0000 7f9a29405640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f9a2415ec20 0x7f9a240d2e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:46880/0 (socket says 172.21.15.132:46880) 2024-04-16T15:52:53.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.418+0000 7f9a29405640 1 -- 172.21.15.132:0/3256635843 learned_addr learned my addr 172.21.15.132:0/3256635843 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:53.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.418+0000 7f9a28c04640 1 --2- 172.21.15.132:0/3256635843 >> v2:172.21.15.179:3300/0 conn(0x7f9a240d1920 0x7f9a240d1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:53.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.418+0000 7f9a1bfff640 1 -- 172.21.15.132:0/3256635843 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 41387688 0 0) 0x7f9a240d3850 con 0x7f9a2415ec20 2024-04-16T15:52:53.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.418+0000 7f9a1bfff640 1 -- 172.21.15.132:0/3256635843 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a10003520 con 0x7f9a2415ec20 2024-04-16T15:52:53.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.418+0000 7f9a1bfff640 1 -- 172.21.15.132:0/3256635843 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1185852012 0 0) 0x7f9a10003520 con 0x7f9a2415ec20 2024-04-16T15:52:53.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.418+0000 7f9a1bfff640 1 -- 172.21.15.132:0/3256635843 >> v2:172.21.15.179:3300/0 conn(0x7f9a240d1920 msgr2=0x7f9a240d1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:53.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.418+0000 7f9a1bfff640 1 --2- 172.21.15.132:0/3256635843 >> v2:172.21.15.179:3300/0 conn(0x7f9a240d1920 0x7f9a240d1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:53.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.418+0000 7f9a1bfff640 1 -- 172.21.15.132:0/3256635843 >> v1:172.21.15.179:6789/0 conn(0x7f9a240b7bb0 legacy=0x7f9a240b8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:53.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.418+0000 7f9a1bfff640 1 -- 172.21.15.132:0/3256635843 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a240d3e10 con 0x7f9a2415ec20 2024-04-16T15:52:53.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.418+0000 7f9a1bfff640 1 -- 172.21.15.132:0/3256635843 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2803668828 0 0) 0x7f9a20001670 con 0x7f9a2415ec20 2024-04-16T15:52:53.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.418+0000 7f9a1bfff640 1 -- 172.21.15.132:0/3256635843 >> v1:172.21.15.132:6789/0 conn(0x7f9a2415ec20 legacy=0x7f9a240d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:53.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.418+0000 7f9a1bfff640 1 --2- 172.21.15.132:0/3256635843 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a100039b0 0x7f9a10003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:53.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.418+0000 7f9a1bfff640 1 --2- 172.21.15.132:0/3256635843 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a10004800 0x7f9a10004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:53.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.418+0000 7f9a1bfff640 1 --2- 172.21.15.132:0/3256635843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a100051c0 0x7f9a1000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:53.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.418+0000 7f9a1bfff640 1 -- 172.21.15.132:0/3256635843 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f9a1000c040 con 0x7f9a10004800 2024-04-16T15:52:53.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.418+0000 7f9a1bfff640 1 -- 172.21.15.132:0/3256635843 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9a1000c1f0 con 0x7f9a100051c0 2024-04-16T15:52:53.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.418+0000 7f9a1bfff640 1 -- 172.21.15.132:0/3256635843 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9a1000c3f0 con 0x7f9a100039b0 2024-04-16T15:52:53.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.419+0000 7f9a28c04640 1 --2- 172.21.15.132:0/3256635843 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a10004800 0x7f9a10004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:53.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.419+0000 7f9a29405640 1 --2- 172.21.15.132:0/3256635843 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a100039b0 0x7f9a10003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:53.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.419+0000 7f9a29c06640 1 --2- 172.21.15.132:0/3256635843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a100051c0 0x7f9a1000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:53.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.419+0000 7f9a28c04640 1 -- 172.21.15.132:0/3256635843 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a100039b0 msgr2=0x7f9a10003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:53.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.419+0000 7f9a28c04640 1 --2- 172.21.15.132:0/3256635843 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a100039b0 0x7f9a10003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:53.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.419+0000 7f9a28c04640 1 -- 172.21.15.132:0/3256635843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a100051c0 msgr2=0x7f9a1000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:53.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.419+0000 7f9a28c04640 1 --2- 172.21.15.132:0/3256635843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a100051c0 0x7f9a1000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:53.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.419+0000 7f9a28c04640 1 -- 172.21.15.132:0/3256635843 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a10003520 con 0x7f9a10004800 2024-04-16T15:52:53.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.419+0000 7f9a29c06640 1 -- 172.21.15.132:0/3256635843 reap_dead start 2024-04-16T15:52:53.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.419+0000 7f9a29405640 1 --2- 172.21.15.132:0/3256635843 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a100039b0 0x7f9a10003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:53.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.420+0000 7f9a28c04640 1 --2- 172.21.15.132:0/3256635843 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a10004800 0x7f9a10004c80 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9a14009ac0 tx=0x7f9a10005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c34e4ca38602dcf server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:53.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.420+0000 7f9a1bfff640 1 -- 172.21.15.132:0/3256635843 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a14039070 con 0x7f9a10004800 2024-04-16T15:52:53.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.420+0000 7f9a1bfff640 1 -- 172.21.15.132:0/3256635843 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a1402c6b0 con 0x7f9a10004800 2024-04-16T15:52:53.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.420+0000 7f9a1bfff640 1 -- 172.21.15.132:0/3256635843 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a14009690 con 0x7f9a10004800 2024-04-16T15:52:53.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.420+0000 7f9a2b669640 1 -- 172.21.15.132:0/3256635843 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a10004800 msgr2=0x7f9a10004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:53.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.420+0000 7f9a2b669640 1 --2- 172.21.15.132:0/3256635843 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a10004800 0x7f9a10004c80 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9a14009ac0 tx=0x7f9a10005830 comp rx=0 tx=0).stop 2024-04-16T15:52:53.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.420+0000 7f9a2b669640 1 -- 172.21.15.132:0/3256635843 shutdown_connections 2024-04-16T15:52:53.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.420+0000 7f9a2b669640 1 --2- 172.21.15.132:0/3256635843 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a10004800 0x7f9a10004c80 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:53.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.420+0000 7f9a2b669640 1 -- 172.21.15.132:0/3256635843 >> 172.21.15.132:0/3256635843 conn(0x7f9a2406d2d0 msgr2=0x7f9a2406d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:53.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.420+0000 7f9a2b669640 1 -- 172.21.15.132:0/3256635843 shutdown_connections 2024-04-16T15:52:53.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.420+0000 7f9a2b669640 1 -- 172.21.15.132:0/3256635843 wait complete. 2024-04-16T15:52:53.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.422+0000 7f9a2b669640 1 Processor -- start 2024-04-16T15:52:53.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.422+0000 7f9a2b669640 1 -- start start 2024-04-16T15:52:53.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.422+0000 7f9a2b669640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a10004800 0x7f9a2415ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:53.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.422+0000 7f9a2b669640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a240ccb50 0x7f9a24151df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:53.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.422+0000 7f9a2b669640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a240ce2f0 0x7f9a240cf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:53.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.422+0000 7f9a2b669640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f9a2415f000 con 0x7f9a10004800 2024-04-16T15:52:53.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.422+0000 7f9a2b669640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9a240d43d0 con 0x7f9a240ce2f0 2024-04-16T15:52:53.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.422+0000 7f9a2b669640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9a240cf3a0 con 0x7f9a240ccb50 2024-04-16T15:52:53.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.422+0000 7f9a29405640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a10004800 0x7f9a2415ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:53.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.422+0000 7f9a29405640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a10004800 0x7f9a2415ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60354/0 (socket says 172.21.15.132:60354) 2024-04-16T15:52:53.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.422+0000 7f9a29405640 1 -- 172.21.15.132:0/857892569 learned_addr learned my addr 172.21.15.132:0/857892569 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:53.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.423+0000 7f9a28c04640 1 --2- 172.21.15.132:0/857892569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a240ccb50 0x7f9a24151df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:53.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.423+0000 7f9a29c06640 1 --2- 172.21.15.132:0/857892569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a240ce2f0 0x7f9a240cf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:53.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.423+0000 7f9a29405640 1 -- 172.21.15.132:0/857892569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a240ccb50 msgr2=0x7f9a24151df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:53.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.423+0000 7f9a29405640 1 --2- 172.21.15.132:0/857892569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a240ccb50 0x7f9a24151df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:53.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.423+0000 7f9a29405640 1 -- 172.21.15.132:0/857892569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a240ce2f0 msgr2=0x7f9a240cf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:53.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.423+0000 7f9a29405640 1 --2- 172.21.15.132:0/857892569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a240ce2f0 0x7f9a240cf6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:53.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.423+0000 7f9a29405640 1 -- 172.21.15.132:0/857892569 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a240ccfd0 con 0x7f9a10004800 2024-04-16T15:52:53.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.423+0000 7f9a29c06640 1 --2- 172.21.15.132:0/857892569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a240ce2f0 0x7f9a240cf6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:53.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.423+0000 7f9a29405640 1 --2- 172.21.15.132:0/857892569 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a10004800 0x7f9a2415ae20 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9a20001ca0 tx=0x7f9a2000ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:53.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.423+0000 7f9a19ffb640 1 -- 172.21.15.132:0/857892569 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a2000ee60 con 0x7f9a10004800 2024-04-16T15:52:53.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.423+0000 7f9a19ffb640 1 -- 172.21.15.132:0/857892569 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a20018070 con 0x7f9a10004800 2024-04-16T15:52:53.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.423+0000 7f9a2b669640 1 -- 172.21.15.132:0/857892569 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a24152330 con 0x7f9a10004800 2024-04-16T15:52:53.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.423+0000 7f9a19ffb640 1 -- 172.21.15.132:0/857892569 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a2000caa0 con 0x7f9a10004800 2024-04-16T15:52:53.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.423+0000 7f9a2b669640 1 -- 172.21.15.132:0/857892569 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a240cd530 con 0x7f9a10004800 2024-04-16T15:52:53.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.424+0000 7f9a2b669640 1 -- 172.21.15.132:0/857892569 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a24075510 con 0x7f9a10004800 2024-04-16T15:52:53.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.425+0000 7f9a19ffb640 1 -- 172.21.15.132:0/857892569 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9a2000cc40 con 0x7f9a10004800 2024-04-16T15:52:53.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.425+0000 7f9a19ffb640 1 --2- 172.21.15.132:0/857892569 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f9a0806c8f0 0x7f9a0806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:53.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.425+0000 7f9a19ffb640 1 -- 172.21.15.132:0/857892569 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9a2008b8e0 con 0x7f9a10004800 2024-04-16T15:52:53.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.425+0000 7f9a28c04640 1 --2- 172.21.15.132:0/857892569 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f9a0806c8f0 0x7f9a0806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:53.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.426+0000 7f9a28c04640 1 --2- 172.21.15.132:0/857892569 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f9a0806c8f0 0x7f9a0806edb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9a14036000 tx=0x7f9a14030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:53.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.430+0000 7f9a19ffb640 1 -- 172.21.15.132:0/857892569 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9a24152330 con 0x7f9a10004800 2024-04-16T15:52:53.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.603+0000 7f9a2b669640 1 -- 172.21.15.132:0/857892569 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9a24068b00 con 0x7f9a10004800 2024-04-16T15:52:53.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.604+0000 7f9a19ffb640 1 -- 172.21.15.132:0/857892569 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f9a240ccfd0 con 0x7f9a10004800 2024-04-16T15:52:53.604 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2024-04-16T15:52:53.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.606+0000 7f9a2b669640 1 -- 172.21.15.132:0/857892569 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f9a0806c8f0 msgr2=0x7f9a0806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:53.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.606+0000 7f9a2b669640 1 --2- 172.21.15.132:0/857892569 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f9a0806c8f0 0x7f9a0806edb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9a14036000 tx=0x7f9a14030000 comp rx=0 tx=0).stop 2024-04-16T15:52:53.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.606+0000 7f9a2b669640 1 -- 172.21.15.132:0/857892569 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a10004800 msgr2=0x7f9a2415ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:53.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.606+0000 7f9a2b669640 1 --2- 172.21.15.132:0/857892569 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a10004800 0x7f9a2415ae20 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9a20001ca0 tx=0x7f9a2000ec10 comp rx=0 tx=0).stop 2024-04-16T15:52:53.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.606+0000 7f9a2b669640 1 -- 172.21.15.132:0/857892569 shutdown_connections 2024-04-16T15:52:53.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.606+0000 7f9a2b669640 1 --2- 172.21.15.132:0/857892569 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f9a0806c8f0 0x7f9a0806edb0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:53.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.606+0000 7f9a2b669640 1 --2- 172.21.15.132:0/857892569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a240ce2f0 0x7f9a240cf6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:53.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.606+0000 7f9a2b669640 1 --2- 172.21.15.132:0/857892569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a240ccb50 0x7f9a24151df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:53.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.606+0000 7f9a2b669640 1 --2- 172.21.15.132:0/857892569 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a10004800 0x7f9a2415ae20 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:53.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.606+0000 7f9a2b669640 1 -- 172.21.15.132:0/857892569 >> 172.21.15.132:0/857892569 conn(0x7f9a2406d2d0 msgr2=0x7f9a240b46c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:53.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.606+0000 7f9a2b669640 1 -- 172.21.15.132:0/857892569 shutdown_connections 2024-04-16T15:52:53.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.606+0000 7f9a2b669640 1 -- 172.21.15.132:0/857892569 wait complete. 2024-04-16T15:52:53.617 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T15:52:53.724 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.724+0000 7f11de700640 1 Processor -- start 2024-04-16T15:52:53.725 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.724+0000 7f11de700640 1 -- start start 2024-04-16T15:52:53.725 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.725+0000 7f11de700640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f11d815c830 0x7f11d80cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:53.725 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.725+0000 7f11de700640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11d815cc10 0x7f11d80cfae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:53.725 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.725+0000 7f11de700640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11d8072b00 con 0x7f11d80ccf00 2024-04-16T15:52:53.725 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.725+0000 7f11de700640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f11d80cda60 con 0x7f11d815c830 2024-04-16T15:52:53.725 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.725+0000 7f11de700640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f11d80d0020 con 0x7f11d815cc10 2024-04-16T15:52:53.725 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.725+0000 7f11d7fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f11d815c830 0x7f11d80cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:53.725 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.725+0000 7f11dcc9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f11d80ccf00 0x7f11d8160570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:46888/0 (socket says 172.21.15.132:46888) 2024-04-16T15:52:53.725 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.725+0000 7f11d7fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f11d815c830 0x7f11d80cf5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60358/0 (socket says 172.21.15.132:60358) 2024-04-16T15:52:53.725 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.725+0000 7f11dcc9d640 1 -- 172.21.15.132:0/465956594 learned_addr learned my addr 172.21.15.132:0/465956594 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:53.725 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.725+0000 7f11d77fe640 1 --2- 172.21.15.132:0/465956594 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11d815cc10 0x7f11d80cfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:53.725 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.725+0000 7f11d7fff640 1 -- 172.21.15.132:0/465956594 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11d815cc10 msgr2=0x7f11d80cfae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:53.725 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.725+0000 7f11d7fff640 1 --2- 172.21.15.132:0/465956594 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11d815cc10 0x7f11d80cfae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:53.726 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.725+0000 7f11d7fff640 1 -- 172.21.15.132:0/465956594 >> v1:172.21.15.132:6789/0 conn(0x7f11d80ccf00 legacy=0x7f11d8160570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:53.726 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.725+0000 7f11d7fff640 1 -- 172.21.15.132:0/465956594 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11d80b4bb0 con 0x7f11d815c830 2024-04-16T15:52:53.726 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.725+0000 7f11d77fe640 1 --2- 172.21.15.132:0/465956594 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11d815cc10 0x7f11d80cfae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:52:53.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.726+0000 7f11d7fff640 1 --2- 172.21.15.132:0/465956594 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11d815c830 0x7f11d80cf5a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f11c80097a0 tx=0x7f11c802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99f4e2c950d91436 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:53.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.726+0000 7f11d6ffd640 1 -- 172.21.15.132:0/465956594 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c80315a0 con 0x7f11d815c830 2024-04-16T15:52:53.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.726+0000 7f11d6ffd640 1 -- 172.21.15.132:0/465956594 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11c8037070 con 0x7f11d815c830 2024-04-16T15:52:53.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.726+0000 7f11d6ffd640 1 -- 172.21.15.132:0/465956594 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c8031960 con 0x7f11d815c830 2024-04-16T15:52:53.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.727+0000 7f11de700640 1 -- 172.21.15.132:0/465956594 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11d815c830 msgr2=0x7f11d80cf5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:53.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.727+0000 7f11de700640 1 --2- 172.21.15.132:0/465956594 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11d815c830 0x7f11d80cf5a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f11c80097a0 tx=0x7f11c802b840 comp rx=0 tx=0).stop 2024-04-16T15:52:53.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.727+0000 7f11de700640 1 -- 172.21.15.132:0/465956594 shutdown_connections 2024-04-16T15:52:53.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.727+0000 7f11de700640 1 --2- 172.21.15.132:0/465956594 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11d815cc10 0x7f11d80cfae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:53.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.727+0000 7f11de700640 1 --2- 172.21.15.132:0/465956594 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11d815c830 0x7f11d80cf5a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:53.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.727+0000 7f11de700640 1 -- 172.21.15.132:0/465956594 >> 172.21.15.132:0/465956594 conn(0x7f11d80d0490 msgr2=0x7f11d80d08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:53.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.727+0000 7f11de700640 1 -- 172.21.15.132:0/465956594 shutdown_connections 2024-04-16T15:52:53.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.727+0000 7f11de700640 1 -- 172.21.15.132:0/465956594 wait complete. 2024-04-16T15:52:53.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.728+0000 7f11de700640 1 Processor -- start 2024-04-16T15:52:53.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.728+0000 7f11de700640 1 -- start start 2024-04-16T15:52:53.730 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.729+0000 7f11de700640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11d80ccf00 0x7f11d814bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:53.730 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.729+0000 7f11de700640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11d815c830 0x7f11d80ac670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:53.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.729+0000 7f11de700640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11d815cc10 0x7f11d8158fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:53.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.729+0000 7f11de700640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f11d80730a0 con 0x7f11d80ccf00 2024-04-16T15:52:53.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.729+0000 7f11de700640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f11d80b4550 con 0x7f11d815cc10 2024-04-16T15:52:53.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.729+0000 7f11de700640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f11d80cdef0 con 0x7f11d815c830 2024-04-16T15:52:53.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.729+0000 7f11d7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11d80ccf00 0x7f11d814bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:53.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.729+0000 7f11d7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11d80ccf00 0x7f11d814bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60372/0 (socket says 172.21.15.132:60372) 2024-04-16T15:52:53.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.729+0000 7f11d7fff640 1 -- 172.21.15.132:0/1727947719 learned_addr learned my addr 172.21.15.132:0/1727947719 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:53.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.729+0000 7f11d77fe640 1 --2- 172.21.15.132:0/1727947719 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11d815c830 0x7f11d80ac670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:53.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.729+0000 7f11dcc9d640 1 --2- 172.21.15.132:0/1727947719 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11d815cc10 0x7f11d8158fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:53.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.729+0000 7f11d7fff640 1 -- 172.21.15.132:0/1727947719 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11d815c830 msgr2=0x7f11d80ac670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:53.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.729+0000 7f11d7fff640 1 --2- 172.21.15.132:0/1727947719 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11d815c830 0x7f11d80ac670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:53.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.729+0000 7f11d7fff640 1 -- 172.21.15.132:0/1727947719 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11d815cc10 msgr2=0x7f11d8158fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:53.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.729+0000 7f11d7fff640 1 --2- 172.21.15.132:0/1727947719 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11d815cc10 0x7f11d8158fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:53.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.729+0000 7f11d7fff640 1 -- 172.21.15.132:0/1727947719 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11d80acbb0 con 0x7f11d80ccf00 2024-04-16T15:52:53.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.729+0000 7f11d7fff640 1 --2- 172.21.15.132:0/1727947719 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11d80ccf00 0x7f11d814bfe0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f11c80098c0 tx=0x7f11c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:53.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.729+0000 7f11d4ff9640 1 -- 172.21.15.132:0/1727947719 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c8032840 con 0x7f11d80ccf00 2024-04-16T15:52:53.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.729+0000 7f11d4ff9640 1 -- 172.21.15.132:0/1727947719 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11c8032a00 con 0x7f11d80ccf00 2024-04-16T15:52:53.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.729+0000 7f11de700640 1 -- 172.21.15.132:0/1727947719 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11d81e1e90 con 0x7f11d80ccf00 2024-04-16T15:52:53.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.729+0000 7f11d4ff9640 1 -- 172.21.15.132:0/1727947719 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c8032df0 con 0x7f11d80ccf00 2024-04-16T15:52:53.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.730+0000 7f11de700640 1 -- 172.21.15.132:0/1727947719 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11d80aeec0 con 0x7f11d80ccf00 2024-04-16T15:52:53.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.730+0000 7f11de700640 1 -- 172.21.15.132:0/1727947719 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11d8075510 con 0x7f11d80ccf00 2024-04-16T15:52:53.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.731+0000 7f11d4ff9640 1 -- 172.21.15.132:0/1727947719 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f11c804e430 con 0x7f11d80ccf00 2024-04-16T15:52:53.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.731+0000 7f11d4ff9640 1 --2- 172.21.15.132:0/1727947719 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f11c406c920 0x7f11c406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:53.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.731+0000 7f11d4ff9640 1 -- 172.21.15.132:0/1727947719 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f11c802f030 con 0x7f11d80ccf00 2024-04-16T15:52:53.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.731+0000 7f11d77fe640 1 --2- 172.21.15.132:0/1727947719 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f11c406c920 0x7f11c406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:53.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.732+0000 7f11d77fe640 1 --2- 172.21.15.132:0/1727947719 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f11c406c920 0x7f11c406ede0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f11d80ab650 tx=0x7f11cc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:53.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.736+0000 7f11d4ff9640 1 -- 172.21.15.132:0/1727947719 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f11c8040070 con 0x7f11d80ccf00 2024-04-16T15:52:53.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.910+0000 7f11de700640 1 -- 172.21.15.132:0/1727947719 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f11d815bfe0 con 0x7f11d80ccf00 2024-04-16T15:52:53.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.910+0000 7f11d4ff9640 1 -- 172.21.15.132:0/1727947719 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f11c807bfa0 con 0x7f11d80ccf00 2024-04-16T15:52:53.910 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2024-04-16T15:52:53.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.912+0000 7f11de700640 1 -- 172.21.15.132:0/1727947719 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f11c406c920 msgr2=0x7f11c406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:53.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.912+0000 7f11de700640 1 --2- 172.21.15.132:0/1727947719 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f11c406c920 0x7f11c406ede0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f11d80ab650 tx=0x7f11cc008040 comp rx=0 tx=0).stop 2024-04-16T15:52:53.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.912+0000 7f11de700640 1 -- 172.21.15.132:0/1727947719 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11d80ccf00 msgr2=0x7f11d814bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:53.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.912+0000 7f11de700640 1 --2- 172.21.15.132:0/1727947719 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11d80ccf00 0x7f11d814bfe0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f11c80098c0 tx=0x7f11c80046c0 comp rx=0 tx=0).stop 2024-04-16T15:52:53.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.912+0000 7f11de700640 1 -- 172.21.15.132:0/1727947719 shutdown_connections 2024-04-16T15:52:53.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.912+0000 7f11de700640 1 --2- 172.21.15.132:0/1727947719 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f11c406c920 0x7f11c406ede0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:53.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.912+0000 7f11de700640 1 --2- 172.21.15.132:0/1727947719 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11d815cc10 0x7f11d8158fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:53.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.912+0000 7f11de700640 1 --2- 172.21.15.132:0/1727947719 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11d815c830 0x7f11d80ac670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:53.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.912+0000 7f11de700640 1 --2- 172.21.15.132:0/1727947719 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11d80ccf00 0x7f11d814bfe0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:53.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.912+0000 7f11de700640 1 -- 172.21.15.132:0/1727947719 >> 172.21.15.132:0/1727947719 conn(0x7f11d80d0490 msgr2=0x7f11d80b1930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:53.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.912+0000 7f11de700640 1 -- 172.21.15.132:0/1727947719 shutdown_connections 2024-04-16T15:52:53.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:53.912+0000 7f11de700640 1 -- 172.21.15.132:0/1727947719 wait complete. 2024-04-16T15:52:53.923 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T15:52:54.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.031+0000 7f1603c35640 1 Processor -- start 2024-04-16T15:52:54.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.031+0000 7f1603c35640 1 -- start start 2024-04-16T15:52:54.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.032+0000 7f1603c35640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f15fc15ee80 0x7f15fc0700f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:54.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.032+0000 7f1603c35640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f15fc067a00 0x7f15fc06ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:54.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.032+0000 7f1603c35640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15fc06f050 con 0x7f15fc15eaa0 2024-04-16T15:52:54.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.032+0000 7f1603c35640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f15fc06fc60 con 0x7f15fc067a00 2024-04-16T15:52:54.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.032+0000 7f1603c35640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f15fc06f330 con 0x7f15fc15ee80 2024-04-16T15:52:54.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.032+0000 7f16021d2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f15fc067a00 0x7f15fc06ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:54.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.032+0000 7f16019d1640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f15fc15eaa0 0x7f15fc06e870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:46898/0 (socket says 172.21.15.132:46898) 2024-04-16T15:52:54.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.032+0000 7f16019d1640 1 -- 172.21.15.132:0/3805388232 learned_addr learned my addr 172.21.15.132:0/3805388232 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:54.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.032+0000 7f16011d0640 1 --2- 172.21.15.132:0/3805388232 >> v2:172.21.15.179:3300/0 conn(0x7f15fc15ee80 0x7f15fc0700f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:54.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.033+0000 7f16021d2640 1 -- 172.21.15.132:0/3805388232 >> v2:172.21.15.179:3300/0 conn(0x7f15fc15ee80 msgr2=0x7f15fc0700f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:54.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.033+0000 7f16021d2640 1 --2- 172.21.15.132:0/3805388232 >> v2:172.21.15.179:3300/0 conn(0x7f15fc15ee80 0x7f15fc0700f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:54.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.033+0000 7f16021d2640 1 -- 172.21.15.132:0/3805388232 >> v1:172.21.15.132:6789/0 conn(0x7f15fc15eaa0 legacy=0x7f15fc06e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:54.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.033+0000 7f16009cf640 1 -- 172.21.15.132:0/3805388232 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3805863687 0 0) 0x7f15fc06f050 con 0x7f15fc15eaa0 2024-04-16T15:52:54.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.033+0000 7f16021d2640 1 -- 172.21.15.132:0/3805388232 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15fc06f610 con 0x7f15fc067a00 2024-04-16T15:52:54.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.033+0000 7f16021d2640 1 --2- 172.21.15.132:0/3805388232 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15fc067a00 0x7f15fc06ca30 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f15fc072380 tx=0x7f15f402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dab47a5412c7c91b server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:54.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.033+0000 7f16009cf640 1 -- 172.21.15.132:0/3805388232 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f4039070 con 0x7f15fc067a00 2024-04-16T15:52:54.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.033+0000 7f16009cf640 1 -- 172.21.15.132:0/3805388232 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15f402cbf0 con 0x7f15fc067a00 2024-04-16T15:52:54.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.033+0000 7f16009cf640 1 -- 172.21.15.132:0/3805388232 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f4034440 con 0x7f15fc067a00 2024-04-16T15:52:54.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.034+0000 7f1603c35640 1 -- 172.21.15.132:0/3805388232 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15fc067a00 msgr2=0x7f15fc06ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:54.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.034+0000 7f1603c35640 1 --2- 172.21.15.132:0/3805388232 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15fc067a00 0x7f15fc06ca30 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f15fc072380 tx=0x7f15f402be40 comp rx=0 tx=0).stop 2024-04-16T15:52:54.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.034+0000 7f1603c35640 1 -- 172.21.15.132:0/3805388232 shutdown_connections 2024-04-16T15:52:54.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.034+0000 7f1603c35640 1 --2- 172.21.15.132:0/3805388232 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15fc067a00 0x7f15fc06ca30 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:54.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.034+0000 7f1603c35640 1 --2- 172.21.15.132:0/3805388232 >> v2:172.21.15.179:3300/0 conn(0x7f15fc15ee80 0x7f15fc0700f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:54.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.034+0000 7f1603c35640 1 -- 172.21.15.132:0/3805388232 >> 172.21.15.132:0/3805388232 conn(0x7f15fc072810 msgr2=0x7f15fc072c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:54.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.034+0000 7f1603c35640 1 -- 172.21.15.132:0/3805388232 shutdown_connections 2024-04-16T15:52:54.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.034+0000 7f1603c35640 1 -- 172.21.15.132:0/3805388232 wait complete. 2024-04-16T15:52:54.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.035+0000 7f1603c35640 1 Processor -- start 2024-04-16T15:52:54.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.035+0000 7f1603c35640 1 -- start start 2024-04-16T15:52:54.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.036+0000 7f1603c35640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15fc067a00 0x7f15fc14bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:54.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.036+0000 7f1603c35640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15fc15eaa0 0x7f15fc1489d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:54.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.036+0000 7f1603c35640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15fc15ee80 0x7f15fc15a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:54.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.036+0000 7f1603c35640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f15fc06cf70 con 0x7f15fc067a00 2024-04-16T15:52:54.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.036+0000 7f1603c35640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f15fc070630 con 0x7f15fc15eaa0 2024-04-16T15:52:54.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.036+0000 7f1603c35640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f15fc06d0f0 con 0x7f15fc15ee80 2024-04-16T15:52:54.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.036+0000 7f16019d1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15fc067a00 0x7f15fc14bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:54.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.036+0000 7f16019d1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15fc067a00 0x7f15fc14bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60396/0 (socket says 172.21.15.132:60396) 2024-04-16T15:52:54.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.036+0000 7f16019d1640 1 -- 172.21.15.132:0/107984046 learned_addr learned my addr 172.21.15.132:0/107984046 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:54.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.036+0000 7f16011d0640 1 --2- 172.21.15.132:0/107984046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15fc15eaa0 0x7f15fc1489d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:54.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.036+0000 7f16021d2640 1 --2- 172.21.15.132:0/107984046 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15fc15ee80 0x7f15fc15a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:54.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.036+0000 7f16019d1640 1 -- 172.21.15.132:0/107984046 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15fc15ee80 msgr2=0x7f15fc15a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:54.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.036+0000 7f16019d1640 1 --2- 172.21.15.132:0/107984046 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15fc15ee80 0x7f15fc15a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:54.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.036+0000 7f16019d1640 1 -- 172.21.15.132:0/107984046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15fc15eaa0 msgr2=0x7f15fc1489d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:54.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.036+0000 7f16019d1640 1 --2- 172.21.15.132:0/107984046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15fc15eaa0 0x7f15fc1489d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:54.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.036+0000 7f16019d1640 1 -- 172.21.15.132:0/107984046 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15fc14c300 con 0x7f15fc067a00 2024-04-16T15:52:54.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.037+0000 7f16019d1640 1 --2- 172.21.15.132:0/107984046 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15fc067a00 0x7f15fc14bdc0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f15f800c4d0 tx=0x7f15f800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:54.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.037+0000 7f15f27fc640 1 -- 172.21.15.132:0/107984046 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f8018070 con 0x7f15fc067a00 2024-04-16T15:52:54.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.037+0000 7f15f27fc640 1 -- 172.21.15.132:0/107984046 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15f8007500 con 0x7f15fc067a00 2024-04-16T15:52:54.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.037+0000 7f1603c35640 1 -- 172.21.15.132:0/107984046 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15fc1f4c10 con 0x7f15fc067a00 2024-04-16T15:52:54.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.037+0000 7f15f27fc640 1 -- 172.21.15.132:0/107984046 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f8004a20 con 0x7f15fc067a00 2024-04-16T15:52:54.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.037+0000 7f1603c35640 1 -- 172.21.15.132:0/107984046 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15fc1f51d0 con 0x7f15fc067a00 2024-04-16T15:52:54.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.038+0000 7f1603c35640 1 -- 172.21.15.132:0/107984046 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15fc075510 con 0x7f15fc067a00 2024-04-16T15:52:54.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.038+0000 7f15f27fc640 1 -- 172.21.15.132:0/107984046 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f15f801b070 con 0x7f15fc067a00 2024-04-16T15:52:54.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.039+0000 7f15f27fc640 1 --2- 172.21.15.132:0/107984046 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f15e006c8f0 0x7f15e006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:54.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.039+0000 7f15f27fc640 1 -- 172.21.15.132:0/107984046 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f15f808adf0 con 0x7f15fc067a00 2024-04-16T15:52:54.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.039+0000 7f16011d0640 1 --2- 172.21.15.132:0/107984046 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f15e006c8f0 0x7f15e006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:54.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.039+0000 7f16011d0640 1 --2- 172.21.15.132:0/107984046 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f15e006c8f0 0x7f15e006edb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f15fc15a220 tx=0x7f15ec008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:54.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.043+0000 7f15f27fc640 1 -- 172.21.15.132:0/107984046 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f15fc14c300 con 0x7f15fc067a00 2024-04-16T15:52:54.218 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.219+0000 7f1603c35640 1 -- 172.21.15.132:0/107984046 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f15fc073400 con 0x7f15fc067a00 2024-04-16T15:52:54.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.220+0000 7f15f27fc640 1 -- 172.21.15.132:0/107984046 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f15f8058bd0 con 0x7f15fc067a00 2024-04-16T15:52:54.219 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2024-04-16T15:52:54.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.221+0000 7f1603c35640 1 -- 172.21.15.132:0/107984046 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f15e006c8f0 msgr2=0x7f15e006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:54.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.221+0000 7f1603c35640 1 --2- 172.21.15.132:0/107984046 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f15e006c8f0 0x7f15e006edb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f15fc15a220 tx=0x7f15ec008040 comp rx=0 tx=0).stop 2024-04-16T15:52:54.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.221+0000 7f1603c35640 1 -- 172.21.15.132:0/107984046 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15fc067a00 msgr2=0x7f15fc14bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:54.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.221+0000 7f1603c35640 1 --2- 172.21.15.132:0/107984046 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15fc067a00 0x7f15fc14bdc0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f15f800c4d0 tx=0x7f15f800c990 comp rx=0 tx=0).stop 2024-04-16T15:52:54.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.222+0000 7f1603c35640 1 -- 172.21.15.132:0/107984046 shutdown_connections 2024-04-16T15:52:54.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.222+0000 7f1603c35640 1 --2- 172.21.15.132:0/107984046 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f15e006c8f0 0x7f15e006edb0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:54.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.222+0000 7f1603c35640 1 --2- 172.21.15.132:0/107984046 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15fc15ee80 0x7f15fc15a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:54.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.222+0000 7f1603c35640 1 --2- 172.21.15.132:0/107984046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15fc15eaa0 0x7f15fc1489d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:54.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.222+0000 7f1603c35640 1 --2- 172.21.15.132:0/107984046 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15fc067a00 0x7f15fc14bdc0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:54.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.222+0000 7f1603c35640 1 -- 172.21.15.132:0/107984046 >> 172.21.15.132:0/107984046 conn(0x7f15fc072810 msgr2=0x7f15fc072bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:54.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.222+0000 7f1603c35640 1 -- 172.21.15.132:0/107984046 shutdown_connections 2024-04-16T15:52:54.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.222+0000 7f1603c35640 1 -- 172.21.15.132:0/107984046 wait complete. 2024-04-16T15:52:54.232 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-16T15:52:54.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.337+0000 7ffbe9b00640 1 Processor -- start 2024-04-16T15:52:54.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.337+0000 7ffbe9b00640 1 -- start start 2024-04-16T15:52:54.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.338+0000 7ffbe9b00640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ffbe4145f00 0x7ffbe40b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:54.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.338+0000 7ffbe9b00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbe41462e0 0x7ffbe406ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:54.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.338+0000 7ffbe9b00640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbe4160480 con 0x7ffbe406bf60 2024-04-16T15:52:54.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.338+0000 7ffbe9b00640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7ffbe4160760 con 0x7ffbe4145f00 2024-04-16T15:52:54.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.338+0000 7ffbe9b00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ffbe4160a40 con 0x7ffbe41462e0 2024-04-16T15:52:54.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.338+0000 7ffbe2ffd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbe41462e0 0x7ffbe406ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:54.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.338+0000 7ffbe37fe640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ffbe4145f00 0x7ffbe40b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:54.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.338+0000 7ffbe3fff640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7ffbe406bf60 0x7ffbe40cf720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.132:42034/0 (socket says 172.21.15.132:42034) 2024-04-16T15:52:54.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.338+0000 7ffbe3fff640 1 -- 172.21.15.132:0/3973213029 learned_addr learned my addr 172.21.15.132:0/3973213029 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:54.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.338+0000 7ffbe37fe640 1 -- 172.21.15.132:0/3973213029 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbe41462e0 msgr2=0x7ffbe406ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:54.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.338+0000 7ffbe37fe640 1 --2- 172.21.15.132:0/3973213029 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbe41462e0 0x7ffbe406ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:54.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.338+0000 7ffbe37fe640 1 -- 172.21.15.132:0/3973213029 >> v1:172.21.15.179:6789/0 conn(0x7ffbe406bf60 legacy=0x7ffbe40cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:54.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.338+0000 7ffbe27fc640 1 -- 172.21.15.132:0/3973213029 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1073980798 0 0) 0x7ffbe4160480 con 0x7ffbe406bf60 2024-04-16T15:52:54.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.338+0000 7ffbe37fe640 1 -- 172.21.15.132:0/3973213029 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbe4160d20 con 0x7ffbe4145f00 2024-04-16T15:52:54.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.339+0000 7ffbe37fe640 1 --2- 172.21.15.132:0/3973213029 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbe4145f00 0x7ffbe40b3d60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ffbd40097a0 tx=0x7ffbd402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d10e379ab499f25 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:54.341 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.339+0000 7ffbe27fc640 1 -- 172.21.15.132:0/3973213029 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbd4035020 con 0x7ffbe4145f00 2024-04-16T15:52:54.341 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.339+0000 7ffbe27fc640 1 -- 172.21.15.132:0/3973213029 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbd4031830 con 0x7ffbe4145f00 2024-04-16T15:52:54.341 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.340+0000 7ffbe27fc640 1 -- 172.21.15.132:0/3973213029 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbd4031c00 con 0x7ffbe4145f00 2024-04-16T15:52:54.341 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.340+0000 7ffbe9b00640 1 -- 172.21.15.132:0/3973213029 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbe4145f00 msgr2=0x7ffbe40b3d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:54.341 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.340+0000 7ffbe9b00640 1 --2- 172.21.15.132:0/3973213029 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbe4145f00 0x7ffbe40b3d60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ffbd40097a0 tx=0x7ffbd402b8d0 comp rx=0 tx=0).stop 2024-04-16T15:52:54.341 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.340+0000 7ffbe9b00640 1 -- 172.21.15.132:0/3973213029 shutdown_connections 2024-04-16T15:52:54.341 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.340+0000 7ffbe9b00640 1 --2- 172.21.15.132:0/3973213029 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbe41462e0 0x7ffbe406ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:54.341 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.340+0000 7ffbe9b00640 1 --2- 172.21.15.132:0/3973213029 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbe4145f00 0x7ffbe40b3d60 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:54.341 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.340+0000 7ffbe9b00640 1 -- 172.21.15.132:0/3973213029 >> 172.21.15.132:0/3973213029 conn(0x7ffbe4067ff0 msgr2=0x7ffbe40b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:54.341 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.340+0000 7ffbe9b00640 1 -- 172.21.15.132:0/3973213029 shutdown_connections 2024-04-16T15:52:54.341 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.340+0000 7ffbe9b00640 1 -- 172.21.15.132:0/3973213029 wait complete. 2024-04-16T15:52:54.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.341+0000 7ffbe9b00640 1 Processor -- start 2024-04-16T15:52:54.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.341+0000 7ffbe9b00640 1 -- start start 2024-04-16T15:52:54.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.342+0000 7ffbe9b00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbe406bf60 0x7ffbe41f5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:54.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.342+0000 7ffbe9b00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffbe4145f00 0x7ffbe414e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:54.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.342+0000 7ffbe9b00640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbe41462e0 0x7ffbe413a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:54.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.342+0000 7ffbe9b00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7ffbe40cffb0 con 0x7ffbe4145f00 2024-04-16T15:52:54.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.342+0000 7ffbe9b00640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ffbe40cfe30 con 0x7ffbe406bf60 2024-04-16T15:52:54.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.342+0000 7ffbe9b00640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ffbe40d0130 con 0x7ffbe41462e0 2024-04-16T15:52:54.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.342+0000 7ffbe2ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffbe4145f00 0x7ffbe414e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:54.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.342+0000 7ffbe2ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffbe4145f00 0x7ffbe414e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60404/0 (socket says 172.21.15.132:60404) 2024-04-16T15:52:54.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.342+0000 7ffbe2ffd640 1 -- 172.21.15.132:0/1942672998 learned_addr learned my addr 172.21.15.132:0/1942672998 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:54.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.342+0000 7ffbe3fff640 1 --2- 172.21.15.132:0/1942672998 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbe41462e0 0x7ffbe413a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:54.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.342+0000 7ffbe37fe640 1 --2- 172.21.15.132:0/1942672998 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbe406bf60 0x7ffbe41f5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:54.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.343+0000 7ffbe2ffd640 1 -- 172.21.15.132:0/1942672998 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbe41462e0 msgr2=0x7ffbe413a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:54.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.343+0000 7ffbe2ffd640 1 --2- 172.21.15.132:0/1942672998 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbe41462e0 0x7ffbe413a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:54.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.343+0000 7ffbe2ffd640 1 -- 172.21.15.132:0/1942672998 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbe406bf60 msgr2=0x7ffbe41f5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:54.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.343+0000 7ffbe2ffd640 1 --2- 172.21.15.132:0/1942672998 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbe406bf60 0x7ffbe41f5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:54.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.343+0000 7ffbe2ffd640 1 -- 172.21.15.132:0/1942672998 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbe41f6360 con 0x7ffbe4145f00 2024-04-16T15:52:54.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.343+0000 7ffbe37fe640 1 --2- 172.21.15.132:0/1942672998 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbe406bf60 0x7ffbe41f5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:54.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.343+0000 7ffbe3fff640 1 --2- 172.21.15.132:0/1942672998 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbe41462e0 0x7ffbe413a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:54.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.343+0000 7ffbe2ffd640 1 --2- 172.21.15.132:0/1942672998 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffbe4145f00 0x7ffbe414e890 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ffbd800e9b0 tx=0x7ffbd800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:54.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.343+0000 7ffbcbfff640 1 -- 172.21.15.132:0/1942672998 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbd8017070 con 0x7ffbe4145f00 2024-04-16T15:52:54.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.343+0000 7ffbcbfff640 1 -- 172.21.15.132:0/1942672998 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbd800c9a0 con 0x7ffbe4145f00 2024-04-16T15:52:54.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.343+0000 7ffbe9b00640 1 -- 172.21.15.132:0/1942672998 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbe41f6640 con 0x7ffbe4145f00 2024-04-16T15:52:54.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.343+0000 7ffbcbfff640 1 -- 172.21.15.132:0/1942672998 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbd800cd90 con 0x7ffbe4145f00 2024-04-16T15:52:54.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.343+0000 7ffbe9b00640 1 -- 172.21.15.132:0/1942672998 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbe413cc70 con 0x7ffbe4145f00 2024-04-16T15:52:54.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.344+0000 7ffbe9b00640 1 -- 172.21.15.132:0/1942672998 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbe41f6b60 con 0x7ffbe4145f00 2024-04-16T15:52:54.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.344+0000 7ffbcbfff640 1 -- 172.21.15.132:0/1942672998 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ffbd801a070 con 0x7ffbe4145f00 2024-04-16T15:52:54.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.345+0000 7ffbcbfff640 1 --2- 172.21.15.132:0/1942672998 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7ffbd006c8f0 0x7ffbd006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:54.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.345+0000 7ffbe37fe640 1 --2- 172.21.15.132:0/1942672998 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7ffbd006c8f0 0x7ffbd006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:54.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.345+0000 7ffbcbfff640 1 -- 172.21.15.132:0/1942672998 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ffbd808bf10 con 0x7ffbe4145f00 2024-04-16T15:52:54.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.346+0000 7ffbe37fe640 1 --2- 172.21.15.132:0/1942672998 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7ffbd006c8f0 0x7ffbd006edb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4036000 tx=0x7ffbd4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:54.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.350+0000 7ffbcbfff640 1 -- 172.21.15.132:0/1942672998 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ffbe41f6b60 con 0x7ffbe4145f00 2024-04-16T15:52:54.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.537+0000 7ffbe9b00640 1 -- 172.21.15.132:0/1942672998 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ffbe4075510 con 0x7ffbe4145f00 2024-04-16T15:52:54.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.538+0000 7ffbcbfff640 1 -- 172.21.15.132:0/1942672998 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7ffbd805a340 con 0x7ffbe4145f00 2024-04-16T15:52:54.537 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2024-04-16T15:52:54.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.540+0000 7ffbe9b00640 1 -- 172.21.15.132:0/1942672998 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7ffbd006c8f0 msgr2=0x7ffbd006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:54.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.540+0000 7ffbe9b00640 1 --2- 172.21.15.132:0/1942672998 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7ffbd006c8f0 0x7ffbd006edb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4036000 tx=0x7ffbd4008030 comp rx=0 tx=0).stop 2024-04-16T15:52:54.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.540+0000 7ffbe9b00640 1 -- 172.21.15.132:0/1942672998 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffbe4145f00 msgr2=0x7ffbe414e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:54.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.540+0000 7ffbe9b00640 1 --2- 172.21.15.132:0/1942672998 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffbe4145f00 0x7ffbe414e890 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ffbd800e9b0 tx=0x7ffbd800ee70 comp rx=0 tx=0).stop 2024-04-16T15:52:54.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.540+0000 7ffbe9b00640 1 -- 172.21.15.132:0/1942672998 shutdown_connections 2024-04-16T15:52:54.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.540+0000 7ffbe9b00640 1 --2- 172.21.15.132:0/1942672998 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7ffbd006c8f0 0x7ffbd006edb0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:54.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.540+0000 7ffbe9b00640 1 --2- 172.21.15.132:0/1942672998 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbe41462e0 0x7ffbe413a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:54.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.540+0000 7ffbe9b00640 1 --2- 172.21.15.132:0/1942672998 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffbe4145f00 0x7ffbe414e890 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:54.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.540+0000 7ffbe9b00640 1 --2- 172.21.15.132:0/1942672998 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbe406bf60 0x7ffbe41f5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:54.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.540+0000 7ffbe9b00640 1 -- 172.21.15.132:0/1942672998 >> 172.21.15.132:0/1942672998 conn(0x7ffbe4067ff0 msgr2=0x7ffbe415cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:54.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.540+0000 7ffbe9b00640 1 -- 172.21.15.132:0/1942672998 shutdown_connections 2024-04-16T15:52:54.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.540+0000 7ffbe9b00640 1 -- 172.21.15.132:0/1942672998 wait complete. 2024-04-16T15:52:54.550 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi132.front.sepia.ceph.com... 2024-04-16T15:52:54.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:52:54.551 DEBUG:teuthology.orchestra.run.smithi132:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-04-16T15:52:54.581 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T15:52:54.581 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi132.front.sepia.ceph.com 2024-04-16T15:52:54.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:52:54.581 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-04-16T15:52:54.637 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-16T15:52:54.637 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T15:52:54.656 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-16T15:52:54.657 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T15:52:54.717 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:52:54.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.820+0000 7f2ba8a0d640 1 Processor -- start 2024-04-16T15:52:54.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.820+0000 7f2ba8a0d640 1 -- start start 2024-04-16T15:52:54.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.821+0000 7f2ba8a0d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2ba415eaf0 0x7f2ba40ba300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:54.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.821+0000 7f2ba8a0d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ba415eed0 0x7f2ba40b63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:54.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.821+0000 7f2ba8a0d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2ba41627e0 0x7f2ba40b6930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:54.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.821+0000 7f2ba8a0d640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f2ba40d2af0 con 0x7f2ba415eaf0 2024-04-16T15:52:54.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.821+0000 7f2ba8a0d640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f2ba4162cc0 con 0x7f2ba41627e0 2024-04-16T15:52:54.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.821+0000 7f2ba8a0d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f2ba4162fa0 con 0x7f2ba415eed0 2024-04-16T15:52:54.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.822+0000 7f2ba259c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2ba415eaf0 0x7f2ba40ba300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:54.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.822+0000 7f2ba259c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2ba415eaf0 0x7f2ba40ba300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60412/0 (socket says 172.21.15.132:60412) 2024-04-16T15:52:54.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.822+0000 7f2ba259c640 1 -- 172.21.15.132:0/3735175612 learned_addr learned my addr 172.21.15.132:0/3735175612 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:54.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.822+0000 7f2ba2d9d640 1 --2- 172.21.15.132:0/3735175612 >> v2:172.21.15.179:3300/0 conn(0x7f2ba41627e0 0x7f2ba40b6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:54.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.822+0000 7f2ba1d9b640 1 --2- 172.21.15.132:0/3735175612 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ba415eed0 0x7f2ba40b63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:54.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.822+0000 7f2ba259c640 1 -- 172.21.15.132:0/3735175612 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ba415eed0 msgr2=0x7f2ba40b63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:54.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.822+0000 7f2ba259c640 1 --2- 172.21.15.132:0/3735175612 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ba415eed0 0x7f2ba40b63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:54.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.822+0000 7f2ba259c640 1 -- 172.21.15.132:0/3735175612 >> v2:172.21.15.179:3300/0 conn(0x7f2ba41627e0 msgr2=0x7f2ba40b6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:54.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.822+0000 7f2ba259c640 1 --2- 172.21.15.132:0/3735175612 >> v2:172.21.15.179:3300/0 conn(0x7f2ba41627e0 0x7f2ba40b6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:54.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.822+0000 7f2ba259c640 1 -- 172.21.15.132:0/3735175612 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ba4163280 con 0x7f2ba415eaf0 2024-04-16T15:52:54.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.823+0000 7f2ba259c640 1 --2- 172.21.15.132:0/3735175612 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ba415eaf0 0x7f2ba40ba300 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2ba40cb9f0 tx=0x7f2b9c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6353ddcca0f7582 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:54.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.823+0000 7f2ba159a640 1 -- 172.21.15.132:0/3735175612 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b9c02ca70 con 0x7f2ba415eaf0 2024-04-16T15:52:54.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.823+0000 7f2ba159a640 1 -- 172.21.15.132:0/3735175612 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b9c02cc10 con 0x7f2ba415eaf0 2024-04-16T15:52:54.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.823+0000 7f2ba159a640 1 -- 172.21.15.132:0/3735175612 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b9c0343f0 con 0x7f2ba415eaf0 2024-04-16T15:52:54.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.823+0000 7f2ba8a0d640 1 -- 172.21.15.132:0/3735175612 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ba415eaf0 msgr2=0x7f2ba40ba300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:54.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.823+0000 7f2ba8a0d640 1 --2- 172.21.15.132:0/3735175612 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ba415eaf0 0x7f2ba40ba300 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2ba40cb9f0 tx=0x7f2b9c02bed0 comp rx=0 tx=0).stop 2024-04-16T15:52:54.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.823+0000 7f2ba8a0d640 1 -- 172.21.15.132:0/3735175612 shutdown_connections 2024-04-16T15:52:54.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.823+0000 7f2ba8a0d640 1 --2- 172.21.15.132:0/3735175612 >> v2:172.21.15.179:3300/0 conn(0x7f2ba41627e0 0x7f2ba40b6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:54.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.823+0000 7f2ba8a0d640 1 --2- 172.21.15.132:0/3735175612 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ba415eed0 0x7f2ba40b63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:54.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.823+0000 7f2ba8a0d640 1 --2- 172.21.15.132:0/3735175612 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ba415eaf0 0x7f2ba40ba300 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:54.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.823+0000 7f2ba8a0d640 1 -- 172.21.15.132:0/3735175612 >> 172.21.15.132:0/3735175612 conn(0x7f2ba40d13f0 msgr2=0x7f2ba40d1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:54.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.823+0000 7f2ba8a0d640 1 -- 172.21.15.132:0/3735175612 shutdown_connections 2024-04-16T15:52:54.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.823+0000 7f2ba8a0d640 1 -- 172.21.15.132:0/3735175612 wait complete. 2024-04-16T15:52:54.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.825+0000 7f2ba8a0d640 1 Processor -- start 2024-04-16T15:52:54.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.825+0000 7f2ba8a0d640 1 -- start start 2024-04-16T15:52:54.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.825+0000 7f2ba8a0d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ba415eaf0 0x7f2ba40b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:54.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.825+0000 7f2ba8a0d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ba415eed0 0x7f2ba40cba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:54.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.825+0000 7f2ba8a0d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ba41627e0 0x7f2ba40cbf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:54.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.825+0000 7f2ba8a0d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f2ba4067760 con 0x7f2ba41627e0 2024-04-16T15:52:54.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.825+0000 7f2ba8a0d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2ba40ba840 con 0x7f2ba415eaf0 2024-04-16T15:52:54.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.825+0000 7f2ba8a0d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f2ba40678e0 con 0x7f2ba415eed0 2024-04-16T15:52:54.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.826+0000 7f2ba2d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ba41627e0 0x7f2ba40cbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:54.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.826+0000 7f2ba2d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ba41627e0 0x7f2ba40cbf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60420/0 (socket says 172.21.15.132:60420) 2024-04-16T15:52:54.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.826+0000 7f2ba2d9d640 1 -- 172.21.15.132:0/3123684827 learned_addr learned my addr 172.21.15.132:0/3123684827 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:54.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.826+0000 7f2ba259c640 1 --2- 172.21.15.132:0/3123684827 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ba415eaf0 0x7f2ba40b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:54.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.826+0000 7f2ba2d9d640 1 -- 172.21.15.132:0/3123684827 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ba415eed0 msgr2=0x7f2ba40cba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:54.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.826+0000 7f2ba1d9b640 1 --2- 172.21.15.132:0/3123684827 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ba415eed0 0x7f2ba40cba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:54.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.826+0000 7f2ba2d9d640 1 --2- 172.21.15.132:0/3123684827 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ba415eed0 0x7f2ba40cba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:54.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.826+0000 7f2ba2d9d640 1 -- 172.21.15.132:0/3123684827 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ba415eaf0 msgr2=0x7f2ba40b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:54.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.826+0000 7f2ba2d9d640 1 --2- 172.21.15.132:0/3123684827 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ba415eaf0 0x7f2ba40b27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:54.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.826+0000 7f2ba2d9d640 1 -- 172.21.15.132:0/3123684827 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ba40cb3b0 con 0x7f2ba41627e0 2024-04-16T15:52:54.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.826+0000 7f2ba259c640 1 --2- 172.21.15.132:0/3123684827 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ba415eaf0 0x7f2ba40b27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:52:54.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.826+0000 7f2ba1d9b640 1 --2- 172.21.15.132:0/3123684827 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ba415eed0 0x7f2ba40cba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:52:54.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.826+0000 7f2ba2d9d640 1 --2- 172.21.15.132:0/3123684827 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ba41627e0 0x7f2ba40cbf80 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2b9400d4e0 tx=0x7f2b9400d9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:54.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.826+0000 7f2b9affd640 1 -- 172.21.15.132:0/3123684827 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b940125f0 con 0x7f2ba41627e0 2024-04-16T15:52:54.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.826+0000 7f2b9affd640 1 -- 172.21.15.132:0/3123684827 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b94019070 con 0x7f2ba41627e0 2024-04-16T15:52:54.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.826+0000 7f2ba8a0d640 1 -- 172.21.15.132:0/3123684827 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ba40b2d10 con 0x7f2ba41627e0 2024-04-16T15:52:54.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.826+0000 7f2b9affd640 1 -- 172.21.15.132:0/3123684827 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b940129f0 con 0x7f2ba41627e0 2024-04-16T15:52:54.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.826+0000 7f2ba8a0d640 1 -- 172.21.15.132:0/3123684827 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ba4161700 con 0x7f2ba41627e0 2024-04-16T15:52:54.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.827+0000 7f2ba8a0d640 1 -- 172.21.15.132:0/3123684827 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ba4075510 con 0x7f2ba41627e0 2024-04-16T15:52:54.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.828+0000 7f2b9affd640 1 -- 172.21.15.132:0/3123684827 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2b94012b90 con 0x7f2ba41627e0 2024-04-16T15:52:54.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.828+0000 7f2b9affd640 1 --2- 172.21.15.132:0/3123684827 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f2b8406c8f0 0x7f2b8406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:54.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.828+0000 7f2b9affd640 1 -- 172.21.15.132:0/3123684827 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2b9408bee0 con 0x7f2ba41627e0 2024-04-16T15:52:54.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.828+0000 7f2ba259c640 1 --2- 172.21.15.132:0/3123684827 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f2b8406c8f0 0x7f2b8406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:54.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.829+0000 7f2ba259c640 1 --2- 172.21.15.132:0/3123684827 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f2b8406c8f0 0x7f2b8406edb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c035000 tx=0x7f2b9c030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:54.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:54.832+0000 7f2b9affd640 1 -- 172.21.15.132:0/3123684827 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2b9405a310 con 0x7f2ba41627e0 2024-04-16T15:52:55.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.012+0000 7f2ba8a0d640 1 -- 172.21.15.132:0/3123684827 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2ba415e230 con 0x7f2ba41627e0 2024-04-16T15:52:55.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.013+0000 7f2b9affd640 1 -- 172.21.15.132:0/3123684827 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16605 (secure 0 0 0) 0x7f2b94059c10 con 0x7f2ba41627e0 2024-04-16T15:52:55.012 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:52:55.012 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"6bdec5d9-f406-43ad-8584-0503b32f6f0d","created":"2024-04-16T15:51:51.073040+0000","modified":"2024-04-16T15:52:16.950186+0000","last_up_change":"2024-04-16T15:52:02.280496+0000","last_in_change":"2024-04-16T15:51:53.376468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:52:03.284927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:52:13.363758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T15:52:14.246647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d45908b-6e22-4619-b190-897af594b712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6801","nonce":1170594668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6803","nonce":1170594668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6807","nonce":1170594668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6805","nonce":1170594668}]},"public_addr":"172.21.15.132:6801/1170594668","cluster_addr":"172.21.15.132:6803/1170594668","heartbeat_back_addr":"172.21.15.132:6807/1170594668","heartbeat_front_addr":"172.21.15.132:6805/1170594668","state":["exists","up"]},{"osd":1,"uuid":"c88bf082-e51f-4ee6-815a-025f6ce0d67b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6809","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6811","nonce":2494780358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6815","nonce":2494780358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6823","nonce":2494780358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6819","nonce":2494780358}]},"public_addr":"172.21.15.132:6811/2494780358","cluster_addr":"172.21.15.132:6815/2494780358","heartbeat_back_addr":"172.21.15.132:6823/2494780358","heartbeat_front_addr":"172.21.15.132:6819/2494780358","state":["exists","up"]},{"osd":2,"uuid":"e5dbd6b4-4e7b-47e4-ad4e-35b4b81696c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6825","nonce":27655483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6827","nonce":27655483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6831","nonce":27655483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6829","nonce":27655483}]},"public_addr":"172.21.15.132:6825/27655483","cluster_addr":"172.21.15.132:6827/27655483","heartbeat_back_addr":"172.21.15.132:6831/27655483","heartbeat_front_addr":"172.21.15.132:6829/27655483","state":["exists","up"]},{"osd":3,"uuid":"9d75cd67-3b8a-4424-8884-5f3660e1f5f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6810","nonce":3100919191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6814","nonce":3100919191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6821","nonce":3100919191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6818","nonce":3100919191}]},"public_addr":"172.21.15.132:6810/3100919191","cluster_addr":"172.21.15.132:6814/3100919191","heartbeat_back_addr":"172.21.15.132:6821/3100919191","heartbeat_front_addr":"172.21.15.132:6818/3100919191","state":["exists","up"]},{"osd":4,"uuid":"83aea46a-8642-4777-912b-c130e5890da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6825","nonce":123637799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6827","nonce":123637799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6831","nonce":123637799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6829","nonce":123637799}]},"public_addr":"172.21.15.179:6825/123637799","cluster_addr":"172.21.15.179:6827/123637799","heartbeat_back_addr":"172.21.15.179:6831/123637799","heartbeat_front_addr":"172.21.15.179:6829/123637799","state":["exists","up"]},{"osd":5,"uuid":"534117c8-3317-48d6-b436-afd5709f71e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6801","nonce":2224750370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6803","nonce":2224750370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6807","nonce":2224750370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6805","nonce":2224750370}]},"public_addr":"172.21.15.179:6801/2224750370","cluster_addr":"172.21.15.179:6803/2224750370","heartbeat_back_addr":"172.21.15.179:6807/2224750370","heartbeat_front_addr":"172.21.15.179:6805/2224750370","state":["exists","up"]},{"osd":6,"uuid":"0ba363e7-fa9d-42b1-ae09-a6a0f57d41f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6809","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6811","nonce":101498164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6813","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6815","nonce":101498164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6823","nonce":101498164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6819","nonce":101498164}]},"public_addr":"172.21.15.179:6811/101498164","cluster_addr":"172.21.15.179:6815/101498164","heartbeat_back_addr":"172.21.15.179:6823/101498164","heartbeat_front_addr":"172.21.15.179:6819/101498164","state":["exists","up"]},{"osd":7,"uuid":"e6830c77-2f2d-4067-9866-ee7625afc1a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6810","nonce":872148365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6814","nonce":872148365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6822","nonce":872148365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6818","nonce":872148365}]},"public_addr":"172.21.15.179:6810/872148365","cluster_addr":"172.21.15.179:6814/872148365","heartbeat_back_addr":"172.21.15.179:6822/872148365","heartbeat_front_addr":"172.21.15.179:6818/872148365","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.535221+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.563769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.520765+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.526264+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.517058+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.500842+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.534332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.512486+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:52:55.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.015+0000 7f2ba8a0d640 1 -- 172.21.15.132:0/3123684827 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f2b8406c8f0 msgr2=0x7f2b8406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:55.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.015+0000 7f2ba8a0d640 1 --2- 172.21.15.132:0/3123684827 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f2b8406c8f0 0x7f2b8406edb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c035000 tx=0x7f2b9c030000 comp rx=0 tx=0).stop 2024-04-16T15:52:55.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.015+0000 7f2ba8a0d640 1 -- 172.21.15.132:0/3123684827 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ba41627e0 msgr2=0x7f2ba40cbf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:55.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.015+0000 7f2ba8a0d640 1 --2- 172.21.15.132:0/3123684827 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ba41627e0 0x7f2ba40cbf80 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2b9400d4e0 tx=0x7f2b9400d9a0 comp rx=0 tx=0).stop 2024-04-16T15:52:55.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.015+0000 7f2ba8a0d640 1 -- 172.21.15.132:0/3123684827 shutdown_connections 2024-04-16T15:52:55.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.015+0000 7f2ba8a0d640 1 --2- 172.21.15.132:0/3123684827 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f2b8406c8f0 0x7f2b8406edb0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:55.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.015+0000 7f2ba8a0d640 1 --2- 172.21.15.132:0/3123684827 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ba41627e0 0x7f2ba40cbf80 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:55.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.015+0000 7f2ba8a0d640 1 --2- 172.21.15.132:0/3123684827 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ba415eed0 0x7f2ba40cba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:55.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.015+0000 7f2ba8a0d640 1 --2- 172.21.15.132:0/3123684827 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ba415eaf0 0x7f2ba40b27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:55.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.015+0000 7f2ba8a0d640 1 -- 172.21.15.132:0/3123684827 >> 172.21.15.132:0/3123684827 conn(0x7f2ba40d13f0 msgr2=0x7f2ba40b9d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:55.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.015+0000 7f2ba8a0d640 1 -- 172.21.15.132:0/3123684827 shutdown_connections 2024-04-16T15:52:55.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.015+0000 7f2ba8a0d640 1 -- 172.21.15.132:0/3123684827 wait complete. 2024-04-16T15:52:55.026 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T15:52:03.284927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T15:52:13.363758+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T15:52:14.246647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T15:52:55.026 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T15:52:55.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.133+0000 7f895b214640 1 Processor -- start 2024-04-16T15:52:55.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.133+0000 7f895b214640 1 -- start start 2024-04-16T15:52:55.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.134+0000 7f895b214640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f895415eaa0 0x7f895406e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:55.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.134+0000 7f895b214640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f895415ee80 0x7f89540700f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:55.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.134+0000 7f895b214640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8954067a00 0x7f895406ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:55.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.134+0000 7f895b214640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f895406fc60 con 0x7f895415eaa0 2024-04-16T15:52:55.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.134+0000 7f895b214640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f895406edb0 con 0x7f895415ee80 2024-04-16T15:52:55.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.134+0000 7f895b214640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f895406f050 con 0x7f8954067a00 2024-04-16T15:52:55.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.134+0000 7f8958fb0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f895415eaa0 0x7f895406e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:55.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.134+0000 7f8958fb0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f895415eaa0 0x7f895406e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60422/0 (socket says 172.21.15.132:60422) 2024-04-16T15:52:55.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.134+0000 7f8958fb0640 1 -- 172.21.15.132:0/3866862124 learned_addr learned my addr 172.21.15.132:0/3866862124 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:55.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.134+0000 7f8953fff640 1 --2- 172.21.15.132:0/3866862124 >> v2:172.21.15.179:3300/0 conn(0x7f895415ee80 0x7f89540700f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:55.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.134+0000 7f89597b1640 1 --2- 172.21.15.132:0/3866862124 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8954067a00 0x7f895406ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:55.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.135+0000 7f8958fb0640 1 -- 172.21.15.132:0/3866862124 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8954067a00 msgr2=0x7f895406ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:55.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.135+0000 7f8958fb0640 1 --2- 172.21.15.132:0/3866862124 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8954067a00 0x7f895406ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:55.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.135+0000 7f8958fb0640 1 -- 172.21.15.132:0/3866862124 >> v2:172.21.15.179:3300/0 conn(0x7f895415ee80 msgr2=0x7f89540700f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:55.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.135+0000 7f8958fb0640 1 --2- 172.21.15.132:0/3866862124 >> v2:172.21.15.179:3300/0 conn(0x7f895415ee80 0x7f89540700f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:55.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.135+0000 7f8958fb0640 1 -- 172.21.15.132:0/3866862124 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f895406f330 con 0x7f895415eaa0 2024-04-16T15:52:55.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.135+0000 7f8958fb0640 1 --2- 172.21.15.132:0/3866862124 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f895415eaa0 0x7f895406e870 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8954072220 tx=0x7f894402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36d6fac65c78cc6e server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:55.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.135+0000 7f89537fe640 1 -- 172.21.15.132:0/3866862124 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8944035020 con 0x7f895415eaa0 2024-04-16T15:52:55.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.135+0000 7f89537fe640 1 -- 172.21.15.132:0/3866862124 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8944031870 con 0x7f895415eaa0 2024-04-16T15:52:55.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.135+0000 7f89537fe640 1 -- 172.21.15.132:0/3866862124 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8944031c40 con 0x7f895415eaa0 2024-04-16T15:52:55.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.136+0000 7f895b214640 1 -- 172.21.15.132:0/3866862124 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f895415eaa0 msgr2=0x7f895406e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:55.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.136+0000 7f895b214640 1 --2- 172.21.15.132:0/3866862124 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f895415eaa0 0x7f895406e870 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8954072220 tx=0x7f894402b910 comp rx=0 tx=0).stop 2024-04-16T15:52:55.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.136+0000 7f895b214640 1 -- 172.21.15.132:0/3866862124 shutdown_connections 2024-04-16T15:52:55.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.136+0000 7f895b214640 1 --2- 172.21.15.132:0/3866862124 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8954067a00 0x7f895406ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:55.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.136+0000 7f895b214640 1 --2- 172.21.15.132:0/3866862124 >> v2:172.21.15.179:3300/0 conn(0x7f895415ee80 0x7f89540700f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:55.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.136+0000 7f895b214640 1 --2- 172.21.15.132:0/3866862124 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f895415eaa0 0x7f895406e870 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:55.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.136+0000 7f895b214640 1 -- 172.21.15.132:0/3866862124 >> 172.21.15.132:0/3866862124 conn(0x7f8954072810 msgr2=0x7f8954072c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:55.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.136+0000 7f895b214640 1 -- 172.21.15.132:0/3866862124 shutdown_connections 2024-04-16T15:52:55.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.136+0000 7f895b214640 1 -- 172.21.15.132:0/3866862124 wait complete. 2024-04-16T15:52:55.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.137+0000 7f895b214640 1 Processor -- start 2024-04-16T15:52:55.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.137+0000 7f895b214640 1 -- start start 2024-04-16T15:52:55.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.138+0000 7f895b214640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8954067a00 0x7f8954153250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:55.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.138+0000 7f895b214640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f895415eaa0 0x7f8954162730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:55.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.138+0000 7f895b214640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f895415ee80 0x7f89540af740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:55.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.138+0000 7f895b214640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f8954070630 con 0x7f895415ee80 2024-04-16T15:52:55.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.138+0000 7f895b214640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f895406f8f0 con 0x7f895415eaa0 2024-04-16T15:52:55.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.138+0000 7f895b214640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f895406cf70 con 0x7f8954067a00 2024-04-16T15:52:55.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.138+0000 7f89597b1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f895415ee80 0x7f89540af740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:55.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.138+0000 7f89597b1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f895415ee80 0x7f89540af740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60436/0 (socket says 172.21.15.132:60436) 2024-04-16T15:52:55.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.138+0000 7f89597b1640 1 -- 172.21.15.132:0/3721497115 learned_addr learned my addr 172.21.15.132:0/3721497115 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:55.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.138+0000 7f8958fb0640 1 --2- 172.21.15.132:0/3721497115 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8954067a00 0x7f8954153250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:55.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.138+0000 7f8953fff640 1 --2- 172.21.15.132:0/3721497115 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f895415eaa0 0x7f8954162730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:55.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.138+0000 7f89597b1640 1 -- 172.21.15.132:0/3721497115 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8954067a00 msgr2=0x7f8954153250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:55.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.138+0000 7f89597b1640 1 --2- 172.21.15.132:0/3721497115 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8954067a00 0x7f8954153250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:55.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.138+0000 7f89597b1640 1 -- 172.21.15.132:0/3721497115 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f895415eaa0 msgr2=0x7f8954162730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:55.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.138+0000 7f89597b1640 1 --2- 172.21.15.132:0/3721497115 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f895415eaa0 0x7f8954162730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:55.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.138+0000 7f89597b1640 1 -- 172.21.15.132:0/3721497115 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8954162c70 con 0x7f895415ee80 2024-04-16T15:52:55.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.138+0000 7f8953fff640 1 --2- 172.21.15.132:0/3721497115 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f895415eaa0 0x7f8954162730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:55.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.139+0000 7f89597b1640 1 --2- 172.21.15.132:0/3721497115 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f895415ee80 0x7f89540af740 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f894c007e40 tx=0x7f894c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:55.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.139+0000 7f89517fa640 1 -- 172.21.15.132:0/3721497115 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f894c014620 con 0x7f895415ee80 2024-04-16T15:52:55.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.139+0000 7f89517fa640 1 -- 172.21.15.132:0/3721497115 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f894c019070 con 0x7f895415ee80 2024-04-16T15:52:55.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.139+0000 7f895b214640 1 -- 172.21.15.132:0/3721497115 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8954162f10 con 0x7f895415ee80 2024-04-16T15:52:55.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.139+0000 7f89517fa640 1 -- 172.21.15.132:0/3721497115 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f894c014a20 con 0x7f895415ee80 2024-04-16T15:52:55.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.139+0000 7f895b214640 1 -- 172.21.15.132:0/3721497115 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89540cf1e0 con 0x7f895415ee80 2024-04-16T15:52:55.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.140+0000 7f895b214640 1 -- 172.21.15.132:0/3721497115 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8954075510 con 0x7f895415ee80 2024-04-16T15:52:55.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.140+0000 7f89517fa640 1 -- 172.21.15.132:0/3721497115 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f894c014bc0 con 0x7f895415ee80 2024-04-16T15:52:55.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.141+0000 7f89517fa640 1 --2- 172.21.15.132:0/3721497115 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f894006c8f0 0x7f894006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:55.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.141+0000 7f8958fb0640 1 --2- 172.21.15.132:0/3721497115 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f894006c8f0 0x7f894006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:55.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.141+0000 7f89517fa640 1 -- 172.21.15.132:0/3721497115 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f894c08c3b0 con 0x7f895415ee80 2024-04-16T15:52:55.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.141+0000 7f8958fb0640 1 --2- 172.21.15.132:0/3721497115 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f894006c8f0 0x7f894006edb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8944036000 tx=0x7f894403c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:55.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.145+0000 7f89517fa640 1 -- 172.21.15.132:0/3721497115 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f894c05a870 con 0x7f895415ee80 2024-04-16T15:52:55.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.323+0000 7f895b214640 1 -- 172.21.15.132:0/3721497115 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f895415d810 con 0x7f895415ee80 2024-04-16T15:52:55.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.323+0000 7f89517fa640 1 -- 172.21.15.132:0/3721497115 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f894c05a170 con 0x7f895415ee80 2024-04-16T15:52:55.323 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2024-04-16T15:52:55.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.325+0000 7f895b214640 1 -- 172.21.15.132:0/3721497115 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f894006c8f0 msgr2=0x7f894006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:55.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.325+0000 7f895b214640 1 --2- 172.21.15.132:0/3721497115 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f894006c8f0 0x7f894006edb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8944036000 tx=0x7f894403c040 comp rx=0 tx=0).stop 2024-04-16T15:52:55.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.326+0000 7f895b214640 1 -- 172.21.15.132:0/3721497115 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f895415ee80 msgr2=0x7f89540af740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:55.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.326+0000 7f895b214640 1 --2- 172.21.15.132:0/3721497115 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f895415ee80 0x7f89540af740 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f894c007e40 tx=0x7f894c00e4b0 comp rx=0 tx=0).stop 2024-04-16T15:52:55.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.326+0000 7f895b214640 1 -- 172.21.15.132:0/3721497115 shutdown_connections 2024-04-16T15:52:55.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.326+0000 7f895b214640 1 --2- 172.21.15.132:0/3721497115 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f894006c8f0 0x7f894006edb0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:55.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.326+0000 7f895b214640 1 --2- 172.21.15.132:0/3721497115 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f895415ee80 0x7f89540af740 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:55.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.326+0000 7f895b214640 1 --2- 172.21.15.132:0/3721497115 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f895415eaa0 0x7f8954162730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:55.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.326+0000 7f895b214640 1 --2- 172.21.15.132:0/3721497115 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8954067a00 0x7f8954153250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:55.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.326+0000 7f895b214640 1 -- 172.21.15.132:0/3721497115 >> 172.21.15.132:0/3721497115 conn(0x7f8954072810 msgr2=0x7f895415da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:55.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.326+0000 7f895b214640 1 -- 172.21.15.132:0/3721497115 shutdown_connections 2024-04-16T15:52:55.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.326+0000 7f895b214640 1 -- 172.21.15.132:0/3721497115 wait complete. 2024-04-16T15:52:55.336 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T15:52:55.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.444+0000 7f702ac63640 1 Processor -- start 2024-04-16T15:52:55.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.444+0000 7f702ac63640 1 -- start start 2024-04-16T15:52:55.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.445+0000 7f702ac63640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f702415ea80 0x7f70240b3540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:55.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.445+0000 7f702ac63640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70240b3e40 con 0x7f702415ad10 2024-04-16T15:52:55.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.445+0000 7f702ac63640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70240b4120 con 0x7f70240727e0 2024-04-16T15:52:55.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.445+0000 7f702ac63640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f70240b4400 con 0x7f702415ea80 2024-04-16T15:52:55.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.445+0000 7f7023fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f702415ea80 0x7f70240b3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:55.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.445+0000 7f70289ff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f702415ad10 0x7f70240b4ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:46904/0 (socket says 172.21.15.132:46904) 2024-04-16T15:52:55.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.445+0000 7f70289ff640 1 -- 172.21.15.132:0/656782473 learned_addr learned my addr 172.21.15.132:0/656782473 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:55.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.445+0000 7f7023fff640 1 -- 172.21.15.132:0/656782473 >> v1:172.21.15.179:6789/0 conn(0x7f70240727e0 legacy=0x7f70240cdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:55.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.445+0000 7f7023fff640 1 -- 172.21.15.132:0/656782473 >> v1:172.21.15.132:6789/0 conn(0x7f702415ad10 legacy=0x7f70240b4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:55.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.445+0000 7f7023fff640 1 -- 172.21.15.132:0/656782473 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70240b46e0 con 0x7f702415ea80 2024-04-16T15:52:55.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.445+0000 7f70237fe640 1 -- 172.21.15.132:0/656782473 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4237674561 0 0) 0x7f70240b3e40 con 0x7f702415ad10 2024-04-16T15:52:55.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.446+0000 7f7023fff640 1 --2- 172.21.15.132:0/656782473 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f702415ea80 0x7f70240b3540 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f701800a940 tx=0x7f701802cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2651caaeee5cce4 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:55.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.446+0000 7f70237fe640 1 -- 172.21.15.132:0/656782473 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f701803a070 con 0x7f702415ea80 2024-04-16T15:52:55.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.446+0000 7f70237fe640 1 -- 172.21.15.132:0/656782473 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f701802db40 con 0x7f702415ea80 2024-04-16T15:52:55.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.446+0000 7f70237fe640 1 -- 172.21.15.132:0/656782473 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f701800b040 con 0x7f702415ea80 2024-04-16T15:52:55.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.447+0000 7f702ac63640 1 -- 172.21.15.132:0/656782473 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f702415ea80 msgr2=0x7f70240b3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:55.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.447+0000 7f702ac63640 1 --2- 172.21.15.132:0/656782473 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f702415ea80 0x7f70240b3540 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f701800a940 tx=0x7f701802cd90 comp rx=0 tx=0).stop 2024-04-16T15:52:55.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.447+0000 7f702ac63640 1 -- 172.21.15.132:0/656782473 shutdown_connections 2024-04-16T15:52:55.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.447+0000 7f702ac63640 1 --2- 172.21.15.132:0/656782473 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f702415ea80 0x7f70240b3540 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:55.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.447+0000 7f702ac63640 1 -- 172.21.15.132:0/656782473 >> 172.21.15.132:0/656782473 conn(0x7f70240d0490 msgr2=0x7f70240d08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:55.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.447+0000 7f702ac63640 1 -- 172.21.15.132:0/656782473 shutdown_connections 2024-04-16T15:52:55.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.447+0000 7f702ac63640 1 -- 172.21.15.132:0/656782473 wait complete. 2024-04-16T15:52:55.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.448+0000 7f702ac63640 1 Processor -- start 2024-04-16T15:52:55.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.448+0000 7f702ac63640 1 -- start start 2024-04-16T15:52:55.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.449+0000 7f702ac63640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70240727e0 0x7f7024146610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:55.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.449+0000 7f702ac63640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f702415ad10 0x7f702406ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:55.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.449+0000 7f702ac63640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f702415ea80 0x7f702406f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:55.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.449+0000 7f702ac63640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f70240b3c00 con 0x7f70240727e0 2024-04-16T15:52:55.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.449+0000 7f702ac63640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f70240b3a80 con 0x7f702415ea80 2024-04-16T15:52:55.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.449+0000 7f702ac63640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f702415b0f0 con 0x7f702415ad10 2024-04-16T15:52:55.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.449+0000 7f70289ff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70240727e0 0x7f7024146610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:55.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.449+0000 7f70289ff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70240727e0 0x7f7024146610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60456/0 (socket says 172.21.15.132:60456) 2024-04-16T15:52:55.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.449+0000 7f70289ff640 1 -- 172.21.15.132:0/1169822821 learned_addr learned my addr 172.21.15.132:0/1169822821 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:55.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.449+0000 7f70289ff640 1 -- 172.21.15.132:0/1169822821 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f702415ad10 msgr2=0x7f702406ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:55.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.449+0000 7f70289ff640 1 --2- 172.21.15.132:0/1169822821 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f702415ad10 0x7f702406ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:55.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.449+0000 7f70289ff640 1 -- 172.21.15.132:0/1169822821 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f702415ea80 msgr2=0x7f702406f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:55.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.449+0000 7f70289ff640 1 --2- 172.21.15.132:0/1169822821 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f702415ea80 0x7f702406f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:55.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.449+0000 7f70289ff640 1 -- 172.21.15.132:0/1169822821 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7024148dc0 con 0x7f70240727e0 2024-04-16T15:52:55.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.450+0000 7f70289ff640 1 --2- 172.21.15.132:0/1169822821 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70240727e0 0x7f7024146610 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f701400c500 tx=0x7f701400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:55.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.450+0000 7f70217fa640 1 -- 172.21.15.132:0/1169822821 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7014018070 con 0x7f70240727e0 2024-04-16T15:52:55.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.450+0000 7f70217fa640 1 -- 172.21.15.132:0/1169822821 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7014007580 con 0x7f70240727e0 2024-04-16T15:52:55.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.450+0000 7f702ac63640 1 -- 172.21.15.132:0/1169822821 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7024149090 con 0x7f70240727e0 2024-04-16T15:52:55.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.450+0000 7f70217fa640 1 -- 172.21.15.132:0/1169822821 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7014004a20 con 0x7f70240727e0 2024-04-16T15:52:55.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.450+0000 7f702ac63640 1 -- 172.21.15.132:0/1169822821 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7024149650 con 0x7f70240727e0 2024-04-16T15:52:55.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.451+0000 7f702ac63640 1 -- 172.21.15.132:0/1169822821 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7024075510 con 0x7f70240727e0 2024-04-16T15:52:55.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.451+0000 7f70217fa640 1 -- 172.21.15.132:0/1169822821 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f701401b070 con 0x7f70240727e0 2024-04-16T15:52:55.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.452+0000 7f70217fa640 1 --2- 172.21.15.132:0/1169822821 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f701006c8f0 0x7f701006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:55.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.452+0000 7f70217fa640 1 -- 172.21.15.132:0/1169822821 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f701408adc0 con 0x7f70240727e0 2024-04-16T15:52:55.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.452+0000 7f7023fff640 1 --2- 172.21.15.132:0/1169822821 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f701006c8f0 0x7f701006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:55.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.452+0000 7f7023fff640 1 --2- 172.21.15.132:0/1169822821 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f701006c8f0 0x7f701006edb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7018037000 tx=0x7f701802f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:55.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.456+0000 7f70217fa640 1 -- 172.21.15.132:0/1169822821 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7014059280 con 0x7f70240727e0 2024-04-16T15:52:55.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.631+0000 7f702ac63640 1 -- 172.21.15.132:0/1169822821 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f70240c8bd0 con 0x7f70240727e0 2024-04-16T15:52:55.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.631+0000 7f70217fa640 1 -- 172.21.15.132:0/1169822821 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f7014058b80 con 0x7f70240727e0 2024-04-16T15:52:55.631 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2024-04-16T15:52:55.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.634+0000 7f702ac63640 1 -- 172.21.15.132:0/1169822821 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f701006c8f0 msgr2=0x7f701006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:55.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.634+0000 7f702ac63640 1 --2- 172.21.15.132:0/1169822821 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f701006c8f0 0x7f701006edb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7018037000 tx=0x7f701802f000 comp rx=0 tx=0).stop 2024-04-16T15:52:55.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.634+0000 7f702ac63640 1 -- 172.21.15.132:0/1169822821 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70240727e0 msgr2=0x7f7024146610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:55.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.634+0000 7f702ac63640 1 --2- 172.21.15.132:0/1169822821 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70240727e0 0x7f7024146610 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f701400c500 tx=0x7f701400c9c0 comp rx=0 tx=0).stop 2024-04-16T15:52:55.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.634+0000 7f702ac63640 1 -- 172.21.15.132:0/1169822821 shutdown_connections 2024-04-16T15:52:55.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.634+0000 7f702ac63640 1 --2- 172.21.15.132:0/1169822821 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f701006c8f0 0x7f701006edb0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:55.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.634+0000 7f702ac63640 1 --2- 172.21.15.132:0/1169822821 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f702415ea80 0x7f702406f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:55.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.634+0000 7f702ac63640 1 --2- 172.21.15.132:0/1169822821 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f702415ad10 0x7f702406ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:55.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.634+0000 7f702ac63640 1 --2- 172.21.15.132:0/1169822821 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70240727e0 0x7f7024146610 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:55.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.634+0000 7f702ac63640 1 -- 172.21.15.132:0/1169822821 >> 172.21.15.132:0/1169822821 conn(0x7f70240d0490 msgr2=0x7f70240cf530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:55.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.634+0000 7f702ac63640 1 -- 172.21.15.132:0/1169822821 shutdown_connections 2024-04-16T15:52:55.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.634+0000 7f702ac63640 1 -- 172.21.15.132:0/1169822821 wait complete. 2024-04-16T15:52:55.645 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T15:52:55.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.751+0000 7fd7a5500640 1 Processor -- start 2024-04-16T15:52:55.751 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.751+0000 7fd7a5500640 1 -- start start 2024-04-16T15:52:55.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.752+0000 7fd7a5500640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd7a015ea80 0x7fd7a00d1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:55.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.752+0000 7fd7a5500640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7a006fb60 0x7fd7a00cafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:55.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.752+0000 7fd7a5500640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7a015ee60 con 0x7fd7a00b4660 2024-04-16T15:52:55.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.752+0000 7fd7a5500640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fd7a00b4dd0 con 0x7fd7a015ea80 2024-04-16T15:52:55.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.752+0000 7fd7a5500640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fd7a00b50b0 con 0x7fd7a006fb60 2024-04-16T15:52:55.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.752+0000 7fd79effd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd7a015ea80 0x7fd7a00d1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:55.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.752+0000 7fd79effd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd7a015ea80 0x7fd7a00d1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60462/0 (socket says 172.21.15.132:60462) 2024-04-16T15:52:55.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.752+0000 7fd79effd640 1 -- 172.21.15.132:0/3502701798 learned_addr learned my addr 172.21.15.132:0/3502701798 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:55.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.753+0000 7fd79effd640 1 -- 172.21.15.132:0/3502701798 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7a006fb60 msgr2=0x7fd7a00cafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:55.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.753+0000 7fd79effd640 1 --2- 172.21.15.132:0/3502701798 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7a006fb60 0x7fd7a00cafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:55.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.753+0000 7fd79effd640 1 -- 172.21.15.132:0/3502701798 >> v1:172.21.15.179:6789/0 conn(0x7fd7a00b4660 legacy=0x7fd7a006f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:55.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.753+0000 7fd79effd640 1 -- 172.21.15.132:0/3502701798 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7a00b5390 con 0x7fd7a015ea80 2024-04-16T15:52:55.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.753+0000 7fd79effd640 1 --2- 172.21.15.132:0/3502701798 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7a015ea80 0x7fd7a00d1d30 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd7a00b6940 tx=0x7fd79002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5f15bfb39d96315 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:55.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.753+0000 7fd79dffb640 1 -- 172.21.15.132:0/3502701798 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd79002caf0 con 0x7fd7a015ea80 2024-04-16T15:52:55.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.753+0000 7fd79dffb640 1 -- 172.21.15.132:0/3502701798 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd79002cc90 con 0x7fd7a015ea80 2024-04-16T15:52:55.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.753+0000 7fd79dffb640 1 -- 172.21.15.132:0/3502701798 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd790034610 con 0x7fd7a015ea80 2024-04-16T15:52:55.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.754+0000 7fd7a5500640 1 -- 172.21.15.132:0/3502701798 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7a015ea80 msgr2=0x7fd7a00d1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:55.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.754+0000 7fd7a5500640 1 --2- 172.21.15.132:0/3502701798 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7a015ea80 0x7fd7a00d1d30 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd7a00b6940 tx=0x7fd79002bf50 comp rx=0 tx=0).stop 2024-04-16T15:52:55.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.754+0000 7fd7a5500640 1 -- 172.21.15.132:0/3502701798 shutdown_connections 2024-04-16T15:52:55.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.754+0000 7fd7a5500640 1 --2- 172.21.15.132:0/3502701798 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7a006fb60 0x7fd7a00cafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:55.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.754+0000 7fd7a5500640 1 --2- 172.21.15.132:0/3502701798 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7a015ea80 0x7fd7a00d1d30 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:55.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.754+0000 7fd7a5500640 1 -- 172.21.15.132:0/3502701798 >> 172.21.15.132:0/3502701798 conn(0x7fd7a00b6b80 msgr2=0x7fd7a00b6f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:55.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.754+0000 7fd7a5500640 1 -- 172.21.15.132:0/3502701798 shutdown_connections 2024-04-16T15:52:55.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.754+0000 7fd7a5500640 1 -- 172.21.15.132:0/3502701798 wait complete. 2024-04-16T15:52:55.759 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.755+0000 7fd7a5500640 1 Processor -- start 2024-04-16T15:52:55.759 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.755+0000 7fd7a5500640 1 -- start start 2024-04-16T15:52:55.759 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.756+0000 7fd7a5500640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7a006fb60 0x7fd7a014c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:55.759 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.756+0000 7fd7a5500640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7a00b4660 0x7fd7a01f8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:55.759 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.756+0000 7fd7a5500640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7a015ea80 0x7fd7a0160fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:55.759 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.756+0000 7fd7a5500640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a00b4ac0 con 0x7fd7a00b4660 2024-04-16T15:52:55.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.756+0000 7fd7a5500640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a00caa80 con 0x7fd7a006fb60 2024-04-16T15:52:55.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.756+0000 7fd7a5500640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fd7a00cb4e0 con 0x7fd7a015ea80 2024-04-16T15:52:55.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.756+0000 7fd79e7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7a00b4660 0x7fd7a01f8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:55.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.756+0000 7fd79e7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7a00b4660 0x7fd7a01f8730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60468/0 (socket says 172.21.15.132:60468) 2024-04-16T15:52:55.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.756+0000 7fd79e7fc640 1 -- 172.21.15.132:0/3585712156 learned_addr learned my addr 172.21.15.132:0/3585712156 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:55.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.756+0000 7fd79effd640 1 --2- 172.21.15.132:0/3585712156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7a006fb60 0x7fd7a014c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:55.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.756+0000 7fd79f7fe640 1 --2- 172.21.15.132:0/3585712156 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7a015ea80 0x7fd7a0160fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:55.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.757+0000 7fd79e7fc640 1 -- 172.21.15.132:0/3585712156 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7a015ea80 msgr2=0x7fd7a0160fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:55.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.757+0000 7fd79e7fc640 1 --2- 172.21.15.132:0/3585712156 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7a015ea80 0x7fd7a0160fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:55.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.757+0000 7fd79e7fc640 1 -- 172.21.15.132:0/3585712156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7a006fb60 msgr2=0x7fd7a014c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:55.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.757+0000 7fd79e7fc640 1 --2- 172.21.15.132:0/3585712156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7a006fb60 0x7fd7a014c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:55.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.757+0000 7fd79e7fc640 1 -- 172.21.15.132:0/3585712156 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7a01f8c70 con 0x7fd7a00b4660 2024-04-16T15:52:55.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.757+0000 7fd79e7fc640 1 --2- 172.21.15.132:0/3585712156 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7a00b4660 0x7fd7a01f8730 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd78800c440 tx=0x7fd78800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:55.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.757+0000 7fd7977fe640 1 -- 172.21.15.132:0/3585712156 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd788017070 con 0x7fd7a00b4660 2024-04-16T15:52:55.761 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.757+0000 7fd7977fe640 1 -- 172.21.15.132:0/3585712156 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7880035f0 con 0x7fd7a00b4660 2024-04-16T15:52:55.761 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.757+0000 7fd7a5500640 1 -- 172.21.15.132:0/3585712156 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7a00b12b0 con 0x7fd7a00b4660 2024-04-16T15:52:55.761 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.757+0000 7fd7977fe640 1 -- 172.21.15.132:0/3585712156 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7880039e0 con 0x7fd7a00b4660 2024-04-16T15:52:55.761 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.757+0000 7fd7a5500640 1 -- 172.21.15.132:0/3585712156 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7a0157de0 con 0x7fd7a00b4660 2024-04-16T15:52:55.761 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.758+0000 7fd7a5500640 1 -- 172.21.15.132:0/3585712156 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7a0075510 con 0x7fd7a00b4660 2024-04-16T15:52:55.761 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.758+0000 7fd7977fe640 1 -- 172.21.15.132:0/3585712156 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd78801a070 con 0x7fd7a00b4660 2024-04-16T15:52:55.761 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.759+0000 7fd7977fe640 1 --2- 172.21.15.132:0/3585712156 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fd78006c8f0 0x7fd78006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:55.761 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.759+0000 7fd7977fe640 1 -- 172.21.15.132:0/3585712156 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd78808adc0 con 0x7fd7a00b4660 2024-04-16T15:52:55.761 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.759+0000 7fd79effd640 1 --2- 172.21.15.132:0/3585712156 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fd78006c8f0 0x7fd78006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:55.761 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.759+0000 7fd79effd640 1 --2- 172.21.15.132:0/3585712156 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fd78006c8f0 0x7fd78006edb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd790035000 tx=0x7fd790030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:55.762 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.763+0000 7fd7977fe640 1 -- 172.21.15.132:0/3585712156 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd7a01f8c70 con 0x7fd7a00b4660 2024-04-16T15:52:55.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.936+0000 7fd7a5500640 1 -- 172.21.15.132:0/3585712156 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd7a01580e0 con 0x7fd7a00b4660 2024-04-16T15:52:55.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.936+0000 7fd7977fe640 1 -- 172.21.15.132:0/3585712156 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fd7880010c0 con 0x7fd7a00b4660 2024-04-16T15:52:55.935 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2024-04-16T15:52:55.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.938+0000 7fd7a5500640 1 -- 172.21.15.132:0/3585712156 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fd78006c8f0 msgr2=0x7fd78006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:55.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.938+0000 7fd7a5500640 1 --2- 172.21.15.132:0/3585712156 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fd78006c8f0 0x7fd78006edb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd790035000 tx=0x7fd790030000 comp rx=0 tx=0).stop 2024-04-16T15:52:55.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.938+0000 7fd7a5500640 1 -- 172.21.15.132:0/3585712156 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7a00b4660 msgr2=0x7fd7a01f8730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:55.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.938+0000 7fd7a5500640 1 --2- 172.21.15.132:0/3585712156 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7a00b4660 0x7fd7a01f8730 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd78800c440 tx=0x7fd78800c900 comp rx=0 tx=0).stop 2024-04-16T15:52:55.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.938+0000 7fd7a5500640 1 -- 172.21.15.132:0/3585712156 shutdown_connections 2024-04-16T15:52:55.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.938+0000 7fd7a5500640 1 --2- 172.21.15.132:0/3585712156 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fd78006c8f0 0x7fd78006edb0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:55.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.938+0000 7fd7a5500640 1 --2- 172.21.15.132:0/3585712156 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7a015ea80 0x7fd7a0160fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:55.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.938+0000 7fd7a5500640 1 --2- 172.21.15.132:0/3585712156 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7a00b4660 0x7fd7a01f8730 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:55.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.938+0000 7fd7a5500640 1 --2- 172.21.15.132:0/3585712156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7a006fb60 0x7fd7a014c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:55.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.938+0000 7fd7a5500640 1 -- 172.21.15.132:0/3585712156 >> 172.21.15.132:0/3585712156 conn(0x7fd7a00b6b80 msgr2=0x7fd7a015d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:55.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.938+0000 7fd7a5500640 1 -- 172.21.15.132:0/3585712156 shutdown_connections 2024-04-16T15:52:55.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:55.938+0000 7fd7a5500640 1 -- 172.21.15.132:0/3585712156 wait complete. 2024-04-16T15:52:55.948 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-16T15:52:56.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.061+0000 7f7619540640 1 Processor -- start 2024-04-16T15:52:56.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.061+0000 7f7619540640 1 -- start start 2024-04-16T15:52:56.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.062+0000 7f7619540640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7614070780 0x7f7614070be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:56.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.062+0000 7f7619540640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f761406f370 0x7f761406f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:56.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.062+0000 7f7619540640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f761415ef60 con 0x7f761415eb80 2024-04-16T15:52:56.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.062+0000 7f7619540640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f7614071120 con 0x7f761406f370 2024-04-16T15:52:56.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.062+0000 7f7619540640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f761406c910 con 0x7f7614070780 2024-04-16T15:52:56.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.062+0000 7f7612ffd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f761415eb80 0x7f76140b06b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:46910/0 (socket says 172.21.15.132:46910) 2024-04-16T15:52:56.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.062+0000 7f7612ffd640 1 -- 172.21.15.132:0/4170514678 learned_addr learned my addr 172.21.15.132:0/4170514678 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:56.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.062+0000 7f76127fc640 1 --2- 172.21.15.132:0/4170514678 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7614070780 0x7f7614070be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:56.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.062+0000 7f76137fe640 1 --2- 172.21.15.132:0/4170514678 >> v2:172.21.15.179:3300/0 conn(0x7f761406f370 0x7f761406f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:56.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.063+0000 7f7611ffb640 1 -- 172.21.15.132:0/4170514678 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2076358253 0 0) 0x7f761415ef60 con 0x7f761415eb80 2024-04-16T15:52:56.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.063+0000 7f7611ffb640 1 -- 172.21.15.132:0/4170514678 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7600003520 con 0x7f761415eb80 2024-04-16T15:52:56.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.063+0000 7f7611ffb640 1 -- 172.21.15.132:0/4170514678 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3584761906 0 0) 0x7f7600003520 con 0x7f761415eb80 2024-04-16T15:52:56.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.063+0000 7f7611ffb640 1 -- 172.21.15.132:0/4170514678 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7614070780 msgr2=0x7f7614070be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:56.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.063+0000 7f7611ffb640 1 --2- 172.21.15.132:0/4170514678 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7614070780 0x7f7614070be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:56.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.063+0000 7f7611ffb640 1 -- 172.21.15.132:0/4170514678 >> v2:172.21.15.179:3300/0 conn(0x7f761406f370 msgr2=0x7f761406f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:56.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.063+0000 7f7611ffb640 1 --2- 172.21.15.132:0/4170514678 >> v2:172.21.15.179:3300/0 conn(0x7f761406f370 0x7f761406f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:56.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.063+0000 7f7611ffb640 1 -- 172.21.15.132:0/4170514678 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76140ae480 con 0x7f761415eb80 2024-04-16T15:52:56.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.063+0000 7f7611ffb640 1 -- 172.21.15.132:0/4170514678 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2803668828 0 0) 0x7f76040019f0 con 0x7f761415eb80 2024-04-16T15:52:56.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.063+0000 7f7611ffb640 1 -- 172.21.15.132:0/4170514678 >> v1:172.21.15.132:6789/0 conn(0x7f761415eb80 legacy=0x7f76140b06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:56.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.063+0000 7f7611ffb640 1 --2- 172.21.15.132:0/4170514678 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76000039b0 0x7f7600003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:56.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.063+0000 7f7611ffb640 1 --2- 172.21.15.132:0/4170514678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7600004800 0x7f7600004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:56.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.063+0000 7f7611ffb640 1 --2- 172.21.15.132:0/4170514678 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7614070780 0x7f76000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:56.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.063+0000 7f7611ffb640 1 -- 172.21.15.132:0/4170514678 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f761406c910 con 0x7f76000039b0 2024-04-16T15:52:56.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.063+0000 7f7611ffb640 1 -- 172.21.15.132:0/4170514678 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f760000b9c0 con 0x7f7600004800 2024-04-16T15:52:56.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.063+0000 7f7611ffb640 1 -- 172.21.15.132:0/4170514678 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f760000bb40 con 0x7f7614070780 2024-04-16T15:52:56.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.063+0000 7f7612ffd640 1 --2- 172.21.15.132:0/4170514678 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76000039b0 0x7f7600003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:56.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.063+0000 7f76127fc640 1 --2- 172.21.15.132:0/4170514678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7600004800 0x7f7600004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:56.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.063+0000 7f76137fe640 1 --2- 172.21.15.132:0/4170514678 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7614070780 0x7f76000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:56.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.063+0000 7f7612ffd640 1 -- 172.21.15.132:0/4170514678 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7614070780 msgr2=0x7f76000051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:56.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.063+0000 7f7612ffd640 1 --2- 172.21.15.132:0/4170514678 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7614070780 0x7f76000051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:56.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.063+0000 7f7612ffd640 1 -- 172.21.15.132:0/4170514678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7600004800 msgr2=0x7f7600004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:56.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.063+0000 7f7612ffd640 1 --2- 172.21.15.132:0/4170514678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7600004800 0x7f7600004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:56.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.063+0000 7f7612ffd640 1 -- 172.21.15.132:0/4170514678 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7600003520 con 0x7f76000039b0 2024-04-16T15:52:56.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.063+0000 7f76127fc640 1 --2- 172.21.15.132:0/4170514678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7600004800 0x7f7600004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:56.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.064+0000 7f7612ffd640 1 --2- 172.21.15.132:0/4170514678 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76000039b0 0x7f7600003dd0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f760400a8a0 tx=0x7f7600005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c18e4011bdead096 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:56.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.064+0000 7f7611ffb640 1 -- 172.21.15.132:0/4170514678 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f760400a4c0 con 0x7f76000039b0 2024-04-16T15:52:56.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.064+0000 7f7611ffb640 1 -- 172.21.15.132:0/4170514678 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7604034650 con 0x7f76000039b0 2024-04-16T15:52:56.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.064+0000 7f7611ffb640 1 -- 172.21.15.132:0/4170514678 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7604034a40 con 0x7f76000039b0 2024-04-16T15:52:56.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.065+0000 7f7619540640 1 -- 172.21.15.132:0/4170514678 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76000039b0 msgr2=0x7f7600003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:56.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.065+0000 7f7619540640 1 --2- 172.21.15.132:0/4170514678 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76000039b0 0x7f7600003dd0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f760400a8a0 tx=0x7f7600005830 comp rx=0 tx=0).stop 2024-04-16T15:52:56.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.065+0000 7f76137fe640 1 -- 172.21.15.132:0/4170514678 reap_dead start 2024-04-16T15:52:56.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.065+0000 7f7619540640 1 -- 172.21.15.132:0/4170514678 shutdown_connections 2024-04-16T15:52:56.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.065+0000 7f7619540640 1 -- 172.21.15.132:0/4170514678 >> 172.21.15.132:0/4170514678 conn(0x7f761409aa30 msgr2=0x7f76140b31a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:56.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.065+0000 7f7619540640 1 -- 172.21.15.132:0/4170514678 shutdown_connections 2024-04-16T15:52:56.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.065+0000 7f7619540640 1 -- 172.21.15.132:0/4170514678 wait complete. 2024-04-16T15:52:56.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.066+0000 7f7619540640 1 Processor -- start 2024-04-16T15:52:56.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.066+0000 7f7619540640 1 -- start start 2024-04-16T15:52:56.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.067+0000 7f7619540640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76000039b0 0x7f76140b2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:56.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.067+0000 7f7619540640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76140b2750 0x7f76140cc080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:56.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.067+0000 7f7619540640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76140cc5c0 0x7f76140b5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:56.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.067+0000 7f7619540640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f761406bfe0 con 0x7f76140cc5c0 2024-04-16T15:52:56.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.067+0000 7f7619540640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f761406bd00 con 0x7f76140b2750 2024-04-16T15:52:56.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.067+0000 7f7619540640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f761406c2c0 con 0x7f76000039b0 2024-04-16T15:52:56.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.067+0000 7f76137fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76140cc5c0 0x7f76140b5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:56.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.067+0000 7f76137fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76140cc5c0 0x7f76140b5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60500/0 (socket says 172.21.15.132:60500) 2024-04-16T15:52:56.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.067+0000 7f76137fe640 1 -- 172.21.15.132:0/1551533942 learned_addr learned my addr 172.21.15.132:0/1551533942 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:56.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.067+0000 7f76127fc640 1 --2- 172.21.15.132:0/1551533942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76140b2750 0x7f76140cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:56.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.067+0000 7f7612ffd640 1 --2- 172.21.15.132:0/1551533942 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76000039b0 0x7f76140b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:56.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.067+0000 7f76137fe640 1 -- 172.21.15.132:0/1551533942 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76000039b0 msgr2=0x7f76140b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:56.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.067+0000 7f76137fe640 1 --2- 172.21.15.132:0/1551533942 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76000039b0 0x7f76140b2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:56.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.067+0000 7f76137fe640 1 -- 172.21.15.132:0/1551533942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76140b2750 msgr2=0x7f76140cc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:56.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.067+0000 7f76137fe640 1 --2- 172.21.15.132:0/1551533942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76140b2750 0x7f76140cc080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:56.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.067+0000 7f76137fe640 1 -- 172.21.15.132:0/1551533942 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76140b1b30 con 0x7f76140cc5c0 2024-04-16T15:52:56.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.067+0000 7f76127fc640 1 --2- 172.21.15.132:0/1551533942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76140b2750 0x7f76140cc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:56.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.067+0000 7f76137fe640 1 --2- 172.21.15.132:0/1551533942 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76140cc5c0 0x7f76140b5810 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f76140cdfb0 tx=0x7f760c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:56.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.067+0000 7f760b7fe640 1 -- 172.21.15.132:0/1551533942 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f760c004440 con 0x7f76140cc5c0 2024-04-16T15:52:56.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.067+0000 7f760b7fe640 1 -- 172.21.15.132:0/1551533942 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f760c01b070 con 0x7f76140cc5c0 2024-04-16T15:52:56.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.067+0000 7f7619540640 1 -- 172.21.15.132:0/1551533942 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76140b65b0 con 0x7f76140cc5c0 2024-04-16T15:52:56.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.067+0000 7f760b7fe640 1 -- 172.21.15.132:0/1551533942 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f760c003850 con 0x7f76140cc5c0 2024-04-16T15:52:56.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.068+0000 7f7619540640 1 -- 172.21.15.132:0/1551533942 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76140b6b70 con 0x7f76140cc5c0 2024-04-16T15:52:56.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.068+0000 7f7619540640 1 -- 172.21.15.132:0/1551533942 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76140b0560 con 0x7f76140cc5c0 2024-04-16T15:52:56.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.069+0000 7f760b7fe640 1 -- 172.21.15.132:0/1551533942 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f760c0039f0 con 0x7f76140cc5c0 2024-04-16T15:52:56.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.069+0000 7f760b7fe640 1 --2- 172.21.15.132:0/1551533942 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f75f406c920 0x7f75f406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:56.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.070+0000 7f7612ffd640 1 --2- 172.21.15.132:0/1551533942 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f75f406c920 0x7f75f406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:56.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.070+0000 7f760b7fe640 1 -- 172.21.15.132:0/1551533942 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f760c08b8e0 con 0x7f76140cc5c0 2024-04-16T15:52:56.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.070+0000 7f7612ffd640 1 --2- 172.21.15.132:0/1551533942 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f75f406c920 0x7f75f406ede0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7604034000 tx=0x7f7604009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:56.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.074+0000 7f760b7fe640 1 -- 172.21.15.132:0/1551533942 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f76140b0560 con 0x7f76140cc5c0 2024-04-16T15:52:56.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.267+0000 7f7619540640 1 -- 172.21.15.132:0/1551533942 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7614075510 con 0x7f76140cc5c0 2024-04-16T15:52:56.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.267+0000 7f760b7fe640 1 -- 172.21.15.132:0/1551533942 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f760c024020 con 0x7f76140cc5c0 2024-04-16T15:52:56.267 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2024-04-16T15:52:56.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.269+0000 7f7619540640 1 -- 172.21.15.132:0/1551533942 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f75f406c920 msgr2=0x7f75f406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:56.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.269+0000 7f7619540640 1 --2- 172.21.15.132:0/1551533942 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f75f406c920 0x7f75f406ede0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7604034000 tx=0x7f7604009030 comp rx=0 tx=0).stop 2024-04-16T15:52:56.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.269+0000 7f7619540640 1 -- 172.21.15.132:0/1551533942 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76140cc5c0 msgr2=0x7f76140b5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:56.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.269+0000 7f7619540640 1 --2- 172.21.15.132:0/1551533942 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76140cc5c0 0x7f76140b5810 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f76140cdfb0 tx=0x7f760c009f90 comp rx=0 tx=0).stop 2024-04-16T15:52:56.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.269+0000 7f7619540640 1 -- 172.21.15.132:0/1551533942 shutdown_connections 2024-04-16T15:52:56.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.269+0000 7f7619540640 1 --2- 172.21.15.132:0/1551533942 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f75f406c920 0x7f75f406ede0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:56.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.269+0000 7f7619540640 1 --2- 172.21.15.132:0/1551533942 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76140cc5c0 0x7f76140b5810 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:56.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.269+0000 7f7619540640 1 --2- 172.21.15.132:0/1551533942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76140b2750 0x7f76140cc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:56.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.269+0000 7f7619540640 1 --2- 172.21.15.132:0/1551533942 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76000039b0 0x7f76140b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:56.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.269+0000 7f7619540640 1 -- 172.21.15.132:0/1551533942 >> 172.21.15.132:0/1551533942 conn(0x7f761409aa30 msgr2=0x7f76140d0680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:56.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.270+0000 7f7619540640 1 -- 172.21.15.132:0/1551533942 shutdown_connections 2024-04-16T15:52:56.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.270+0000 7f7619540640 1 -- 172.21.15.132:0/1551533942 wait complete. 2024-04-16T15:52:56.280 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-16T15:52:56.280 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T15:52:56.300 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:52:56.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.405+0000 7fd3a6159640 1 Processor -- start 2024-04-16T15:52:56.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.405+0000 7fd3a6159640 1 -- start start 2024-04-16T15:52:56.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.406+0000 7fd3a6159640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd3a00b5cc0 0x7fd3a00b6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:56.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.406+0000 7fd3a6159640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd3a006dc90 0x7fd3a006e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:56.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.406+0000 7fd3a6159640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3a00cec90 con 0x7fd3a0151e90 2024-04-16T15:52:56.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.406+0000 7fd3a6159640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fd3a00d00e0 con 0x7fd3a006dc90 2024-04-16T15:52:56.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.406+0000 7fd3a6159640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fd3a00cf540 con 0x7fd3a00b5cc0 2024-04-16T15:52:56.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.406+0000 7fd39ffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd3a006dc90 0x7fd3a006e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:56.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.406+0000 7fd39ffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd3a006dc90 0x7fd3a006e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60510/0 (socket says 172.21.15.132:60510) 2024-04-16T15:52:56.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.406+0000 7fd39ffff640 1 -- 172.21.15.132:0/3390906235 learned_addr learned my addr 172.21.15.132:0/3390906235 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:56.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.406+0000 7fd39ffff640 1 -- 172.21.15.132:0/3390906235 >> v2:172.21.15.179:3300/0 conn(0x7fd3a00b5cc0 msgr2=0x7fd3a00b6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:56.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.406+0000 7fd39ffff640 1 --2- 172.21.15.132:0/3390906235 >> v2:172.21.15.179:3300/0 conn(0x7fd3a00b5cc0 0x7fd3a00b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:56.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.406+0000 7fd39ffff640 1 -- 172.21.15.132:0/3390906235 >> v1:172.21.15.179:6789/0 conn(0x7fd3a0151e90 legacy=0x7fd3a00cf9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:56.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.406+0000 7fd39ffff640 1 -- 172.21.15.132:0/3390906235 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3a00cef10 con 0x7fd3a006dc90 2024-04-16T15:52:56.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.407+0000 7fd39ffff640 1 --2- 172.21.15.132:0/3390906235 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd3a006dc90 0x7fd3a006e0e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd3a00ce720 tx=0x7fd39802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddf9425e3706feff server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:56.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.407+0000 7fd39e7fc640 1 -- 172.21.15.132:0/3390906235 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd39802ca80 con 0x7fd3a006dc90 2024-04-16T15:52:56.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.407+0000 7fd39e7fc640 1 -- 172.21.15.132:0/3390906235 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd39802cc20 con 0x7fd3a006dc90 2024-04-16T15:52:56.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.407+0000 7fd39e7fc640 1 -- 172.21.15.132:0/3390906235 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3980343f0 con 0x7fd3a006dc90 2024-04-16T15:52:56.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.408+0000 7fd3a6159640 1 -- 172.21.15.132:0/3390906235 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd3a006dc90 msgr2=0x7fd3a006e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:56.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.408+0000 7fd3a6159640 1 --2- 172.21.15.132:0/3390906235 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd3a006dc90 0x7fd3a006e0e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd3a00ce720 tx=0x7fd39802bee0 comp rx=0 tx=0).stop 2024-04-16T15:52:56.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.408+0000 7fd3a6159640 1 -- 172.21.15.132:0/3390906235 shutdown_connections 2024-04-16T15:52:56.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.408+0000 7fd3a6159640 1 --2- 172.21.15.132:0/3390906235 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd3a006dc90 0x7fd3a006e0e0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:56.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.408+0000 7fd3a6159640 1 --2- 172.21.15.132:0/3390906235 >> v2:172.21.15.179:3300/0 conn(0x7fd3a00b5cc0 0x7fd3a00b6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:56.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.408+0000 7fd3a6159640 1 -- 172.21.15.132:0/3390906235 >> 172.21.15.132:0/3390906235 conn(0x7fd3a00b2d50 msgr2=0x7fd3a006ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:56.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.408+0000 7fd3a6159640 1 -- 172.21.15.132:0/3390906235 shutdown_connections 2024-04-16T15:52:56.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.408+0000 7fd3a6159640 1 -- 172.21.15.132:0/3390906235 wait complete. 2024-04-16T15:52:56.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.409+0000 7fd3a6159640 1 Processor -- start 2024-04-16T15:52:56.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.409+0000 7fd3a6159640 1 -- start start 2024-04-16T15:52:56.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.410+0000 7fd3a6159640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3a006dc90 0x7fd3a014af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:56.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.410+0000 7fd3a6159640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd3a00b5cc0 0x7fd3a0152cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:56.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.410+0000 7fd3a6159640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3a0151e90 0x7fd3a01531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:56.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.410+0000 7fd3a6159640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a00cf1d0 con 0x7fd3a00b5cc0 2024-04-16T15:52:56.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.410+0000 7fd3a6159640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a015c130 con 0x7fd3a006dc90 2024-04-16T15:52:56.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.410+0000 7fd3a6159640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fd3a006e620 con 0x7fd3a0151e90 2024-04-16T15:52:56.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.410+0000 7fd39effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd3a00b5cc0 0x7fd3a0152cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:56.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.410+0000 7fd39effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd3a00b5cc0 0x7fd3a0152cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60518/0 (socket says 172.21.15.132:60518) 2024-04-16T15:52:56.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.410+0000 7fd39effd640 1 -- 172.21.15.132:0/2317382685 learned_addr learned my addr 172.21.15.132:0/2317382685 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:56.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.410+0000 7fd39f7fe640 1 --2- 172.21.15.132:0/2317382685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3a006dc90 0x7fd3a014af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:56.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.410+0000 7fd39effd640 1 -- 172.21.15.132:0/2317382685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3a0151e90 msgr2=0x7fd3a01531f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:56.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.410+0000 7fd39effd640 1 --2- 172.21.15.132:0/2317382685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3a0151e90 0x7fd3a01531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:56.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.410+0000 7fd39effd640 1 -- 172.21.15.132:0/2317382685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3a006dc90 msgr2=0x7fd3a014af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:56.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.410+0000 7fd39effd640 1 --2- 172.21.15.132:0/2317382685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3a006dc90 0x7fd3a014af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:56.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.410+0000 7fd39effd640 1 -- 172.21.15.132:0/2317382685 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3a0154600 con 0x7fd3a00b5cc0 2024-04-16T15:52:56.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.410+0000 7fd39f7fe640 1 --2- 172.21.15.132:0/2317382685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3a006dc90 0x7fd3a014af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:52:56.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.411+0000 7fd39effd640 1 --2- 172.21.15.132:0/2317382685 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd3a00b5cc0 0x7fd3a0152cb0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd39400b4a0 tx=0x7fd39400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:56.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.411+0000 7fd387fff640 1 -- 172.21.15.132:0/2317382685 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd394014070 con 0x7fd3a00b5cc0 2024-04-16T15:52:56.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.411+0000 7fd387fff640 1 -- 172.21.15.132:0/2317382685 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd394010610 con 0x7fd3a00b5cc0 2024-04-16T15:52:56.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.411+0000 7fd387fff640 1 -- 172.21.15.132:0/2317382685 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd394010a00 con 0x7fd3a00b5cc0 2024-04-16T15:52:56.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.411+0000 7fd3a6159640 1 -- 172.21.15.132:0/2317382685 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3a01548e0 con 0x7fd3a00b5cc0 2024-04-16T15:52:56.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.411+0000 7fd3a6159640 1 -- 172.21.15.132:0/2317382685 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3a0152790 con 0x7fd3a00b5cc0 2024-04-16T15:52:56.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.412+0000 7fd3a6159640 1 -- 172.21.15.132:0/2317382685 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3a00cfad0 con 0x7fd3a00b5cc0 2024-04-16T15:52:56.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.412+0000 7fd387fff640 1 -- 172.21.15.132:0/2317382685 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd394017070 con 0x7fd3a00b5cc0 2024-04-16T15:52:56.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.413+0000 7fd387fff640 1 --2- 172.21.15.132:0/2317382685 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fd38c06c920 0x7fd38c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:56.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.413+0000 7fd387fff640 1 -- 172.21.15.132:0/2317382685 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5825+0+0 (secure 0 0 0) 0x7fd39408b5c0 con 0x7fd3a00b5cc0 2024-04-16T15:52:56.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.413+0000 7fd39f7fe640 1 --2- 172.21.15.132:0/2317382685 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fd38c06c920 0x7fd38c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:56.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.413+0000 7fd39f7fe640 1 --2- 172.21.15.132:0/2317382685 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fd38c06c920 0x7fd38c06ede0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd3a0153ef0 tx=0x7fd390008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:56.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.417+0000 7fd387fff640 1 -- 172.21.15.132:0/2317382685 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd3a00cfad0 con 0x7fd3a00b5cc0 2024-04-16T15:52:56.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.598+0000 7fd3a6159640 1 -- 172.21.15.132:0/2317382685 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd3a0075510 con 0x7fd3a00b5cc0 2024-04-16T15:52:56.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.599+0000 7fd387fff640 1 -- 172.21.15.132:0/2317382685 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16855 (secure 0 0 0) 0x7fd394059a00 con 0x7fd3a00b5cc0 2024-04-16T15:52:56.599 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:52:56.599 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":21,"fsid":"6bdec5d9-f406-43ad-8584-0503b32f6f0d","created":"2024-04-16T15:51:51.073040+0000","modified":"2024-04-16T15:52:56.147839+0000","last_up_change":"2024-04-16T15:52:02.280496+0000","last_in_change":"2024-04-16T15:51:53.376468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:52:03.284927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:52:13.363758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T15:52:14.246647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d45908b-6e22-4619-b190-897af594b712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6801","nonce":1170594668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6803","nonce":1170594668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6807","nonce":1170594668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6805","nonce":1170594668}]},"public_addr":"172.21.15.132:6801/1170594668","cluster_addr":"172.21.15.132:6803/1170594668","heartbeat_back_addr":"172.21.15.132:6807/1170594668","heartbeat_front_addr":"172.21.15.132:6805/1170594668","state":["exists","up"]},{"osd":1,"uuid":"c88bf082-e51f-4ee6-815a-025f6ce0d67b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6809","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6811","nonce":2494780358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6815","nonce":2494780358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6823","nonce":2494780358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6819","nonce":2494780358}]},"public_addr":"172.21.15.132:6811/2494780358","cluster_addr":"172.21.15.132:6815/2494780358","heartbeat_back_addr":"172.21.15.132:6823/2494780358","heartbeat_front_addr":"172.21.15.132:6819/2494780358","state":["exists","up"]},{"osd":2,"uuid":"e5dbd6b4-4e7b-47e4-ad4e-35b4b81696c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6825","nonce":27655483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6827","nonce":27655483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6831","nonce":27655483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6829","nonce":27655483}]},"public_addr":"172.21.15.132:6825/27655483","cluster_addr":"172.21.15.132:6827/27655483","heartbeat_back_addr":"172.21.15.132:6831/27655483","heartbeat_front_addr":"172.21.15.132:6829/27655483","state":["exists","up"]},{"osd":3,"uuid":"9d75cd67-3b8a-4424-8884-5f3660e1f5f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6810","nonce":3100919191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6814","nonce":3100919191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6821","nonce":3100919191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6818","nonce":3100919191}]},"public_addr":"172.21.15.132:6810/3100919191","cluster_addr":"172.21.15.132:6814/3100919191","heartbeat_back_addr":"172.21.15.132:6821/3100919191","heartbeat_front_addr":"172.21.15.132:6818/3100919191","state":["exists","up"]},{"osd":4,"uuid":"83aea46a-8642-4777-912b-c130e5890da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6825","nonce":123637799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6827","nonce":123637799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6831","nonce":123637799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6829","nonce":123637799}]},"public_addr":"172.21.15.179:6825/123637799","cluster_addr":"172.21.15.179:6827/123637799","heartbeat_back_addr":"172.21.15.179:6831/123637799","heartbeat_front_addr":"172.21.15.179:6829/123637799","state":["exists","up"]},{"osd":5,"uuid":"534117c8-3317-48d6-b436-afd5709f71e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6801","nonce":2224750370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6803","nonce":2224750370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6807","nonce":2224750370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6805","nonce":2224750370}]},"public_addr":"172.21.15.179:6801/2224750370","cluster_addr":"172.21.15.179:6803/2224750370","heartbeat_back_addr":"172.21.15.179:6807/2224750370","heartbeat_front_addr":"172.21.15.179:6805/2224750370","state":["exists","up"]},{"osd":6,"uuid":"0ba363e7-fa9d-42b1-ae09-a6a0f57d41f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6809","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6811","nonce":101498164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6813","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6815","nonce":101498164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6823","nonce":101498164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6819","nonce":101498164}]},"public_addr":"172.21.15.179:6811/101498164","cluster_addr":"172.21.15.179:6815/101498164","heartbeat_back_addr":"172.21.15.179:6823/101498164","heartbeat_front_addr":"172.21.15.179:6819/101498164","state":["exists","up"]},{"osd":7,"uuid":"e6830c77-2f2d-4067-9866-ee7625afc1a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6810","nonce":872148365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6814","nonce":872148365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6822","nonce":872148365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6818","nonce":872148365}]},"public_addr":"172.21.15.179:6810/872148365","cluster_addr":"172.21.15.179:6814/872148365","heartbeat_back_addr":"172.21.15.179:6822/872148365","heartbeat_front_addr":"172.21.15.179:6818/872148365","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.535221+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.563769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.520765+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.526264+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.517058+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.500842+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.534332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.512486+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":1}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:52:56.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.601+0000 7fd3a6159640 1 -- 172.21.15.132:0/2317382685 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fd38c06c920 msgr2=0x7fd38c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:56.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.601+0000 7fd3a6159640 1 --2- 172.21.15.132:0/2317382685 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fd38c06c920 0x7fd38c06ede0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd3a0153ef0 tx=0x7fd390008040 comp rx=0 tx=0).stop 2024-04-16T15:52:56.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.601+0000 7fd3a6159640 1 -- 172.21.15.132:0/2317382685 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd3a00b5cc0 msgr2=0x7fd3a0152cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:56.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.601+0000 7fd3a6159640 1 --2- 172.21.15.132:0/2317382685 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd3a00b5cc0 0x7fd3a0152cb0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd39400b4a0 tx=0x7fd39400b960 comp rx=0 tx=0).stop 2024-04-16T15:52:56.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.601+0000 7fd3a6159640 1 -- 172.21.15.132:0/2317382685 shutdown_connections 2024-04-16T15:52:56.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.601+0000 7fd3a6159640 1 --2- 172.21.15.132:0/2317382685 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fd38c06c920 0x7fd38c06ede0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:56.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.601+0000 7fd3a6159640 1 --2- 172.21.15.132:0/2317382685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3a0151e90 0x7fd3a01531f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:56.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.601+0000 7fd3a6159640 1 --2- 172.21.15.132:0/2317382685 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd3a00b5cc0 0x7fd3a0152cb0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:56.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.601+0000 7fd3a6159640 1 --2- 172.21.15.132:0/2317382685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3a006dc90 0x7fd3a014af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:56.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.601+0000 7fd3a6159640 1 -- 172.21.15.132:0/2317382685 >> 172.21.15.132:0/2317382685 conn(0x7fd3a00b2d50 msgr2=0x7fd3a00b5130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:56.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.601+0000 7fd3a6159640 1 -- 172.21.15.132:0/2317382685 shutdown_connections 2024-04-16T15:52:56.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.601+0000 7fd3a6159640 1 -- 172.21.15.132:0/2317382685 wait complete. 2024-04-16T15:52:56.612 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T15:52:03.284927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T15:52:13.363758+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T15:52:14.246647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T15:52:56.612 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T15:52:56.718 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.719+0000 7fdd8cfe2640 1 Processor -- start 2024-04-16T15:52:56.718 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.719+0000 7fdd8cfe2640 1 -- start start 2024-04-16T15:52:56.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.720+0000 7fdd8cfe2640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdd880b4bb0 0x7fdd8806f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:56.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.720+0000 7fdd8cfe2640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd8806dfb0 con 0x7fdd880b4750 2024-04-16T15:52:56.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.720+0000 7fdd8cfe2640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd8806e290 con 0x7fdd8815b840 2024-04-16T15:52:56.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.720+0000 7fdd8cfe2640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fdd8806e570 con 0x7fdd880b4bb0 2024-04-16T15:52:56.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.720+0000 7fdd7ffff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fdd880b4750 0x7fdd8806f050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:46920/0 (socket says 172.21.15.132:46920) 2024-04-16T15:52:56.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.720+0000 7fdd7ffff640 1 -- 172.21.15.132:0/167944431 learned_addr learned my addr 172.21.15.132:0/167944431 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:56.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.720+0000 7fdd86d9d640 1 --2- 172.21.15.132:0/167944431 >> v2:172.21.15.179:3300/0 conn(0x7fdd880b4bb0 0x7fdd8806f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:56.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.720+0000 7fdd85d9b640 1 -- 172.21.15.132:0/167944431 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 756819276 0 0) 0x7fdd8806dfb0 con 0x7fdd880b4750 2024-04-16T15:52:56.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.720+0000 7fdd85d9b640 1 -- 172.21.15.132:0/167944431 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd74003520 con 0x7fdd880b4750 2024-04-16T15:52:56.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.721+0000 7fdd85d9b640 1 -- 172.21.15.132:0/167944431 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4286955357 0 0) 0x7fdd74003520 con 0x7fdd880b4750 2024-04-16T15:52:56.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.721+0000 7fdd85d9b640 1 -- 172.21.15.132:0/167944431 >> v2:172.21.15.179:3300/0 conn(0x7fdd880b4bb0 msgr2=0x7fdd8806f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:56.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.721+0000 7fdd85d9b640 1 --2- 172.21.15.132:0/167944431 >> v2:172.21.15.179:3300/0 conn(0x7fdd880b4bb0 0x7fdd8806f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:56.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.721+0000 7fdd85d9b640 1 -- 172.21.15.132:0/167944431 >> v1:172.21.15.179:6789/0 conn(0x7fdd8815b840 legacy=0x7fdd880cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:56.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.721+0000 7fdd85d9b640 1 -- 172.21.15.132:0/167944431 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd8806e850 con 0x7fdd880b4750 2024-04-16T15:52:56.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.721+0000 7fdd85d9b640 1 -- 172.21.15.132:0/167944431 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2803668828 0 0) 0x7fdd70001670 con 0x7fdd880b4750 2024-04-16T15:52:56.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.721+0000 7fdd85d9b640 1 -- 172.21.15.132:0/167944431 >> v1:172.21.15.132:6789/0 conn(0x7fdd880b4750 legacy=0x7fdd8806f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:56.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.721+0000 7fdd85d9b640 1 --2- 172.21.15.132:0/167944431 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd740039b0 0x7fdd74003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:56.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.721+0000 7fdd85d9b640 1 --2- 172.21.15.132:0/167944431 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd74004800 0x7fdd74004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:56.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.721+0000 7fdd85d9b640 1 --2- 172.21.15.132:0/167944431 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd740051c0 0x7fdd7400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:56.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.721+0000 7fdd85d9b640 1 -- 172.21.15.132:0/167944431 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fdd8806e570 con 0x7fdd740039b0 2024-04-16T15:52:56.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.721+0000 7fdd85d9b640 1 -- 172.21.15.132:0/167944431 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdd7400c060 con 0x7fdd740051c0 2024-04-16T15:52:56.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.721+0000 7fdd85d9b640 1 -- 172.21.15.132:0/167944431 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fdd7400c260 con 0x7fdd74004800 2024-04-16T15:52:56.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.721+0000 7fdd8659c640 1 --2- 172.21.15.132:0/167944431 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd740039b0 0x7fdd74003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:56.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.721+0000 7fdd7ffff640 1 --2- 172.21.15.132:0/167944431 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd74004800 0x7fdd74004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:56.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.721+0000 7fdd86d9d640 1 --2- 172.21.15.132:0/167944431 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd740051c0 0x7fdd7400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:56.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.721+0000 7fdd8659c640 1 -- 172.21.15.132:0/167944431 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd74004800 msgr2=0x7fdd74004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:56.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.721+0000 7fdd8659c640 1 --2- 172.21.15.132:0/167944431 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd74004800 0x7fdd74004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:56.724 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.721+0000 7fdd8659c640 1 -- 172.21.15.132:0/167944431 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd740051c0 msgr2=0x7fdd7400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:56.724 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.721+0000 7fdd8659c640 1 --2- 172.21.15.132:0/167944431 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd740051c0 0x7fdd7400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:56.724 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.721+0000 7fdd86d9d640 1 -- 172.21.15.132:0/167944431 reap_dead start 2024-04-16T15:52:56.724 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.721+0000 7fdd8659c640 1 -- 172.21.15.132:0/167944431 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd74003520 con 0x7fdd740039b0 2024-04-16T15:52:56.724 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.722+0000 7fdd8659c640 1 --2- 172.21.15.132:0/167944431 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd740039b0 0x7fdd74003dd0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fdd78001750 tx=0x7fdd74005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50db9ef5c1d52ea6 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:56.724 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.722+0000 7fdd85d9b640 1 -- 172.21.15.132:0/167944431 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd78001370 con 0x7fdd740039b0 2024-04-16T15:52:56.724 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.722+0000 7fdd85d9b640 1 -- 172.21.15.132:0/167944431 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd780052d0 con 0x7fdd740039b0 2024-04-16T15:52:56.724 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.722+0000 7fdd85d9b640 1 -- 172.21.15.132:0/167944431 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd78003830 con 0x7fdd740039b0 2024-04-16T15:52:56.724 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.722+0000 7fdd8cfe2640 1 -- 172.21.15.132:0/167944431 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd740039b0 msgr2=0x7fdd74003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:56.724 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.722+0000 7fdd8cfe2640 1 --2- 172.21.15.132:0/167944431 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd740039b0 0x7fdd74003dd0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fdd78001750 tx=0x7fdd74005830 comp rx=0 tx=0).stop 2024-04-16T15:52:56.724 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.722+0000 7fdd8cfe2640 1 -- 172.21.15.132:0/167944431 shutdown_connections 2024-04-16T15:52:56.724 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.722+0000 7fdd8cfe2640 1 --2- 172.21.15.132:0/167944431 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd740039b0 0x7fdd74003dd0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:56.724 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.723+0000 7fdd8cfe2640 1 -- 172.21.15.132:0/167944431 >> 172.21.15.132:0/167944431 conn(0x7fdd880d0490 msgr2=0x7fdd880d08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:56.725 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.723+0000 7fdd8cfe2640 1 -- 172.21.15.132:0/167944431 shutdown_connections 2024-04-16T15:52:56.725 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.723+0000 7fdd8cfe2640 1 -- 172.21.15.132:0/167944431 wait complete. 2024-04-16T15:52:56.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.724+0000 7fdd8cfe2640 1 Processor -- start 2024-04-16T15:52:56.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.724+0000 7fdd8cfe2640 1 -- start start 2024-04-16T15:52:56.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.725+0000 7fdd8cfe2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd740039b0 0x7fdd8814d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:56.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.725+0000 7fdd8cfe2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd88142dc0 0x7fdd8814e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:56.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.725+0000 7fdd8cfe2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd8814e5f0 0x7fdd8815d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:56.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.725+0000 7fdd8cfe2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fdd880b5740 con 0x7fdd8814e5f0 2024-04-16T15:52:56.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.725+0000 7fdd8cfe2640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdd880b5000 con 0x7fdd88142dc0 2024-04-16T15:52:56.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.725+0000 7fdd8cfe2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fdd8815bc20 con 0x7fdd740039b0 2024-04-16T15:52:56.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.725+0000 7fdd86d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd8814e5f0 0x7fdd8815d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:56.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.725+0000 7fdd86d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd8814e5f0 0x7fdd8815d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60542/0 (socket says 172.21.15.132:60542) 2024-04-16T15:52:56.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.725+0000 7fdd86d9d640 1 -- 172.21.15.132:0/827652839 learned_addr learned my addr 172.21.15.132:0/827652839 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:56.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.725+0000 7fdd7ffff640 1 --2- 172.21.15.132:0/827652839 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd88142dc0 0x7fdd8814e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:56.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.725+0000 7fdd8659c640 1 --2- 172.21.15.132:0/827652839 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd740039b0 0x7fdd8814d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:56.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.725+0000 7fdd86d9d640 1 -- 172.21.15.132:0/827652839 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd740039b0 msgr2=0x7fdd8814d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:56.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.725+0000 7fdd86d9d640 1 --2- 172.21.15.132:0/827652839 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd740039b0 0x7fdd8814d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:56.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.725+0000 7fdd86d9d640 1 -- 172.21.15.132:0/827652839 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd88142dc0 msgr2=0x7fdd8814e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:56.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.725+0000 7fdd86d9d640 1 --2- 172.21.15.132:0/827652839 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd88142dc0 0x7fdd8814e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:56.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.725+0000 7fdd86d9d640 1 -- 172.21.15.132:0/827652839 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd88068da0 con 0x7fdd8814e5f0 2024-04-16T15:52:56.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.725+0000 7fdd86d9d640 1 --2- 172.21.15.132:0/827652839 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd8814e5f0 0x7fdd8815d000 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fdd80011b40 tx=0x7fdd8000f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:56.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.725+0000 7fdd7effd640 1 -- 172.21.15.132:0/827652839 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd8000fd10 con 0x7fdd8814e5f0 2024-04-16T15:52:56.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.725+0000 7fdd7effd640 1 -- 172.21.15.132:0/827652839 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd8001d070 con 0x7fdd8814e5f0 2024-04-16T15:52:56.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.725+0000 7fdd8cfe2640 1 -- 172.21.15.132:0/827652839 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd8815bf60 con 0x7fdd8814e5f0 2024-04-16T15:52:56.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.725+0000 7fdd7effd640 1 -- 172.21.15.132:0/827652839 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd80015670 con 0x7fdd8814e5f0 2024-04-16T15:52:56.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.725+0000 7fdd8cfe2640 1 -- 172.21.15.132:0/827652839 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd8815c520 con 0x7fdd8814e5f0 2024-04-16T15:52:56.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.726+0000 7fdd8cfe2640 1 -- 172.21.15.132:0/827652839 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd88075510 con 0x7fdd8814e5f0 2024-04-16T15:52:56.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.727+0000 7fdd7effd640 1 -- 172.21.15.132:0/827652839 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdd80015810 con 0x7fdd8814e5f0 2024-04-16T15:52:56.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.727+0000 7fdd7effd640 1 --2- 172.21.15.132:0/827652839 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fdd6806c8f0 0x7fdd6806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:56.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.727+0000 7fdd7effd640 1 -- 172.21.15.132:0/827652839 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5825+0+0 (secure 0 0 0) 0x7fdd8008c470 con 0x7fdd8814e5f0 2024-04-16T15:52:56.730 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.727+0000 7fdd8659c640 1 --2- 172.21.15.132:0/827652839 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fdd6806c8f0 0x7fdd6806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:56.730 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.728+0000 7fdd8659c640 1 --2- 172.21.15.132:0/827652839 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fdd6806c8f0 0x7fdd6806edb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdd78033000 tx=0x7fdd78009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:56.730 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.731+0000 7fdd7effd640 1 -- 172.21.15.132:0/827652839 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdd80010040 con 0x7fdd8814e5f0 2024-04-16T15:52:56.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.906+0000 7fdd8cfe2640 1 -- 172.21.15.132:0/827652839 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdd880cfeb0 con 0x7fdd8814e5f0 2024-04-16T15:52:56.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.907+0000 7fdd7effd640 1 -- 172.21.15.132:0/827652839 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7fdd8005a820 con 0x7fdd8814e5f0 2024-04-16T15:52:56.906 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2024-04-16T15:52:56.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.908+0000 7fdd8cfe2640 1 -- 172.21.15.132:0/827652839 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fdd6806c8f0 msgr2=0x7fdd6806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:56.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.908+0000 7fdd8cfe2640 1 --2- 172.21.15.132:0/827652839 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fdd6806c8f0 0x7fdd6806edb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdd78033000 tx=0x7fdd78009030 comp rx=0 tx=0).stop 2024-04-16T15:52:56.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.908+0000 7fdd8cfe2640 1 -- 172.21.15.132:0/827652839 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd8814e5f0 msgr2=0x7fdd8815d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:56.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.908+0000 7fdd8cfe2640 1 --2- 172.21.15.132:0/827652839 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd8814e5f0 0x7fdd8815d000 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fdd80011b40 tx=0x7fdd8000f1b0 comp rx=0 tx=0).stop 2024-04-16T15:52:56.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.908+0000 7fdd8cfe2640 1 -- 172.21.15.132:0/827652839 shutdown_connections 2024-04-16T15:52:56.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.908+0000 7fdd8cfe2640 1 --2- 172.21.15.132:0/827652839 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fdd6806c8f0 0x7fdd6806edb0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:56.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.908+0000 7fdd8cfe2640 1 --2- 172.21.15.132:0/827652839 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd8814e5f0 0x7fdd8815d000 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:56.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.908+0000 7fdd8cfe2640 1 --2- 172.21.15.132:0/827652839 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd88142dc0 0x7fdd8814e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:56.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.909+0000 7fdd8cfe2640 1 --2- 172.21.15.132:0/827652839 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd740039b0 0x7fdd8814d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:56.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.909+0000 7fdd8cfe2640 1 -- 172.21.15.132:0/827652839 >> 172.21.15.132:0/827652839 conn(0x7fdd880d0490 msgr2=0x7fdd880b1900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:56.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.909+0000 7fdd8cfe2640 1 -- 172.21.15.132:0/827652839 shutdown_connections 2024-04-16T15:52:56.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:56.909+0000 7fdd8cfe2640 1 -- 172.21.15.132:0/827652839 wait complete. 2024-04-16T15:52:56.920 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T15:52:57.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.027+0000 7fe16b435640 1 Processor -- start 2024-04-16T15:52:57.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.028+0000 7fe16b435640 1 -- start start 2024-04-16T15:52:57.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.028+0000 7fe16b435640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1640b4750 0x7fe1640b4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:57.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.028+0000 7fe16b435640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe16406f050 0x7fe16406f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:57.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.028+0000 7fe16b435640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe16406dfb0 con 0x7fe16415b840 2024-04-16T15:52:57.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.028+0000 7fe16b435640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fe1640b50f0 con 0x7fe16406f050 2024-04-16T15:52:57.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.028+0000 7fe16b435640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe16406e290 con 0x7fe1640b4750 2024-04-16T15:52:57.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.028+0000 7fe1691d1640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fe16415b840 0x7fe1640cef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:46936/0 (socket says 172.21.15.132:46936) 2024-04-16T15:52:57.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.029+0000 7fe1691d1640 1 -- 172.21.15.132:0/1777123509 learned_addr learned my addr 172.21.15.132:0/1777123509 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:57.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.029+0000 7fe1689d0640 1 --2- 172.21.15.132:0/1777123509 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1640b4750 0x7fe1640b4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:57.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.029+0000 7fe1699d2640 1 --2- 172.21.15.132:0/1777123509 >> v2:172.21.15.179:3300/0 conn(0x7fe16406f050 0x7fe16406f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:57.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.029+0000 7fe15bfff640 1 -- 172.21.15.132:0/1777123509 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4266410954 0 0) 0x7fe16406dfb0 con 0x7fe16415b840 2024-04-16T15:52:57.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.029+0000 7fe15bfff640 1 -- 172.21.15.132:0/1777123509 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe150003520 con 0x7fe16415b840 2024-04-16T15:52:57.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.029+0000 7fe15bfff640 1 -- 172.21.15.132:0/1777123509 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4081412045 0 0) 0x7fe150003520 con 0x7fe16415b840 2024-04-16T15:52:57.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.029+0000 7fe15bfff640 1 -- 172.21.15.132:0/1777123509 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1640b4750 msgr2=0x7fe1640b4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:57.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.029+0000 7fe15bfff640 1 --2- 172.21.15.132:0/1777123509 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1640b4750 0x7fe1640b4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:57.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.029+0000 7fe15bfff640 1 -- 172.21.15.132:0/1777123509 >> v2:172.21.15.179:3300/0 conn(0x7fe16406f050 msgr2=0x7fe16406f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:57.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.029+0000 7fe15bfff640 1 --2- 172.21.15.132:0/1777123509 >> v2:172.21.15.179:3300/0 conn(0x7fe16406f050 0x7fe16406f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:57.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.029+0000 7fe15bfff640 1 -- 172.21.15.132:0/1777123509 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe16406e570 con 0x7fe16415b840 2024-04-16T15:52:57.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.029+0000 7fe15bfff640 1 -- 172.21.15.132:0/1777123509 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2803668828 0 0) 0x7fe1600019f0 con 0x7fe16415b840 2024-04-16T15:52:57.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.029+0000 7fe15bfff640 1 -- 172.21.15.132:0/1777123509 >> v1:172.21.15.132:6789/0 conn(0x7fe16415b840 legacy=0x7fe1640cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:57.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.029+0000 7fe15bfff640 1 --2- 172.21.15.132:0/1777123509 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1500039b0 0x7fe150003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:57.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.029+0000 7fe15bfff640 1 --2- 172.21.15.132:0/1777123509 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1640b4750 0x7fe150004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:57.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.029+0000 7fe15bfff640 1 --2- 172.21.15.132:0/1777123509 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe150004d40 0x7fe1500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:57.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.029+0000 7fe15bfff640 1 -- 172.21.15.132:0/1777123509 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe16406e290 con 0x7fe1500039b0 2024-04-16T15:52:57.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.029+0000 7fe15bfff640 1 -- 172.21.15.132:0/1777123509 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe15000b9c0 con 0x7fe150004d40 2024-04-16T15:52:57.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.029+0000 7fe15bfff640 1 -- 172.21.15.132:0/1777123509 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe15000bb40 con 0x7fe1640b4750 2024-04-16T15:52:57.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.029+0000 7fe1691d1640 1 --2- 172.21.15.132:0/1777123509 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1500039b0 0x7fe150003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:57.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.029+0000 7fe1699d2640 1 --2- 172.21.15.132:0/1777123509 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe150004d40 0x7fe1500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:57.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.029+0000 7fe1689d0640 1 --2- 172.21.15.132:0/1777123509 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1640b4750 0x7fe150004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:57.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.029+0000 7fe1691d1640 1 -- 172.21.15.132:0/1777123509 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1640b4750 msgr2=0x7fe150004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:57.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.029+0000 7fe1691d1640 1 --2- 172.21.15.132:0/1777123509 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1640b4750 0x7fe150004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:57.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.029+0000 7fe1691d1640 1 -- 172.21.15.132:0/1777123509 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe150004d40 msgr2=0x7fe1500051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:57.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.029+0000 7fe1691d1640 1 --2- 172.21.15.132:0/1777123509 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe150004d40 0x7fe1500051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:57.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.029+0000 7fe1691d1640 1 -- 172.21.15.132:0/1777123509 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe150003520 con 0x7fe1500039b0 2024-04-16T15:52:57.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.029+0000 7fe1699d2640 1 --2- 172.21.15.132:0/1777123509 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe150004d40 0x7fe1500051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:57.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.030+0000 7fe1691d1640 1 --2- 172.21.15.132:0/1777123509 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1500039b0 0x7fe150003dd0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe16000a460 tx=0x7fe150005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af739489dc6e4f0d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:57.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.030+0000 7fe15bfff640 1 -- 172.21.15.132:0/1777123509 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe16000a4a0 con 0x7fe1500039b0 2024-04-16T15:52:57.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.030+0000 7fe15bfff640 1 -- 172.21.15.132:0/1777123509 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe160039070 con 0x7fe1500039b0 2024-04-16T15:52:57.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.030+0000 7fe15bfff640 1 -- 172.21.15.132:0/1777123509 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe160035c70 con 0x7fe1500039b0 2024-04-16T15:52:57.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.031+0000 7fe16b435640 1 -- 172.21.15.132:0/1777123509 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1500039b0 msgr2=0x7fe150003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:57.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.031+0000 7fe16b435640 1 --2- 172.21.15.132:0/1777123509 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1500039b0 0x7fe150003dd0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe16000a460 tx=0x7fe150005830 comp rx=0 tx=0).stop 2024-04-16T15:52:57.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.031+0000 7fe1699d2640 1 -- 172.21.15.132:0/1777123509 reap_dead start 2024-04-16T15:52:57.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.031+0000 7fe16b435640 1 -- 172.21.15.132:0/1777123509 shutdown_connections 2024-04-16T15:52:57.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.031+0000 7fe16b435640 1 -- 172.21.15.132:0/1777123509 >> 172.21.15.132:0/1777123509 conn(0x7fe1640d0490 msgr2=0x7fe1640d08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:57.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.031+0000 7fe16b435640 1 -- 172.21.15.132:0/1777123509 shutdown_connections 2024-04-16T15:52:57.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.031+0000 7fe16b435640 1 -- 172.21.15.132:0/1777123509 wait complete. 2024-04-16T15:52:57.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.032+0000 7fe16b435640 1 Processor -- start 2024-04-16T15:52:57.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.032+0000 7fe16b435640 1 -- start start 2024-04-16T15:52:57.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.033+0000 7fe16b435640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1500039b0 0x7fe164151130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:57.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.033+0000 7fe16b435640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1641f01a0 0x7fe164155e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:57.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.033+0000 7fe16b435640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe16415e9a0 0x7fe1641563d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:57.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.033+0000 7fe16b435640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe1640b5740 con 0x7fe1500039b0 2024-04-16T15:52:57.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.033+0000 7fe16b435640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe16406eb30 con 0x7fe1641f01a0 2024-04-16T15:52:57.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.033+0000 7fe16b435640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe16415bc20 con 0x7fe16415e9a0 2024-04-16T15:52:57.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.033+0000 7fe1691d1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1500039b0 0x7fe164151130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:57.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.033+0000 7fe1691d1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1500039b0 0x7fe164151130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60568/0 (socket says 172.21.15.132:60568) 2024-04-16T15:52:57.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.033+0000 7fe1691d1640 1 -- 172.21.15.132:0/90752259 learned_addr learned my addr 172.21.15.132:0/90752259 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:57.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.033+0000 7fe1689d0640 1 --2- 172.21.15.132:0/90752259 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1641f01a0 0x7fe164155e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:57.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.033+0000 7fe1699d2640 1 --2- 172.21.15.132:0/90752259 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe16415e9a0 0x7fe1641563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:57.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.033+0000 7fe1691d1640 1 -- 172.21.15.132:0/90752259 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe16415e9a0 msgr2=0x7fe1641563d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:57.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.033+0000 7fe1691d1640 1 --2- 172.21.15.132:0/90752259 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe16415e9a0 0x7fe1641563d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:57.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.033+0000 7fe1691d1640 1 -- 172.21.15.132:0/90752259 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1641f01a0 msgr2=0x7fe164155e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:57.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.033+0000 7fe1691d1640 1 --2- 172.21.15.132:0/90752259 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1641f01a0 0x7fe164155e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:57.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.033+0000 7fe1691d1640 1 -- 172.21.15.132:0/90752259 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe164151670 con 0x7fe1500039b0 2024-04-16T15:52:57.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.033+0000 7fe1689d0640 1 --2- 172.21.15.132:0/90752259 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1641f01a0 0x7fe164155e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:57.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.033+0000 7fe1691d1640 1 --2- 172.21.15.132:0/90752259 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1500039b0 0x7fe164151130 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe1600354a0 tx=0x7fe16406e740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:57.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.034+0000 7fe159ffb640 1 -- 172.21.15.132:0/90752259 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe16004e070 con 0x7fe1500039b0 2024-04-16T15:52:57.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.034+0000 7fe159ffb640 1 -- 172.21.15.132:0/90752259 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe160004d60 con 0x7fe1500039b0 2024-04-16T15:52:57.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.034+0000 7fe16b435640 1 -- 172.21.15.132:0/90752259 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1641f0680 con 0x7fe1500039b0 2024-04-16T15:52:57.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.034+0000 7fe159ffb640 1 -- 172.21.15.132:0/90752259 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe160001ff0 con 0x7fe1500039b0 2024-04-16T15:52:57.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.034+0000 7fe16b435640 1 -- 172.21.15.132:0/90752259 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1641f0c40 con 0x7fe1500039b0 2024-04-16T15:52:57.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.035+0000 7fe16b435640 1 -- 172.21.15.132:0/90752259 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe164075510 con 0x7fe1500039b0 2024-04-16T15:52:57.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.035+0000 7fe159ffb640 1 -- 172.21.15.132:0/90752259 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe160051070 con 0x7fe1500039b0 2024-04-16T15:52:57.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.036+0000 7fe159ffb640 1 --2- 172.21.15.132:0/90752259 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fe14806c920 0x7fe14806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:57.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.036+0000 7fe159ffb640 1 -- 172.21.15.132:0/90752259 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5825+0+0 (secure 0 0 0) 0x7fe1600b5c60 con 0x7fe1500039b0 2024-04-16T15:52:57.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.036+0000 7fe1689d0640 1 --2- 172.21.15.132:0/90752259 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fe14806c920 0x7fe14806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:57.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.036+0000 7fe1689d0640 1 --2- 172.21.15.132:0/90752259 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fe14806c920 0x7fe14806ede0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe1641593a0 tx=0x7fe154008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:57.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.040+0000 7fe159ffb640 1 -- 172.21.15.132:0/90752259 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe1600840a0 con 0x7fe1500039b0 2024-04-16T15:52:57.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.220+0000 7fe16b435640 1 -- 172.21.15.132:0/90752259 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe1640ce5f0 con 0x7fe1500039b0 2024-04-16T15:52:57.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.220+0000 7fe159ffb640 1 -- 172.21.15.132:0/90752259 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7fe1600839a0 con 0x7fe1500039b0 2024-04-16T15:52:57.220 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2024-04-16T15:52:57.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.222+0000 7fe16b435640 1 -- 172.21.15.132:0/90752259 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fe14806c920 msgr2=0x7fe14806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:57.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.222+0000 7fe16b435640 1 --2- 172.21.15.132:0/90752259 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fe14806c920 0x7fe14806ede0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe1641593a0 tx=0x7fe154008040 comp rx=0 tx=0).stop 2024-04-16T15:52:57.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.222+0000 7fe16b435640 1 -- 172.21.15.132:0/90752259 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1500039b0 msgr2=0x7fe164151130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:57.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.222+0000 7fe16b435640 1 --2- 172.21.15.132:0/90752259 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1500039b0 0x7fe164151130 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe1600354a0 tx=0x7fe16406e740 comp rx=0 tx=0).stop 2024-04-16T15:52:57.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.223+0000 7fe16b435640 1 -- 172.21.15.132:0/90752259 shutdown_connections 2024-04-16T15:52:57.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.223+0000 7fe16b435640 1 --2- 172.21.15.132:0/90752259 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fe14806c920 0x7fe14806ede0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:57.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.223+0000 7fe16b435640 1 --2- 172.21.15.132:0/90752259 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe16415e9a0 0x7fe1641563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:57.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.223+0000 7fe16b435640 1 --2- 172.21.15.132:0/90752259 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1641f01a0 0x7fe164155e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:57.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.223+0000 7fe16b435640 1 --2- 172.21.15.132:0/90752259 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1500039b0 0x7fe164151130 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:57.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.223+0000 7fe16b435640 1 -- 172.21.15.132:0/90752259 >> 172.21.15.132:0/90752259 conn(0x7fe1640d0490 msgr2=0x7fe164071e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:57.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.223+0000 7fe16b435640 1 -- 172.21.15.132:0/90752259 shutdown_connections 2024-04-16T15:52:57.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.223+0000 7fe16b435640 1 -- 172.21.15.132:0/90752259 wait complete. 2024-04-16T15:52:57.233 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T15:52:57.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.341+0000 7f8bcc9bd640 1 Processor -- start 2024-04-16T15:52:57.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.341+0000 7f8bcc9bd640 1 -- start start 2024-04-16T15:52:57.341 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.341+0000 7f8bcc9bd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8bc80b4750 0x7f8bc80b4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:57.341 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.341+0000 7f8bcc9bd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8bc806f050 0x7f8bc806f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:57.341 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.341+0000 7f8bcc9bd640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bc806dfb0 con 0x7f8bc815b840 2024-04-16T15:52:57.341 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.341+0000 7f8bcc9bd640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f8bc80b50f0 con 0x7f8bc80b4750 2024-04-16T15:52:57.341 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.341+0000 7f8bcc9bd640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f8bc806e290 con 0x7f8bc806f050 2024-04-16T15:52:57.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.342+0000 7f8bbdd9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8bc80b4750 0x7f8bc80b4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:57.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.342+0000 7f8bc659c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f8bc815b840 0x7f8bc80cef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:46944/0 (socket says 172.21.15.132:46944) 2024-04-16T15:52:57.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.342+0000 7f8bc659c640 1 -- 172.21.15.132:0/2948690856 learned_addr learned my addr 172.21.15.132:0/2948690856 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:57.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.342+0000 7f8bbdd9b640 1 -- 172.21.15.132:0/2948690856 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8bc806f050 msgr2=0x7f8bc806f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:57.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.342+0000 7f8bbdd9b640 1 --2- 172.21.15.132:0/2948690856 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8bc806f050 0x7f8bc806f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:57.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.342+0000 7f8bbdd9b640 1 -- 172.21.15.132:0/2948690856 >> v1:172.21.15.132:6789/0 conn(0x7f8bc815b840 legacy=0x7f8bc80cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:57.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.342+0000 7f8bc5d9b640 1 -- 172.21.15.132:0/2948690856 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 829389919 0 0) 0x7f8bc806dfb0 con 0x7f8bc815b840 2024-04-16T15:52:57.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.342+0000 7f8bbdd9b640 1 -- 172.21.15.132:0/2948690856 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bc806e570 con 0x7f8bc80b4750 2024-04-16T15:52:57.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.343+0000 7f8bbdd9b640 1 --2- 172.21.15.132:0/2948690856 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8bc80b4750 0x7f8bc80b4bb0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8bb00097a0 tx=0x7f8bb002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4567cdc22e815e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:57.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.343+0000 7f8bc5d9b640 1 -- 172.21.15.132:0/2948690856 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb0035020 con 0x7f8bc80b4750 2024-04-16T15:52:57.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.343+0000 7f8bc5d9b640 1 -- 172.21.15.132:0/2948690856 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bb0031830 con 0x7f8bc80b4750 2024-04-16T15:52:57.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.343+0000 7f8bc5d9b640 1 -- 172.21.15.132:0/2948690856 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb0031c00 con 0x7f8bc80b4750 2024-04-16T15:52:57.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.343+0000 7f8bcc9bd640 1 -- 172.21.15.132:0/2948690856 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8bc80b4750 msgr2=0x7f8bc80b4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:57.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.343+0000 7f8bcc9bd640 1 --2- 172.21.15.132:0/2948690856 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8bc80b4750 0x7f8bc80b4bb0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8bb00097a0 tx=0x7f8bb002b8d0 comp rx=0 tx=0).stop 2024-04-16T15:52:57.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.343+0000 7f8bcc9bd640 1 -- 172.21.15.132:0/2948690856 shutdown_connections 2024-04-16T15:52:57.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.343+0000 7f8bcc9bd640 1 --2- 172.21.15.132:0/2948690856 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8bc806f050 0x7f8bc806f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:57.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.343+0000 7f8bcc9bd640 1 --2- 172.21.15.132:0/2948690856 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8bc80b4750 0x7f8bc80b4bb0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:57.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.343+0000 7f8bcc9bd640 1 -- 172.21.15.132:0/2948690856 >> 172.21.15.132:0/2948690856 conn(0x7f8bc80d0490 msgr2=0x7f8bc80d08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:57.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.343+0000 7f8bcc9bd640 1 -- 172.21.15.132:0/2948690856 shutdown_connections 2024-04-16T15:52:57.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.343+0000 7f8bcc9bd640 1 -- 172.21.15.132:0/2948690856 wait complete. 2024-04-16T15:52:57.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.345+0000 7f8bcc9bd640 1 Processor -- start 2024-04-16T15:52:57.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.345+0000 7f8bcc9bd640 1 -- start start 2024-04-16T15:52:57.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.346+0000 7f8bcc9bd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8bc806f050 0x7f8bc81f3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:57.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.346+0000 7f8bcc9bd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8bc80b4750 0x7f8bc81ef980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:57.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.346+0000 7f8bcc9bd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8bc815b840 0x7f8bc80b1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:57.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.346+0000 7f8bcc9bd640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc80b5740 con 0x7f8bc815b840 2024-04-16T15:52:57.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.346+0000 7f8bcc9bd640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc806eb30 con 0x7f8bc806f050 2024-04-16T15:52:57.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.346+0000 7f8bcc9bd640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f8bc815bc20 con 0x7f8bc80b4750 2024-04-16T15:52:57.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.346+0000 7f8bc6d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8bc815b840 0x7f8bc80b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:57.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.346+0000 7f8bc6d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8bc815b840 0x7f8bc80b1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60588/0 (socket says 172.21.15.132:60588) 2024-04-16T15:52:57.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.346+0000 7f8bc6d9d640 1 -- 172.21.15.132:0/1600680848 learned_addr learned my addr 172.21.15.132:0/1600680848 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:57.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.346+0000 7f8bc659c640 1 --2- 172.21.15.132:0/1600680848 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8bc806f050 0x7f8bc81f3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:57.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.346+0000 7f8bbdd9b640 1 --2- 172.21.15.132:0/1600680848 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8bc80b4750 0x7f8bc81ef980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:57.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.346+0000 7f8bc6d9d640 1 -- 172.21.15.132:0/1600680848 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8bc80b4750 msgr2=0x7f8bc81ef980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:57.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.346+0000 7f8bc6d9d640 1 --2- 172.21.15.132:0/1600680848 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8bc80b4750 0x7f8bc81ef980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:57.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.346+0000 7f8bc6d9d640 1 -- 172.21.15.132:0/1600680848 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8bc806f050 msgr2=0x7f8bc81f3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:57.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.346+0000 7f8bc6d9d640 1 --2- 172.21.15.132:0/1600680848 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8bc806f050 0x7f8bc81f3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:57.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.346+0000 7f8bc6d9d640 1 -- 172.21.15.132:0/1600680848 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bc81f3bc0 con 0x7f8bc815b840 2024-04-16T15:52:57.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.346+0000 7f8bc659c640 1 --2- 172.21.15.132:0/1600680848 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8bc806f050 0x7f8bc81f3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:52:57.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.346+0000 7f8bc6d9d640 1 --2- 172.21.15.132:0/1600680848 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8bc815b840 0x7f8bc80b1200 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8bc000b9a0 tx=0x7f8bc000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:57.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.346+0000 7f8bbf7fe640 1 -- 172.21.15.132:0/1600680848 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc0019070 con 0x7f8bc815b840 2024-04-16T15:52:57.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.346+0000 7f8bbf7fe640 1 -- 172.21.15.132:0/1600680848 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bc000cbc0 con 0x7f8bc815b840 2024-04-16T15:52:57.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.346+0000 7f8bcc9bd640 1 -- 172.21.15.132:0/1600680848 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bc81efec0 con 0x7f8bc815b840 2024-04-16T15:52:57.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.346+0000 7f8bbf7fe640 1 -- 172.21.15.132:0/1600680848 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc0014440 con 0x7f8bc815b840 2024-04-16T15:52:57.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.346+0000 7f8bcc9bd640 1 -- 172.21.15.132:0/1600680848 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bc81f33f0 con 0x7f8bc815b840 2024-04-16T15:52:57.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.348+0000 7f8bcc9bd640 1 -- 172.21.15.132:0/1600680848 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bc8075510 con 0x7f8bc815b840 2024-04-16T15:52:57.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.348+0000 7f8bbf7fe640 1 -- 172.21.15.132:0/1600680848 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8bc001c070 con 0x7f8bc815b840 2024-04-16T15:52:57.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.348+0000 7f8bbf7fe640 1 --2- 172.21.15.132:0/1600680848 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f8ba806c8f0 0x7f8ba806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:57.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.348+0000 7f8bbf7fe640 1 -- 172.21.15.132:0/1600680848 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f8bc008b8c0 con 0x7f8bc815b840 2024-04-16T15:52:57.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.348+0000 7f8bc659c640 1 --2- 172.21.15.132:0/1600680848 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f8ba806c8f0 0x7f8ba806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:57.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.349+0000 7f8bc659c640 1 --2- 172.21.15.132:0/1600680848 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f8ba806c8f0 0x7f8ba806edb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8bb8000f60 tx=0x7f8bb8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:57.351 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.353+0000 7f8bbf7fe640 1 -- 172.21.15.132:0/1600680848 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8bc0059c70 con 0x7f8bc815b840 2024-04-16T15:52:57.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.528+0000 7f8bcc9bd640 1 -- 172.21.15.132:0/1600680848 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f8bc8158e40 con 0x7f8bc815b840 2024-04-16T15:52:57.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.529+0000 7f8bbf7fe640 1 -- 172.21.15.132:0/1600680848 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7f8bc0059570 con 0x7f8bc815b840 2024-04-16T15:52:57.528 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2024-04-16T15:52:57.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.530+0000 7f8bcc9bd640 1 -- 172.21.15.132:0/1600680848 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f8ba806c8f0 msgr2=0x7f8ba806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:57.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.530+0000 7f8bcc9bd640 1 --2- 172.21.15.132:0/1600680848 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f8ba806c8f0 0x7f8ba806edb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8bb8000f60 tx=0x7f8bb8009040 comp rx=0 tx=0).stop 2024-04-16T15:52:57.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.531+0000 7f8bcc9bd640 1 -- 172.21.15.132:0/1600680848 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8bc815b840 msgr2=0x7f8bc80b1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:57.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.531+0000 7f8bcc9bd640 1 --2- 172.21.15.132:0/1600680848 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8bc815b840 0x7f8bc80b1200 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8bc000b9a0 tx=0x7f8bc000be60 comp rx=0 tx=0).stop 2024-04-16T15:52:57.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.531+0000 7f8bcc9bd640 1 -- 172.21.15.132:0/1600680848 shutdown_connections 2024-04-16T15:52:57.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.531+0000 7f8bcc9bd640 1 --2- 172.21.15.132:0/1600680848 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f8ba806c8f0 0x7f8ba806edb0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:57.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.531+0000 7f8bcc9bd640 1 --2- 172.21.15.132:0/1600680848 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8bc815b840 0x7f8bc80b1200 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:57.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.531+0000 7f8bcc9bd640 1 --2- 172.21.15.132:0/1600680848 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8bc80b4750 0x7f8bc81ef980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:57.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.531+0000 7f8bcc9bd640 1 --2- 172.21.15.132:0/1600680848 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8bc806f050 0x7f8bc81f3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:57.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.531+0000 7f8bcc9bd640 1 -- 172.21.15.132:0/1600680848 >> 172.21.15.132:0/1600680848 conn(0x7f8bc80d0490 msgr2=0x7f8bc8159360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:57.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.531+0000 7f8bcc9bd640 1 -- 172.21.15.132:0/1600680848 shutdown_connections 2024-04-16T15:52:57.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.531+0000 7f8bcc9bd640 1 -- 172.21.15.132:0/1600680848 wait complete. 2024-04-16T15:52:57.541 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-16T15:52:57.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.645+0000 7fb1d08c8640 1 Processor -- start 2024-04-16T15:52:57.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.645+0000 7fb1d08c8640 1 -- start start 2024-04-16T15:52:57.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.646+0000 7fb1d08c8640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb1cc15cb70 0x7fb1cc0ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:57.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.646+0000 7fb1d08c8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1cc09b140 0x7fb1cc160f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:57.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.646+0000 7fb1d08c8640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1cc0cd740 con 0x7fb1cc0d0430 2024-04-16T15:52:57.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.646+0000 7fb1d08c8640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fb1cc161490 con 0x7fb1cc15cb70 2024-04-16T15:52:57.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.646+0000 7fb1d08c8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb1cc0cda20 con 0x7fb1cc09b140 2024-04-16T15:52:57.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.646+0000 7fb1ca59c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb1cc15cb70 0x7fb1cc0ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:57.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.646+0000 7fb1c9d9b640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fb1cc0d0430 0x7fb1cc09aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:46952/0 (socket says 172.21.15.132:46952) 2024-04-16T15:52:57.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.646+0000 7fb1c9d9b640 1 -- 172.21.15.132:0/4024439661 learned_addr learned my addr 172.21.15.132:0/4024439661 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:57.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.647+0000 7fb1ca59c640 1 -- 172.21.15.132:0/4024439661 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1cc09b140 msgr2=0x7fb1cc160f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:57.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.647+0000 7fb1cad9d640 1 --2- 172.21.15.132:0/4024439661 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1cc09b140 0x7fb1cc160f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:57.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.647+0000 7fb1ca59c640 1 --2- 172.21.15.132:0/4024439661 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1cc09b140 0x7fb1cc160f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:57.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.647+0000 7fb1c959a640 1 -- 172.21.15.132:0/4024439661 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 862728281 0 0) 0x7fb1cc0cd740 con 0x7fb1cc0d0430 2024-04-16T15:52:57.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.647+0000 7fb1ca59c640 1 -- 172.21.15.132:0/4024439661 >> v1:172.21.15.132:6789/0 conn(0x7fb1cc0d0430 legacy=0x7fb1cc09aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:57.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.647+0000 7fb1ca59c640 1 -- 172.21.15.132:0/4024439661 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1cc0cdd00 con 0x7fb1cc15cb70 2024-04-16T15:52:57.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.647+0000 7fb1cad9d640 1 --2- 172.21.15.132:0/4024439661 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1cc09b140 0x7fb1cc160f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:52:57.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.647+0000 7fb1ca59c640 1 --2- 172.21.15.132:0/4024439661 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb1cc15cb70 0x7fb1cc0ce7e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc0097a0 tx=0x7fb1bc02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bec0c7cdc9fafc67 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:57.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.648+0000 7fb1c959a640 1 -- 172.21.15.132:0/4024439661 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1bc034070 con 0x7fb1cc15cb70 2024-04-16T15:52:57.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.648+0000 7fb1c959a640 1 -- 172.21.15.132:0/4024439661 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1bc030610 con 0x7fb1cc15cb70 2024-04-16T15:52:57.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.648+0000 7fb1c959a640 1 -- 172.21.15.132:0/4024439661 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1bc0309e0 con 0x7fb1cc15cb70 2024-04-16T15:52:57.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.648+0000 7fb1d08c8640 1 -- 172.21.15.132:0/4024439661 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb1cc15cb70 msgr2=0x7fb1cc0ce7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:57.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.648+0000 7fb1d08c8640 1 --2- 172.21.15.132:0/4024439661 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb1cc15cb70 0x7fb1cc0ce7e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc0097a0 tx=0x7fb1bc02b960 comp rx=0 tx=0).stop 2024-04-16T15:52:57.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.648+0000 7fb1d08c8640 1 -- 172.21.15.132:0/4024439661 shutdown_connections 2024-04-16T15:52:57.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.648+0000 7fb1d08c8640 1 --2- 172.21.15.132:0/4024439661 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1cc09b140 0x7fb1cc160f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:57.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.648+0000 7fb1d08c8640 1 --2- 172.21.15.132:0/4024439661 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb1cc15cb70 0x7fb1cc0ce7e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:57.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.648+0000 7fb1d08c8640 1 -- 172.21.15.132:0/4024439661 >> 172.21.15.132:0/4024439661 conn(0x7fb1cc0b4190 msgr2=0x7fb1cc0b45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:57.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.648+0000 7fb1d08c8640 1 -- 172.21.15.132:0/4024439661 shutdown_connections 2024-04-16T15:52:57.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.648+0000 7fb1d08c8640 1 -- 172.21.15.132:0/4024439661 wait complete. 2024-04-16T15:52:57.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.650+0000 7fb1d08c8640 1 Processor -- start 2024-04-16T15:52:57.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.650+0000 7fb1d08c8640 1 -- start start 2024-04-16T15:52:57.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.650+0000 7fb1d08c8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1cc09b140 0x7fb1cc14d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:57.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.650+0000 7fb1d08c8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1cc0d0430 0x7fb1cc0b7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:57.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.650+0000 7fb1d08c8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb1cc15cb70 0x7fb1cc071620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:57.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.650+0000 7fb1d08c8640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fb1cc0cd440 con 0x7fb1cc15cb70 2024-04-16T15:52:57.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.650+0000 7fb1d08c8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb1cc0ce2c0 con 0x7fb1cc09b140 2024-04-16T15:52:57.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.650+0000 7fb1d08c8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb1cc0af370 con 0x7fb1cc0d0430 2024-04-16T15:52:57.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.651+0000 7fb1cad9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb1cc15cb70 0x7fb1cc071620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:57.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.651+0000 7fb1cad9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb1cc15cb70 0x7fb1cc071620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60596/0 (socket says 172.21.15.132:60596) 2024-04-16T15:52:57.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.651+0000 7fb1cad9d640 1 -- 172.21.15.132:0/891502170 learned_addr learned my addr 172.21.15.132:0/891502170 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:57.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.651+0000 7fb1cad9d640 1 -- 172.21.15.132:0/891502170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1cc0d0430 msgr2=0x7fb1cc0b7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:57.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.651+0000 7fb1c9d9b640 1 --2- 172.21.15.132:0/891502170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1cc0d0430 0x7fb1cc0b7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:57.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.651+0000 7fb1cad9d640 1 --2- 172.21.15.132:0/891502170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1cc0d0430 0x7fb1cc0b7860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:57.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.651+0000 7fb1ca59c640 1 --2- 172.21.15.132:0/891502170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1cc09b140 0x7fb1cc14d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:57.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.651+0000 7fb1cad9d640 1 -- 172.21.15.132:0/891502170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1cc09b140 msgr2=0x7fb1cc14d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:57.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.651+0000 7fb1cad9d640 1 --2- 172.21.15.132:0/891502170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1cc09b140 0x7fb1cc14d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:57.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.651+0000 7fb1cad9d640 1 -- 172.21.15.132:0/891502170 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1cc15e100 con 0x7fb1cc15cb70 2024-04-16T15:52:57.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.651+0000 7fb1cad9d640 1 --2- 172.21.15.132:0/891502170 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb1cc15cb70 0x7fb1cc071620 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb1c400cf20 tx=0x7fb1c400a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:57.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.651+0000 7fb1baffd640 1 -- 172.21.15.132:0/891502170 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c401a070 con 0x7fb1cc15cb70 2024-04-16T15:52:57.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.651+0000 7fb1baffd640 1 -- 172.21.15.132:0/891502170 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1c400d840 con 0x7fb1cc15cb70 2024-04-16T15:52:57.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.651+0000 7fb1baffd640 1 -- 172.21.15.132:0/891502170 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c400dc30 con 0x7fb1cc15cb70 2024-04-16T15:52:57.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.651+0000 7fb1d08c8640 1 -- 172.21.15.132:0/891502170 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1cc15e3a0 con 0x7fb1cc15cb70 2024-04-16T15:52:57.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.651+0000 7fb1d08c8640 1 -- 172.21.15.132:0/891502170 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1cc14df00 con 0x7fb1cc15cb70 2024-04-16T15:52:57.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.652+0000 7fb1d08c8640 1 -- 172.21.15.132:0/891502170 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1cc075510 con 0x7fb1cc15cb70 2024-04-16T15:52:57.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.653+0000 7fb1baffd640 1 -- 172.21.15.132:0/891502170 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb1c401d070 con 0x7fb1cc15cb70 2024-04-16T15:52:57.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.653+0000 7fb1baffd640 1 --2- 172.21.15.132:0/891502170 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fb1ac06c8f0 0x7fb1ac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:57.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.653+0000 7fb1ca59c640 1 --2- 172.21.15.132:0/891502170 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fb1ac06c8f0 0x7fb1ac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:57.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.653+0000 7fb1baffd640 1 -- 172.21.15.132:0/891502170 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fb1c408c400 con 0x7fb1cc15cb70 2024-04-16T15:52:57.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.654+0000 7fb1ca59c640 1 --2- 172.21.15.132:0/891502170 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fb1ac06c8f0 0x7fb1ac06edb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc036000 tx=0x7fb1bc008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:57.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.657+0000 7fb1baffd640 1 -- 172.21.15.132:0/891502170 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb1c405a840 con 0x7fb1cc15cb70 2024-04-16T15:52:57.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.846+0000 7fb1d08c8640 1 -- 172.21.15.132:0/891502170 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb1cc0b5030 con 0x7fb1cc15cb70 2024-04-16T15:52:57.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.847+0000 7fb1baffd640 1 -- 172.21.15.132:0/891502170 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7fb1c405a140 con 0x7fb1cc15cb70 2024-04-16T15:52:57.846 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2024-04-16T15:52:57.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.849+0000 7fb1d08c8640 1 -- 172.21.15.132:0/891502170 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fb1ac06c8f0 msgr2=0x7fb1ac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:57.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.849+0000 7fb1d08c8640 1 --2- 172.21.15.132:0/891502170 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fb1ac06c8f0 0x7fb1ac06edb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc036000 tx=0x7fb1bc008030 comp rx=0 tx=0).stop 2024-04-16T15:52:57.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.849+0000 7fb1d08c8640 1 -- 172.21.15.132:0/891502170 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb1cc15cb70 msgr2=0x7fb1cc071620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:57.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.849+0000 7fb1d08c8640 1 --2- 172.21.15.132:0/891502170 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb1cc15cb70 0x7fb1cc071620 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb1c400cf20 tx=0x7fb1c400a7d0 comp rx=0 tx=0).stop 2024-04-16T15:52:57.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.849+0000 7fb1d08c8640 1 -- 172.21.15.132:0/891502170 shutdown_connections 2024-04-16T15:52:57.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.849+0000 7fb1d08c8640 1 --2- 172.21.15.132:0/891502170 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fb1ac06c8f0 0x7fb1ac06edb0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:57.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.849+0000 7fb1d08c8640 1 --2- 172.21.15.132:0/891502170 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb1cc15cb70 0x7fb1cc071620 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:57.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.849+0000 7fb1d08c8640 1 --2- 172.21.15.132:0/891502170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1cc0d0430 0x7fb1cc0b7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:57.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.849+0000 7fb1d08c8640 1 --2- 172.21.15.132:0/891502170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1cc09b140 0x7fb1cc14d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:57.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.849+0000 7fb1d08c8640 1 -- 172.21.15.132:0/891502170 >> 172.21.15.132:0/891502170 conn(0x7fb1cc0b4190 msgr2=0x7fb1cc070350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:57.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.849+0000 7fb1d08c8640 1 -- 172.21.15.132:0/891502170 shutdown_connections 2024-04-16T15:52:57.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:57.849+0000 7fb1d08c8640 1 -- 172.21.15.132:0/891502170 wait complete. 2024-04-16T15:52:57.859 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi179.front.sepia.ceph.com... 2024-04-16T15:52:57.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:52:57.860 DEBUG:teuthology.orchestra.run.smithi179:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-04-16T15:52:57.894 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T15:52:57.894 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi179.front.sepia.ceph.com 2024-04-16T15:52:57.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:52:57.895 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-04-16T15:52:57.952 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-16T15:52:57.953 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T15:52:58.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.056+0000 7fa5f919d640 1 Processor -- start 2024-04-16T15:52:58.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.056+0000 7fa5f919d640 1 -- start start 2024-04-16T15:52:58.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.057+0000 7fa5f919d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa5f41627f0 0x7fa5f40d21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:58.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.057+0000 7fa5f919d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa5f4162bd0 0x7fa5f40d1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:58.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.057+0000 7fa5f919d640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5f406d920 con 0x7fa5f40d1bb0 2024-04-16T15:52:58.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.057+0000 7fa5f919d640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fa5f40d2710 con 0x7fa5f41627f0 2024-04-16T15:52:58.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.057+0000 7fa5f919d640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fa5f40d11e0 con 0x7fa5f4162bd0 2024-04-16T15:52:58.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.057+0000 7fa5f2d9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa5f41627f0 0x7fa5f40d21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:58.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.057+0000 7fa5f359e640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fa5f40d1bb0 0x7fa5f40ccfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:46962/0 (socket says 172.21.15.132:46962) 2024-04-16T15:52:58.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.057+0000 7fa5f359e640 1 -- 172.21.15.132:0/1273540864 learned_addr learned my addr 172.21.15.132:0/1273540864 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:58.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.058+0000 7fa5f259c640 1 --2- 172.21.15.132:0/1273540864 >> v2:172.21.15.179:3300/0 conn(0x7fa5f4162bd0 0x7fa5f40d1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:58.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.058+0000 7fa5f2d9d640 1 -- 172.21.15.132:0/1273540864 >> v2:172.21.15.179:3300/0 conn(0x7fa5f4162bd0 msgr2=0x7fa5f40d1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:58.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.058+0000 7fa5f2d9d640 1 --2- 172.21.15.132:0/1273540864 >> v2:172.21.15.179:3300/0 conn(0x7fa5f4162bd0 0x7fa5f40d1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:58.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.058+0000 7fa5f2d9d640 1 -- 172.21.15.132:0/1273540864 >> v1:172.21.15.132:6789/0 conn(0x7fa5f40d1bb0 legacy=0x7fa5f40ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:58.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.058+0000 7fa5f2d9d640 1 -- 172.21.15.132:0/1273540864 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5f40d0b90 con 0x7fa5f41627f0 2024-04-16T15:52:58.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.058+0000 7fa5f1d9b640 1 -- 172.21.15.132:0/1273540864 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 761835218 0 0) 0x7fa5f406d920 con 0x7fa5f40d1bb0 2024-04-16T15:52:58.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.058+0000 7fa5f259c640 1 --2- 172.21.15.132:0/1273540864 >> v2:172.21.15.179:3300/0 conn(0x7fa5f4162bd0 0x7fa5f40d1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:52:58.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.058+0000 7fa5f2d9d640 1 --2- 172.21.15.132:0/1273540864 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5f41627f0 0x7fa5f40d21d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa5f4073820 tx=0x7fa5e402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9036e15c4531d9b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:58.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.059+0000 7fa5f1d9b640 1 -- 172.21.15.132:0/1273540864 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e4039070 con 0x7fa5f41627f0 2024-04-16T15:52:58.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.059+0000 7fa5f1d9b640 1 -- 172.21.15.132:0/1273540864 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5e402cc80 con 0x7fa5f41627f0 2024-04-16T15:52:58.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.059+0000 7fa5f1d9b640 1 -- 172.21.15.132:0/1273540864 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e4034660 con 0x7fa5f41627f0 2024-04-16T15:52:58.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.059+0000 7fa5f919d640 1 -- 172.21.15.132:0/1273540864 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5f41627f0 msgr2=0x7fa5f40d21d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:58.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.059+0000 7fa5f919d640 1 --2- 172.21.15.132:0/1273540864 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5f41627f0 0x7fa5f40d21d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa5f4073820 tx=0x7fa5e402bed0 comp rx=0 tx=0).stop 2024-04-16T15:52:58.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.059+0000 7fa5f919d640 1 -- 172.21.15.132:0/1273540864 shutdown_connections 2024-04-16T15:52:58.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.059+0000 7fa5f919d640 1 --2- 172.21.15.132:0/1273540864 >> v2:172.21.15.179:3300/0 conn(0x7fa5f4162bd0 0x7fa5f40d1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:58.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.059+0000 7fa5f919d640 1 --2- 172.21.15.132:0/1273540864 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5f41627f0 0x7fa5f40d21d0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:58.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.059+0000 7fa5f919d640 1 -- 172.21.15.132:0/1273540864 >> 172.21.15.132:0/1273540864 conn(0x7fa5f40b4450 msgr2=0x7fa5f40b4860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:58.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.059+0000 7fa5f919d640 1 -- 172.21.15.132:0/1273540864 shutdown_connections 2024-04-16T15:52:58.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.059+0000 7fa5f919d640 1 -- 172.21.15.132:0/1273540864 wait complete. 2024-04-16T15:52:58.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.061+0000 7fa5f919d640 1 Processor -- start 2024-04-16T15:52:58.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.061+0000 7fa5f919d640 1 -- start start 2024-04-16T15:52:58.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.061+0000 7fa5f919d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5f40d1bb0 0x7fa5f415a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:58.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.061+0000 7fa5f919d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa5f41627f0 0x7fa5f415b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:58.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.061+0000 7fa5f919d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa5f4162bd0 0x7fa5f415b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:58.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.061+0000 7fa5f919d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f4163630 con 0x7fa5f40d1bb0 2024-04-16T15:52:58.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.061+0000 7fa5f919d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f41634b0 con 0x7fa5f41627f0 2024-04-16T15:52:58.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.061+0000 7fa5f919d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fa5f4163010 con 0x7fa5f4162bd0 2024-04-16T15:52:58.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.061+0000 7fa5f2d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5f40d1bb0 0x7fa5f415a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:58.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.061+0000 7fa5f2d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5f40d1bb0 0x7fa5f415a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60612/0 (socket says 172.21.15.132:60612) 2024-04-16T15:52:58.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.061+0000 7fa5f2d9d640 1 -- 172.21.15.132:0/248368662 learned_addr learned my addr 172.21.15.132:0/248368662 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:58.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.062+0000 7fa5f259c640 1 --2- 172.21.15.132:0/248368662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa5f41627f0 0x7fa5f415b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:58.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.062+0000 7fa5f359e640 1 --2- 172.21.15.132:0/248368662 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa5f4162bd0 0x7fa5f415b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:58.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.062+0000 7fa5f2d9d640 1 -- 172.21.15.132:0/248368662 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa5f4162bd0 msgr2=0x7fa5f415b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:58.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.062+0000 7fa5f2d9d640 1 --2- 172.21.15.132:0/248368662 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa5f4162bd0 0x7fa5f415b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:58.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.062+0000 7fa5f2d9d640 1 -- 172.21.15.132:0/248368662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa5f41627f0 msgr2=0x7fa5f415b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:58.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.062+0000 7fa5f2d9d640 1 --2- 172.21.15.132:0/248368662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa5f41627f0 0x7fa5f415b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:58.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.062+0000 7fa5f2d9d640 1 -- 172.21.15.132:0/248368662 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5f40c6540 con 0x7fa5f40d1bb0 2024-04-16T15:52:58.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.062+0000 7fa5f259c640 1 --2- 172.21.15.132:0/248368662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa5f41627f0 0x7fa5f415b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:52:58.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.062+0000 7fa5f359e640 1 --2- 172.21.15.132:0/248368662 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa5f4162bd0 0x7fa5f415b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:52:58.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.062+0000 7fa5f2d9d640 1 --2- 172.21.15.132:0/248368662 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5f40d1bb0 0x7fa5f415a290 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa5e4037040 tx=0x7fa5e4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:58.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.062+0000 7fa5eb7fe640 1 -- 172.21.15.132:0/248368662 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e4039050 con 0x7fa5f40d1bb0 2024-04-16T15:52:58.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.062+0000 7fa5eb7fe640 1 -- 172.21.15.132:0/248368662 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5e4045070 con 0x7fa5f40d1bb0 2024-04-16T15:52:58.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.062+0000 7fa5eb7fe640 1 -- 172.21.15.132:0/248368662 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e403ea50 con 0x7fa5f40d1bb0 2024-04-16T15:52:58.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.062+0000 7fa5f919d640 1 -- 172.21.15.132:0/248368662 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5f40c6820 con 0x7fa5f40d1bb0 2024-04-16T15:52:58.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.062+0000 7fa5f919d640 1 -- 172.21.15.132:0/248368662 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5f40c6de0 con 0x7fa5f40d1bb0 2024-04-16T15:52:58.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.063+0000 7fa5f919d640 1 -- 172.21.15.132:0/248368662 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5f4075510 con 0x7fa5f40d1bb0 2024-04-16T15:52:58.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.064+0000 7fa5eb7fe640 1 -- 172.21.15.132:0/248368662 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa5e402cb40 con 0x7fa5f40d1bb0 2024-04-16T15:52:58.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.064+0000 7fa5eb7fe640 1 --2- 172.21.15.132:0/248368662 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fa5d406c920 0x7fa5d406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:58.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.064+0000 7fa5f259c640 1 --2- 172.21.15.132:0/248368662 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fa5d406c920 0x7fa5d406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:58.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.064+0000 7fa5eb7fe640 1 -- 172.21.15.132:0/248368662 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fa5e40ae3e0 con 0x7fa5f40d1bb0 2024-04-16T15:52:58.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.064+0000 7fa5f259c640 1 --2- 172.21.15.132:0/248368662 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fa5d406c920 0x7fa5d406ede0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc006fd0 tx=0x7fa5dc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:58.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.068+0000 7fa5eb7fe640 1 -- 172.21.15.132:0/248368662 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa5e404e020 con 0x7fa5f40d1bb0 2024-04-16T15:52:58.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.281+0000 7fa5f919d640 1 -- 172.21.15.132:0/248368662 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa5f409bc90 con 0x7fa5f40d1bb0 2024-04-16T15:52:58.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.281+0000 7fa5eb7fe640 1 -- 172.21.15.132:0/248368662 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5175 (secure 0 0 0) 0x7fa5e40333a0 con 0x7fa5f40d1bb0 2024-04-16T15:52:58.281 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:52:58.281 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/659108212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":659108212},{"type":"v1","addr":"172.21.15.132:6835","nonce":659108212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/811468074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":811468074},{"type":"v1","addr":"172.21.15.132:6837","nonce":811468074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/493922944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":493922944},{"type":"v1","addr":"172.21.15.179:6834","nonce":493922944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T15:52:15.286161+0000","modified":"2024-04-16T15:52:17.305756+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/202618568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":202618568},{"type":"v1","addr":"172.21.15.179:6835","nonce":202618568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1}]} 2024-04-16T15:52:58.281 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 6 2024-04-16T15:52:58.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.283+0000 7fa5f919d640 1 -- 172.21.15.132:0/248368662 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fa5d406c920 msgr2=0x7fa5d406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:58.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.283+0000 7fa5f919d640 1 --2- 172.21.15.132:0/248368662 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fa5d406c920 0x7fa5d406ede0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc006fd0 tx=0x7fa5dc008040 comp rx=0 tx=0).stop 2024-04-16T15:52:58.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.283+0000 7fa5f919d640 1 -- 172.21.15.132:0/248368662 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5f40d1bb0 msgr2=0x7fa5f415a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:58.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.283+0000 7fa5f919d640 1 --2- 172.21.15.132:0/248368662 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5f40d1bb0 0x7fa5f415a290 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa5e4037040 tx=0x7fa5e4004a40 comp rx=0 tx=0).stop 2024-04-16T15:52:58.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.283+0000 7fa5f919d640 1 -- 172.21.15.132:0/248368662 shutdown_connections 2024-04-16T15:52:58.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.283+0000 7fa5f919d640 1 --2- 172.21.15.132:0/248368662 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fa5d406c920 0x7fa5d406ede0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:58.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.283+0000 7fa5f919d640 1 --2- 172.21.15.132:0/248368662 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa5f4162bd0 0x7fa5f415b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:58.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.283+0000 7fa5f919d640 1 --2- 172.21.15.132:0/248368662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa5f41627f0 0x7fa5f415b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:58.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.283+0000 7fa5f919d640 1 --2- 172.21.15.132:0/248368662 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5f40d1bb0 0x7fa5f415a290 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:58.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.284+0000 7fa5f919d640 1 -- 172.21.15.132:0/248368662 >> 172.21.15.132:0/248368662 conn(0x7fa5f40b4450 msgr2=0x7fa5f406cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:58.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.284+0000 7fa5f919d640 1 -- 172.21.15.132:0/248368662 shutdown_connections 2024-04-16T15:52:58.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.284+0000 7fa5f919d640 1 -- 172.21.15.132:0/248368662 wait complete. 2024-04-16T15:52:58.295 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:52:58.398 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.399+0000 7fa8ffcf2640 1 Processor -- start 2024-04-16T15:52:58.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.399+0000 7fa8ffcf2640 1 -- start start 2024-04-16T15:52:58.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.400+0000 7fa8ffcf2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa8f815e9d0 0x7fa8f8070cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:58.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.400+0000 7fa8ffcf2640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa8f806ba20 0x7fa8f806beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:58.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.400+0000 7fa8ffcf2640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8f80aeb20 con 0x7fa8f80b0460 2024-04-16T15:52:58.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.400+0000 7fa8ffcf2640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fa8f80b08c0 con 0x7fa8f815e9d0 2024-04-16T15:52:58.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.400+0000 7fa8ffcf2640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fa8f80b4840 con 0x7fa8f806ba20 2024-04-16T15:52:58.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.400+0000 7fa8fda8e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa8f815e9d0 0x7fa8f8070cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:58.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.400+0000 7fa8fda8e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa8f815e9d0 0x7fa8f8070cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60614/0 (socket says 172.21.15.132:60614) 2024-04-16T15:52:58.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.400+0000 7fa8fda8e640 1 -- 172.21.15.132:0/718652168 learned_addr learned my addr 172.21.15.132:0/718652168 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:58.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.401+0000 7fa8fda8e640 1 -- 172.21.15.132:0/718652168 >> v2:172.21.15.179:3300/0 conn(0x7fa8f806ba20 msgr2=0x7fa8f806beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:58.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.401+0000 7fa8fda8e640 1 --2- 172.21.15.132:0/718652168 >> v2:172.21.15.179:3300/0 conn(0x7fa8f806ba20 0x7fa8f806beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:58.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.401+0000 7fa8fda8e640 1 -- 172.21.15.132:0/718652168 >> v1:172.21.15.179:6789/0 conn(0x7fa8f80b0460 legacy=0x7fa8f80ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:58.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.401+0000 7fa8fda8e640 1 -- 172.21.15.132:0/718652168 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8f80b66e0 con 0x7fa8f815e9d0 2024-04-16T15:52:58.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.401+0000 7fa8fda8e640 1 --2- 172.21.15.132:0/718652168 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8f815e9d0 0x7fa8f8070cf0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa8f80b5b60 tx=0x7fa8f402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5a030e0595377d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:58.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.402+0000 7fa8fca8c640 1 -- 172.21.15.132:0/718652168 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8f402e070 con 0x7fa8f815e9d0 2024-04-16T15:52:58.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.402+0000 7fa8fca8c640 1 -- 172.21.15.132:0/718652168 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8f4037070 con 0x7fa8f815e9d0 2024-04-16T15:52:58.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.402+0000 7fa8fca8c640 1 -- 172.21.15.132:0/718652168 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8f4031a00 con 0x7fa8f815e9d0 2024-04-16T15:52:58.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.402+0000 7fa8ffcf2640 1 -- 172.21.15.132:0/718652168 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8f815e9d0 msgr2=0x7fa8f8070cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:58.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.402+0000 7fa8ffcf2640 1 --2- 172.21.15.132:0/718652168 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8f815e9d0 0x7fa8f8070cf0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa8f80b5b60 tx=0x7fa8f402b880 comp rx=0 tx=0).stop 2024-04-16T15:52:58.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.402+0000 7fa8ffcf2640 1 -- 172.21.15.132:0/718652168 shutdown_connections 2024-04-16T15:52:58.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.402+0000 7fa8ffcf2640 1 --2- 172.21.15.132:0/718652168 >> v2:172.21.15.179:3300/0 conn(0x7fa8f806ba20 0x7fa8f806beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:58.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.402+0000 7fa8ffcf2640 1 --2- 172.21.15.132:0/718652168 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8f815e9d0 0x7fa8f8070cf0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:58.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.402+0000 7fa8ffcf2640 1 -- 172.21.15.132:0/718652168 >> 172.21.15.132:0/718652168 conn(0x7fa8f809aa30 msgr2=0x7fa8f80b6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:58.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.402+0000 7fa8ffcf2640 1 -- 172.21.15.132:0/718652168 shutdown_connections 2024-04-16T15:52:58.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.402+0000 7fa8ffcf2640 1 -- 172.21.15.132:0/718652168 wait complete. 2024-04-16T15:52:58.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.403+0000 7fa8ffcf2640 1 Processor -- start 2024-04-16T15:52:58.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.403+0000 7fa8ffcf2640 1 -- start start 2024-04-16T15:52:58.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.404+0000 7fa8ffcf2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8f806ba20 0x7fa8f80b2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:58.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.404+0000 7fa8ffcf2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8f80b0460 0x7fa8f815c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:58.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.404+0000 7fa8ffcf2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8f815e9d0 0x7fa8f81f5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:58.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.404+0000 7fa8ffcf2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f815edb0 con 0x7fa8f806ba20 2024-04-16T15:52:58.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.404+0000 7fa8ffcf2640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f80b44d0 con 0x7fa8f80b0460 2024-04-16T15:52:58.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.404+0000 7fa8ffcf2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fa8f80b6020 con 0x7fa8f815e9d0 2024-04-16T15:52:58.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.404+0000 7fa8fda8e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8f806ba20 0x7fa8f80b2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:58.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.404+0000 7fa8fda8e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8f806ba20 0x7fa8f80b2720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60624/0 (socket says 172.21.15.132:60624) 2024-04-16T15:52:58.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.404+0000 7fa8fda8e640 1 -- 172.21.15.132:0/2512067403 learned_addr learned my addr 172.21.15.132:0/2512067403 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:58.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.404+0000 7fa8fda8e640 1 -- 172.21.15.132:0/2512067403 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8f815e9d0 msgr2=0x7fa8f81f5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:58.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.404+0000 7fa8fda8e640 1 --2- 172.21.15.132:0/2512067403 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8f815e9d0 0x7fa8f81f5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:58.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.404+0000 7fa8fda8e640 1 -- 172.21.15.132:0/2512067403 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8f80b0460 msgr2=0x7fa8f815c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:58.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.404+0000 7fa8fda8e640 1 --2- 172.21.15.132:0/2512067403 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8f80b0460 0x7fa8f815c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:58.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.404+0000 7fa8fda8e640 1 -- 172.21.15.132:0/2512067403 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8f81f58d0 con 0x7fa8f806ba20 2024-04-16T15:52:58.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.405+0000 7fa8fda8e640 1 --2- 172.21.15.132:0/2512067403 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8f806ba20 0x7fa8f80b2720 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa8f402b8c0 tx=0x7fa8f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:58.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.405+0000 7fa8ee7fc640 1 -- 172.21.15.132:0/2512067403 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8f4032880 con 0x7fa8f806ba20 2024-04-16T15:52:58.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.405+0000 7fa8ee7fc640 1 -- 172.21.15.132:0/2512067403 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8f4032a40 con 0x7fa8f806ba20 2024-04-16T15:52:58.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.405+0000 7fa8ffcf2640 1 -- 172.21.15.132:0/2512067403 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8f80b1680 con 0x7fa8f806ba20 2024-04-16T15:52:58.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.405+0000 7fa8ee7fc640 1 -- 172.21.15.132:0/2512067403 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8f4032e30 con 0x7fa8f806ba20 2024-04-16T15:52:58.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.405+0000 7fa8ffcf2640 1 -- 172.21.15.132:0/2512067403 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8f80b1c40 con 0x7fa8f806ba20 2024-04-16T15:52:58.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.406+0000 7fa8ffcf2640 1 -- 172.21.15.132:0/2512067403 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8f806c620 con 0x7fa8f806ba20 2024-04-16T15:52:58.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.406+0000 7fa8ee7fc640 1 -- 172.21.15.132:0/2512067403 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa8f40453f0 con 0x7fa8f806ba20 2024-04-16T15:52:58.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.407+0000 7fa8ee7fc640 1 --2- 172.21.15.132:0/2512067403 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fa8dc06c8f0 0x7fa8dc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:58.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.407+0000 7fa8fd28d640 1 --2- 172.21.15.132:0/2512067403 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fa8dc06c8f0 0x7fa8dc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:58.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.407+0000 7fa8ee7fc640 1 -- 172.21.15.132:0/2512067403 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fa8f40adb10 con 0x7fa8f806ba20 2024-04-16T15:52:58.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.407+0000 7fa8fd28d640 1 --2- 172.21.15.132:0/2512067403 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fa8dc06c8f0 0x7fa8dc06edb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa8f80b4190 tx=0x7fa8e8007990 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:58.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.411+0000 7fa8ee7fc640 1 -- 172.21.15.132:0/2512067403 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa8f81f58d0 con 0x7fa8f806ba20 2024-04-16T15:52:58.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.590+0000 7fa8ffcf2640 1 -- 172.21.15.132:0/2512067403 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa8f8158290 con 0x7fa8f806ba20 2024-04-16T15:52:58.590 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.591+0000 7fa8ee7fc640 1 -- 172.21.15.132:0/2512067403 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16855 (secure 0 0 0) 0x7fa8f4080e20 con 0x7fa8f806ba20 2024-04-16T15:52:58.591 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:52:58.591 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":22,"fsid":"6bdec5d9-f406-43ad-8584-0503b32f6f0d","created":"2024-04-16T15:51:51.073040+0000","modified":"2024-04-16T15:52:57.156755+0000","last_up_change":"2024-04-16T15:52:02.280496+0000","last_in_change":"2024-04-16T15:51:53.376468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:52:03.284927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:52:13.363758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T15:52:14.246647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d45908b-6e22-4619-b190-897af594b712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6801","nonce":1170594668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6803","nonce":1170594668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6807","nonce":1170594668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6805","nonce":1170594668}]},"public_addr":"172.21.15.132:6801/1170594668","cluster_addr":"172.21.15.132:6803/1170594668","heartbeat_back_addr":"172.21.15.132:6807/1170594668","heartbeat_front_addr":"172.21.15.132:6805/1170594668","state":["exists","up"]},{"osd":1,"uuid":"c88bf082-e51f-4ee6-815a-025f6ce0d67b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6809","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6811","nonce":2494780358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6815","nonce":2494780358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6823","nonce":2494780358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6819","nonce":2494780358}]},"public_addr":"172.21.15.132:6811/2494780358","cluster_addr":"172.21.15.132:6815/2494780358","heartbeat_back_addr":"172.21.15.132:6823/2494780358","heartbeat_front_addr":"172.21.15.132:6819/2494780358","state":["exists","up"]},{"osd":2,"uuid":"e5dbd6b4-4e7b-47e4-ad4e-35b4b81696c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6825","nonce":27655483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6827","nonce":27655483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6831","nonce":27655483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6829","nonce":27655483}]},"public_addr":"172.21.15.132:6825/27655483","cluster_addr":"172.21.15.132:6827/27655483","heartbeat_back_addr":"172.21.15.132:6831/27655483","heartbeat_front_addr":"172.21.15.132:6829/27655483","state":["exists","up"]},{"osd":3,"uuid":"9d75cd67-3b8a-4424-8884-5f3660e1f5f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6810","nonce":3100919191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6814","nonce":3100919191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6821","nonce":3100919191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6818","nonce":3100919191}]},"public_addr":"172.21.15.132:6810/3100919191","cluster_addr":"172.21.15.132:6814/3100919191","heartbeat_back_addr":"172.21.15.132:6821/3100919191","heartbeat_front_addr":"172.21.15.132:6818/3100919191","state":["exists","up"]},{"osd":4,"uuid":"83aea46a-8642-4777-912b-c130e5890da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6825","nonce":123637799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6827","nonce":123637799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6831","nonce":123637799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6829","nonce":123637799}]},"public_addr":"172.21.15.179:6825/123637799","cluster_addr":"172.21.15.179:6827/123637799","heartbeat_back_addr":"172.21.15.179:6831/123637799","heartbeat_front_addr":"172.21.15.179:6829/123637799","state":["exists","up"]},{"osd":5,"uuid":"534117c8-3317-48d6-b436-afd5709f71e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6801","nonce":2224750370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6803","nonce":2224750370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6807","nonce":2224750370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6805","nonce":2224750370}]},"public_addr":"172.21.15.179:6801/2224750370","cluster_addr":"172.21.15.179:6803/2224750370","heartbeat_back_addr":"172.21.15.179:6807/2224750370","heartbeat_front_addr":"172.21.15.179:6805/2224750370","state":["exists","up"]},{"osd":6,"uuid":"0ba363e7-fa9d-42b1-ae09-a6a0f57d41f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6809","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6811","nonce":101498164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6813","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6815","nonce":101498164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6823","nonce":101498164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6819","nonce":101498164}]},"public_addr":"172.21.15.179:6811/101498164","cluster_addr":"172.21.15.179:6815/101498164","heartbeat_back_addr":"172.21.15.179:6823/101498164","heartbeat_front_addr":"172.21.15.179:6819/101498164","state":["exists","up"]},{"osd":7,"uuid":"e6830c77-2f2d-4067-9866-ee7625afc1a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6810","nonce":872148365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6814","nonce":872148365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6822","nonce":872148365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6818","nonce":872148365}]},"public_addr":"172.21.15.179:6810/872148365","cluster_addr":"172.21.15.179:6814/872148365","heartbeat_back_addr":"172.21.15.179:6822/872148365","heartbeat_front_addr":"172.21.15.179:6818/872148365","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.535221+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.563769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.520765+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.526264+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.517058+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.500842+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.534332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.512486+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":1}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:52:58.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.593+0000 7fa8ffcf2640 1 -- 172.21.15.132:0/2512067403 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fa8dc06c8f0 msgr2=0x7fa8dc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:58.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.593+0000 7fa8ffcf2640 1 --2- 172.21.15.132:0/2512067403 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fa8dc06c8f0 0x7fa8dc06edb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa8f80b4190 tx=0x7fa8e8007990 comp rx=0 tx=0).stop 2024-04-16T15:52:58.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.593+0000 7fa8ffcf2640 1 -- 172.21.15.132:0/2512067403 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8f806ba20 msgr2=0x7fa8f80b2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:58.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.593+0000 7fa8ffcf2640 1 --2- 172.21.15.132:0/2512067403 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8f806ba20 0x7fa8f80b2720 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa8f402b8c0 tx=0x7fa8f40046c0 comp rx=0 tx=0).stop 2024-04-16T15:52:58.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.593+0000 7fa8ffcf2640 1 -- 172.21.15.132:0/2512067403 shutdown_connections 2024-04-16T15:52:58.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.593+0000 7fa8ffcf2640 1 --2- 172.21.15.132:0/2512067403 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fa8dc06c8f0 0x7fa8dc06edb0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:58.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.593+0000 7fa8ffcf2640 1 --2- 172.21.15.132:0/2512067403 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8f815e9d0 0x7fa8f81f5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:58.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.593+0000 7fa8ffcf2640 1 --2- 172.21.15.132:0/2512067403 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8f80b0460 0x7fa8f815c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:58.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.593+0000 7fa8ffcf2640 1 --2- 172.21.15.132:0/2512067403 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8f806ba20 0x7fa8f80b2720 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:58.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.593+0000 7fa8ffcf2640 1 -- 172.21.15.132:0/2512067403 >> 172.21.15.132:0/2512067403 conn(0x7fa8f809aa30 msgr2=0x7fa8f8161180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:58.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.594+0000 7fa8ffcf2640 1 -- 172.21.15.132:0/2512067403 shutdown_connections 2024-04-16T15:52:58.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.594+0000 7fa8ffcf2640 1 -- 172.21.15.132:0/2512067403 wait complete. 2024-04-16T15:52:58.604 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T15:52:03.284927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T15:52:13.363758+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T15:52:14.246647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T15:52:58.604 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T15:52:58.710 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.711+0000 7fdf4a660640 1 Processor -- start 2024-04-16T15:52:58.710 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.711+0000 7fdf4a660640 1 -- start start 2024-04-16T15:52:58.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.711+0000 7fdf4a660640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdf4415ea80 0x7fdf440b3540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:58.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.711+0000 7fdf4a660640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf440727e0 0x7fdf44072c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:58.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.711+0000 7fdf4a660640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf440b3e40 con 0x7fdf4415ad10 2024-04-16T15:52:58.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.711+0000 7fdf4a660640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fdf440b4120 con 0x7fdf4415ea80 2024-04-16T15:52:58.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.711+0000 7fdf4a660640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fdf440b4400 con 0x7fdf440727e0 2024-04-16T15:52:58.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.712+0000 7fdf43fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fdf4415ad10 0x7fdf440b4ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:46968/0 (socket says 172.21.15.132:46968) 2024-04-16T15:52:58.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.712+0000 7fdf43fff640 1 -- 172.21.15.132:0/849838787 learned_addr learned my addr 172.21.15.132:0/849838787 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:52:58.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.712+0000 7fdf437fe640 1 --2- 172.21.15.132:0/849838787 >> v2:172.21.15.179:3300/0 conn(0x7fdf4415ea80 0x7fdf440b3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:58.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.712+0000 7fdf48bfd640 1 --2- 172.21.15.132:0/849838787 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf440727e0 0x7fdf44072c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:58.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.712+0000 7fdf42ffd640 1 -- 172.21.15.132:0/849838787 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2871514240 0 0) 0x7fdf440b3e40 con 0x7fdf4415ad10 2024-04-16T15:52:58.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.712+0000 7fdf42ffd640 1 -- 172.21.15.132:0/849838787 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf2c003520 con 0x7fdf4415ad10 2024-04-16T15:52:58.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.712+0000 7fdf42ffd640 1 -- 172.21.15.132:0/849838787 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1311042849 0 0) 0x7fdf2c003520 con 0x7fdf4415ad10 2024-04-16T15:52:58.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.712+0000 7fdf42ffd640 1 -- 172.21.15.132:0/849838787 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf440727e0 msgr2=0x7fdf44072c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:58.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.712+0000 7fdf42ffd640 1 --2- 172.21.15.132:0/849838787 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf440727e0 0x7fdf44072c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:58.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.712+0000 7fdf42ffd640 1 -- 172.21.15.132:0/849838787 >> v2:172.21.15.179:3300/0 conn(0x7fdf4415ea80 msgr2=0x7fdf440b3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:58.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.712+0000 7fdf42ffd640 1 --2- 172.21.15.132:0/849838787 >> v2:172.21.15.179:3300/0 conn(0x7fdf4415ea80 0x7fdf440b3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:58.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.712+0000 7fdf42ffd640 1 -- 172.21.15.132:0/849838787 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf440b46e0 con 0x7fdf4415ad10 2024-04-16T15:52:58.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.712+0000 7fdf42ffd640 1 -- 172.21.15.132:0/849838787 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2803668828 0 0) 0x7fdf34001670 con 0x7fdf4415ad10 2024-04-16T15:52:58.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.712+0000 7fdf48bfd640 1 --2- 172.21.15.132:0/849838787 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf440727e0 0x7fdf44072c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:52:58.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.712+0000 7fdf437fe640 1 --2- 172.21.15.132:0/849838787 >> v2:172.21.15.179:3300/0 conn(0x7fdf4415ea80 0x7fdf440b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:52:58.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.712+0000 7fdf42ffd640 1 -- 172.21.15.132:0/849838787 >> v1:172.21.15.132:6789/0 conn(0x7fdf4415ad10 legacy=0x7fdf440b4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:58.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.712+0000 7fdf42ffd640 1 --2- 172.21.15.132:0/849838787 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf2c0039b0 0x7fdf2c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:58.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.712+0000 7fdf42ffd640 1 --2- 172.21.15.132:0/849838787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf2c004800 0x7fdf2c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:58.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.712+0000 7fdf42ffd640 1 --2- 172.21.15.132:0/849838787 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf440727e0 0x7fdf2c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:58.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.712+0000 7fdf42ffd640 1 -- 172.21.15.132:0/849838787 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fdf440b4120 con 0x7fdf2c0039b0 2024-04-16T15:52:58.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.712+0000 7fdf42ffd640 1 -- 172.21.15.132:0/849838787 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdf440b4400 con 0x7fdf2c004800 2024-04-16T15:52:58.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.712+0000 7fdf42ffd640 1 -- 172.21.15.132:0/849838787 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fdf2c00b9c0 con 0x7fdf440727e0 2024-04-16T15:52:58.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.712+0000 7fdf43fff640 1 --2- 172.21.15.132:0/849838787 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf2c0039b0 0x7fdf2c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:58.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.712+0000 7fdf437fe640 1 --2- 172.21.15.132:0/849838787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf2c004800 0x7fdf2c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:58.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.712+0000 7fdf48bfd640 1 --2- 172.21.15.132:0/849838787 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf440727e0 0x7fdf2c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:58.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.713+0000 7fdf43fff640 1 -- 172.21.15.132:0/849838787 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf440727e0 msgr2=0x7fdf2c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:58.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.713+0000 7fdf43fff640 1 --2- 172.21.15.132:0/849838787 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf440727e0 0x7fdf2c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:58.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.713+0000 7fdf43fff640 1 -- 172.21.15.132:0/849838787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf2c004800 msgr2=0x7fdf2c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:58.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.713+0000 7fdf43fff640 1 --2- 172.21.15.132:0/849838787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf2c004800 0x7fdf2c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:58.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.713+0000 7fdf43fff640 1 -- 172.21.15.132:0/849838787 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf2c003520 con 0x7fdf2c0039b0 2024-04-16T15:52:58.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.713+0000 7fdf43fff640 1 --2- 172.21.15.132:0/849838787 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf2c0039b0 0x7fdf2c003dd0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fdf3400c240 tx=0x7fdf2c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4844f7062e84e60 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:58.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.714+0000 7fdf42ffd640 1 -- 172.21.15.132:0/849838787 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf34007d30 con 0x7fdf2c0039b0 2024-04-16T15:52:58.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.714+0000 7fdf42ffd640 1 -- 172.21.15.132:0/849838787 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf34030070 con 0x7fdf2c0039b0 2024-04-16T15:52:58.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.714+0000 7fdf42ffd640 1 -- 172.21.15.132:0/849838787 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf3402cd60 con 0x7fdf2c0039b0 2024-04-16T15:52:58.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.714+0000 7fdf4a660640 1 -- 172.21.15.132:0/849838787 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf2c0039b0 msgr2=0x7fdf2c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:58.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.714+0000 7fdf4a660640 1 --2- 172.21.15.132:0/849838787 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf2c0039b0 0x7fdf2c003dd0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fdf3400c240 tx=0x7fdf2c005830 comp rx=0 tx=0).stop 2024-04-16T15:52:58.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.714+0000 7fdf48bfd640 1 -- 172.21.15.132:0/849838787 reap_dead start 2024-04-16T15:52:58.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.714+0000 7fdf4a660640 1 -- 172.21.15.132:0/849838787 shutdown_connections 2024-04-16T15:52:58.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.714+0000 7fdf4a660640 1 -- 172.21.15.132:0/849838787 >> 172.21.15.132:0/849838787 conn(0x7fdf440d0490 msgr2=0x7fdf440d08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:58.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.714+0000 7fdf4a660640 1 -- 172.21.15.132:0/849838787 shutdown_connections 2024-04-16T15:52:58.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.714+0000 7fdf4a660640 1 -- 172.21.15.132:0/849838787 wait complete. 2024-04-16T15:52:58.720 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.715+0000 7fdf4a660640 1 Processor -- start 2024-04-16T15:52:58.720 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.716+0000 7fdf4a660640 1 -- start start 2024-04-16T15:52:58.720 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.716+0000 7fdf4a660640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf441f5e00 0x7fdf440cc580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:58.720 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.716+0000 7fdf4a660640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf441f61e0 0x7fdf4414b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:58.720 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.716+0000 7fdf4a660640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf4414bcf0 0x7fdf44145600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:58.720 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.716+0000 7fdf4a660640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fdf440b3c00 con 0x7fdf441f5e00 2024-04-16T15:52:58.720 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.716+0000 7fdf4a660640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdf440b3a80 con 0x7fdf4414bcf0 2024-04-16T15:52:58.720 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.716+0000 7fdf4a660640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fdf4415b0f0 con 0x7fdf441f61e0 2024-04-16T15:52:58.720 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.716+0000 7fdf43fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf441f5e00 0x7fdf440cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:58.720 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.716+0000 7fdf43fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf441f5e00 0x7fdf440cc580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60642/0 (socket says 172.21.15.132:60642) 2024-04-16T15:52:58.720 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.716+0000 7fdf43fff640 1 -- 172.21.15.132:0/4099370189 learned_addr learned my addr 172.21.15.132:0/4099370189 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:58.720 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.717+0000 7fdf43fff640 1 -- 172.21.15.132:0/4099370189 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf441f61e0 msgr2=0x7fdf4414b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:58.720 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.717+0000 7fdf48bfd640 1 --2- 172.21.15.132:0/4099370189 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf4414bcf0 0x7fdf44145600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:58.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.717+0000 7fdf43fff640 1 --2- 172.21.15.132:0/4099370189 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf441f61e0 0x7fdf4414b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:58.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.717+0000 7fdf43fff640 1 -- 172.21.15.132:0/4099370189 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf4414bcf0 msgr2=0x7fdf44145600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:58.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.717+0000 7fdf43fff640 1 --2- 172.21.15.132:0/4099370189 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf4414bcf0 0x7fdf44145600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:58.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.717+0000 7fdf43fff640 1 -- 172.21.15.132:0/4099370189 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf440c62a0 con 0x7fdf441f5e00 2024-04-16T15:52:58.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.717+0000 7fdf43fff640 1 --2- 172.21.15.132:0/4099370189 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf441f5e00 0x7fdf440cc580 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fdf3400c360 tx=0x7fdf440b4010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:58.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.717+0000 7fdf40ff9640 1 -- 172.21.15.132:0/4099370189 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf34001c70 con 0x7fdf441f5e00 2024-04-16T15:52:58.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.717+0000 7fdf40ff9640 1 -- 172.21.15.132:0/4099370189 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf34004cb0 con 0x7fdf441f5e00 2024-04-16T15:52:58.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.717+0000 7fdf4a660640 1 -- 172.21.15.132:0/4099370189 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf440c6580 con 0x7fdf441f5e00 2024-04-16T15:52:58.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.717+0000 7fdf40ff9640 1 -- 172.21.15.132:0/4099370189 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf34004e60 con 0x7fdf441f5e00 2024-04-16T15:52:58.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.717+0000 7fdf4a660640 1 -- 172.21.15.132:0/4099370189 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf440c6b40 con 0x7fdf441f5e00 2024-04-16T15:52:58.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.718+0000 7fdf4a660640 1 -- 172.21.15.132:0/4099370189 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf44075510 con 0x7fdf441f5e00 2024-04-16T15:52:58.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.719+0000 7fdf40ff9640 1 -- 172.21.15.132:0/4099370189 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdf34048020 con 0x7fdf441f5e00 2024-04-16T15:52:58.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.719+0000 7fdf40ff9640 1 --2- 172.21.15.132:0/4099370189 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fdf3006c8f0 0x7fdf3006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:58.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.719+0000 7fdf40ff9640 1 -- 172.21.15.132:0/4099370189 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fdf340ad0d0 con 0x7fdf441f5e00 2024-04-16T15:52:58.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.719+0000 7fdf437fe640 1 --2- 172.21.15.132:0/4099370189 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fdf3006c8f0 0x7fdf3006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:58.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.719+0000 7fdf437fe640 1 --2- 172.21.15.132:0/4099370189 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fdf3006c8f0 0x7fdf3006edb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdf44158750 tx=0x7fdf38006bd0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:58.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.723+0000 7fdf40ff9640 1 -- 172.21.15.132:0/4099370189 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdf3407b480 con 0x7fdf441f5e00 2024-04-16T15:52:58.894 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.895+0000 7fdf4a660640 1 -- 172.21.15.132:0/4099370189 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdf440b1580 con 0x7fdf441f5e00 2024-04-16T15:52:58.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.896+0000 7fdf40ff9640 1 -- 172.21.15.132:0/4099370189 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7fdf3407ad80 con 0x7fdf441f5e00 2024-04-16T15:52:58.895 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2024-04-16T15:52:58.897 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.898+0000 7fdf4a660640 1 -- 172.21.15.132:0/4099370189 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fdf3006c8f0 msgr2=0x7fdf3006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:58.897 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.898+0000 7fdf4a660640 1 --2- 172.21.15.132:0/4099370189 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fdf3006c8f0 0x7fdf3006edb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdf44158750 tx=0x7fdf38006bd0 comp rx=0 tx=0).stop 2024-04-16T15:52:58.897 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.898+0000 7fdf4a660640 1 -- 172.21.15.132:0/4099370189 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf441f5e00 msgr2=0x7fdf440cc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:58.897 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.898+0000 7fdf4a660640 1 --2- 172.21.15.132:0/4099370189 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf441f5e00 0x7fdf440cc580 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fdf3400c360 tx=0x7fdf440b4010 comp rx=0 tx=0).stop 2024-04-16T15:52:58.897 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.898+0000 7fdf4a660640 1 -- 172.21.15.132:0/4099370189 shutdown_connections 2024-04-16T15:52:58.897 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.898+0000 7fdf4a660640 1 --2- 172.21.15.132:0/4099370189 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fdf3006c8f0 0x7fdf3006edb0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:58.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.898+0000 7fdf4a660640 1 --2- 172.21.15.132:0/4099370189 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf4414bcf0 0x7fdf44145600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:58.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.898+0000 7fdf4a660640 1 --2- 172.21.15.132:0/4099370189 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf441f61e0 0x7fdf4414b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:58.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.898+0000 7fdf4a660640 1 --2- 172.21.15.132:0/4099370189 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf441f5e00 0x7fdf440cc580 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:58.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.898+0000 7fdf4a660640 1 -- 172.21.15.132:0/4099370189 >> 172.21.15.132:0/4099370189 conn(0x7fdf440d0490 msgr2=0x7fdf4415cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:58.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.898+0000 7fdf4a660640 1 -- 172.21.15.132:0/4099370189 shutdown_connections 2024-04-16T15:52:58.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:58.898+0000 7fdf4a660640 1 -- 172.21.15.132:0/4099370189 wait complete. 2024-04-16T15:52:58.908 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T15:52:59.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.014+0000 7f12fbe7b640 1 Processor -- start 2024-04-16T15:52:59.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.014+0000 7f12fbe7b640 1 -- start start 2024-04-16T15:52:59.014 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.015+0000 7f12fbe7b640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f12f40b6020 0x7f12f40ae480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:59.014 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.015+0000 7f12fbe7b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12f4070eb0 0x7f12f40b0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:59.014 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.015+0000 7f12fbe7b640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12f40b67c0 con 0x7f12f415eae0 2024-04-16T15:52:59.014 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.015+0000 7f12fbe7b640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f12f40b0860 con 0x7f12f40b6020 2024-04-16T15:52:59.014 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.015+0000 7f12fbe7b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f12f40b4b90 con 0x7f12f4070eb0 2024-04-16T15:52:59.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.015+0000 7f12fa418640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12f4070eb0 0x7f12f40b0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:59.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.015+0000 7f12f9416640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f12f40b6020 0x7f12f40ae480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:59.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.015+0000 7f12fa418640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12f4070eb0 0x7f12f40b0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.132:53630/0 (socket says 172.21.15.132:53630) 2024-04-16T15:52:59.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.015+0000 7f12fa418640 1 -- 172.21.15.132:0/672098157 learned_addr learned my addr 172.21.15.132:0/672098157 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:59.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.016+0000 7f12fa418640 1 -- 172.21.15.132:0/672098157 >> v2:172.21.15.179:3300/0 conn(0x7f12f40b6020 msgr2=0x7f12f40ae480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:59.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.016+0000 7f12fa418640 1 --2- 172.21.15.132:0/672098157 >> v2:172.21.15.179:3300/0 conn(0x7f12f40b6020 0x7f12f40ae480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:59.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.016+0000 7f12fa418640 1 -- 172.21.15.132:0/672098157 >> v1:172.21.15.179:6789/0 conn(0x7f12f415eae0 legacy=0x7f12f406fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:59.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.016+0000 7f12fa418640 1 -- 172.21.15.132:0/672098157 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12f40b64e0 con 0x7f12f4070eb0 2024-04-16T15:52:59.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.017+0000 7f12fa418640 1 --2- 172.21.15.132:0/672098157 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12f4070eb0 0x7f12f40b0320 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f12ec009870 tx=0x7f12ec02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbfd5cd0bdbf398f server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:59.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.017+0000 7f12f8c15640 1 -- 172.21.15.132:0/672098157 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12ec035020 con 0x7f12f4070eb0 2024-04-16T15:52:59.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.017+0000 7f12f8c15640 1 -- 172.21.15.132:0/672098157 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12ec031640 con 0x7f12f4070eb0 2024-04-16T15:52:59.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.017+0000 7f12f8c15640 1 -- 172.21.15.132:0/672098157 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12ec02d040 con 0x7f12f4070eb0 2024-04-16T15:52:59.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.017+0000 7f12fbe7b640 1 -- 172.21.15.132:0/672098157 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12f4070eb0 msgr2=0x7f12f40b0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:59.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.017+0000 7f12fbe7b640 1 --2- 172.21.15.132:0/672098157 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12f4070eb0 0x7f12f40b0320 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f12ec009870 tx=0x7f12ec02b8f0 comp rx=0 tx=0).stop 2024-04-16T15:52:59.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.017+0000 7f12fbe7b640 1 -- 172.21.15.132:0/672098157 shutdown_connections 2024-04-16T15:52:59.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.017+0000 7f12fbe7b640 1 --2- 172.21.15.132:0/672098157 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12f4070eb0 0x7f12f40b0320 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:59.018 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.017+0000 7f12fbe7b640 1 --2- 172.21.15.132:0/672098157 >> v2:172.21.15.179:3300/0 conn(0x7f12f40b6020 0x7f12f40ae480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:59.018 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.017+0000 7f12fbe7b640 1 -- 172.21.15.132:0/672098157 >> 172.21.15.132:0/672098157 conn(0x7f12f409aa30 msgr2=0x7f12f40b69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:59.018 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.017+0000 7f12fbe7b640 1 -- 172.21.15.132:0/672098157 shutdown_connections 2024-04-16T15:52:59.018 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.017+0000 7f12fbe7b640 1 -- 172.21.15.132:0/672098157 wait complete. 2024-04-16T15:52:59.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.019+0000 7f12fbe7b640 1 Processor -- start 2024-04-16T15:52:59.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.019+0000 7f12fbe7b640 1 -- start start 2024-04-16T15:52:59.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.019+0000 7f12fbe7b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12f4070eb0 0x7f12f41f56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:59.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.019+0000 7f12fbe7b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12f40b6020 0x7f12f414bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:59.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.019+0000 7f12fbe7b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12f406ba20 0x7f12f406beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:59.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.019+0000 7f12fbe7b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f12f40b0c60 con 0x7f12f406ba20 2024-04-16T15:52:59.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.019+0000 7f12fbe7b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f12f40b48b0 con 0x7f12f40b6020 2024-04-16T15:52:59.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.019+0000 7f12fbe7b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f12f4070220 con 0x7f12f4070eb0 2024-04-16T15:52:59.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.019+0000 7f12fa418640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12f406ba20 0x7f12f406beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:59.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.019+0000 7f12fa418640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12f406ba20 0x7f12f406beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60648/0 (socket says 172.21.15.132:60648) 2024-04-16T15:52:59.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.019+0000 7f12fa418640 1 -- 172.21.15.132:0/1527006278 learned_addr learned my addr 172.21.15.132:0/1527006278 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:59.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.020+0000 7f12f9416640 1 --2- 172.21.15.132:0/1527006278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12f40b6020 0x7f12f414bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:59.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.020+0000 7f12f9c17640 1 --2- 172.21.15.132:0/1527006278 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12f4070eb0 0x7f12f41f56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:59.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.020+0000 7f12fa418640 1 -- 172.21.15.132:0/1527006278 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12f4070eb0 msgr2=0x7f12f41f56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:59.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.020+0000 7f12fa418640 1 --2- 172.21.15.132:0/1527006278 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12f4070eb0 0x7f12f41f56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:59.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.020+0000 7f12fa418640 1 -- 172.21.15.132:0/1527006278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12f40b6020 msgr2=0x7f12f414bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:59.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.020+0000 7f12fa418640 1 --2- 172.21.15.132:0/1527006278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12f40b6020 0x7f12f414bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:59.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.020+0000 7f12fa418640 1 -- 172.21.15.132:0/1527006278 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12f41f5c10 con 0x7f12f406ba20 2024-04-16T15:52:59.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.020+0000 7f12f9416640 1 --2- 172.21.15.132:0/1527006278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12f40b6020 0x7f12f414bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:52:59.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.020+0000 7f12f9c17640 1 --2- 172.21.15.132:0/1527006278 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12f4070eb0 0x7f12f41f56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:52:59.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.020+0000 7f12fa418640 1 --2- 172.21.15.132:0/1527006278 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12f406ba20 0x7f12f406beb0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f12ec009870 tx=0x7f12ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:59.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.020+0000 7f12ea7fc640 1 -- 172.21.15.132:0/1527006278 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12ec040070 con 0x7f12f406ba20 2024-04-16T15:52:59.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.020+0000 7f12ea7fc640 1 -- 172.21.15.132:0/1527006278 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12ec0399f0 con 0x7f12f406ba20 2024-04-16T15:52:59.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.020+0000 7f12fbe7b640 1 -- 172.21.15.132:0/1527006278 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12f41f5470 con 0x7f12f406ba20 2024-04-16T15:52:59.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.020+0000 7f12ea7fc640 1 -- 172.21.15.132:0/1527006278 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12ec035040 con 0x7f12f406ba20 2024-04-16T15:52:59.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.020+0000 7f12fbe7b640 1 -- 172.21.15.132:0/1527006278 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12f40b11b0 con 0x7f12f406ba20 2024-04-16T15:52:59.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.021+0000 7f12fbe7b640 1 -- 172.21.15.132:0/1527006278 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12f4075510 con 0x7f12f406ba20 2024-04-16T15:52:59.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.022+0000 7f12ea7fc640 1 -- 172.21.15.132:0/1527006278 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f12ec04b060 con 0x7f12f406ba20 2024-04-16T15:52:59.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.022+0000 7f12ea7fc640 1 --2- 172.21.15.132:0/1527006278 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f12d806c8f0 0x7f12d806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:59.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.022+0000 7f12ea7fc640 1 -- 172.21.15.132:0/1527006278 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f12ec0ad460 con 0x7f12f406ba20 2024-04-16T15:52:59.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.022+0000 7f12f9c17640 1 --2- 172.21.15.132:0/1527006278 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f12d806c8f0 0x7f12d806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:59.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.022+0000 7f12f9c17640 1 --2- 172.21.15.132:0/1527006278 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f12d806c8f0 0x7f12d806edb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f12f40b0690 tx=0x7f12f0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:59.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.026+0000 7f12ea7fc640 1 -- 172.21.15.132:0/1527006278 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f12ec07b810 con 0x7f12f406ba20 2024-04-16T15:52:59.203 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.204+0000 7f12fbe7b640 1 -- 172.21.15.132:0/1527006278 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f12f4162490 con 0x7f12f406ba20 2024-04-16T15:52:59.203 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.204+0000 7f12ea7fc640 1 -- 172.21.15.132:0/1527006278 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7f12ec07b110 con 0x7f12f406ba20 2024-04-16T15:52:59.203 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2024-04-16T15:52:59.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.206+0000 7f12fbe7b640 1 -- 172.21.15.132:0/1527006278 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f12d806c8f0 msgr2=0x7f12d806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:59.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.206+0000 7f12fbe7b640 1 --2- 172.21.15.132:0/1527006278 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f12d806c8f0 0x7f12d806edb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f12f40b0690 tx=0x7f12f0009040 comp rx=0 tx=0).stop 2024-04-16T15:52:59.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.206+0000 7f12fbe7b640 1 -- 172.21.15.132:0/1527006278 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12f406ba20 msgr2=0x7f12f406beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:59.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.206+0000 7f12fbe7b640 1 --2- 172.21.15.132:0/1527006278 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12f406ba20 0x7f12f406beb0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f12ec009870 tx=0x7f12ec0046c0 comp rx=0 tx=0).stop 2024-04-16T15:52:59.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.206+0000 7f12fbe7b640 1 -- 172.21.15.132:0/1527006278 shutdown_connections 2024-04-16T15:52:59.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.206+0000 7f12fbe7b640 1 --2- 172.21.15.132:0/1527006278 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f12d806c8f0 0x7f12d806edb0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:59.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.206+0000 7f12fbe7b640 1 --2- 172.21.15.132:0/1527006278 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12f406ba20 0x7f12f406beb0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:59.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.206+0000 7f12fbe7b640 1 --2- 172.21.15.132:0/1527006278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12f40b6020 0x7f12f414bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:59.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.206+0000 7f12fbe7b640 1 --2- 172.21.15.132:0/1527006278 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12f4070eb0 0x7f12f41f56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:59.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.206+0000 7f12fbe7b640 1 -- 172.21.15.132:0/1527006278 >> 172.21.15.132:0/1527006278 conn(0x7f12f409aa30 msgr2=0x7f12f4162c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:59.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.206+0000 7f12fbe7b640 1 -- 172.21.15.132:0/1527006278 shutdown_connections 2024-04-16T15:52:59.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.206+0000 7f12fbe7b640 1 -- 172.21.15.132:0/1527006278 wait complete. 2024-04-16T15:52:59.217 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T15:52:59.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.324+0000 7f9178b82640 1 Processor -- start 2024-04-16T15:52:59.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.324+0000 7f9178b82640 1 -- start start 2024-04-16T15:52:59.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.325+0000 7f9178b82640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f917415ec20 0x7f91740d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:59.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.325+0000 7f9178b82640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f91740d2030 0x7f91740b7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:59.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.325+0000 7f9178b82640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91740d3850 con 0x7f91740d3340 2024-04-16T15:52:59.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.325+0000 7f9178b82640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f91740d3b30 con 0x7f91740d2030 2024-04-16T15:52:59.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.325+0000 7f9178b82640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f91740d3e10 con 0x7f917415ec20 2024-04-16T15:52:59.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.325+0000 7f9172d9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f91740d2030 0x7f91740b7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:59.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.325+0000 7f9172d9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f91740d2030 0x7f91740b7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60654/0 (socket says 172.21.15.132:60654) 2024-04-16T15:52:59.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.325+0000 7f9172d9d640 1 -- 172.21.15.132:0/557919601 learned_addr learned my addr 172.21.15.132:0/557919601 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:59.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.325+0000 7f917259c640 1 --2- 172.21.15.132:0/557919601 >> v2:172.21.15.179:3300/0 conn(0x7f917415ec20 0x7f91740d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:59.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.325+0000 7f9172d9d640 1 -- 172.21.15.132:0/557919601 >> v2:172.21.15.179:3300/0 conn(0x7f917415ec20 msgr2=0x7f91740d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:59.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.325+0000 7f9172d9d640 1 --2- 172.21.15.132:0/557919601 >> v2:172.21.15.179:3300/0 conn(0x7f917415ec20 0x7f91740d2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:59.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.325+0000 7f9172d9d640 1 -- 172.21.15.132:0/557919601 >> v1:172.21.15.179:6789/0 conn(0x7f91740d3340 legacy=0x7f91740d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:59.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.325+0000 7f9172d9d640 1 -- 172.21.15.132:0/557919601 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91740d40f0 con 0x7f91740d2030 2024-04-16T15:52:59.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.325+0000 7f917259c640 1 --2- 172.21.15.132:0/557919601 >> v2:172.21.15.179:3300/0 conn(0x7f917415ec20 0x7f91740d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:52:59.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.326+0000 7f9172d9d640 1 --2- 172.21.15.132:0/557919601 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f91740d2030 0x7f91740b7bb0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f91740d59d0 tx=0x7f916c02c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fffd8bd8bdde5072 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:59.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.326+0000 7f9171d9b640 1 -- 172.21.15.132:0/557919601 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f916c02cbb0 con 0x7f91740d2030 2024-04-16T15:52:59.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.326+0000 7f9171d9b640 1 -- 172.21.15.132:0/557919601 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f916c02cd50 con 0x7f91740d2030 2024-04-16T15:52:59.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.326+0000 7f9171d9b640 1 -- 172.21.15.132:0/557919601 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f916c034610 con 0x7f91740d2030 2024-04-16T15:52:59.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.327+0000 7f9178b82640 1 -- 172.21.15.132:0/557919601 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f91740d2030 msgr2=0x7f91740b7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:59.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.327+0000 7f9178b82640 1 --2- 172.21.15.132:0/557919601 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f91740d2030 0x7f91740b7bb0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f91740d59d0 tx=0x7f916c02c010 comp rx=0 tx=0).stop 2024-04-16T15:52:59.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.327+0000 7f9178b82640 1 -- 172.21.15.132:0/557919601 shutdown_connections 2024-04-16T15:52:59.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.327+0000 7f9178b82640 1 --2- 172.21.15.132:0/557919601 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f91740d2030 0x7f91740b7bb0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:59.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.327+0000 7f9178b82640 1 --2- 172.21.15.132:0/557919601 >> v2:172.21.15.179:3300/0 conn(0x7f917415ec20 0x7f91740d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:59.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.327+0000 7f9178b82640 1 -- 172.21.15.132:0/557919601 >> 172.21.15.132:0/557919601 conn(0x7f917406d2d0 msgr2=0x7f917406d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:59.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.327+0000 7f9178b82640 1 -- 172.21.15.132:0/557919601 shutdown_connections 2024-04-16T15:52:59.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.327+0000 7f9178b82640 1 -- 172.21.15.132:0/557919601 wait complete. 2024-04-16T15:52:59.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.328+0000 7f9178b82640 1 Processor -- start 2024-04-16T15:52:59.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.328+0000 7f9178b82640 1 -- start start 2024-04-16T15:52:59.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.329+0000 7f9178b82640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91740d2030 0x7f91740cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:59.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.329+0000 7f9178b82640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91740d3340 0x7f917414d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:59.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.329+0000 7f9178b82640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f917415ec20 0x7f917414b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:59.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.329+0000 7f9178b82640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f91740cf3a0 con 0x7f917415ec20 2024-04-16T15:52:59.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.329+0000 7f9178b82640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f917415f000 con 0x7f91740d3340 2024-04-16T15:52:59.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.329+0000 7f9178b82640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f91740cf520 con 0x7f91740d2030 2024-04-16T15:52:59.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.329+0000 7f9172d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f917415ec20 0x7f917414b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:59.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.329+0000 7f9172d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f917415ec20 0x7f917414b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60670/0 (socket says 172.21.15.132:60670) 2024-04-16T15:52:59.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.329+0000 7f9172d9d640 1 -- 172.21.15.132:0/2778961678 learned_addr learned my addr 172.21.15.132:0/2778961678 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:59.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.329+0000 7f916bfff640 1 --2- 172.21.15.132:0/2778961678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91740d3340 0x7f917414d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:59.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.329+0000 7f917259c640 1 --2- 172.21.15.132:0/2778961678 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91740d2030 0x7f91740cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:59.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.329+0000 7f9172d9d640 1 -- 172.21.15.132:0/2778961678 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91740d2030 msgr2=0x7f91740cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:59.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.329+0000 7f9172d9d640 1 --2- 172.21.15.132:0/2778961678 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91740d2030 0x7f91740cdf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:59.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.329+0000 7f9172d9d640 1 -- 172.21.15.132:0/2778961678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91740d3340 msgr2=0x7f917414d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:59.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.329+0000 7f9172d9d640 1 --2- 172.21.15.132:0/2778961678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91740d3340 0x7f917414d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:59.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.329+0000 7f9172d9d640 1 -- 172.21.15.132:0/2778961678 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91740ce490 con 0x7f917415ec20 2024-04-16T15:52:59.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.329+0000 7f9172d9d640 1 --2- 172.21.15.132:0/2778961678 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f917415ec20 0x7f917414b5c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f916c036040 tx=0x7f916c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:59.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.330+0000 7f916affd640 1 -- 172.21.15.132:0/2778961678 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f916c043020 con 0x7f917415ec20 2024-04-16T15:52:59.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.330+0000 7f916affd640 1 -- 172.21.15.132:0/2778961678 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f916c03e450 con 0x7f917415ec20 2024-04-16T15:52:59.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.330+0000 7f916affd640 1 -- 172.21.15.132:0/2778961678 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f916c009510 con 0x7f917415ec20 2024-04-16T15:52:59.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.330+0000 7f9178b82640 1 -- 172.21.15.132:0/2778961678 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f917414a520 con 0x7f917415ec20 2024-04-16T15:52:59.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.330+0000 7f9178b82640 1 -- 172.21.15.132:0/2778961678 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f917414aae0 con 0x7f917415ec20 2024-04-16T15:52:59.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.331+0000 7f9178b82640 1 -- 172.21.15.132:0/2778961678 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9174075510 con 0x7f917415ec20 2024-04-16T15:52:59.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.331+0000 7f916affd640 1 -- 172.21.15.132:0/2778961678 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f916c046020 con 0x7f917415ec20 2024-04-16T15:52:59.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.331+0000 7f916affd640 1 --2- 172.21.15.132:0/2778961678 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f915406c8f0 0x7f915406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:59.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.331+0000 7f916affd640 1 -- 172.21.15.132:0/2778961678 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f916c0ae270 con 0x7f917415ec20 2024-04-16T15:52:59.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.332+0000 7f917259c640 1 --2- 172.21.15.132:0/2778961678 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f915406c8f0 0x7f915406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:59.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.332+0000 7f917259c640 1 --2- 172.21.15.132:0/2778961678 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f915406c8f0 0x7f915406edb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f91741f7ca0 tx=0x7f9164008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:59.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.336+0000 7f916affd640 1 -- 172.21.15.132:0/2778961678 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f916c04d030 con 0x7f917415ec20 2024-04-16T15:52:59.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.512+0000 7f9178b82640 1 -- 172.21.15.132:0/2778961678 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f91740ba210 con 0x7f917415ec20 2024-04-16T15:52:59.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.512+0000 7f916affd640 1 -- 172.21.15.132:0/2778961678 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7f916c07c060 con 0x7f917415ec20 2024-04-16T15:52:59.512 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2024-04-16T15:52:59.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.514+0000 7f9178b82640 1 -- 172.21.15.132:0/2778961678 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f915406c8f0 msgr2=0x7f915406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:59.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.514+0000 7f9178b82640 1 --2- 172.21.15.132:0/2778961678 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f915406c8f0 0x7f915406edb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f91741f7ca0 tx=0x7f9164008040 comp rx=0 tx=0).stop 2024-04-16T15:52:59.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.514+0000 7f9178b82640 1 -- 172.21.15.132:0/2778961678 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f917415ec20 msgr2=0x7f917414b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:59.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.514+0000 7f9178b82640 1 --2- 172.21.15.132:0/2778961678 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f917415ec20 0x7f917414b5c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f916c036040 tx=0x7f916c004a40 comp rx=0 tx=0).stop 2024-04-16T15:52:59.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.514+0000 7f9178b82640 1 -- 172.21.15.132:0/2778961678 shutdown_connections 2024-04-16T15:52:59.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.514+0000 7f9178b82640 1 --2- 172.21.15.132:0/2778961678 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f915406c8f0 0x7f915406edb0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:59.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.514+0000 7f9178b82640 1 --2- 172.21.15.132:0/2778961678 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f917415ec20 0x7f917414b5c0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:59.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.514+0000 7f9178b82640 1 --2- 172.21.15.132:0/2778961678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91740d3340 0x7f917414d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:59.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.514+0000 7f9178b82640 1 --2- 172.21.15.132:0/2778961678 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91740d2030 0x7f91740cdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:59.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.514+0000 7f9178b82640 1 -- 172.21.15.132:0/2778961678 >> 172.21.15.132:0/2778961678 conn(0x7f917406d2d0 msgr2=0x7f9174160a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:59.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.514+0000 7f9178b82640 1 -- 172.21.15.132:0/2778961678 shutdown_connections 2024-04-16T15:52:59.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.514+0000 7f9178b82640 1 -- 172.21.15.132:0/2778961678 wait complete. 2024-04-16T15:52:59.525 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T15:52:59.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.629+0000 7fe01ab1c640 1 Processor -- start 2024-04-16T15:52:59.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.629+0000 7fe01ab1c640 1 -- start start 2024-04-16T15:52:59.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.629+0000 7fe01ab1c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe01415eaf0 0x7fe0140ba300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:59.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.629+0000 7fe01ab1c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe01415eed0 0x7fe0140b63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:59.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.629+0000 7fe01ab1c640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe014162cc0 con 0x7fe0141627e0 2024-04-16T15:52:59.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.629+0000 7fe01ab1c640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fe0140d2af0 con 0x7fe01415eaf0 2024-04-16T15:52:59.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.629+0000 7fe01ab1c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe014162fa0 con 0x7fe01415eed0 2024-04-16T15:52:59.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.630+0000 7fe0188b8640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe01415eaf0 0x7fe0140ba300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:59.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.630+0000 7fe013fff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe01415eed0 0x7fe0140b63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:59.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.630+0000 7fe0188b8640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe01415eaf0 0x7fe0140ba300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.132:48958/0 (socket says 172.21.15.132:48958) 2024-04-16T15:52:59.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.630+0000 7fe0188b8640 1 -- 172.21.15.132:0/2384349536 learned_addr learned my addr 172.21.15.132:0/2384349536 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:59.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.630+0000 7fe0190b9640 1 --1- 172.21.15.132:0/2384349536 >> v1:172.21.15.179:6789/0 conn(0x7fe0141627e0 0x7fe014067760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.132:42104/0 (socket says 172.21.15.132:42104) 2024-04-16T15:52:59.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.630+0000 7fe0188b8640 1 -- 172.21.15.132:0/2384349536 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe01415eed0 msgr2=0x7fe0140b63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:59.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.630+0000 7fe0188b8640 1 --2- 172.21.15.132:0/2384349536 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe01415eed0 0x7fe0140b63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:59.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.630+0000 7fe0188b8640 1 -- 172.21.15.132:0/2384349536 >> v1:172.21.15.179:6789/0 conn(0x7fe0141627e0 legacy=0x7fe014067760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:59.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.630+0000 7fe0188b8640 1 -- 172.21.15.132:0/2384349536 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe014163280 con 0x7fe01415eaf0 2024-04-16T15:52:59.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.631+0000 7fe0188b8640 1 --2- 172.21.15.132:0/2384349536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe01415eaf0 0x7fe0140ba300 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe008009870 tx=0x7fe00802b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7f8d32c01ff589e server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:59.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.631+0000 7fe0137fe640 1 -- 172.21.15.132:0/2384349536 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe008034070 con 0x7fe01415eaf0 2024-04-16T15:52:59.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.631+0000 7fe0137fe640 1 -- 172.21.15.132:0/2384349536 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe008030840 con 0x7fe01415eaf0 2024-04-16T15:52:59.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.631+0000 7fe0137fe640 1 -- 172.21.15.132:0/2384349536 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe008030c10 con 0x7fe01415eaf0 2024-04-16T15:52:59.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.632+0000 7fe01ab1c640 1 -- 172.21.15.132:0/2384349536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe01415eaf0 msgr2=0x7fe0140ba300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:59.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.632+0000 7fe01ab1c640 1 --2- 172.21.15.132:0/2384349536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe01415eaf0 0x7fe0140ba300 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe008009870 tx=0x7fe00802b980 comp rx=0 tx=0).stop 2024-04-16T15:52:59.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.632+0000 7fe01ab1c640 1 -- 172.21.15.132:0/2384349536 shutdown_connections 2024-04-16T15:52:59.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.632+0000 7fe01ab1c640 1 --2- 172.21.15.132:0/2384349536 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe01415eed0 0x7fe0140b63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:59.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.632+0000 7fe01ab1c640 1 --2- 172.21.15.132:0/2384349536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe01415eaf0 0x7fe0140ba300 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:59.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.632+0000 7fe01ab1c640 1 -- 172.21.15.132:0/2384349536 >> 172.21.15.132:0/2384349536 conn(0x7fe0140d13f0 msgr2=0x7fe0140d1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:59.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.632+0000 7fe01ab1c640 1 -- 172.21.15.132:0/2384349536 shutdown_connections 2024-04-16T15:52:59.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.632+0000 7fe01ab1c640 1 -- 172.21.15.132:0/2384349536 wait complete. 2024-04-16T15:52:59.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.633+0000 7fe01ab1c640 1 Processor -- start 2024-04-16T15:52:59.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.633+0000 7fe01ab1c640 1 -- start start 2024-04-16T15:52:59.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.634+0000 7fe01ab1c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe01415eaf0 0x7fe014158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:59.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.634+0000 7fe01ab1c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe01415eed0 0x7fe0140c99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:59.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.634+0000 7fe01ab1c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0141627e0 0x7fe014160b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:59.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.634+0000 7fe01ab1c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe0140d3f90 con 0x7fe0141627e0 2024-04-16T15:52:59.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.634+0000 7fe01ab1c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe0140ba840 con 0x7fe01415eaf0 2024-04-16T15:52:59.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.634+0000 7fe01ab1c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe0140d4110 con 0x7fe01415eed0 2024-04-16T15:52:59.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.634+0000 7fe0190b9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0141627e0 0x7fe014160b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:59.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.634+0000 7fe0190b9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0141627e0 0x7fe014160b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60680/0 (socket says 172.21.15.132:60680) 2024-04-16T15:52:59.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.634+0000 7fe0190b9640 1 -- 172.21.15.132:0/2235054054 learned_addr learned my addr 172.21.15.132:0/2235054054 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:59.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.634+0000 7fe0188b8640 1 --2- 172.21.15.132:0/2235054054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe01415eaf0 0x7fe014158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:59.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.634+0000 7fe013fff640 1 --2- 172.21.15.132:0/2235054054 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe01415eed0 0x7fe0140c99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:59.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.634+0000 7fe0190b9640 1 -- 172.21.15.132:0/2235054054 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe01415eed0 msgr2=0x7fe0140c99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:59.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.634+0000 7fe0190b9640 1 --2- 172.21.15.132:0/2235054054 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe01415eed0 0x7fe0140c99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:59.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.634+0000 7fe0190b9640 1 -- 172.21.15.132:0/2235054054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe01415eaf0 msgr2=0x7fe014158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:59.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.634+0000 7fe0190b9640 1 --2- 172.21.15.132:0/2235054054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe01415eaf0 0x7fe014158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:59.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.634+0000 7fe0190b9640 1 -- 172.21.15.132:0/2235054054 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0140c8910 con 0x7fe0141627e0 2024-04-16T15:52:59.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.634+0000 7fe0188b8640 1 --2- 172.21.15.132:0/2235054054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe01415eaf0 0x7fe014158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:52:59.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.634+0000 7fe0190b9640 1 --2- 172.21.15.132:0/2235054054 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0141627e0 0x7fe014160b10 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe00c00c760 tx=0x7fe00c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:59.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.635+0000 7fe0117fa640 1 -- 172.21.15.132:0/2235054054 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe00c017070 con 0x7fe0141627e0 2024-04-16T15:52:59.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.635+0000 7fe0117fa640 1 -- 172.21.15.132:0/2235054054 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe00c00ce10 con 0x7fe0141627e0 2024-04-16T15:52:59.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.635+0000 7fe01ab1c640 1 -- 172.21.15.132:0/2235054054 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0140c8bf0 con 0x7fe0141627e0 2024-04-16T15:52:59.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.635+0000 7fe0117fa640 1 -- 172.21.15.132:0/2235054054 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe00c00a840 con 0x7fe0141627e0 2024-04-16T15:52:59.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.635+0000 7fe01ab1c640 1 -- 172.21.15.132:0/2235054054 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0140c91b0 con 0x7fe0141627e0 2024-04-16T15:52:59.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.636+0000 7fe01ab1c640 1 -- 172.21.15.132:0/2235054054 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe014075510 con 0x7fe0141627e0 2024-04-16T15:52:59.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.636+0000 7fe0117fa640 1 -- 172.21.15.132:0/2235054054 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe00c01a070 con 0x7fe0141627e0 2024-04-16T15:52:59.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.637+0000 7fe0117fa640 1 --2- 172.21.15.132:0/2235054054 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fdff806c8f0 0x7fdff806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:59.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.637+0000 7fe0117fa640 1 -- 172.21.15.132:0/2235054054 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fe00c08af40 con 0x7fe0141627e0 2024-04-16T15:52:59.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.637+0000 7fe0188b8640 1 --2- 172.21.15.132:0/2235054054 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fdff806c8f0 0x7fdff806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:59.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.637+0000 7fe0188b8640 1 --2- 172.21.15.132:0/2235054054 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fdff806c8f0 0x7fdff806edb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe008036000 tx=0x7fe008008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:59.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.641+0000 7fe0117fa640 1 -- 172.21.15.132:0/2235054054 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe00c058d30 con 0x7fe0141627e0 2024-04-16T15:52:59.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.853+0000 7fe01ab1c640 1 -- 172.21.15.132:0/2235054054 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe0140d2610 con 0x7fe0141627e0 2024-04-16T15:52:59.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.854+0000 7fe0117fa640 1 -- 172.21.15.132:0/2235054054 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5175 (secure 0 0 0) 0x7fe00c05d030 con 0x7fe0141627e0 2024-04-16T15:52:59.853 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:52:59.853 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/659108212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":659108212},{"type":"v1","addr":"172.21.15.132:6835","nonce":659108212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/811468074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":811468074},{"type":"v1","addr":"172.21.15.132:6837","nonce":811468074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/493922944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":493922944},{"type":"v1","addr":"172.21.15.179:6834","nonce":493922944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T15:52:15.286161+0000","modified":"2024-04-16T15:52:17.305756+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/202618568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":202618568},{"type":"v1","addr":"172.21.15.179:6835","nonce":202618568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1}]} 2024-04-16T15:52:59.853 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 6 2024-04-16T15:52:59.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.856+0000 7fe01ab1c640 1 -- 172.21.15.132:0/2235054054 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fdff806c8f0 msgr2=0x7fdff806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:59.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.856+0000 7fe01ab1c640 1 --2- 172.21.15.132:0/2235054054 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fdff806c8f0 0x7fdff806edb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe008036000 tx=0x7fe008008030 comp rx=0 tx=0).stop 2024-04-16T15:52:59.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.856+0000 7fe01ab1c640 1 -- 172.21.15.132:0/2235054054 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0141627e0 msgr2=0x7fe014160b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:59.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.856+0000 7fe01ab1c640 1 --2- 172.21.15.132:0/2235054054 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0141627e0 0x7fe014160b10 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe00c00c760 tx=0x7fe00c00cc20 comp rx=0 tx=0).stop 2024-04-16T15:52:59.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.856+0000 7fe01ab1c640 1 -- 172.21.15.132:0/2235054054 shutdown_connections 2024-04-16T15:52:59.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.856+0000 7fe01ab1c640 1 --2- 172.21.15.132:0/2235054054 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fdff806c8f0 0x7fdff806edb0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:59.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.856+0000 7fe01ab1c640 1 --2- 172.21.15.132:0/2235054054 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0141627e0 0x7fe014160b10 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:59.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.856+0000 7fe01ab1c640 1 --2- 172.21.15.132:0/2235054054 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe01415eed0 0x7fe0140c99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:59.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.856+0000 7fe01ab1c640 1 --2- 172.21.15.132:0/2235054054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe01415eaf0 0x7fe014158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:59.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.856+0000 7fe01ab1c640 1 -- 172.21.15.132:0/2235054054 >> 172.21.15.132:0/2235054054 conn(0x7fe0140d13f0 msgr2=0x7fe0140cfc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:59.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.856+0000 7fe01ab1c640 1 -- 172.21.15.132:0/2235054054 shutdown_connections 2024-04-16T15:52:59.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.856+0000 7fe01ab1c640 1 -- 172.21.15.132:0/2235054054 wait complete. 2024-04-16T15:52:59.867 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:52:59.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.970+0000 7f569824e640 1 Processor -- start 2024-04-16T15:52:59.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.971+0000 7f569824e640 1 -- start start 2024-04-16T15:52:59.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.971+0000 7f569824e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f569015eaf0 0x7f56900ba300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:59.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.971+0000 7f569824e640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f569015eed0 0x7f56900b63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:59.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.971+0000 7f569824e640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5690162cc0 con 0x7f56901627e0 2024-04-16T15:52:59.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.971+0000 7f569824e640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f56900d2af0 con 0x7f569015eed0 2024-04-16T15:52:59.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.971+0000 7f569824e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f5690162fa0 con 0x7f569015eaf0 2024-04-16T15:52:59.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.972+0000 7f5695fea640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f569015eaf0 0x7f56900ba300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:59.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.972+0000 7f56957e9640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f569015eed0 0x7f56900b63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:59.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.972+0000 7f5695fea640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f569015eaf0 0x7f56900ba300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.132:53676/0 (socket says 172.21.15.132:53676) 2024-04-16T15:52:59.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.972+0000 7f5695fea640 1 -- 172.21.15.132:0/4056737808 learned_addr learned my addr 172.21.15.132:0/4056737808 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:59.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.972+0000 7f56957e9640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f569015eed0 0x7f56900b63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.132:48968/0 (socket says 172.21.15.132:48968) 2024-04-16T15:52:59.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.972+0000 7f56967eb640 1 --1- 172.21.15.132:0/4056737808 >> v1:172.21.15.179:6789/0 conn(0x7f56901627e0 0x7f5690067760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.132:42120/0 (socket says 172.21.15.132:42120) 2024-04-16T15:52:59.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.972+0000 7f5695fea640 1 -- 172.21.15.132:0/4056737808 >> v2:172.21.15.179:3300/0 conn(0x7f569015eed0 msgr2=0x7f56900b63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:52:59.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.972+0000 7f5695fea640 1 --2- 172.21.15.132:0/4056737808 >> v2:172.21.15.179:3300/0 conn(0x7f569015eed0 0x7f56900b63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:59.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.972+0000 7f5695fea640 1 -- 172.21.15.132:0/4056737808 >> v1:172.21.15.179:6789/0 conn(0x7f56901627e0 legacy=0x7f5690067760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:59.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.972+0000 7f5695fea640 1 -- 172.21.15.132:0/4056737808 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5690163280 con 0x7f569015eaf0 2024-04-16T15:52:59.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.972+0000 7f56957e9640 1 --2- 172.21.15.132:0/4056737808 >> v2:172.21.15.179:3300/0 conn(0x7f569015eed0 0x7f56900b63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:52:59.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.973+0000 7f5695fea640 1 --2- 172.21.15.132:0/4056737808 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f569015eaf0 0x7f56900ba300 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f568c009e50 tx=0x7f568c02bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd14b3523fc2e315 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:59.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.973+0000 7f5694fe8640 1 -- 172.21.15.132:0/4056737808 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f568c02cb00 con 0x7f569015eaf0 2024-04-16T15:52:59.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.973+0000 7f5694fe8640 1 -- 172.21.15.132:0/4056737808 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f568c02cca0 con 0x7f569015eaf0 2024-04-16T15:52:59.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.973+0000 7f5694fe8640 1 -- 172.21.15.132:0/4056737808 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f568c034610 con 0x7f569015eaf0 2024-04-16T15:52:59.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.974+0000 7f569824e640 1 -- 172.21.15.132:0/4056737808 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f569015eaf0 msgr2=0x7f56900ba300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:59.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.974+0000 7f569824e640 1 --2- 172.21.15.132:0/4056737808 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f569015eaf0 0x7f56900ba300 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f568c009e50 tx=0x7f568c02bf60 comp rx=0 tx=0).stop 2024-04-16T15:52:59.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.974+0000 7f569824e640 1 -- 172.21.15.132:0/4056737808 shutdown_connections 2024-04-16T15:52:59.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.974+0000 7f569824e640 1 --2- 172.21.15.132:0/4056737808 >> v2:172.21.15.179:3300/0 conn(0x7f569015eed0 0x7f56900b63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:59.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.974+0000 7f569824e640 1 --2- 172.21.15.132:0/4056737808 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f569015eaf0 0x7f56900ba300 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:59.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.974+0000 7f569824e640 1 -- 172.21.15.132:0/4056737808 >> 172.21.15.132:0/4056737808 conn(0x7f56900d13f0 msgr2=0x7f56900d1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:52:59.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.974+0000 7f569824e640 1 -- 172.21.15.132:0/4056737808 shutdown_connections 2024-04-16T15:52:59.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.974+0000 7f569824e640 1 -- 172.21.15.132:0/4056737808 wait complete. 2024-04-16T15:52:59.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.975+0000 7f569824e640 1 Processor -- start 2024-04-16T15:52:59.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.975+0000 7f569824e640 1 -- start start 2024-04-16T15:52:59.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.976+0000 7f569824e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f569015eaf0 0x7f56900ce590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:59.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.976+0000 7f569824e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f569015eed0 0x7f56900c9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:59.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.976+0000 7f569824e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56901627e0 0x7f569015b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:59.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.976+0000 7f569824e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f56900d3f90 con 0x7f56901627e0 2024-04-16T15:52:59.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.976+0000 7f569824e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f56900ba840 con 0x7f569015eed0 2024-04-16T15:52:59.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.976+0000 7f569824e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f56900d4110 con 0x7f569015eaf0 2024-04-16T15:52:59.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.976+0000 7f56967eb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56901627e0 0x7f569015b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:59.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.976+0000 7f56967eb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56901627e0 0x7f569015b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60688/0 (socket says 172.21.15.132:60688) 2024-04-16T15:52:59.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.976+0000 7f56967eb640 1 -- 172.21.15.132:0/446240394 learned_addr learned my addr 172.21.15.132:0/446240394 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:52:59.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.976+0000 7f5695fea640 1 --2- 172.21.15.132:0/446240394 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f569015eaf0 0x7f56900ce590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:59.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.976+0000 7f56957e9640 1 --2- 172.21.15.132:0/446240394 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f569015eed0 0x7f56900c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:59.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.976+0000 7f56967eb640 1 -- 172.21.15.132:0/446240394 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f569015eaf0 msgr2=0x7f56900ce590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:59.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.976+0000 7f56967eb640 1 --2- 172.21.15.132:0/446240394 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f569015eaf0 0x7f56900ce590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:59.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.976+0000 7f56967eb640 1 -- 172.21.15.132:0/446240394 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f569015eed0 msgr2=0x7f56900c9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:52:59.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.976+0000 7f56967eb640 1 --2- 172.21.15.132:0/446240394 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f569015eed0 0x7f56900c9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:52:59.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.976+0000 7f56967eb640 1 -- 172.21.15.132:0/446240394 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56900ca2e0 con 0x7f56901627e0 2024-04-16T15:52:59.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.976+0000 7f56967eb640 1 --2- 172.21.15.132:0/446240394 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56901627e0 0x7f569015b3c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f568800c3c0 tx=0x7f568800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:59.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.976+0000 7f56867fc640 1 -- 172.21.15.132:0/446240394 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56880074e0 con 0x7f56901627e0 2024-04-16T15:52:59.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.976+0000 7f56867fc640 1 -- 172.21.15.132:0/446240394 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5688007680 con 0x7f56901627e0 2024-04-16T15:52:59.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.976+0000 7f569824e640 1 -- 172.21.15.132:0/446240394 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56900ca5c0 con 0x7f56901627e0 2024-04-16T15:52:59.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.976+0000 7f56867fc640 1 -- 172.21.15.132:0/446240394 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56880049e0 con 0x7f56901627e0 2024-04-16T15:52:59.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.976+0000 7f569824e640 1 -- 172.21.15.132:0/446240394 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56900cab80 con 0x7f56901627e0 2024-04-16T15:52:59.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.978+0000 7f569824e640 1 -- 172.21.15.132:0/446240394 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5690075510 con 0x7f56901627e0 2024-04-16T15:52:59.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.978+0000 7f56867fc640 1 -- 172.21.15.132:0/446240394 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f568801a020 con 0x7f56901627e0 2024-04-16T15:52:59.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.978+0000 7f56867fc640 1 --2- 172.21.15.132:0/446240394 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f567406c8f0 0x7f567406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:52:59.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.978+0000 7f56867fc640 1 -- 172.21.15.132:0/446240394 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f568808b250 con 0x7f56901627e0 2024-04-16T15:52:59.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.978+0000 7f5695fea640 1 --2- 172.21.15.132:0/446240394 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f567406c8f0 0x7f567406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:52:59.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.979+0000 7f5695fea640 1 --2- 172.21.15.132:0/446240394 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f567406c8f0 0x7f567406edb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f568c035000 tx=0x7f568c030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:52:59.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:52:59.983+0000 7f56867fc640 1 -- 172.21.15.132:0/446240394 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5688058f30 con 0x7f56901627e0 2024-04-16T15:53:00.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.160+0000 7f569824e640 1 -- 172.21.15.132:0/446240394 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f56900cad50 con 0x7f56901627e0 2024-04-16T15:53:00.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.161+0000 7f56867fc640 1 -- 172.21.15.132:0/446240394 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16855 (secure 0 0 0) 0x7f568805d230 con 0x7f56901627e0 2024-04-16T15:53:00.161 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:53:00.161 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":22,"fsid":"6bdec5d9-f406-43ad-8584-0503b32f6f0d","created":"2024-04-16T15:51:51.073040+0000","modified":"2024-04-16T15:52:57.156755+0000","last_up_change":"2024-04-16T15:52:02.280496+0000","last_in_change":"2024-04-16T15:51:53.376468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:52:03.284927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:52:13.363758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T15:52:14.246647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d45908b-6e22-4619-b190-897af594b712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6801","nonce":1170594668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6803","nonce":1170594668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6807","nonce":1170594668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6805","nonce":1170594668}]},"public_addr":"172.21.15.132:6801/1170594668","cluster_addr":"172.21.15.132:6803/1170594668","heartbeat_back_addr":"172.21.15.132:6807/1170594668","heartbeat_front_addr":"172.21.15.132:6805/1170594668","state":["exists","up"]},{"osd":1,"uuid":"c88bf082-e51f-4ee6-815a-025f6ce0d67b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6809","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6811","nonce":2494780358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6815","nonce":2494780358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6823","nonce":2494780358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6819","nonce":2494780358}]},"public_addr":"172.21.15.132:6811/2494780358","cluster_addr":"172.21.15.132:6815/2494780358","heartbeat_back_addr":"172.21.15.132:6823/2494780358","heartbeat_front_addr":"172.21.15.132:6819/2494780358","state":["exists","up"]},{"osd":2,"uuid":"e5dbd6b4-4e7b-47e4-ad4e-35b4b81696c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6825","nonce":27655483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6827","nonce":27655483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6831","nonce":27655483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6829","nonce":27655483}]},"public_addr":"172.21.15.132:6825/27655483","cluster_addr":"172.21.15.132:6827/27655483","heartbeat_back_addr":"172.21.15.132:6831/27655483","heartbeat_front_addr":"172.21.15.132:6829/27655483","state":["exists","up"]},{"osd":3,"uuid":"9d75cd67-3b8a-4424-8884-5f3660e1f5f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6810","nonce":3100919191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6814","nonce":3100919191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6821","nonce":3100919191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6818","nonce":3100919191}]},"public_addr":"172.21.15.132:6810/3100919191","cluster_addr":"172.21.15.132:6814/3100919191","heartbeat_back_addr":"172.21.15.132:6821/3100919191","heartbeat_front_addr":"172.21.15.132:6818/3100919191","state":["exists","up"]},{"osd":4,"uuid":"83aea46a-8642-4777-912b-c130e5890da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6825","nonce":123637799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6827","nonce":123637799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6831","nonce":123637799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6829","nonce":123637799}]},"public_addr":"172.21.15.179:6825/123637799","cluster_addr":"172.21.15.179:6827/123637799","heartbeat_back_addr":"172.21.15.179:6831/123637799","heartbeat_front_addr":"172.21.15.179:6829/123637799","state":["exists","up"]},{"osd":5,"uuid":"534117c8-3317-48d6-b436-afd5709f71e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6801","nonce":2224750370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6803","nonce":2224750370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6807","nonce":2224750370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6805","nonce":2224750370}]},"public_addr":"172.21.15.179:6801/2224750370","cluster_addr":"172.21.15.179:6803/2224750370","heartbeat_back_addr":"172.21.15.179:6807/2224750370","heartbeat_front_addr":"172.21.15.179:6805/2224750370","state":["exists","up"]},{"osd":6,"uuid":"0ba363e7-fa9d-42b1-ae09-a6a0f57d41f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6809","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6811","nonce":101498164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6813","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6815","nonce":101498164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6823","nonce":101498164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6819","nonce":101498164}]},"public_addr":"172.21.15.179:6811/101498164","cluster_addr":"172.21.15.179:6815/101498164","heartbeat_back_addr":"172.21.15.179:6823/101498164","heartbeat_front_addr":"172.21.15.179:6819/101498164","state":["exists","up"]},{"osd":7,"uuid":"e6830c77-2f2d-4067-9866-ee7625afc1a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6810","nonce":872148365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6814","nonce":872148365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6822","nonce":872148365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6818","nonce":872148365}]},"public_addr":"172.21.15.179:6810/872148365","cluster_addr":"172.21.15.179:6814/872148365","heartbeat_back_addr":"172.21.15.179:6822/872148365","heartbeat_front_addr":"172.21.15.179:6818/872148365","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.535221+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.563769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.520765+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.526264+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.517058+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.500842+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.534332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.512486+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":1}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:53:00.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.163+0000 7f569824e640 1 -- 172.21.15.132:0/446240394 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f567406c8f0 msgr2=0x7f567406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:00.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.163+0000 7f569824e640 1 --2- 172.21.15.132:0/446240394 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f567406c8f0 0x7f567406edb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f568c035000 tx=0x7f568c030000 comp rx=0 tx=0).stop 2024-04-16T15:53:00.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.163+0000 7f569824e640 1 -- 172.21.15.132:0/446240394 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56901627e0 msgr2=0x7f569015b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:00.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.163+0000 7f569824e640 1 --2- 172.21.15.132:0/446240394 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56901627e0 0x7f569015b3c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f568800c3c0 tx=0x7f568800c880 comp rx=0 tx=0).stop 2024-04-16T15:53:00.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.163+0000 7f569824e640 1 -- 172.21.15.132:0/446240394 shutdown_connections 2024-04-16T15:53:00.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.163+0000 7f569824e640 1 --2- 172.21.15.132:0/446240394 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f567406c8f0 0x7f567406edb0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:00.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.163+0000 7f569824e640 1 --2- 172.21.15.132:0/446240394 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56901627e0 0x7f569015b3c0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:00.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.163+0000 7f569824e640 1 --2- 172.21.15.132:0/446240394 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f569015eed0 0x7f56900c9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:00.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.163+0000 7f569824e640 1 --2- 172.21.15.132:0/446240394 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f569015eaf0 0x7f56900ce590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:00.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.163+0000 7f569824e640 1 -- 172.21.15.132:0/446240394 >> 172.21.15.132:0/446240394 conn(0x7f56900d13f0 msgr2=0x7f56900b99e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:00.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.163+0000 7f569824e640 1 -- 172.21.15.132:0/446240394 shutdown_connections 2024-04-16T15:53:00.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.163+0000 7f569824e640 1 -- 172.21.15.132:0/446240394 wait complete. 2024-04-16T15:53:00.175 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-16T15:53:00.175 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T15:53:00.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.279+0000 7f4b25f8f640 1 Processor -- start 2024-04-16T15:53:00.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.279+0000 7f4b25f8f640 1 -- start start 2024-04-16T15:53:00.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.280+0000 7f4b25f8f640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4b2015e9d0 0x7f4b20070cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:00.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.280+0000 7f4b25f8f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b2006ba20 0x7f4b2006beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:00.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.280+0000 7f4b25f8f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b200aeb20 con 0x7f4b200b0460 2024-04-16T15:53:00.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.280+0000 7f4b25f8f640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f4b200b08c0 con 0x7f4b2015e9d0 2024-04-16T15:53:00.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.280+0000 7f4b25f8f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f4b200b4840 con 0x7f4b2006ba20 2024-04-16T15:53:00.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.280+0000 7f4b1effd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f4b200b0460 0x7f4b200ae410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:46972/0 (socket says 172.21.15.132:46972) 2024-04-16T15:53:00.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.280+0000 7f4b1effd640 1 -- 172.21.15.132:0/358066562 learned_addr learned my addr 172.21.15.132:0/358066562 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:53:00.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.280+0000 7f4b1f7fe640 1 --2- 172.21.15.132:0/358066562 >> v2:172.21.15.179:3300/0 conn(0x7f4b2015e9d0 0x7f4b20070cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:00.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.280+0000 7f4b1ffff640 1 --2- 172.21.15.132:0/358066562 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b2006ba20 0x7f4b2006beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:00.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.280+0000 7f4b1e7fc640 1 -- 172.21.15.132:0/358066562 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3176041698 0 0) 0x7f4b200aeb20 con 0x7f4b200b0460 2024-04-16T15:53:00.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.280+0000 7f4b1e7fc640 1 -- 172.21.15.132:0/358066562 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b08003520 con 0x7f4b200b0460 2024-04-16T15:53:00.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.281+0000 7f4b1e7fc640 1 -- 172.21.15.132:0/358066562 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2809209889 0 0) 0x7f4b08003520 con 0x7f4b200b0460 2024-04-16T15:53:00.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.281+0000 7f4b1f7fe640 1 -- 172.21.15.132:0/358066562 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b2006ba20 msgr2=0x7f4b2006beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:00.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.281+0000 7f4b1f7fe640 1 --2- 172.21.15.132:0/358066562 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b2006ba20 0x7f4b2006beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:00.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.281+0000 7f4b1f7fe640 1 -- 172.21.15.132:0/358066562 >> v1:172.21.15.132:6789/0 conn(0x7f4b200b0460 legacy=0x7f4b200ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:00.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.281+0000 7f4b1f7fe640 1 -- 172.21.15.132:0/358066562 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b200b66e0 con 0x7f4b2015e9d0 2024-04-16T15:53:00.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.281+0000 7f4b1f7fe640 1 --2- 172.21.15.132:0/358066562 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b2015e9d0 0x7f4b20070cf0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4b10009d90 tx=0x7f4b1002bce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60bd8412f15f5052 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:00.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.282+0000 7f4b1e7fc640 1 -- 172.21.15.132:0/358066562 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b10039070 con 0x7f4b2015e9d0 2024-04-16T15:53:00.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.282+0000 7f4b1e7fc640 1 -- 172.21.15.132:0/358066562 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b1002c810 con 0x7f4b2015e9d0 2024-04-16T15:53:00.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.282+0000 7f4b1e7fc640 1 -- 172.21.15.132:0/358066562 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b14001670 con 0x7f4b2015e9d0 2024-04-16T15:53:00.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.282+0000 7f4b25f8f640 1 -- 172.21.15.132:0/358066562 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b2015e9d0 msgr2=0x7f4b20070cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:00.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.282+0000 7f4b25f8f640 1 --2- 172.21.15.132:0/358066562 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b2015e9d0 0x7f4b20070cf0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4b10009d90 tx=0x7f4b1002bce0 comp rx=0 tx=0).stop 2024-04-16T15:53:00.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.282+0000 7f4b25f8f640 1 -- 172.21.15.132:0/358066562 shutdown_connections 2024-04-16T15:53:00.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.282+0000 7f4b25f8f640 1 --2- 172.21.15.132:0/358066562 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b2006ba20 0x7f4b2006beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:00.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.282+0000 7f4b25f8f640 1 --2- 172.21.15.132:0/358066562 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b2015e9d0 0x7f4b20070cf0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:00.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.282+0000 7f4b25f8f640 1 -- 172.21.15.132:0/358066562 >> 172.21.15.132:0/358066562 conn(0x7f4b2009aa30 msgr2=0x7f4b200b6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:00.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.282+0000 7f4b25f8f640 1 -- 172.21.15.132:0/358066562 shutdown_connections 2024-04-16T15:53:00.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.282+0000 7f4b25f8f640 1 -- 172.21.15.132:0/358066562 wait complete. 2024-04-16T15:53:00.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.283+0000 7f4b25f8f640 1 Processor -- start 2024-04-16T15:53:00.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.284+0000 7f4b25f8f640 1 -- start start 2024-04-16T15:53:00.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.284+0000 7f4b25f8f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b2006ba20 0x7f4b20159160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:00.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.284+0000 7f4b25f8f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b200b0460 0x7f4b2009e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:00.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.284+0000 7f4b25f8f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b2015e9d0 0x7f4b2009eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:00.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.284+0000 7f4b25f8f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f4b2015edb0 con 0x7f4b200b0460 2024-04-16T15:53:00.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.284+0000 7f4b25f8f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4b200b44d0 con 0x7f4b2015e9d0 2024-04-16T15:53:00.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.284+0000 7f4b25f8f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f4b200b6020 con 0x7f4b2006ba20 2024-04-16T15:53:00.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.284+0000 7f4b1effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b200b0460 0x7f4b2009e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:00.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.284+0000 7f4b1effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b200b0460 0x7f4b2009e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60694/0 (socket says 172.21.15.132:60694) 2024-04-16T15:53:00.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.284+0000 7f4b1effd640 1 -- 172.21.15.132:0/2414649201 learned_addr learned my addr 172.21.15.132:0/2414649201 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:00.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.285+0000 7f4b1effd640 1 -- 172.21.15.132:0/2414649201 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b2006ba20 msgr2=0x7f4b20159160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:00.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.285+0000 7f4b1ffff640 1 --2- 172.21.15.132:0/2414649201 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b2015e9d0 0x7f4b2009eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:00.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.285+0000 7f4b1f7fe640 1 --2- 172.21.15.132:0/2414649201 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b2006ba20 0x7f4b20159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:00.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.285+0000 7f4b1effd640 1 --2- 172.21.15.132:0/2414649201 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b2006ba20 0x7f4b20159160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:00.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.285+0000 7f4b1effd640 1 -- 172.21.15.132:0/2414649201 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b2015e9d0 msgr2=0x7f4b2009eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:00.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.285+0000 7f4b1effd640 1 --2- 172.21.15.132:0/2414649201 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b2015e9d0 0x7f4b2009eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:00.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.285+0000 7f4b1effd640 1 -- 172.21.15.132:0/2414649201 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b2015ccd0 con 0x7f4b200b0460 2024-04-16T15:53:00.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.285+0000 7f4b1ffff640 1 --2- 172.21.15.132:0/2414649201 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b2015e9d0 0x7f4b2009eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:53:00.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.285+0000 7f4b1f7fe640 1 --2- 172.21.15.132:0/2414649201 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b2006ba20 0x7f4b20159160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:53:00.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.285+0000 7f4b1effd640 1 --2- 172.21.15.132:0/2414649201 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b200b0460 0x7f4b2009e660 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4b1400c780 tx=0x7f4b1400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:00.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.285+0000 7f4b07fff640 1 -- 172.21.15.132:0/2414649201 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b14005ad0 con 0x7f4b200b0460 2024-04-16T15:53:00.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.285+0000 7f4b07fff640 1 -- 172.21.15.132:0/2414649201 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b14005c90 con 0x7f4b200b0460 2024-04-16T15:53:00.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.285+0000 7f4b25f8f640 1 -- 172.21.15.132:0/2414649201 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b2015cfb0 con 0x7f4b200b0460 2024-04-16T15:53:00.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.285+0000 7f4b07fff640 1 -- 172.21.15.132:0/2414649201 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b140072b0 con 0x7f4b200b0460 2024-04-16T15:53:00.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.285+0000 7f4b25f8f640 1 -- 172.21.15.132:0/2414649201 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b2015d570 con 0x7f4b200b0460 2024-04-16T15:53:00.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.286+0000 7f4b25f8f640 1 -- 172.21.15.132:0/2414649201 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b20075510 con 0x7f4b200b0460 2024-04-16T15:53:00.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.286+0000 7f4b07fff640 1 -- 172.21.15.132:0/2414649201 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4b14007450 con 0x7f4b200b0460 2024-04-16T15:53:00.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.287+0000 7f4b07fff640 1 --2- 172.21.15.132:0/2414649201 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f4b0c06c8f0 0x7f4b0c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:00.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.287+0000 7f4b07fff640 1 -- 172.21.15.132:0/2414649201 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f4b1408bae0 con 0x7f4b200b0460 2024-04-16T15:53:00.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.287+0000 7f4b1f7fe640 1 --2- 172.21.15.132:0/2414649201 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f4b0c06c8f0 0x7f4b0c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:00.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.287+0000 7f4b1f7fe640 1 --2- 172.21.15.132:0/2414649201 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f4b0c06c8f0 0x7f4b0c06edb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4b10036000 tx=0x7f4b10030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:00.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.291+0000 7f4b07fff640 1 -- 172.21.15.132:0/2414649201 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4b14010300 con 0x7f4b200b0460 2024-04-16T15:53:00.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.502+0000 7f4b25f8f640 1 -- 172.21.15.132:0/2414649201 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4b200b0f70 con 0x7f4b200b0460 2024-04-16T15:53:00.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.502+0000 7f4b07fff640 1 -- 172.21.15.132:0/2414649201 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5175 (secure 0 0 0) 0x7f4b14059e90 con 0x7f4b200b0460 2024-04-16T15:53:00.502 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:53:00.502 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/659108212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":659108212},{"type":"v1","addr":"172.21.15.132:6835","nonce":659108212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/811468074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":811468074},{"type":"v1","addr":"172.21.15.132:6837","nonce":811468074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/493922944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":493922944},{"type":"v1","addr":"172.21.15.179:6834","nonce":493922944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T15:52:15.286161+0000","modified":"2024-04-16T15:52:17.305756+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/202618568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":202618568},{"type":"v1","addr":"172.21.15.179:6835","nonce":202618568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1}]} 2024-04-16T15:53:00.502 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 6 2024-04-16T15:53:00.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.504+0000 7f4b25f8f640 1 -- 172.21.15.132:0/2414649201 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f4b0c06c8f0 msgr2=0x7f4b0c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:00.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.504+0000 7f4b25f8f640 1 --2- 172.21.15.132:0/2414649201 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f4b0c06c8f0 0x7f4b0c06edb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4b10036000 tx=0x7f4b10030000 comp rx=0 tx=0).stop 2024-04-16T15:53:00.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.504+0000 7f4b25f8f640 1 -- 172.21.15.132:0/2414649201 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b200b0460 msgr2=0x7f4b2009e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:00.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.504+0000 7f4b25f8f640 1 --2- 172.21.15.132:0/2414649201 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b200b0460 0x7f4b2009e660 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4b1400c780 tx=0x7f4b1400cc40 comp rx=0 tx=0).stop 2024-04-16T15:53:00.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.504+0000 7f4b25f8f640 1 -- 172.21.15.132:0/2414649201 shutdown_connections 2024-04-16T15:53:00.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.504+0000 7f4b25f8f640 1 --2- 172.21.15.132:0/2414649201 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f4b0c06c8f0 0x7f4b0c06edb0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:00.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.504+0000 7f4b25f8f640 1 --2- 172.21.15.132:0/2414649201 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b2015e9d0 0x7f4b2009eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:00.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.504+0000 7f4b25f8f640 1 --2- 172.21.15.132:0/2414649201 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b200b0460 0x7f4b2009e660 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:00.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.504+0000 7f4b25f8f640 1 --2- 172.21.15.132:0/2414649201 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b2006ba20 0x7f4b20159160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:00.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.504+0000 7f4b25f8f640 1 -- 172.21.15.132:0/2414649201 >> 172.21.15.132:0/2414649201 conn(0x7f4b2009aa30 msgr2=0x7f4b2006be90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:00.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.504+0000 7f4b25f8f640 1 -- 172.21.15.132:0/2414649201 shutdown_connections 2024-04-16T15:53:00.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.504+0000 7f4b25f8f640 1 -- 172.21.15.132:0/2414649201 wait complete. 2024-04-16T15:53:00.515 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T15:53:00.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.619+0000 7f299ce2a640 1 Processor -- start 2024-04-16T15:53:00.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.619+0000 7f299ce2a640 1 -- start start 2024-04-16T15:53:00.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.620+0000 7f299ce2a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f29980b5cc0 0x7f29980b6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:00.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.620+0000 7f299ce2a640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29980cec90 con 0x7f2998151e90 2024-04-16T15:53:00.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.620+0000 7f299ce2a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29980cef10 con 0x7f299806dc90 2024-04-16T15:53:00.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.620+0000 7f299ce2a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f29980d00e0 con 0x7f29980b5cc0 2024-04-16T15:53:00.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.620+0000 7f2995d9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f29980b5cc0 0x7f29980b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:00.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.620+0000 7f299659c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f2998151e90 0x7f29980cf9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:46982/0 (socket says 172.21.15.132:46982) 2024-04-16T15:53:00.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.620+0000 7f299659c640 1 -- 172.21.15.132:0/2924783354 learned_addr learned my addr 172.21.15.132:0/2924783354 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:53:00.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.620+0000 7f2995d9b640 1 -- 172.21.15.132:0/2924783354 >> v1:172.21.15.179:6789/0 conn(0x7f299806dc90 legacy=0x7f299806e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:00.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.620+0000 7f2995d9b640 1 -- 172.21.15.132:0/2924783354 >> v1:172.21.15.132:6789/0 conn(0x7f2998151e90 legacy=0x7f29980cf9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:00.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.620+0000 7f2995d9b640 1 -- 172.21.15.132:0/2924783354 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2998152270 con 0x7f29980b5cc0 2024-04-16T15:53:00.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.620+0000 7f299559a640 1 -- 172.21.15.132:0/2924783354 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2275209340 0 0) 0x7f2990001110 con 0x7f2998151e90 2024-04-16T15:53:00.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.621+0000 7f2995d9b640 1 --2- 172.21.15.132:0/2924783354 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29980b5cc0 0x7f29980b6150 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f29800097a0 tx=0x7f298002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fc8583cb512633 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:00.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.621+0000 7f299559a640 1 -- 172.21.15.132:0/2924783354 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2980035020 con 0x7f29980b5cc0 2024-04-16T15:53:00.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.621+0000 7f299559a640 1 -- 172.21.15.132:0/2924783354 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2980031830 con 0x7f29980b5cc0 2024-04-16T15:53:00.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.621+0000 7f299559a640 1 -- 172.21.15.132:0/2924783354 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2980031c00 con 0x7f29980b5cc0 2024-04-16T15:53:00.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.622+0000 7f299ce2a640 1 -- 172.21.15.132:0/2924783354 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29980b5cc0 msgr2=0x7f29980b6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:00.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.622+0000 7f299ce2a640 1 --2- 172.21.15.132:0/2924783354 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29980b5cc0 0x7f29980b6150 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f29800097a0 tx=0x7f298002b8d0 comp rx=0 tx=0).stop 2024-04-16T15:53:00.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.622+0000 7f299ce2a640 1 -- 172.21.15.132:0/2924783354 shutdown_connections 2024-04-16T15:53:00.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.622+0000 7f299ce2a640 1 --2- 172.21.15.132:0/2924783354 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29980b5cc0 0x7f29980b6150 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:00.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.622+0000 7f299ce2a640 1 -- 172.21.15.132:0/2924783354 >> 172.21.15.132:0/2924783354 conn(0x7f29980b2d50 msgr2=0x7f299806ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:00.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.622+0000 7f299ce2a640 1 -- 172.21.15.132:0/2924783354 shutdown_connections 2024-04-16T15:53:00.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.622+0000 7f299ce2a640 1 -- 172.21.15.132:0/2924783354 wait complete. 2024-04-16T15:53:00.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.623+0000 7f299ce2a640 1 Processor -- start 2024-04-16T15:53:00.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.623+0000 7f299ce2a640 1 -- start start 2024-04-16T15:53:00.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.624+0000 7f299ce2a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f299806dc90 0x7f299813e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:00.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.624+0000 7f299ce2a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29980b5cc0 0x7f29981f4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:00.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.624+0000 7f299ce2a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2998151e90 0x7f29981f5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:00.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.624+0000 7f299ce2a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f29980cf1d0 con 0x7f299806dc90 2024-04-16T15:53:00.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.624+0000 7f299ce2a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f29980cf540 con 0x7f2998151e90 2024-04-16T15:53:00.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.624+0000 7f299ce2a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f299815b390 con 0x7f29980b5cc0 2024-04-16T15:53:00.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.624+0000 7f299659c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f299806dc90 0x7f299813e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:00.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.624+0000 7f299659c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f299806dc90 0x7f299813e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60716/0 (socket says 172.21.15.132:60716) 2024-04-16T15:53:00.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.624+0000 7f299659c640 1 -- 172.21.15.132:0/2658974270 learned_addr learned my addr 172.21.15.132:0/2658974270 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:00.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.624+0000 7f2995d9b640 1 --2- 172.21.15.132:0/2658974270 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29980b5cc0 0x7f29981f4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:00.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.624+0000 7f2996d9d640 1 --2- 172.21.15.132:0/2658974270 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2998151e90 0x7f29981f5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:00.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.624+0000 7f299659c640 1 -- 172.21.15.132:0/2658974270 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29980b5cc0 msgr2=0x7f29981f4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:00.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.624+0000 7f299659c640 1 --2- 172.21.15.132:0/2658974270 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29980b5cc0 0x7f29981f4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:00.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.625+0000 7f299659c640 1 -- 172.21.15.132:0/2658974270 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2998151e90 msgr2=0x7f29981f5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:00.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.625+0000 7f299659c640 1 --2- 172.21.15.132:0/2658974270 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2998151e90 0x7f29981f5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:00.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.625+0000 7f299659c640 1 -- 172.21.15.132:0/2658974270 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f299813f210 con 0x7f299806dc90 2024-04-16T15:53:00.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.625+0000 7f299659c640 1 --2- 172.21.15.132:0/2658974270 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f299806dc90 0x7f299813e570 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f299000e730 tx=0x7f299000ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:00.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.625+0000 7f298effd640 1 -- 172.21.15.132:0/2658974270 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f299000ee40 con 0x7f299806dc90 2024-04-16T15:53:00.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.625+0000 7f298effd640 1 -- 172.21.15.132:0/2658974270 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2990016020 con 0x7f299806dc90 2024-04-16T15:53:00.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.625+0000 7f299ce2a640 1 -- 172.21.15.132:0/2658974270 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2998156a20 con 0x7f299806dc90 2024-04-16T15:53:00.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.625+0000 7f298effd640 1 -- 172.21.15.132:0/2658974270 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2990007520 con 0x7f299806dc90 2024-04-16T15:53:00.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.625+0000 7f299ce2a640 1 -- 172.21.15.132:0/2658974270 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2998156fe0 con 0x7f299806dc90 2024-04-16T15:53:00.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.626+0000 7f299ce2a640 1 -- 172.21.15.132:0/2658974270 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2998075510 con 0x7f299806dc90 2024-04-16T15:53:00.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.626+0000 7f298effd640 1 -- 172.21.15.132:0/2658974270 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f29900016d0 con 0x7f299806dc90 2024-04-16T15:53:00.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.627+0000 7f298effd640 1 --2- 172.21.15.132:0/2658974270 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f297806c8f0 0x7f297806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:00.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.627+0000 7f298effd640 1 -- 172.21.15.132:0/2658974270 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f299008dc00 con 0x7f299806dc90 2024-04-16T15:53:00.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.627+0000 7f2995d9b640 1 --2- 172.21.15.132:0/2658974270 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f297806c8f0 0x7f297806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:00.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.627+0000 7f2995d9b640 1 --2- 172.21.15.132:0/2658974270 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f297806c8f0 0x7f297806edb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2980036000 tx=0x7f298003e040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:00.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.631+0000 7f298effd640 1 -- 172.21.15.132:0/2658974270 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2990094080 con 0x7f299806dc90 2024-04-16T15:53:00.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.842+0000 7f299ce2a640 1 -- 172.21.15.132:0/2658974270 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f29980cfcb0 con 0x7f299806dc90 2024-04-16T15:53:00.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.843+0000 7f298effd640 1 -- 172.21.15.132:0/2658974270 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5175 (secure 0 0 0) 0x7f2990020030 con 0x7f299806dc90 2024-04-16T15:53:00.842 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:53:00.842 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/659108212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":659108212},{"type":"v1","addr":"172.21.15.132:6835","nonce":659108212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/811468074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":811468074},{"type":"v1","addr":"172.21.15.132:6837","nonce":811468074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/493922944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":493922944},{"type":"v1","addr":"172.21.15.179:6834","nonce":493922944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T15:52:15.286161+0000","modified":"2024-04-16T15:52:17.305756+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/202618568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":202618568},{"type":"v1","addr":"172.21.15.179:6835","nonce":202618568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1}]} 2024-04-16T15:53:00.842 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 6 2024-04-16T15:53:00.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.844+0000 7f299ce2a640 1 -- 172.21.15.132:0/2658974270 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f297806c8f0 msgr2=0x7f297806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:00.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.844+0000 7f299ce2a640 1 --2- 172.21.15.132:0/2658974270 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f297806c8f0 0x7f297806edb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2980036000 tx=0x7f298003e040 comp rx=0 tx=0).stop 2024-04-16T15:53:00.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.844+0000 7f299ce2a640 1 -- 172.21.15.132:0/2658974270 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f299806dc90 msgr2=0x7f299813e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:00.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.844+0000 7f299ce2a640 1 --2- 172.21.15.132:0/2658974270 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f299806dc90 0x7f299813e570 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f299000e730 tx=0x7f299000ebf0 comp rx=0 tx=0).stop 2024-04-16T15:53:00.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.845+0000 7f299ce2a640 1 -- 172.21.15.132:0/2658974270 shutdown_connections 2024-04-16T15:53:00.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.845+0000 7f299ce2a640 1 --2- 172.21.15.132:0/2658974270 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f297806c8f0 0x7f297806edb0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:00.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.845+0000 7f299ce2a640 1 --2- 172.21.15.132:0/2658974270 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2998151e90 0x7f29981f5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:00.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.845+0000 7f299ce2a640 1 --2- 172.21.15.132:0/2658974270 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29980b5cc0 0x7f29981f4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:00.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.845+0000 7f299ce2a640 1 --2- 172.21.15.132:0/2658974270 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f299806dc90 0x7f299813e570 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:00.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.845+0000 7f299ce2a640 1 -- 172.21.15.132:0/2658974270 >> 172.21.15.132:0/2658974270 conn(0x7f29980b2d50 msgr2=0x7f299815ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:00.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.845+0000 7f299ce2a640 1 -- 172.21.15.132:0/2658974270 shutdown_connections 2024-04-16T15:53:00.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.845+0000 7f299ce2a640 1 -- 172.21.15.132:0/2658974270 wait complete. 2024-04-16T15:53:00.855 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:53:00.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.959+0000 7f807ae95640 1 Processor -- start 2024-04-16T15:53:00.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.959+0000 7f807ae95640 1 -- start start 2024-04-16T15:53:00.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.959+0000 7f807ae95640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8074151e90 0x7f80740cf9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:00.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.959+0000 7f807ae95640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f807406e3a0 0x7f80740b6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:00.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.959+0000 7f807ae95640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80740cec90 con 0x7f80740b5cc0 2024-04-16T15:53:00.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.959+0000 7f807ae95640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f80740b6660 con 0x7f807406e3a0 2024-04-16T15:53:00.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.959+0000 7f807ae95640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f80740cf540 con 0x7f8074151e90 2024-04-16T15:53:00.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.960+0000 7f8079432640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f807406e3a0 0x7f80740b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:00.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.960+0000 7f8073fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f80740b5cc0 0x7f807406dc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:46994/0 (socket says 172.21.15.132:46994) 2024-04-16T15:53:00.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.960+0000 7f8073fff640 1 -- 172.21.15.132:0/1868802922 learned_addr learned my addr 172.21.15.132:0/1868802922 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:53:00.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.960+0000 7f8078c31640 1 --2- 172.21.15.132:0/1868802922 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8074151e90 0x7f80740cf9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:00.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.960+0000 7f8079432640 1 -- 172.21.15.132:0/1868802922 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8074151e90 msgr2=0x7f80740cf9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:00.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.960+0000 7f8079432640 1 --2- 172.21.15.132:0/1868802922 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8074151e90 0x7f80740cf9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:00.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.960+0000 7f8079432640 1 -- 172.21.15.132:0/1868802922 >> v1:172.21.15.132:6789/0 conn(0x7f80740b5cc0 legacy=0x7f807406dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:00.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.960+0000 7f8079432640 1 -- 172.21.15.132:0/1868802922 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80740cef10 con 0x7f807406e3a0 2024-04-16T15:53:00.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.960+0000 7f80737fe640 1 -- 172.21.15.132:0/1868802922 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 789295863 0 0) 0x7f8060001110 con 0x7f80740b5cc0 2024-04-16T15:53:00.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.961+0000 7f8079432640 1 --2- 172.21.15.132:0/1868802922 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f807406e3a0 0x7f80740b6120 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f806c009d90 tx=0x7f806c02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4baea07e3cc84e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:00.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.961+0000 7f80737fe640 1 -- 172.21.15.132:0/1868802922 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f806c039070 con 0x7f807406e3a0 2024-04-16T15:53:00.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.961+0000 7f80737fe640 1 -- 172.21.15.132:0/1868802922 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f806c02cc50 con 0x7f807406e3a0 2024-04-16T15:53:00.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.961+0000 7f80737fe640 1 -- 172.21.15.132:0/1868802922 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f806c034440 con 0x7f807406e3a0 2024-04-16T15:53:00.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.961+0000 7f807ae95640 1 -- 172.21.15.132:0/1868802922 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f807406e3a0 msgr2=0x7f80740b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:00.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.961+0000 7f807ae95640 1 --2- 172.21.15.132:0/1868802922 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f807406e3a0 0x7f80740b6120 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f806c009d90 tx=0x7f806c02bea0 comp rx=0 tx=0).stop 2024-04-16T15:53:00.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.961+0000 7f807ae95640 1 -- 172.21.15.132:0/1868802922 shutdown_connections 2024-04-16T15:53:00.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.961+0000 7f807ae95640 1 --2- 172.21.15.132:0/1868802922 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f807406e3a0 0x7f80740b6120 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:00.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.961+0000 7f807ae95640 1 --2- 172.21.15.132:0/1868802922 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8074151e90 0x7f80740cf9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:00.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.961+0000 7f807ae95640 1 -- 172.21.15.132:0/1868802922 >> 172.21.15.132:0/1868802922 conn(0x7f80740b2d50 msgr2=0x7f807406ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:00.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.961+0000 7f807ae95640 1 -- 172.21.15.132:0/1868802922 shutdown_connections 2024-04-16T15:53:00.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.961+0000 7f807ae95640 1 -- 172.21.15.132:0/1868802922 wait complete. 2024-04-16T15:53:00.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.963+0000 7f807ae95640 1 Processor -- start 2024-04-16T15:53:00.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.963+0000 7f807ae95640 1 -- start start 2024-04-16T15:53:00.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.963+0000 7f807ae95640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f807406e3a0 0x7f80740add40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:00.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.963+0000 7f807ae95640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80740b5cc0 0x7f8074141a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:00.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.963+0000 7f807ae95640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8074151e90 0x7f807415a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:00.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.963+0000 7f807ae95640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f80740cf1d0 con 0x7f8074151e90 2024-04-16T15:53:00.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.963+0000 7f807ae95640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f807415c130 con 0x7f80740b5cc0 2024-04-16T15:53:00.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.963+0000 7f807ae95640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f80740cff10 con 0x7f807406e3a0 2024-04-16T15:53:00.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.964+0000 7f8079432640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8074151e90 0x7f807415a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:00.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.964+0000 7f8079432640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8074151e90 0x7f807415a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60734/0 (socket says 172.21.15.132:60734) 2024-04-16T15:53:00.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.964+0000 7f8079432640 1 -- 172.21.15.132:0/3570727836 learned_addr learned my addr 172.21.15.132:0/3570727836 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:00.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.964+0000 7f8073fff640 1 --2- 172.21.15.132:0/3570727836 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80740b5cc0 0x7f8074141a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:00.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.964+0000 7f8078c31640 1 --2- 172.21.15.132:0/3570727836 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f807406e3a0 0x7f80740add40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:00.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.964+0000 7f8079432640 1 -- 172.21.15.132:0/3570727836 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f807406e3a0 msgr2=0x7f80740add40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:00.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.964+0000 7f8079432640 1 --2- 172.21.15.132:0/3570727836 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f807406e3a0 0x7f80740add40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:00.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.964+0000 7f8079432640 1 -- 172.21.15.132:0/3570727836 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80740b5cc0 msgr2=0x7f8074141a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:00.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.964+0000 7f8079432640 1 --2- 172.21.15.132:0/3570727836 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80740b5cc0 0x7f8074141a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:00.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.964+0000 7f8079432640 1 -- 172.21.15.132:0/3570727836 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f807415ace0 con 0x7f8074151e90 2024-04-16T15:53:00.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.964+0000 7f8079432640 1 --2- 172.21.15.132:0/3570727836 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8074151e90 0x7f807415a4b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f806c009d90 tx=0x7f806c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:00.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.964+0000 7f80717fa640 1 -- 172.21.15.132:0/3570727836 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f806c039050 con 0x7f8074151e90 2024-04-16T15:53:00.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.964+0000 7f80717fa640 1 -- 172.21.15.132:0/3570727836 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f806c045070 con 0x7f8074151e90 2024-04-16T15:53:00.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.964+0000 7f807ae95640 1 -- 172.21.15.132:0/3570727836 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80741444f0 con 0x7f8074151e90 2024-04-16T15:53:00.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.964+0000 7f80717fa640 1 -- 172.21.15.132:0/3570727836 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f806c009450 con 0x7f8074151e90 2024-04-16T15:53:00.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.964+0000 7f807ae95640 1 -- 172.21.15.132:0/3570727836 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f807415a9f0 con 0x7f8074151e90 2024-04-16T15:53:00.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.965+0000 7f807ae95640 1 -- 172.21.15.132:0/3570727836 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8074075510 con 0x7f8074151e90 2024-04-16T15:53:00.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.966+0000 7f80717fa640 1 -- 172.21.15.132:0/3570727836 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f806c03e610 con 0x7f8074151e90 2024-04-16T15:53:00.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.966+0000 7f80717fa640 1 --2- 172.21.15.132:0/3570727836 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f805806c8f0 0x7f805806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:00.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.966+0000 7f80717fa640 1 -- 172.21.15.132:0/3570727836 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f806c0ae640 con 0x7f8074151e90 2024-04-16T15:53:00.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.966+0000 7f8078c31640 1 --2- 172.21.15.132:0/3570727836 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f805806c8f0 0x7f805806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:00.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.967+0000 7f8078c31640 1 --2- 172.21.15.132:0/3570727836 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f805806c8f0 0x7f805806edb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8068009ad0 tx=0x7f8068008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:00.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:00.971+0000 7f80717fa640 1 -- 172.21.15.132:0/3570727836 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f806c07c9f0 con 0x7f8074151e90 2024-04-16T15:53:01.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.146+0000 7f807ae95640 1 -- 172.21.15.132:0/3570727836 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f80740b3d50 con 0x7f8074151e90 2024-04-16T15:53:01.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.147+0000 7f80717fa640 1 -- 172.21.15.132:0/3570727836 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16855 (secure 0 0 0) 0x7f806c07c2f0 con 0x7f8074151e90 2024-04-16T15:53:01.146 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:53:01.146 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":22,"fsid":"6bdec5d9-f406-43ad-8584-0503b32f6f0d","created":"2024-04-16T15:51:51.073040+0000","modified":"2024-04-16T15:52:57.156755+0000","last_up_change":"2024-04-16T15:52:02.280496+0000","last_in_change":"2024-04-16T15:51:53.376468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:52:03.284927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:52:13.363758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T15:52:14.246647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d45908b-6e22-4619-b190-897af594b712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6801","nonce":1170594668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6803","nonce":1170594668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6807","nonce":1170594668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6805","nonce":1170594668}]},"public_addr":"172.21.15.132:6801/1170594668","cluster_addr":"172.21.15.132:6803/1170594668","heartbeat_back_addr":"172.21.15.132:6807/1170594668","heartbeat_front_addr":"172.21.15.132:6805/1170594668","state":["exists","up"]},{"osd":1,"uuid":"c88bf082-e51f-4ee6-815a-025f6ce0d67b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6809","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6811","nonce":2494780358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6815","nonce":2494780358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6823","nonce":2494780358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6819","nonce":2494780358}]},"public_addr":"172.21.15.132:6811/2494780358","cluster_addr":"172.21.15.132:6815/2494780358","heartbeat_back_addr":"172.21.15.132:6823/2494780358","heartbeat_front_addr":"172.21.15.132:6819/2494780358","state":["exists","up"]},{"osd":2,"uuid":"e5dbd6b4-4e7b-47e4-ad4e-35b4b81696c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6825","nonce":27655483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6827","nonce":27655483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6831","nonce":27655483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6829","nonce":27655483}]},"public_addr":"172.21.15.132:6825/27655483","cluster_addr":"172.21.15.132:6827/27655483","heartbeat_back_addr":"172.21.15.132:6831/27655483","heartbeat_front_addr":"172.21.15.132:6829/27655483","state":["exists","up"]},{"osd":3,"uuid":"9d75cd67-3b8a-4424-8884-5f3660e1f5f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6810","nonce":3100919191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6814","nonce":3100919191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6821","nonce":3100919191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6818","nonce":3100919191}]},"public_addr":"172.21.15.132:6810/3100919191","cluster_addr":"172.21.15.132:6814/3100919191","heartbeat_back_addr":"172.21.15.132:6821/3100919191","heartbeat_front_addr":"172.21.15.132:6818/3100919191","state":["exists","up"]},{"osd":4,"uuid":"83aea46a-8642-4777-912b-c130e5890da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6825","nonce":123637799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6827","nonce":123637799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6831","nonce":123637799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6829","nonce":123637799}]},"public_addr":"172.21.15.179:6825/123637799","cluster_addr":"172.21.15.179:6827/123637799","heartbeat_back_addr":"172.21.15.179:6831/123637799","heartbeat_front_addr":"172.21.15.179:6829/123637799","state":["exists","up"]},{"osd":5,"uuid":"534117c8-3317-48d6-b436-afd5709f71e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6801","nonce":2224750370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6803","nonce":2224750370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6807","nonce":2224750370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6805","nonce":2224750370}]},"public_addr":"172.21.15.179:6801/2224750370","cluster_addr":"172.21.15.179:6803/2224750370","heartbeat_back_addr":"172.21.15.179:6807/2224750370","heartbeat_front_addr":"172.21.15.179:6805/2224750370","state":["exists","up"]},{"osd":6,"uuid":"0ba363e7-fa9d-42b1-ae09-a6a0f57d41f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6809","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6811","nonce":101498164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6813","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6815","nonce":101498164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6823","nonce":101498164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6819","nonce":101498164}]},"public_addr":"172.21.15.179:6811/101498164","cluster_addr":"172.21.15.179:6815/101498164","heartbeat_back_addr":"172.21.15.179:6823/101498164","heartbeat_front_addr":"172.21.15.179:6819/101498164","state":["exists","up"]},{"osd":7,"uuid":"e6830c77-2f2d-4067-9866-ee7625afc1a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6810","nonce":872148365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6814","nonce":872148365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6822","nonce":872148365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6818","nonce":872148365}]},"public_addr":"172.21.15.179:6810/872148365","cluster_addr":"172.21.15.179:6814/872148365","heartbeat_back_addr":"172.21.15.179:6822/872148365","heartbeat_front_addr":"172.21.15.179:6818/872148365","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.535221+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.563769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.520765+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.526264+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.517058+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.500842+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.534332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.512486+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":1}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:53:01.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.149+0000 7f807ae95640 1 -- 172.21.15.132:0/3570727836 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f805806c8f0 msgr2=0x7f805806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:01.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.149+0000 7f807ae95640 1 --2- 172.21.15.132:0/3570727836 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f805806c8f0 0x7f805806edb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8068009ad0 tx=0x7f8068008040 comp rx=0 tx=0).stop 2024-04-16T15:53:01.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.149+0000 7f807ae95640 1 -- 172.21.15.132:0/3570727836 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8074151e90 msgr2=0x7f807415a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:01.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.149+0000 7f807ae95640 1 --2- 172.21.15.132:0/3570727836 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8074151e90 0x7f807415a4b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f806c009d90 tx=0x7f806c004a40 comp rx=0 tx=0).stop 2024-04-16T15:53:01.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.149+0000 7f807ae95640 1 -- 172.21.15.132:0/3570727836 shutdown_connections 2024-04-16T15:53:01.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.149+0000 7f807ae95640 1 --2- 172.21.15.132:0/3570727836 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f805806c8f0 0x7f805806edb0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:01.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.149+0000 7f807ae95640 1 --2- 172.21.15.132:0/3570727836 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8074151e90 0x7f807415a4b0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:01.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.149+0000 7f807ae95640 1 --2- 172.21.15.132:0/3570727836 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80740b5cc0 0x7f8074141a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:01.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.149+0000 7f807ae95640 1 --2- 172.21.15.132:0/3570727836 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f807406e3a0 0x7f80740add40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:01.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.149+0000 7f807ae95640 1 -- 172.21.15.132:0/3570727836 >> 172.21.15.132:0/3570727836 conn(0x7f80740b2d50 msgr2=0x7f807406ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:01.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.149+0000 7f807ae95640 1 -- 172.21.15.132:0/3570727836 shutdown_connections 2024-04-16T15:53:01.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.149+0000 7f807ae95640 1 -- 172.21.15.132:0/3570727836 wait complete. 2024-04-16T15:53:01.159 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-16T15:53:01.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.264+0000 7fdc81bf2640 1 Processor -- start 2024-04-16T15:53:01.264 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.264+0000 7fdc81bf2640 1 -- start start 2024-04-16T15:53:01.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.265+0000 7fdc81bf2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdc7c145f70 0x7fdc7c0cd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:01.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.265+0000 7fdc81bf2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc7c0cdbe0 0x7fdc7c071ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:01.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.265+0000 7fdc81bf2640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdc7c072430 0x7fdc7c06ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:01.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.265+0000 7fdc81bf2640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fdc7c161060 con 0x7fdc7c145f70 2024-04-16T15:53:01.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.265+0000 7fdc81bf2640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fdc7c0d02e0 con 0x7fdc7c072430 2024-04-16T15:53:01.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.265+0000 7fdc81bf2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fdc7c072860 con 0x7fdc7c0cdbe0 2024-04-16T15:53:01.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.265+0000 7fdc7b7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdc7c145f70 0x7fdc7c0cd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:01.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.265+0000 7fdc7b7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdc7c145f70 0x7fdc7c0cd6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60748/0 (socket says 172.21.15.132:60748) 2024-04-16T15:53:01.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.265+0000 7fdc7b7fe640 1 -- 172.21.15.132:0/4261677637 learned_addr learned my addr 172.21.15.132:0/4261677637 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:01.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.266+0000 7fdc7bfff640 1 --2- 172.21.15.132:0/4261677637 >> v2:172.21.15.179:3300/0 conn(0x7fdc7c072430 0x7fdc7c06ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:01.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.266+0000 7fdc7b7fe640 1 -- 172.21.15.132:0/4261677637 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc7c0cdbe0 msgr2=0x7fdc7c071ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:01.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.266+0000 7fdc72ffd640 1 --2- 172.21.15.132:0/4261677637 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc7c0cdbe0 0x7fdc7c071ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:01.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.266+0000 7fdc7b7fe640 1 --2- 172.21.15.132:0/4261677637 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc7c0cdbe0 0x7fdc7c071ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:01.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.266+0000 7fdc7b7fe640 1 -- 172.21.15.132:0/4261677637 >> v2:172.21.15.179:3300/0 conn(0x7fdc7c072430 msgr2=0x7fdc7c06ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:01.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.266+0000 7fdc7b7fe640 1 --2- 172.21.15.132:0/4261677637 >> v2:172.21.15.179:3300/0 conn(0x7fdc7c072430 0x7fdc7c06ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:01.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.266+0000 7fdc7b7fe640 1 -- 172.21.15.132:0/4261677637 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc7c160450 con 0x7fdc7c145f70 2024-04-16T15:53:01.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.266+0000 7fdc7bfff640 1 --2- 172.21.15.132:0/4261677637 >> v2:172.21.15.179:3300/0 conn(0x7fdc7c072430 0x7fdc7c06ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:53:01.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.267+0000 7fdc7b7fe640 1 --2- 172.21.15.132:0/4261677637 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc7c145f70 0x7fdc7c0cd6a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c071e80 tx=0x7fdc6c02b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2301879e66d7b4e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:01.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.267+0000 7fdc7affd640 1 -- 172.21.15.132:0/4261677637 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc6c038070 con 0x7fdc7c145f70 2024-04-16T15:53:01.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.267+0000 7fdc7affd640 1 -- 172.21.15.132:0/4261677637 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc6c031740 con 0x7fdc7c145f70 2024-04-16T15:53:01.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.267+0000 7fdc7affd640 1 -- 172.21.15.132:0/4261677637 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc6c02f050 con 0x7fdc7c145f70 2024-04-16T15:53:01.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.267+0000 7fdc81bf2640 1 -- 172.21.15.132:0/4261677637 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc7c145f70 msgr2=0x7fdc7c0cd6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:01.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.267+0000 7fdc81bf2640 1 --2- 172.21.15.132:0/4261677637 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc7c145f70 0x7fdc7c0cd6a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c071e80 tx=0x7fdc6c02b7e0 comp rx=0 tx=0).stop 2024-04-16T15:53:01.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.267+0000 7fdc81bf2640 1 -- 172.21.15.132:0/4261677637 shutdown_connections 2024-04-16T15:53:01.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.267+0000 7fdc81bf2640 1 --2- 172.21.15.132:0/4261677637 >> v2:172.21.15.179:3300/0 conn(0x7fdc7c072430 0x7fdc7c06ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:01.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.267+0000 7fdc81bf2640 1 --2- 172.21.15.132:0/4261677637 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc7c0cdbe0 0x7fdc7c071ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:01.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.267+0000 7fdc81bf2640 1 --2- 172.21.15.132:0/4261677637 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc7c145f70 0x7fdc7c0cd6a0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:01.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.267+0000 7fdc81bf2640 1 -- 172.21.15.132:0/4261677637 >> 172.21.15.132:0/4261677637 conn(0x7fdc7c067ff0 msgr2=0x7fdc7c0b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:01.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.267+0000 7fdc81bf2640 1 -- 172.21.15.132:0/4261677637 shutdown_connections 2024-04-16T15:53:01.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.267+0000 7fdc81bf2640 1 -- 172.21.15.132:0/4261677637 wait complete. 2024-04-16T15:53:01.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.268+0000 7fdc81bf2640 1 Processor -- start 2024-04-16T15:53:01.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.269+0000 7fdc81bf2640 1 -- start start 2024-04-16T15:53:01.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.269+0000 7fdc81bf2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc7c072430 0x7fdc7c142d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:01.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.269+0000 7fdc81bf2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc7c0cdbe0 0x7fdc7c0ae360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:01.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.269+0000 7fdc81bf2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc7c145f70 0x7fdc7c0ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:01.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.269+0000 7fdc81bf2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c160cf0 con 0x7fdc7c0cdbe0 2024-04-16T15:53:01.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.269+0000 7fdc81bf2640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c160a10 con 0x7fdc7c072430 2024-04-16T15:53:01.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.269+0000 7fdc81bf2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fdc7c06bf60 con 0x7fdc7c145f70 2024-04-16T15:53:01.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.269+0000 7fdc72ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc7c0cdbe0 0x7fdc7c0ae360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:01.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.269+0000 7fdc72ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc7c0cdbe0 0x7fdc7c0ae360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60760/0 (socket says 172.21.15.132:60760) 2024-04-16T15:53:01.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.269+0000 7fdc72ffd640 1 -- 172.21.15.132:0/1567527541 learned_addr learned my addr 172.21.15.132:0/1567527541 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:01.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.270+0000 7fdc7bfff640 1 --2- 172.21.15.132:0/1567527541 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc7c145f70 0x7fdc7c0ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:01.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.270+0000 7fdc7b7fe640 1 --2- 172.21.15.132:0/1567527541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc7c072430 0x7fdc7c142d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:01.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.270+0000 7fdc72ffd640 1 -- 172.21.15.132:0/1567527541 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc7c145f70 msgr2=0x7fdc7c0ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:01.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.270+0000 7fdc72ffd640 1 --2- 172.21.15.132:0/1567527541 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc7c145f70 0x7fdc7c0ae8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:01.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.270+0000 7fdc72ffd640 1 -- 172.21.15.132:0/1567527541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc7c072430 msgr2=0x7fdc7c142d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:01.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.270+0000 7fdc72ffd640 1 --2- 172.21.15.132:0/1567527541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc7c072430 0x7fdc7c142d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:01.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.270+0000 7fdc72ffd640 1 -- 172.21.15.132:0/1567527541 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc7c06fe90 con 0x7fdc7c0cdbe0 2024-04-16T15:53:01.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.270+0000 7fdc72ffd640 1 --2- 172.21.15.132:0/1567527541 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc7c0cdbe0 0x7fdc7c0ae360 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fdc6400c7f0 tx=0x7fdc6400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:01.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.270+0000 7fdc78ff9640 1 -- 172.21.15.132:0/1567527541 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc64015070 con 0x7fdc7c0cdbe0 2024-04-16T15:53:01.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.270+0000 7fdc78ff9640 1 -- 172.21.15.132:0/1567527541 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc64004240 con 0x7fdc7c0cdbe0 2024-04-16T15:53:01.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.270+0000 7fdc81bf2640 1 -- 172.21.15.132:0/1567527541 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc7c143270 con 0x7fdc7c0cdbe0 2024-04-16T15:53:01.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.270+0000 7fdc78ff9640 1 -- 172.21.15.132:0/1567527541 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc64007620 con 0x7fdc7c0cdbe0 2024-04-16T15:53:01.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.270+0000 7fdc81bf2640 1 -- 172.21.15.132:0/1567527541 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc7c1f7bf0 con 0x7fdc7c0cdbe0 2024-04-16T15:53:01.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.271+0000 7fdc81bf2640 1 -- 172.21.15.132:0/1567527541 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc7c075510 con 0x7fdc7c0cdbe0 2024-04-16T15:53:01.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.272+0000 7fdc78ff9640 1 -- 172.21.15.132:0/1567527541 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdc640077c0 con 0x7fdc7c0cdbe0 2024-04-16T15:53:01.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.272+0000 7fdc78ff9640 1 --2- 172.21.15.132:0/1567527541 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fdc5c06c920 0x7fdc5c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:01.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.272+0000 7fdc78ff9640 1 -- 172.21.15.132:0/1567527541 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fdc6408b910 con 0x7fdc7c0cdbe0 2024-04-16T15:53:01.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.272+0000 7fdc7b7fe640 1 --2- 172.21.15.132:0/1567527541 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fdc5c06c920 0x7fdc5c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:01.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.272+0000 7fdc7b7fe640 1 --2- 172.21.15.132:0/1567527541 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fdc5c06c920 0x7fdc5c06ede0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c035000 tx=0x7fdc6c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:01.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.276+0000 7fdc78ff9640 1 -- 172.21.15.132:0/1567527541 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdc64059d50 con 0x7fdc7c0cdbe0 2024-04-16T15:53:01.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.488+0000 7fdc81bf2640 1 -- 172.21.15.132:0/1567527541 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fdc7c0b37d0 con 0x7fdc7c0cdbe0 2024-04-16T15:53:01.488 INFO:tasks.ceph.mon.a.smithi132.stderr:2024-04-16T15:53:01.489+0000 7fa386f52640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-16T15:53:01.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.490+0000 7fdc78ff9640 1 -- 172.21.15.132:0/1567527541 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) ==== 161+0+0 (secure 0 0 0) 0x7fdc64059650 con 0x7fdc7c0cdbe0 2024-04-16T15:53:01.489 INFO:teuthology.orchestra.run.smithi132.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-16T15:53:01.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.493+0000 7fdc81bf2640 1 -- 172.21.15.132:0/1567527541 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fdc5c06c920 msgr2=0x7fdc5c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:01.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.493+0000 7fdc81bf2640 1 --2- 172.21.15.132:0/1567527541 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fdc5c06c920 0x7fdc5c06ede0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c035000 tx=0x7fdc6c008030 comp rx=0 tx=0).stop 2024-04-16T15:53:01.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.493+0000 7fdc81bf2640 1 -- 172.21.15.132:0/1567527541 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc7c0cdbe0 msgr2=0x7fdc7c0ae360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:01.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.493+0000 7fdc81bf2640 1 --2- 172.21.15.132:0/1567527541 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc7c0cdbe0 0x7fdc7c0ae360 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fdc6400c7f0 tx=0x7fdc6400ccb0 comp rx=0 tx=0).stop 2024-04-16T15:53:01.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.493+0000 7fdc81bf2640 1 -- 172.21.15.132:0/1567527541 shutdown_connections 2024-04-16T15:53:01.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.493+0000 7fdc81bf2640 1 --2- 172.21.15.132:0/1567527541 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fdc5c06c920 0x7fdc5c06ede0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:01.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.493+0000 7fdc81bf2640 1 --2- 172.21.15.132:0/1567527541 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc7c145f70 0x7fdc7c0ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:01.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.493+0000 7fdc81bf2640 1 --2- 172.21.15.132:0/1567527541 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc7c0cdbe0 0x7fdc7c0ae360 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:01.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.493+0000 7fdc81bf2640 1 --2- 172.21.15.132:0/1567527541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc7c072430 0x7fdc7c142d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:01.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.493+0000 7fdc81bf2640 1 -- 172.21.15.132:0/1567527541 >> 172.21.15.132:0/1567527541 conn(0x7fdc7c067ff0 msgr2=0x7fdc7c0b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:01.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.493+0000 7fdc81bf2640 1 -- 172.21.15.132:0/1567527541 shutdown_connections 2024-04-16T15:53:01.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.493+0000 7fdc81bf2640 1 -- 172.21.15.132:0/1567527541 wait complete. 2024-04-16T15:53:01.495 INFO:tasks.ceph.mds.b.smithi179.stderr: -2925> 2024-04-16T15:52:19.908+0000 7f5e552b5640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-16T15:53:01.504 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-16T15:53:01.525 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2024-04-16T15:53:01.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.610+0000 7f73c20c8640 1 Processor -- start 2024-04-16T15:53:01.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.610+0000 7f73c20c8640 1 -- start start 2024-04-16T15:53:01.610 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.610+0000 7f73c20c8640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f73bc09b950 0x7f73bc0d1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:01.610 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.610+0000 7f73c20c8640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73bc0b23c0 con 0x7f73bc1600a0 2024-04-16T15:53:01.610 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.610+0000 7f73c20c8640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73bc0b26a0 con 0x7f73bc09ab80 2024-04-16T15:53:01.610 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.610+0000 7f73c20c8640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f73bc0b2980 con 0x7f73bc09b950 2024-04-16T15:53:01.610 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.611+0000 7f73baffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f73bc09b950 0x7f73bc0d1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:01.610 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.611+0000 7f73bb7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f73bc1600a0 0x7f73bc0b3460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:37272/0 (socket says 172.21.15.132:37272) 2024-04-16T15:53:01.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.611+0000 7f73bb7fe640 1 -- 172.21.15.132:0/1190424981 learned_addr learned my addr 172.21.15.132:0/1190424981 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:53:01.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.611+0000 7f73baffd640 1 -- 172.21.15.132:0/1190424981 >> v1:172.21.15.179:6789/0 conn(0x7f73bc09ab80 legacy=0x7f73bc09af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:01.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.611+0000 7f73baffd640 1 -- 172.21.15.132:0/1190424981 >> v1:172.21.15.132:6789/0 conn(0x7f73bc1600a0 legacy=0x7f73bc0b3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:01.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.611+0000 7f73baffd640 1 -- 172.21.15.132:0/1190424981 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73bc0b2c60 con 0x7f73bc09b950 2024-04-16T15:53:01.612 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.611+0000 7f73baffd640 1 --2- 172.21.15.132:0/1190424981 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73bc09b950 0x7f73bc0d1290 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f73ac0097a0 tx=0x7f73ac02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43bbd9e4b4cefaa server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:01.612 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.612+0000 7f73ba7fc640 1 -- 172.21.15.132:0/1190424981 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ac035020 con 0x7f73bc09b950 2024-04-16T15:53:01.612 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.612+0000 7f73ba7fc640 1 -- 172.21.15.132:0/1190424981 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73ac031830 con 0x7f73bc09b950 2024-04-16T15:53:01.612 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.612+0000 7f73ba7fc640 1 -- 172.21.15.132:0/1190424981 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ac031c00 con 0x7f73bc09b950 2024-04-16T15:53:01.612 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.612+0000 7f73c20c8640 1 -- 172.21.15.132:0/1190424981 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73bc09b950 msgr2=0x7f73bc0d1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:01.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.612+0000 7f73c20c8640 1 --2- 172.21.15.132:0/1190424981 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73bc09b950 0x7f73bc0d1290 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f73ac0097a0 tx=0x7f73ac02b8d0 comp rx=0 tx=0).stop 2024-04-16T15:53:01.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.612+0000 7f73c20c8640 1 -- 172.21.15.132:0/1190424981 shutdown_connections 2024-04-16T15:53:01.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.612+0000 7f73c20c8640 1 --2- 172.21.15.132:0/1190424981 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73bc09b950 0x7f73bc0d1290 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:01.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.612+0000 7f73c20c8640 1 -- 172.21.15.132:0/1190424981 >> 172.21.15.132:0/1190424981 conn(0x7f73bc0b4400 msgr2=0x7f73bc0b4810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:01.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.612+0000 7f73c20c8640 1 -- 172.21.15.132:0/1190424981 shutdown_connections 2024-04-16T15:53:01.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.612+0000 7f73c20c8640 1 -- 172.21.15.132:0/1190424981 wait complete. 2024-04-16T15:53:01.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.613+0000 7f73c20c8640 1 Processor -- start 2024-04-16T15:53:01.615 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.614+0000 7f73c20c8640 1 -- start start 2024-04-16T15:53:01.615 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.614+0000 7f73c20c8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73bc09ab80 0x7f73bc0c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:01.615 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.614+0000 7f73c20c8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73bc09b950 0x7f73bc06cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:01.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.614+0000 7f73c20c8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73bc1600a0 0x7f73bc06d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:01.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.614+0000 7f73c20c8640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f73bc0b3b70 con 0x7f73bc09b950 2024-04-16T15:53:01.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.614+0000 7f73c20c8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f73bc0b2090 con 0x7f73bc1600a0 2024-04-16T15:53:01.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.614+0000 7f73c20c8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f73bc160480 con 0x7f73bc09ab80 2024-04-16T15:53:01.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.614+0000 7f73baffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73bc09b950 0x7f73bc06cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:01.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.614+0000 7f73baffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73bc09b950 0x7f73bc06cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52580/0 (socket says 172.21.15.132:52580) 2024-04-16T15:53:01.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.614+0000 7f73baffd640 1 -- 172.21.15.132:0/3354189041 learned_addr learned my addr 172.21.15.132:0/3354189041 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:01.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.615+0000 7f73bb7fe640 1 --2- 172.21.15.132:0/3354189041 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73bc09ab80 0x7f73bc0c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:01.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.615+0000 7f73baffd640 1 -- 172.21.15.132:0/3354189041 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73bc09ab80 msgr2=0x7f73bc0c8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:01.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.615+0000 7f73bbfff640 1 --2- 172.21.15.132:0/3354189041 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73bc1600a0 0x7f73bc06d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:01.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.615+0000 7f73baffd640 1 --2- 172.21.15.132:0/3354189041 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73bc09ab80 0x7f73bc0c8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:01.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.615+0000 7f73baffd640 1 -- 172.21.15.132:0/3354189041 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73bc1600a0 msgr2=0x7f73bc06d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:01.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.615+0000 7f73baffd640 1 --2- 172.21.15.132:0/3354189041 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73bc1600a0 0x7f73bc06d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:01.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.615+0000 7f73baffd640 1 -- 172.21.15.132:0/3354189041 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73bc0cce40 con 0x7f73bc09b950 2024-04-16T15:53:01.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.615+0000 7f73bb7fe640 1 --2- 172.21.15.132:0/3354189041 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73bc09ab80 0x7f73bc0c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:53:01.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.615+0000 7f73bbfff640 1 --2- 172.21.15.132:0/3354189041 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73bc1600a0 0x7f73bc06d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:53:01.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.615+0000 7f73baffd640 1 --2- 172.21.15.132:0/3354189041 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73bc09b950 0x7f73bc06cb30 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f73ac0098c0 tx=0x7f73ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:01.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.615+0000 7f73b3fff640 1 -- 172.21.15.132:0/3354189041 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ac041070 con 0x7f73bc09b950 2024-04-16T15:53:01.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.615+0000 7f73b3fff640 1 -- 172.21.15.132:0/3354189041 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73ac03aa30 con 0x7f73bc09b950 2024-04-16T15:53:01.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.615+0000 7f73c20c8640 1 -- 172.21.15.132:0/3354189041 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73bc0c9c80 con 0x7f73bc09b950 2024-04-16T15:53:01.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.615+0000 7f73b3fff640 1 -- 172.21.15.132:0/3354189041 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ac035040 con 0x7f73bc09b950 2024-04-16T15:53:01.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.615+0000 7f73c20c8640 1 -- 172.21.15.132:0/3354189041 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73bc0b5ea0 con 0x7f73bc09b950 2024-04-16T15:53:01.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.616+0000 7f73c20c8640 1 -- 172.21.15.132:0/3354189041 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73bc075510 con 0x7f73bc09b950 2024-04-16T15:53:01.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.616+0000 7f73b3fff640 1 -- 172.21.15.132:0/3354189041 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f73ac038020 con 0x7f73bc09b950 2024-04-16T15:53:01.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.617+0000 7f73b3fff640 1 --2- 172.21.15.132:0/3354189041 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f739c06c8f0 0x7f739c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:01.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.617+0000 7f73b3fff640 1 -- 172.21.15.132:0/3354189041 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5911+0+0 (secure 0 0 0) 0x7f73ac0ad700 con 0x7f73bc09b950 2024-04-16T15:53:01.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.617+0000 7f73bb7fe640 1 --2- 172.21.15.132:0/3354189041 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f739c06c8f0 0x7f739c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:01.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.617+0000 7f73bb7fe640 1 --2- 172.21.15.132:0/3354189041 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f739c06c8f0 0x7f739c06edb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f73a40012e0 tx=0x7f73a4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:01.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.621+0000 7f73b3fff640 1 -- 172.21.15.132:0/3354189041 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f73ac07ba60 con 0x7f73bc09b950 2024-04-16T15:53:01.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:01.837+0000 7f73c20c8640 1 -- 172.21.15.132:0/3354189041 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f73bc0b85a0 con 0x7f73bc09b950 2024-04-16T15:53:02.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.491+0000 7f73b3fff640 1 -- 172.21.15.132:0/3354189041 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) ==== 104+0+0 (secure 0 0 0) 0x7f73ac07b360 con 0x7f73bc09b950 2024-04-16T15:53:02.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.494+0000 7f73c20c8640 1 -- 172.21.15.132:0/3354189041 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f739c06c8f0 msgr2=0x7f739c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:02.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.494+0000 7f73c20c8640 1 --2- 172.21.15.132:0/3354189041 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f739c06c8f0 0x7f739c06edb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f73a40012e0 tx=0x7f73a4009040 comp rx=0 tx=0).stop 2024-04-16T15:53:02.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.494+0000 7f73c20c8640 1 -- 172.21.15.132:0/3354189041 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73bc09b950 msgr2=0x7f73bc06cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:02.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.494+0000 7f73c20c8640 1 --2- 172.21.15.132:0/3354189041 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73bc09b950 0x7f73bc06cb30 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f73ac0098c0 tx=0x7f73ac0046c0 comp rx=0 tx=0).stop 2024-04-16T15:53:02.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.494+0000 7f73c20c8640 1 -- 172.21.15.132:0/3354189041 shutdown_connections 2024-04-16T15:53:02.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.494+0000 7f73c20c8640 1 --2- 172.21.15.132:0/3354189041 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f739c06c8f0 0x7f739c06edb0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:02.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.494+0000 7f73c20c8640 1 --2- 172.21.15.132:0/3354189041 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73bc1600a0 0x7f73bc06d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:02.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.494+0000 7f73c20c8640 1 --2- 172.21.15.132:0/3354189041 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73bc09b950 0x7f73bc06cb30 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:02.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.494+0000 7f73c20c8640 1 --2- 172.21.15.132:0/3354189041 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73bc09ab80 0x7f73bc0c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:02.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.494+0000 7f73c20c8640 1 -- 172.21.15.132:0/3354189041 >> 172.21.15.132:0/3354189041 conn(0x7f73bc0b4400 msgr2=0x7f73bc0b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:02.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.494+0000 7f73c20c8640 1 -- 172.21.15.132:0/3354189041 shutdown_connections 2024-04-16T15:53:02.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.494+0000 7f73c20c8640 1 -- 172.21.15.132:0/3354189041 wait complete. 2024-04-16T15:53:02.506 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-16T15:53:02.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.616+0000 7f27437cd640 1 Processor -- start 2024-04-16T15:53:02.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.617+0000 7f27437cd640 1 -- start start 2024-04-16T15:53:02.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.617+0000 7f27437cd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f273c0b66d0 0x7f273c1626c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:02.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.617+0000 7f27437cd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f273c0ba3b0 0x7f273c0d3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:02.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.617+0000 7f27437cd640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f273c0ba860 con 0x7f273c15edb0 2024-04-16T15:53:02.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.617+0000 7f27437cd640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f273c162dc0 con 0x7f273c0b66d0 2024-04-16T15:53:02.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.617+0000 7f27437cd640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f273c1630a0 con 0x7f273c0ba3b0 2024-04-16T15:53:02.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.617+0000 7f2741569640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f273c0b66d0 0x7f273c1626c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:02.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.618+0000 7f2741569640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f273c0b66d0 0x7f273c1626c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52592/0 (socket says 172.21.15.132:52592) 2024-04-16T15:53:02.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.618+0000 7f2741569640 1 -- 172.21.15.132:0/2871841984 learned_addr learned my addr 172.21.15.132:0/2871841984 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:02.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.618+0000 7f2741d6a640 1 --2- 172.21.15.132:0/2871841984 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f273c0ba3b0 0x7f273c0d3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:02.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.618+0000 7f2741569640 1 -- 172.21.15.132:0/2871841984 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f273c0ba3b0 msgr2=0x7f273c0d3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:02.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.618+0000 7f2741569640 1 --2- 172.21.15.132:0/2871841984 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f273c0ba3b0 0x7f273c0d3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:02.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.618+0000 7f2741569640 1 -- 172.21.15.132:0/2871841984 >> v1:172.21.15.179:6789/0 conn(0x7f273c15edb0 legacy=0x7f273c0b6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:02.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.618+0000 7f2741569640 1 -- 172.21.15.132:0/2871841984 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f273c163380 con 0x7f273c0b66d0 2024-04-16T15:53:02.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.619+0000 7f2741569640 1 --2- 172.21.15.132:0/2871841984 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f273c0b66d0 0x7f273c1626c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2738009870 tx=0x7f273802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=703f0dd0b64d6b26 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:02.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.619+0000 7f2733fff640 1 -- 172.21.15.132:0/2871841984 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2738034070 con 0x7f273c0b66d0 2024-04-16T15:53:02.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.619+0000 7f2733fff640 1 -- 172.21.15.132:0/2871841984 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2738030840 con 0x7f273c0b66d0 2024-04-16T15:53:02.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.619+0000 7f2733fff640 1 -- 172.21.15.132:0/2871841984 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2738030c10 con 0x7f273c0b66d0 2024-04-16T15:53:02.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.619+0000 7f27437cd640 1 -- 172.21.15.132:0/2871841984 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f273c0b66d0 msgr2=0x7f273c1626c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:02.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.619+0000 7f27437cd640 1 --2- 172.21.15.132:0/2871841984 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f273c0b66d0 0x7f273c1626c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2738009870 tx=0x7f273802b980 comp rx=0 tx=0).stop 2024-04-16T15:53:02.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.619+0000 7f27437cd640 1 -- 172.21.15.132:0/2871841984 shutdown_connections 2024-04-16T15:53:02.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.619+0000 7f27437cd640 1 --2- 172.21.15.132:0/2871841984 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f273c0ba3b0 0x7f273c0d3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:02.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.619+0000 7f27437cd640 1 --2- 172.21.15.132:0/2871841984 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f273c0b66d0 0x7f273c1626c0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:02.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.619+0000 7f27437cd640 1 -- 172.21.15.132:0/2871841984 >> 172.21.15.132:0/2871841984 conn(0x7f273c0d1780 msgr2=0x7f273c0d1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:02.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.619+0000 7f27437cd640 1 -- 172.21.15.132:0/2871841984 shutdown_connections 2024-04-16T15:53:02.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.619+0000 7f27437cd640 1 -- 172.21.15.132:0/2871841984 wait complete. 2024-04-16T15:53:02.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.621+0000 7f27437cd640 1 Processor -- start 2024-04-16T15:53:02.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.621+0000 7f27437cd640 1 -- start start 2024-04-16T15:53:02.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.621+0000 7f27437cd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f273c0b66d0 0x7f273c15b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:02.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.621+0000 7f27437cd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f273c0ba3b0 0x7f273c0b7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:02.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.621+0000 7f27437cd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f273c15edb0 0x7f273c0b8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:02.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.621+0000 7f27437cd640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f273c0d3c10 con 0x7f273c15edb0 2024-04-16T15:53:02.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.621+0000 7f27437cd640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f273c0d3a90 con 0x7f273c0ba3b0 2024-04-16T15:53:02.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.621+0000 7f27437cd640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f273c0d3d90 con 0x7f273c0b66d0 2024-04-16T15:53:02.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.621+0000 7f2741d6a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f273c15edb0 0x7f273c0b8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:02.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.621+0000 7f2741d6a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f273c15edb0 0x7f273c0b8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52600/0 (socket says 172.21.15.132:52600) 2024-04-16T15:53:02.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.621+0000 7f2741d6a640 1 -- 172.21.15.132:0/2892075272 learned_addr learned my addr 172.21.15.132:0/2892075272 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:02.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.622+0000 7f2741d6a640 1 -- 172.21.15.132:0/2892075272 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f273c0b66d0 msgr2=0x7f273c15b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:02.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.622+0000 7f2741d6a640 1 --2- 172.21.15.132:0/2892075272 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f273c0b66d0 0x7f273c15b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:02.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.622+0000 7f2741d6a640 1 -- 172.21.15.132:0/2892075272 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f273c0ba3b0 msgr2=0x7f273c0b7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:02.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.622+0000 7f2740d68640 1 --2- 172.21.15.132:0/2892075272 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f273c0ba3b0 0x7f273c0b7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:02.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.622+0000 7f2741d6a640 1 --2- 172.21.15.132:0/2892075272 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f273c0ba3b0 0x7f273c0b7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:02.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.622+0000 7f2741d6a640 1 -- 172.21.15.132:0/2892075272 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f273c0cb280 con 0x7f273c15edb0 2024-04-16T15:53:02.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.622+0000 7f2740d68640 1 --2- 172.21.15.132:0/2892075272 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f273c0ba3b0 0x7f273c0b7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:53:02.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.622+0000 7f2741d6a640 1 --2- 172.21.15.132:0/2892075272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f273c15edb0 0x7f273c0b8470 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2734007e40 tx=0x7f273400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:02.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.622+0000 7f2731ffb640 1 -- 172.21.15.132:0/2892075272 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2734014620 con 0x7f273c15edb0 2024-04-16T15:53:02.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.622+0000 7f2731ffb640 1 -- 172.21.15.132:0/2892075272 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2734019070 con 0x7f273c15edb0 2024-04-16T15:53:02.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.622+0000 7f27437cd640 1 -- 172.21.15.132:0/2892075272 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f273c0ca1e0 con 0x7f273c15edb0 2024-04-16T15:53:02.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.622+0000 7f2731ffb640 1 -- 172.21.15.132:0/2892075272 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2734014a20 con 0x7f273c15edb0 2024-04-16T15:53:02.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.622+0000 7f27437cd640 1 -- 172.21.15.132:0/2892075272 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f273c0ca7a0 con 0x7f273c15edb0 2024-04-16T15:53:02.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.623+0000 7f27437cd640 1 -- 172.21.15.132:0/2892075272 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f273c068b80 con 0x7f273c15edb0 2024-04-16T15:53:02.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.624+0000 7f2731ffb640 1 -- 172.21.15.132:0/2892075272 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2734014bc0 con 0x7f273c15edb0 2024-04-16T15:53:02.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.624+0000 7f2731ffb640 1 --2- 172.21.15.132:0/2892075272 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f272006c8f0 0x7f272006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:02.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.624+0000 7f2731ffb640 1 -- 172.21.15.132:0/2892075272 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5911+0+0 (secure 0 0 0) 0x7f273408c500 con 0x7f273c15edb0 2024-04-16T15:53:02.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.624+0000 7f2741569640 1 --2- 172.21.15.132:0/2892075272 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f272006c8f0 0x7f272006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:02.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.625+0000 7f2741569640 1 --2- 172.21.15.132:0/2892075272 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f272006c8f0 0x7f272006edb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2738036000 tx=0x7f273803b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:02.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.629+0000 7f2731ffb640 1 -- 172.21.15.132:0/2892075272 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f273c0cb280 con 0x7f273c15edb0 2024-04-16T15:53:02.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:02.804+0000 7f27437cd640 1 -- 172.21.15.132:0/2892075272 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f273c15bee0 con 0x7f273c15edb0 2024-04-16T15:53:03.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.493+0000 7f2731ffb640 1 -- 172.21.15.132:0/2892075272 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) ==== 181+0+0 (secure 0 0 0) 0x7f273405a860 con 0x7f273c15edb0 2024-04-16T15:53:03.492 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_metadata' removed 2024-04-16T15:53:03.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.496+0000 7f27437cd640 1 -- 172.21.15.132:0/2892075272 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f272006c8f0 msgr2=0x7f272006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:03.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.496+0000 7f27437cd640 1 --2- 172.21.15.132:0/2892075272 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f272006c8f0 0x7f272006edb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2738036000 tx=0x7f273803b040 comp rx=0 tx=0).stop 2024-04-16T15:53:03.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.496+0000 7f27437cd640 1 -- 172.21.15.132:0/2892075272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f273c15edb0 msgr2=0x7f273c0b8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:03.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.496+0000 7f27437cd640 1 --2- 172.21.15.132:0/2892075272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f273c15edb0 0x7f273c0b8470 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2734007e40 tx=0x7f273400e4b0 comp rx=0 tx=0).stop 2024-04-16T15:53:03.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.496+0000 7f27437cd640 1 -- 172.21.15.132:0/2892075272 shutdown_connections 2024-04-16T15:53:03.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.496+0000 7f27437cd640 1 --2- 172.21.15.132:0/2892075272 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f272006c8f0 0x7f272006edb0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:03.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.496+0000 7f27437cd640 1 --2- 172.21.15.132:0/2892075272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f273c15edb0 0x7f273c0b8470 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:03.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.496+0000 7f27437cd640 1 --2- 172.21.15.132:0/2892075272 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f273c0ba3b0 0x7f273c0b7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:03.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.496+0000 7f27437cd640 1 --2- 172.21.15.132:0/2892075272 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f273c0b66d0 0x7f273c15b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:03.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.496+0000 7f27437cd640 1 -- 172.21.15.132:0/2892075272 >> 172.21.15.132:0/2892075272 conn(0x7f273c0d1780 msgr2=0x7f273c06ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:03.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.496+0000 7f27437cd640 1 -- 172.21.15.132:0/2892075272 shutdown_connections 2024-04-16T15:53:03.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.496+0000 7f27437cd640 1 -- 172.21.15.132:0/2892075272 wait complete. 2024-04-16T15:53:03.508 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-16T15:53:03.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.617+0000 7f23bc6d9640 1 Processor -- start 2024-04-16T15:53:03.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.618+0000 7f23bc6d9640 1 -- start start 2024-04-16T15:53:03.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.618+0000 7f23bc6d9640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f23b415ca10 0x7f23b40d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:03.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.618+0000 7f23bc6d9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f23b409baa0 0x7f23b409aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:03.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.618+0000 7f23bc6d9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23b409af70 0x7f23b40cd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:03.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.618+0000 7f23bc6d9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f23b409b3e0 con 0x7f23b409baa0 2024-04-16T15:53:03.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.618+0000 7f23bc6d9640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f23b40701e0 con 0x7f23b415ca10 2024-04-16T15:53:03.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.618+0000 7f23bc6d9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f23b40d1230 con 0x7f23b409af70 2024-04-16T15:53:03.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.619+0000 7f23b9c74640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f23b409baa0 0x7f23b409aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:03.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.619+0000 7f23b9c74640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f23b409baa0 0x7f23b409aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52602/0 (socket says 172.21.15.132:52602) 2024-04-16T15:53:03.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.619+0000 7f23b9c74640 1 -- 172.21.15.132:0/3111085063 learned_addr learned my addr 172.21.15.132:0/3111085063 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:03.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.619+0000 7f23ba475640 1 --2- 172.21.15.132:0/3111085063 >> v2:172.21.15.179:3300/0 conn(0x7f23b415ca10 0x7f23b40d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:03.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.619+0000 7f23bac76640 1 --2- 172.21.15.132:0/3111085063 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23b409af70 0x7f23b40cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:03.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.619+0000 7f23b9c74640 1 -- 172.21.15.132:0/3111085063 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23b409af70 msgr2=0x7f23b40cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:03.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.619+0000 7f23b9c74640 1 --2- 172.21.15.132:0/3111085063 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23b409af70 0x7f23b40cd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:03.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.619+0000 7f23b9c74640 1 -- 172.21.15.132:0/3111085063 >> v2:172.21.15.179:3300/0 conn(0x7f23b415ca10 msgr2=0x7f23b40d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:03.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.619+0000 7f23b9c74640 1 --2- 172.21.15.132:0/3111085063 >> v2:172.21.15.179:3300/0 conn(0x7f23b415ca10 0x7f23b40d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:03.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.619+0000 7f23b9c74640 1 -- 172.21.15.132:0/3111085063 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23b40d1510 con 0x7f23b409baa0 2024-04-16T15:53:03.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.619+0000 7f23bac76640 1 --2- 172.21.15.132:0/3111085063 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23b409af70 0x7f23b40cd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:53:03.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.620+0000 7f23b9c74640 1 --2- 172.21.15.132:0/3111085063 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23b409baa0 0x7f23b409aa30 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f23b40b4da0 tx=0x7f23a402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7061115127ed2fee server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:03.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.620+0000 7f23b9473640 1 -- 172.21.15.132:0/3111085063 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a4035020 con 0x7f23b409baa0 2024-04-16T15:53:03.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.620+0000 7f23b9473640 1 -- 172.21.15.132:0/3111085063 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23a4031870 con 0x7f23b409baa0 2024-04-16T15:53:03.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.620+0000 7f23b9473640 1 -- 172.21.15.132:0/3111085063 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a4031c40 con 0x7f23b409baa0 2024-04-16T15:53:03.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.620+0000 7f23bc6d9640 1 -- 172.21.15.132:0/3111085063 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23b409baa0 msgr2=0x7f23b409aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:03.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.620+0000 7f23bc6d9640 1 --2- 172.21.15.132:0/3111085063 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23b409baa0 0x7f23b409aa30 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f23b40b4da0 tx=0x7f23a402b910 comp rx=0 tx=0).stop 2024-04-16T15:53:03.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.620+0000 7f23bc6d9640 1 -- 172.21.15.132:0/3111085063 shutdown_connections 2024-04-16T15:53:03.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.620+0000 7f23bc6d9640 1 --2- 172.21.15.132:0/3111085063 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23b409af70 0x7f23b40cd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:03.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.620+0000 7f23bc6d9640 1 --2- 172.21.15.132:0/3111085063 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23b409baa0 0x7f23b409aa30 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:03.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.620+0000 7f23bc6d9640 1 --2- 172.21.15.132:0/3111085063 >> v2:172.21.15.179:3300/0 conn(0x7f23b415ca10 0x7f23b40d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:03.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.620+0000 7f23bc6d9640 1 -- 172.21.15.132:0/3111085063 >> 172.21.15.132:0/3111085063 conn(0x7f23b40b4160 msgr2=0x7f23b40b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:03.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.621+0000 7f23bc6d9640 1 -- 172.21.15.132:0/3111085063 shutdown_connections 2024-04-16T15:53:03.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.621+0000 7f23bc6d9640 1 -- 172.21.15.132:0/3111085063 wait complete. 2024-04-16T15:53:03.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.622+0000 7f23bc6d9640 1 Processor -- start 2024-04-16T15:53:03.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.622+0000 7f23bc6d9640 1 -- start start 2024-04-16T15:53:03.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.622+0000 7f23bc6d9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23b409af70 0x7f23b40c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:03.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.622+0000 7f23bc6d9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23b409baa0 0x7f23b414ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:03.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.622+0000 7f23bc6d9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23b415ca10 0x7f23b4149750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:03.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.622+0000 7f23bc6d9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f23b40ce5b0 con 0x7f23b409baa0 2024-04-16T15:53:03.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.622+0000 7f23bc6d9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f23b4070710 con 0x7f23b409af70 2024-04-16T15:53:03.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.622+0000 7f23bc6d9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f23b40cd7c0 con 0x7f23b415ca10 2024-04-16T15:53:03.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.622+0000 7f23b9c74640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23b409baa0 0x7f23b414ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:03.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.622+0000 7f23b9c74640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23b409baa0 0x7f23b414ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52618/0 (socket says 172.21.15.132:52618) 2024-04-16T15:53:03.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.622+0000 7f23b9c74640 1 -- 172.21.15.132:0/2394515117 learned_addr learned my addr 172.21.15.132:0/2394515117 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:03.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.623+0000 7f23b9c74640 1 -- 172.21.15.132:0/2394515117 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23b415ca10 msgr2=0x7f23b4149750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:03.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.623+0000 7f23b9c74640 1 --2- 172.21.15.132:0/2394515117 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23b415ca10 0x7f23b4149750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:03.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.623+0000 7f23b9c74640 1 -- 172.21.15.132:0/2394515117 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23b409af70 msgr2=0x7f23b40c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:03.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.623+0000 7f23ba475640 1 --2- 172.21.15.132:0/2394515117 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23b409af70 0x7f23b40c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:03.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.623+0000 7f23b9c74640 1 --2- 172.21.15.132:0/2394515117 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23b409af70 0x7f23b40c81a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:03.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.623+0000 7f23b9c74640 1 -- 172.21.15.132:0/2394515117 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23b4149c90 con 0x7f23b409baa0 2024-04-16T15:53:03.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.623+0000 7f23b9c74640 1 --2- 172.21.15.132:0/2394515117 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23b409baa0 0x7f23b414ca20 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f23a4000c00 tx=0x7f23a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:03.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.623+0000 7f23aaffd640 1 -- 172.21.15.132:0/2394515117 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a4035040 con 0x7f23b409baa0 2024-04-16T15:53:03.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.623+0000 7f23aaffd640 1 -- 172.21.15.132:0/2394515117 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23a4030d00 con 0x7f23b409baa0 2024-04-16T15:53:03.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.623+0000 7f23bc6d9640 1 -- 172.21.15.132:0/2394515117 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23b40c8810 con 0x7f23b409baa0 2024-04-16T15:53:03.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.623+0000 7f23aaffd640 1 -- 172.21.15.132:0/2394515117 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a40456c0 con 0x7f23b409baa0 2024-04-16T15:53:03.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.623+0000 7f23bc6d9640 1 -- 172.21.15.132:0/2394515117 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23b40c8dd0 con 0x7f23b409baa0 2024-04-16T15:53:03.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.624+0000 7f23bc6d9640 1 -- 172.21.15.132:0/2394515117 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23b4068b80 con 0x7f23b409baa0 2024-04-16T15:53:03.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.624+0000 7f23aaffd640 1 -- 172.21.15.132:0/2394515117 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f23a4038020 con 0x7f23b409baa0 2024-04-16T15:53:03.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.625+0000 7f23aaffd640 1 --2- 172.21.15.132:0/2394515117 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f239806c8f0 0x7f239806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:03.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.625+0000 7f23aaffd640 1 -- 172.21.15.132:0/2394515117 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5473+0+0 (secure 0 0 0) 0x7f23a40add40 con 0x7f23b409baa0 2024-04-16T15:53:03.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.625+0000 7f23ba475640 1 --2- 172.21.15.132:0/2394515117 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f239806c8f0 0x7f239806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:03.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.625+0000 7f23ba475640 1 --2- 172.21.15.132:0/2394515117 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f239806c8f0 0x7f239806edb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f23b0006fd0 tx=0x7f23b0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:03.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.629+0000 7f23aaffd640 1 -- 172.21.15.132:0/2394515117 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f23a407c2e0 con 0x7f23b409baa0 2024-04-16T15:53:03.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:03.803+0000 7f23bc6d9640 1 -- 172.21.15.132:0/2394515117 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f23b40ce950 con 0x7f23b409baa0 2024-04-16T15:53:04.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:04.501+0000 7f23aaffd640 1 -- 172.21.15.132:0/2394515117 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) ==== 169+0+0 (secure 0 0 0) 0x7f23a407bbe0 con 0x7f23b409baa0 2024-04-16T15:53:04.501 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_data' removed 2024-04-16T15:53:04.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:04.506+0000 7f23bc6d9640 1 -- 172.21.15.132:0/2394515117 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f239806c8f0 msgr2=0x7f239806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:04.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:04.506+0000 7f23bc6d9640 1 --2- 172.21.15.132:0/2394515117 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f239806c8f0 0x7f239806edb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f23b0006fd0 tx=0x7f23b0008040 comp rx=0 tx=0).stop 2024-04-16T15:53:04.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:04.506+0000 7f23bc6d9640 1 -- 172.21.15.132:0/2394515117 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23b409baa0 msgr2=0x7f23b414ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:04.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:04.506+0000 7f23bc6d9640 1 --2- 172.21.15.132:0/2394515117 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23b409baa0 0x7f23b414ca20 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f23a4000c00 tx=0x7f23a40046c0 comp rx=0 tx=0).stop 2024-04-16T15:53:04.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:04.506+0000 7f23bc6d9640 1 -- 172.21.15.132:0/2394515117 shutdown_connections 2024-04-16T15:53:04.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:04.506+0000 7f23bc6d9640 1 --2- 172.21.15.132:0/2394515117 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f239806c8f0 0x7f239806edb0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:04.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:04.506+0000 7f23bc6d9640 1 --2- 172.21.15.132:0/2394515117 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23b415ca10 0x7f23b4149750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:04.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:04.506+0000 7f23bc6d9640 1 --2- 172.21.15.132:0/2394515117 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23b409baa0 0x7f23b414ca20 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:04.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:04.506+0000 7f23bc6d9640 1 --2- 172.21.15.132:0/2394515117 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23b409af70 0x7f23b40c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:04.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:04.506+0000 7f23bc6d9640 1 -- 172.21.15.132:0/2394515117 >> 172.21.15.132:0/2394515117 conn(0x7f23b40b4160 msgr2=0x7f23b40b3660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:04.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:04.506+0000 7f23bc6d9640 1 -- 172.21.15.132:0/2394515117 shutdown_connections 2024-04-16T15:53:04.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:04.506+0000 7f23bc6d9640 1 -- 172.21.15.132:0/2394515117 wait complete. 2024-04-16T15:53:04.519 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-16T15:53:04.519 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-16T15:53:04.519 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-16T15:53:04.520 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T15:53:04.520 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-16T15:53:04.520 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-16T15:53:04.520 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-16T15:53:04.520 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T15:53:04.520 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-16T15:53:04.520 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-16T15:53:04.521 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-16T15:53:04.521 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T15:53:04.521 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-16T15:53:04.521 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-16T15:53:04.521 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-16T15:53:04.521 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T15:53:04.530 INFO:tasks.ceph.mds.a:Stopped 2024-04-16T15:53:04.530 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-16T15:53:04.531 INFO:tasks.ceph.mds.c:Stopped 2024-04-16T15:53:04.531 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-16T15:53:04.533 INFO:tasks.ceph.mds.d:Stopped 2024-04-16T15:53:04.533 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-16T15:53:04.573 INFO:tasks.ceph.mds.a:Started 2024-04-16T15:53:04.574 DEBUG:teuthology.parallel:result is None 2024-04-16T15:53:04.574 INFO:tasks.ceph.mds.c:Started 2024-04-16T15:53:04.574 DEBUG:teuthology.parallel:result is None 2024-04-16T15:53:04.577 INFO:tasks.ceph.mds.d:Started 2024-04-16T15:53:04.577 DEBUG:teuthology.parallel:result is None 2024-04-16T15:53:04.658 INFO:tasks.ceph.mds.a.smithi132.stdout:starting mds.a at 2024-04-16T15:53:04.659 INFO:tasks.ceph.mds.c.smithi132.stdout:starting mds.c at 2024-04-16T15:53:04.669 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2024-04-16T15:53:07.921 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-04-16T15:53:10.534 INFO:tasks.ceph.mds.b:Stopped 2024-04-16T15:53:10.534 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-16T15:53:10.537 INFO:tasks.ceph.mds.b:Started 2024-04-16T15:53:10.537 DEBUG:teuthology.parallel:result is None 2024-04-16T15:53:10.537 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-16T15:53:10.625 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2024-04-16T15:53:10.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.657+0000 7f859fe28640 1 Processor -- start 2024-04-16T15:53:10.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.657+0000 7f859fe28640 1 -- start start 2024-04-16T15:53:10.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.658+0000 7f859fe28640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8598145f00 0x7f85980b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:10.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.658+0000 7f859fe28640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f85981462e0 0x7f859806ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:10.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.658+0000 7f859fe28640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8598160480 con 0x7f859806bf60 2024-04-16T15:53:10.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.658+0000 7f859fe28640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f8598160760 con 0x7f8598145f00 2024-04-16T15:53:10.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.658+0000 7f859fe28640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f8598160a40 con 0x7f85981462e0 2024-04-16T15:53:10.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.658+0000 7f859dbc4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8598145f00 0x7f85980b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:10.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.658+0000 7f859dbc4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8598145f00 0x7f85980b3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52658/0 (socket says 172.21.15.132:52658) 2024-04-16T15:53:10.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.658+0000 7f859dbc4640 1 -- 172.21.15.132:0/192499748 learned_addr learned my addr 172.21.15.132:0/192499748 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:10.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.658+0000 7f859dbc4640 1 -- 172.21.15.132:0/192499748 >> v2:172.21.15.179:3300/0 conn(0x7f85981462e0 msgr2=0x7f859806ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:10.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.658+0000 7f859dbc4640 1 --2- 172.21.15.132:0/192499748 >> v2:172.21.15.179:3300/0 conn(0x7f85981462e0 0x7f859806ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:10.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.658+0000 7f859dbc4640 1 -- 172.21.15.132:0/192499748 >> v1:172.21.15.179:6789/0 conn(0x7f859806bf60 legacy=0x7f85980cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:10.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.658+0000 7f859dbc4640 1 -- 172.21.15.132:0/192499748 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8598160d20 con 0x7f8598145f00 2024-04-16T15:53:10.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.659+0000 7f859dbc4640 1 --2- 172.21.15.132:0/192499748 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8598145f00 0x7f85980b3d60 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f859806caa0 tx=0x7f859402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef5cdbc73552242f server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:10.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.659+0000 7f859cbc2640 1 -- 172.21.15.132:0/192499748 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8594035020 con 0x7f8598145f00 2024-04-16T15:53:10.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.659+0000 7f859cbc2640 1 -- 172.21.15.132:0/192499748 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8594031870 con 0x7f8598145f00 2024-04-16T15:53:10.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.659+0000 7f859cbc2640 1 -- 172.21.15.132:0/192499748 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8594031c40 con 0x7f8598145f00 2024-04-16T15:53:10.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.660+0000 7f859fe28640 1 -- 172.21.15.132:0/192499748 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8598145f00 msgr2=0x7f85980b3d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:10.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.660+0000 7f859fe28640 1 --2- 172.21.15.132:0/192499748 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8598145f00 0x7f85980b3d60 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f859806caa0 tx=0x7f859402b910 comp rx=0 tx=0).stop 2024-04-16T15:53:10.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.660+0000 7f859fe28640 1 -- 172.21.15.132:0/192499748 shutdown_connections 2024-04-16T15:53:10.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.660+0000 7f859fe28640 1 --2- 172.21.15.132:0/192499748 >> v2:172.21.15.179:3300/0 conn(0x7f85981462e0 0x7f859806ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:10.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.660+0000 7f859fe28640 1 --2- 172.21.15.132:0/192499748 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8598145f00 0x7f85980b3d60 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:10.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.660+0000 7f859fe28640 1 -- 172.21.15.132:0/192499748 >> 172.21.15.132:0/192499748 conn(0x7f8598067ff0 msgr2=0x7f85980b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:10.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.660+0000 7f859fe28640 1 -- 172.21.15.132:0/192499748 shutdown_connections 2024-04-16T15:53:10.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.660+0000 7f859fe28640 1 -- 172.21.15.132:0/192499748 wait complete. 2024-04-16T15:53:10.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.661+0000 7f859fe28640 1 Processor -- start 2024-04-16T15:53:10.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.661+0000 7f859fe28640 1 -- start start 2024-04-16T15:53:10.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.662+0000 7f859fe28640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f859806bf60 0x7f859813b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:10.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.662+0000 7f859fe28640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8598145f00 0x7f8598141400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:10.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.662+0000 7f859fe28640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85981462e0 0x7f859815c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:10.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.662+0000 7f859fe28640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f85980cffb0 con 0x7f8598145f00 2024-04-16T15:53:10.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.662+0000 7f859fe28640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f85980cfe30 con 0x7f859806bf60 2024-04-16T15:53:10.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.662+0000 7f859fe28640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f85980d0130 con 0x7f85981462e0 2024-04-16T15:53:10.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.662+0000 7f859d3c3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8598145f00 0x7f8598141400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:10.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.662+0000 7f859d3c3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8598145f00 0x7f8598141400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52666/0 (socket says 172.21.15.132:52666) 2024-04-16T15:53:10.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.662+0000 7f859d3c3640 1 -- 172.21.15.132:0/230684138 learned_addr learned my addr 172.21.15.132:0/230684138 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:10.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.662+0000 7f859e3c5640 1 --2- 172.21.15.132:0/230684138 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85981462e0 0x7f859815c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:10.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.662+0000 7f859dbc4640 1 --2- 172.21.15.132:0/230684138 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f859806bf60 0x7f859813b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:10.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.662+0000 7f859d3c3640 1 -- 172.21.15.132:0/230684138 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85981462e0 msgr2=0x7f859815c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:10.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.662+0000 7f859d3c3640 1 --2- 172.21.15.132:0/230684138 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85981462e0 0x7f859815c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:10.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.662+0000 7f859d3c3640 1 -- 172.21.15.132:0/230684138 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f859806bf60 msgr2=0x7f859813b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:10.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.662+0000 7f859d3c3640 1 --2- 172.21.15.132:0/230684138 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f859806bf60 0x7f859813b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:10.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.662+0000 7f859d3c3640 1 -- 172.21.15.132:0/230684138 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8598141940 con 0x7f8598145f00 2024-04-16T15:53:10.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.662+0000 7f859e3c5640 1 --2- 172.21.15.132:0/230684138 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85981462e0 0x7f859815c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:53:10.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.662+0000 7f859dbc4640 1 --2- 172.21.15.132:0/230684138 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f859806bf60 0x7f859813b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:53:10.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.662+0000 7f859d3c3640 1 --2- 172.21.15.132:0/230684138 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8598145f00 0x7f8598141400 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f858800b410 tx=0x7f858800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:10.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.662+0000 7f858e7fc640 1 -- 172.21.15.132:0/230684138 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8588015020 con 0x7f8598145f00 2024-04-16T15:53:10.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.662+0000 7f858e7fc640 1 -- 172.21.15.132:0/230684138 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8588011850 con 0x7f8598145f00 2024-04-16T15:53:10.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.662+0000 7f859fe28640 1 -- 172.21.15.132:0/230684138 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f859813b720 con 0x7f8598145f00 2024-04-16T15:53:10.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.663+0000 7f858e7fc640 1 -- 172.21.15.132:0/230684138 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8588011c40 con 0x7f8598145f00 2024-04-16T15:53:10.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.663+0000 7f859fe28640 1 -- 172.21.15.132:0/230684138 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f859813bfc0 con 0x7f8598145f00 2024-04-16T15:53:10.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.664+0000 7f859fe28640 1 -- 172.21.15.132:0/230684138 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8598075510 con 0x7f8598145f00 2024-04-16T15:53:10.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.664+0000 7f858e7fc640 1 -- 172.21.15.132:0/230684138 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8588018020 con 0x7f8598145f00 2024-04-16T15:53:10.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.664+0000 7f858e7fc640 1 --2- 172.21.15.132:0/230684138 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f857c06c8f0 0x7f857c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:10.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.665+0000 7f858e7fc640 1 -- 172.21.15.132:0/230684138 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4943+0+0 (secure 0 0 0) 0x7f858808b6f0 con 0x7f8598145f00 2024-04-16T15:53:10.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.665+0000 7f859dbc4640 1 --2- 172.21.15.132:0/230684138 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f857c06c8f0 0x7f857c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:10.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.665+0000 7f859dbc4640 1 --2- 172.21.15.132:0/230684138 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f857c06c8f0 0x7f857c06edb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8594036000 tx=0x7f859403c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:10.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.669+0000 7f858e7fc640 1 -- 172.21.15.132:0/230684138 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f858801f020 con 0x7f8598145f00 2024-04-16T15:53:10.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:10.853+0000 7f859fe28640 1 -- 172.21.15.132:0/230684138 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f85980008d0 con 0x7f8598145f00 2024-04-16T15:53:12.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.527+0000 7f858e7fc640 1 -- 172.21.15.132:0/230684138 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v30) ==== 97+0+0 (secure 0 0 0) 0x7f8598141940 con 0x7f8598145f00 2024-04-16T15:53:12.526 INFO:teuthology.orchestra.run.smithi132.stderr: removed all blocklist entries 2024-04-16T15:53:12.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.530+0000 7f859fe28640 1 -- 172.21.15.132:0/230684138 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f857c06c8f0 msgr2=0x7f857c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:12.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.530+0000 7f859fe28640 1 --2- 172.21.15.132:0/230684138 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f857c06c8f0 0x7f857c06edb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8594036000 tx=0x7f859403c040 comp rx=0 tx=0).stop 2024-04-16T15:53:12.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.530+0000 7f859fe28640 1 -- 172.21.15.132:0/230684138 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8598145f00 msgr2=0x7f8598141400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:12.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.530+0000 7f859fe28640 1 --2- 172.21.15.132:0/230684138 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8598145f00 0x7f8598141400 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f858800b410 tx=0x7f858800b8d0 comp rx=0 tx=0).stop 2024-04-16T15:53:12.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.530+0000 7f859fe28640 1 -- 172.21.15.132:0/230684138 shutdown_connections 2024-04-16T15:53:12.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.530+0000 7f859fe28640 1 --2- 172.21.15.132:0/230684138 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f857c06c8f0 0x7f857c06edb0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:12.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.530+0000 7f859fe28640 1 --2- 172.21.15.132:0/230684138 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85981462e0 0x7f859815c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:12.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.530+0000 7f859fe28640 1 --2- 172.21.15.132:0/230684138 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8598145f00 0x7f8598141400 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:12.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.530+0000 7f859fe28640 1 --2- 172.21.15.132:0/230684138 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f859806bf60 0x7f859813b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:12.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.530+0000 7f859fe28640 1 -- 172.21.15.132:0/230684138 >> 172.21.15.132:0/230684138 conn(0x7f8598067ff0 msgr2=0x7f85980b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:12.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.530+0000 7f859fe28640 1 -- 172.21.15.132:0/230684138 shutdown_connections 2024-04-16T15:53:12.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.530+0000 7f859fe28640 1 -- 172.21.15.132:0/230684138 wait complete. 2024-04-16T15:53:12.543 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-16T15:53:12.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.652+0000 7f740498d640 1 Processor -- start 2024-04-16T15:53:12.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.652+0000 7f740498d640 1 -- start start 2024-04-16T15:53:12.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.653+0000 7f740498d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7400145eb0 0x7f74000b0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:12.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.653+0000 7f740498d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f74000b5da0 0x7f74000b61f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:12.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.653+0000 7f740498d640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74000ae6a0 con 0x7f7400146290 2024-04-16T15:53:12.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.653+0000 7f740498d640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f74000b6730 con 0x7f74000b5da0 2024-04-16T15:53:12.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.653+0000 7f740498d640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f740015d7f0 con 0x7f7400145eb0 2024-04-16T15:53:12.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.653+0000 7f73fed9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f74000b5da0 0x7f74000b61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:12.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.653+0000 7f73f7fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f7400146290 0x7f740015ccc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:38876/0 (socket says 172.21.15.132:38876) 2024-04-16T15:53:12.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.653+0000 7f73f7fff640 1 -- 172.21.15.132:0/2282530502 learned_addr learned my addr 172.21.15.132:0/2282530502 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:53:12.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.653+0000 7f73fe59c640 1 --2- 172.21.15.132:0/2282530502 >> v2:172.21.15.179:3300/0 conn(0x7f7400145eb0 0x7f74000b0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:12.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.653+0000 7f73fdd9b640 1 -- 172.21.15.132:0/2282530502 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 329332602 0 0) 0x7f74000ae6a0 con 0x7f7400146290 2024-04-16T15:53:12.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.653+0000 7f73fdd9b640 1 -- 172.21.15.132:0/2282530502 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f73ec003520 con 0x7f7400146290 2024-04-16T15:53:12.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.654+0000 7f73fed9d640 1 -- 172.21.15.132:0/2282530502 >> v2:172.21.15.179:3300/0 conn(0x7f7400145eb0 msgr2=0x7f74000b0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:12.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.654+0000 7f73fed9d640 1 --2- 172.21.15.132:0/2282530502 >> v2:172.21.15.179:3300/0 conn(0x7f7400145eb0 0x7f74000b0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:12.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.654+0000 7f73fed9d640 1 -- 172.21.15.132:0/2282530502 >> v1:172.21.15.132:6789/0 conn(0x7f7400146290 legacy=0x7f740015ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:12.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.654+0000 7f73fed9d640 1 -- 172.21.15.132:0/2282530502 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f740015dad0 con 0x7f74000b5da0 2024-04-16T15:53:12.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.654+0000 7f73fdd9b640 1 -- 172.21.15.132:0/2282530502 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1762955650 0 0) 0x7f73ec003520 con 0x7f7400146290 2024-04-16T15:53:12.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.655+0000 7f73fed9d640 1 --2- 172.21.15.132:0/2282530502 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74000b5da0 0x7f74000b61f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f7400073f00 tx=0x7f73f802bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a012c97de28c2829 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:12.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.655+0000 7f73fdd9b640 1 -- 172.21.15.132:0/2282530502 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f8039070 con 0x7f74000b5da0 2024-04-16T15:53:12.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.655+0000 7f73fdd9b640 1 -- 172.21.15.132:0/2282530502 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73f802c8c0 con 0x7f74000b5da0 2024-04-16T15:53:12.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.655+0000 7f73fdd9b640 1 -- 172.21.15.132:0/2282530502 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73e8001670 con 0x7f74000b5da0 2024-04-16T15:53:12.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.655+0000 7f740498d640 1 -- 172.21.15.132:0/2282530502 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74000b5da0 msgr2=0x7f74000b61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:12.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.655+0000 7f740498d640 1 --2- 172.21.15.132:0/2282530502 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74000b5da0 0x7f74000b61f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f7400073f00 tx=0x7f73f802bd90 comp rx=0 tx=0).stop 2024-04-16T15:53:12.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.655+0000 7f740498d640 1 -- 172.21.15.132:0/2282530502 shutdown_connections 2024-04-16T15:53:12.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.655+0000 7f740498d640 1 --2- 172.21.15.132:0/2282530502 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74000b5da0 0x7f74000b61f0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:12.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.655+0000 7f740498d640 1 --2- 172.21.15.132:0/2282530502 >> v2:172.21.15.179:3300/0 conn(0x7f7400145eb0 0x7f74000b0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:12.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.655+0000 7f740498d640 1 -- 172.21.15.132:0/2282530502 >> 172.21.15.132:0/2282530502 conn(0x7f740009aa30 msgr2=0x7f74000b6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:12.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.655+0000 7f740498d640 1 -- 172.21.15.132:0/2282530502 shutdown_connections 2024-04-16T15:53:12.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.656+0000 7f740498d640 1 -- 172.21.15.132:0/2282530502 wait complete. 2024-04-16T15:53:12.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.657+0000 7f740498d640 1 Processor -- start 2024-04-16T15:53:12.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.657+0000 7f740498d640 1 -- start start 2024-04-16T15:53:12.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.658+0000 7f740498d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74000b5da0 0x7f7400157380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:12.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.658+0000 7f740498d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7400145eb0 0x7f740015ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:12.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.658+0000 7f740498d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7400146290 0x7f74001f2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:12.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.658+0000 7f740498d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f74000b0dc0 con 0x7f7400146290 2024-04-16T15:53:12.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.658+0000 7f740498d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f74000b0360 con 0x7f74000b5da0 2024-04-16T15:53:12.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.658+0000 7f740498d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f74000afd70 con 0x7f7400145eb0 2024-04-16T15:53:12.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.658+0000 7f73fed9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7400146290 0x7f74001f2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:12.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.658+0000 7f73fed9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7400146290 0x7f74001f2340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57218/0 (socket says 172.21.15.132:57218) 2024-04-16T15:53:12.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.658+0000 7f73fed9d640 1 -- 172.21.15.132:0/2302193511 learned_addr learned my addr 172.21.15.132:0/2302193511 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:12.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.658+0000 7f73fe59c640 1 --2- 172.21.15.132:0/2302193511 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74000b5da0 0x7f7400157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:12.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.658+0000 7f73f7fff640 1 --2- 172.21.15.132:0/2302193511 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7400145eb0 0x7f740015ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:12.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.658+0000 7f73fed9d640 1 -- 172.21.15.132:0/2302193511 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7400145eb0 msgr2=0x7f740015ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:12.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.658+0000 7f73fed9d640 1 --2- 172.21.15.132:0/2302193511 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7400145eb0 0x7f740015ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:12.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.658+0000 7f73fed9d640 1 -- 172.21.15.132:0/2302193511 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74000b5da0 msgr2=0x7f7400157380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:12.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.658+0000 7f73fed9d640 1 --2- 172.21.15.132:0/2302193511 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74000b5da0 0x7f7400157380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:12.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.658+0000 7f73fed9d640 1 -- 172.21.15.132:0/2302193511 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7400158a00 con 0x7f7400146290 2024-04-16T15:53:12.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.658+0000 7f73fed9d640 1 --2- 172.21.15.132:0/2302193511 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7400146290 0x7f74001f2340 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f73f8009e80 tx=0x7f73f8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:12.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.658+0000 7f73f6ffd640 1 -- 172.21.15.132:0/2302193511 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f8039050 con 0x7f7400146290 2024-04-16T15:53:12.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.658+0000 7f73f6ffd640 1 -- 172.21.15.132:0/2302193511 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73f8045070 con 0x7f7400146290 2024-04-16T15:53:12.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.658+0000 7f740498d640 1 -- 172.21.15.132:0/2302193511 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7400157960 con 0x7f7400146290 2024-04-16T15:53:12.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.658+0000 7f73f6ffd640 1 -- 172.21.15.132:0/2302193511 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f8009450 con 0x7f7400146290 2024-04-16T15:53:12.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.658+0000 7f740498d640 1 -- 172.21.15.132:0/2302193511 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7400157f20 con 0x7f7400146290 2024-04-16T15:53:12.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.660+0000 7f740498d640 1 -- 172.21.15.132:0/2302193511 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7400075510 con 0x7f7400146290 2024-04-16T15:53:12.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.660+0000 7f73f6ffd640 1 -- 172.21.15.132:0/2302193511 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f73f8040690 con 0x7f7400146290 2024-04-16T15:53:12.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.660+0000 7f73f6ffd640 1 --2- 172.21.15.132:0/2302193511 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f73e006c8f0 0x7f73e006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:12.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.660+0000 7f73f6ffd640 1 -- 172.21.15.132:0/2302193511 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f73f80ae040 con 0x7f7400146290 2024-04-16T15:53:12.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.660+0000 7f73fe59c640 1 --2- 172.21.15.132:0/2302193511 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f73e006c8f0 0x7f73e006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:12.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.661+0000 7f73fe59c640 1 --2- 172.21.15.132:0/2302193511 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f73e006c8f0 0x7f73e006edb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f74000b2870 tx=0x7f73f0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:12.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.665+0000 7f73f6ffd640 1 -- 172.21.15.132:0/2302193511 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f73f807c7c0 con 0x7f7400146290 2024-04-16T15:53:12.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.907+0000 7f740498d640 1 -- 172.21.15.132:0/2302193511 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f74000b55e0 con 0x7f7400146290 2024-04-16T15:53:12.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.908+0000 7f73f6ffd640 1 -- 172.21.15.132:0/2302193511 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) ==== 80+0+6645 (secure 0 0 0) 0x7f73f807c0c0 con 0x7f7400146290 2024-04-16T15:53:12.907 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:53:12.907 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-16T15:53:12.907 INFO:teuthology.orchestra.run.smithi132.stdout: "auth_dump": [ 2024-04-16T15:53:12.907 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-16T15:53:12.908 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.a", 2024-04-16T15:53:12.908 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQB1nh5mi1D3DBAAf/33QJ705Ty+AP6ukFTeYg==", 2024-04-16T15:53:12.908 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2024-04-16T15:53:12.908 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2024-04-16T15:53:12.908 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2024-04-16T15:53:12.908 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2024-04-16T15:53:12.908 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2024-04-16T15:53:12.908 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-16T15:53:12.908 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-16T15:53:12.908 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-16T15:53:12.908 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.b", 2024-04-16T15:53:12.908 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQB1nh5mDT3WGRAAWGCnSM2yO01pDPAXWL+adg==", 2024-04-16T15:53:12.908 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2024-04-16T15:53:12.908 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2024-04-16T15:53:12.909 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2024-04-16T15:53:12.909 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2024-04-16T15:53:12.909 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2024-04-16T15:53:12.909 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-16T15:53:12.909 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-16T15:53:12.909 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-16T15:53:12.909 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.c", 2024-04-16T15:53:12.909 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQB1nh5mY8eSFBAA0+GUx4mnmoq7FSYJ0MJYKA==", 2024-04-16T15:53:12.909 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2024-04-16T15:53:12.909 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2024-04-16T15:53:12.909 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2024-04-16T15:53:12.909 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2024-04-16T15:53:12.909 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2024-04-16T15:53:12.909 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-16T15:53:12.910 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-16T15:53:12.910 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-16T15:53:12.910 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.d", 2024-04-16T15:53:12.910 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQB1nh5mCZp5IRAAVzjp6ha9GVGviXhP1B5onQ==", 2024-04-16T15:53:12.910 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2024-04-16T15:53:12.910 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2024-04-16T15:53:12.910 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2024-04-16T15:53:12.910 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2024-04-16T15:53:12.910 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2024-04-16T15:53:12.910 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-16T15:53:12.910 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-16T15:53:12.910 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-16T15:53:12.910 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.0", 2024-04-16T15:53:12.911 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQB5nh5mkOesAxAAS1yb0DA/4s8+ROxvl9Mxow==", 2024-04-16T15:53:12.911 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2024-04-16T15:53:12.911 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2024-04-16T15:53:12.911 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2024-04-16T15:53:12.911 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2024-04-16T15:53:12.911 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-16T15:53:12.911 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-16T15:53:12.911 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-16T15:53:12.911 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.1", 2024-04-16T15:53:12.911 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQB8nh5mDyo0AhAARaIf6z33kpQR/jK5qRxpsw==", 2024-04-16T15:53:12.911 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2024-04-16T15:53:12.911 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2024-04-16T15:53:12.911 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2024-04-16T15:53:12.911 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2024-04-16T15:53:12.911 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-16T15:53:12.912 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-16T15:53:12.912 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-16T15:53:12.912 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.2", 2024-04-16T15:53:12.912 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQB/nh5mQGgFARAAlfLdq8GprK0dFOhY/kUPYA==", 2024-04-16T15:53:12.912 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2024-04-16T15:53:12.912 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2024-04-16T15:53:12.912 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2024-04-16T15:53:12.912 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2024-04-16T15:53:12.912 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-16T15:53:12.912 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-16T15:53:12.912 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-16T15:53:12.912 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.3", 2024-04-16T15:53:12.912 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCBnh5mZIxKOxAAjVmKVE6rOp/ER9jTSgZ3cQ==", 2024-04-16T15:53:12.912 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2024-04-16T15:53:12.913 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2024-04-16T15:53:12.913 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2024-04-16T15:53:12.913 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2024-04-16T15:53:12.913 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-16T15:53:12.913 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-16T15:53:12.913 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-16T15:53:12.913 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.4", 2024-04-16T15:53:12.913 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCInh5mP0pyCBAAGqZA4ARkCOquLuQnKTF9Hg==", 2024-04-16T15:53:12.913 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2024-04-16T15:53:12.913 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2024-04-16T15:53:12.913 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2024-04-16T15:53:12.913 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2024-04-16T15:53:12.913 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-16T15:53:12.913 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-16T15:53:12.913 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-16T15:53:12.914 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.5", 2024-04-16T15:53:12.914 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCLnh5mI/aNBxAAYcGFAsiApb/PUiVX0rw9gA==", 2024-04-16T15:53:12.914 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2024-04-16T15:53:12.914 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2024-04-16T15:53:12.914 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2024-04-16T15:53:12.914 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2024-04-16T15:53:12.914 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-16T15:53:12.914 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-16T15:53:12.914 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-16T15:53:12.914 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.6", 2024-04-16T15:53:12.914 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCOnh5mVzhcBhAAbODQ2u1KagQ13QJYHIYvOg==", 2024-04-16T15:53:12.914 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2024-04-16T15:53:12.914 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2024-04-16T15:53:12.914 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2024-04-16T15:53:12.915 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2024-04-16T15:53:12.915 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-16T15:53:12.915 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-16T15:53:12.915 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-16T15:53:12.915 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.7", 2024-04-16T15:53:12.915 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCRnh5mkWOZBRAAW0nhoapLwmcPmsJonher7A==", 2024-04-16T15:53:12.915 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2024-04-16T15:53:12.915 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2024-04-16T15:53:12.915 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2024-04-16T15:53:12.915 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2024-04-16T15:53:12.915 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-16T15:53:12.915 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-16T15:53:12.915 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-16T15:53:12.915 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.0", 2024-04-16T15:53:12.915 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQB1nh5msfL1JRAAxfWBGq3EmoGhFqhZir0xkg==", 2024-04-16T15:53:12.916 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2024-04-16T15:53:12.916 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2024-04-16T15:53:12.916 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow r", 2024-04-16T15:53:12.916 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow rw", 2024-04-16T15:53:12.916 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rwx" 2024-04-16T15:53:12.916 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-16T15:53:12.916 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-16T15:53:12.916 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-16T15:53:12.916 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.1", 2024-04-16T15:53:12.916 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQB1nh5mIqoZLRAArGq3U7+ErEFogizPylN0Gw==", 2024-04-16T15:53:12.916 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2024-04-16T15:53:12.916 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2024-04-16T15:53:12.916 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow r", 2024-04-16T15:53:12.917 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow rw", 2024-04-16T15:53:12.917 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rwx" 2024-04-16T15:53:12.917 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-16T15:53:12.917 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-16T15:53:12.917 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-16T15:53:12.917 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.2", 2024-04-16T15:53:12.917 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQB1nh5mJ+95KRAA+3ImUsvR4WGoKBTGTdJPfg==", 2024-04-16T15:53:12.917 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2024-04-16T15:53:12.917 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2024-04-16T15:53:12.917 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow r", 2024-04-16T15:53:12.917 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow rw", 2024-04-16T15:53:12.918 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rwx" 2024-04-16T15:53:12.918 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-16T15:53:12.918 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-16T15:53:12.918 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-16T15:53:12.918 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.3", 2024-04-16T15:53:12.918 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQB1nh5mbcOnMBAAs21wgcHB1TA3s70gs6Svrw==", 2024-04-16T15:53:12.918 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2024-04-16T15:53:12.918 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2024-04-16T15:53:12.918 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow r", 2024-04-16T15:53:12.918 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow rw", 2024-04-16T15:53:12.918 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rwx" 2024-04-16T15:53:12.918 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-16T15:53:12.918 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-16T15:53:12.918 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-16T15:53:12.919 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.admin", 2024-04-16T15:53:12.919 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQB0nh5mLgCmKhAAGp5hI9kAvpMHYWo1Ng8oog==", 2024-04-16T15:53:12.919 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2024-04-16T15:53:12.919 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow *", 2024-04-16T15:53:12.919 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2024-04-16T15:53:12.919 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2024-04-16T15:53:12.919 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2024-04-16T15:53:12.919 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-16T15:53:12.919 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-16T15:53:12.919 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-16T15:53:12.919 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.bootstrap-mds", 2024-04-16T15:53:12.919 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCXnh5mYO9gBBAA2RTEbF4pSf+uzlsw4uXleg==", 2024-04-16T15:53:12.919 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2024-04-16T15:53:12.919 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile bootstrap-mds" 2024-04-16T15:53:12.919 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-16T15:53:12.920 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-16T15:53:12.920 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-16T15:53:12.920 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.bootstrap-mgr", 2024-04-16T15:53:12.920 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCXnh5mvfZgBBAAcUvu2daoAukIqPVs+YnCdg==", 2024-04-16T15:53:12.920 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2024-04-16T15:53:12.920 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile bootstrap-mgr" 2024-04-16T15:53:12.920 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-16T15:53:12.920 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-16T15:53:12.920 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-16T15:53:12.920 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.bootstrap-osd", 2024-04-16T15:53:12.920 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCXnh5mXf1gBBAAayUXnoPpby1fYLPRGhU7aw==", 2024-04-16T15:53:12.920 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2024-04-16T15:53:12.921 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile bootstrap-osd" 2024-04-16T15:53:12.921 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-16T15:53:12.921 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-16T15:53:12.921 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-16T15:53:12.921 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.bootstrap-rbd", 2024-04-16T15:53:12.921 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCXnh5m4QNhBBAAd5oSx0Vnzxsd26xCFIfgtg==", 2024-04-16T15:53:12.921 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2024-04-16T15:53:12.921 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile bootstrap-rbd" 2024-04-16T15:53:12.921 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-16T15:53:12.921 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-16T15:53:12.921 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-16T15:53:12.922 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-04-16T15:53:12.922 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCXnh5mcQthBBAAJEoTg6rI3tZ6n7t9vBs/Sw==", 2024-04-16T15:53:12.922 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2024-04-16T15:53:12.922 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-04-16T15:53:12.922 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-16T15:53:12.922 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-16T15:53:12.922 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-16T15:53:12.922 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.bootstrap-rgw", 2024-04-16T15:53:12.922 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCXnh5mQRJhBBAAL20md5SNXGoKRyCAJLVfHw==", 2024-04-16T15:53:12.922 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2024-04-16T15:53:12.922 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile bootstrap-rgw" 2024-04-16T15:53:12.922 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-16T15:53:12.922 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-16T15:53:12.923 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-16T15:53:12.923 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mgr.x", 2024-04-16T15:53:12.923 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQB1nh5m3dZfCRAAoZETk5BYerNva+hZ6FnL3Q==", 2024-04-16T15:53:12.923 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2024-04-16T15:53:12.923 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow *", 2024-04-16T15:53:12.923 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile mgr", 2024-04-16T15:53:12.923 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2024-04-16T15:53:12.923 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-16T15:53:12.923 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-16T15:53:12.923 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-16T15:53:12.923 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mgr.y", 2024-04-16T15:53:12.924 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQB1nh5m5bbkBBAAMJ/gX/XrGsyyODIhrFu+vw==", 2024-04-16T15:53:12.924 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2024-04-16T15:53:12.924 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow *", 2024-04-16T15:53:12.924 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile mgr", 2024-04-16T15:53:12.924 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2024-04-16T15:53:12.924 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-16T15:53:12.924 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-16T15:53:12.925 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-16T15:53:12.925 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-16T15:53:12.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.910+0000 7f740498d640 1 -- 172.21.15.132:0/2302193511 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f73e006c8f0 msgr2=0x7f73e006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:12.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.910+0000 7f740498d640 1 --2- 172.21.15.132:0/2302193511 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f73e006c8f0 0x7f73e006edb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f74000b2870 tx=0x7f73f0008040 comp rx=0 tx=0).stop 2024-04-16T15:53:12.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.910+0000 7f740498d640 1 -- 172.21.15.132:0/2302193511 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7400146290 msgr2=0x7f74001f2340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:12.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.910+0000 7f740498d640 1 --2- 172.21.15.132:0/2302193511 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7400146290 0x7f74001f2340 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f73f8009e80 tx=0x7f73f8004a40 comp rx=0 tx=0).stop 2024-04-16T15:53:12.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.910+0000 7f740498d640 1 -- 172.21.15.132:0/2302193511 shutdown_connections 2024-04-16T15:53:12.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.910+0000 7f740498d640 1 --2- 172.21.15.132:0/2302193511 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f73e006c8f0 0x7f73e006edb0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:12.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.910+0000 7f740498d640 1 --2- 172.21.15.132:0/2302193511 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7400146290 0x7f74001f2340 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:12.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.910+0000 7f740498d640 1 --2- 172.21.15.132:0/2302193511 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7400145eb0 0x7f740015ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:12.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.910+0000 7f740498d640 1 --2- 172.21.15.132:0/2302193511 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74000b5da0 0x7f7400157380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:12.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.910+0000 7f740498d640 1 -- 172.21.15.132:0/2302193511 >> 172.21.15.132:0/2302193511 conn(0x7f740009aa30 msgr2=0x7f74000b1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:12.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.910+0000 7f740498d640 1 -- 172.21.15.132:0/2302193511 shutdown_connections 2024-04-16T15:53:12.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:12.910+0000 7f740498d640 1 -- 172.21.15.132:0/2302193511 wait complete. 2024-04-16T15:53:12.929 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-04-16T15:53:13.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.034+0000 7f967c9b5640 1 Processor -- start 2024-04-16T15:53:13.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.034+0000 7f967c9b5640 1 -- start start 2024-04-16T15:53:13.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.035+0000 7f967c9b5640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9678162080 0x7f96780d1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:13.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.035+0000 7f967c9b5640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9678162780 con 0x7f96780ba2a0 2024-04-16T15:53:13.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.035+0000 7f967c9b5640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9678162a60 con 0x7f96780cfdf0 2024-04-16T15:53:13.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.035+0000 7f967c9b5640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f9678162d40 con 0x7f9678162080 2024-04-16T15:53:13.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.035+0000 7f9675d9b640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f96780ba2a0 0x7f96780cf6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:38882/0 (socket says 172.21.15.132:38882) 2024-04-16T15:53:13.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.035+0000 7f9675d9b640 1 -- 172.21.15.132:0/2122210920 learned_addr learned my addr 172.21.15.132:0/2122210920 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:53:13.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.035+0000 7f967559a640 1 -- 172.21.15.132:0/2122210920 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1609097883 0 0) 0x7f9678162780 con 0x7f96780ba2a0 2024-04-16T15:53:13.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.035+0000 7f967659c640 1 --2- 172.21.15.132:0/2122210920 >> v2:172.21.15.179:3300/0 conn(0x7f9678162080 0x7f96780d1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:13.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.035+0000 7f967559a640 1 -- 172.21.15.132:0/2122210920 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9664003520 con 0x7f96780ba2a0 2024-04-16T15:53:13.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.035+0000 7f967559a640 1 -- 172.21.15.132:0/2122210920 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2990903356 0 0) 0x7f9664003520 con 0x7f96780ba2a0 2024-04-16T15:53:13.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.035+0000 7f967559a640 1 -- 172.21.15.132:0/2122210920 >> v2:172.21.15.179:3300/0 conn(0x7f9678162080 msgr2=0x7f96780d1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:13.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.035+0000 7f967559a640 1 --2- 172.21.15.132:0/2122210920 >> v2:172.21.15.179:3300/0 conn(0x7f9678162080 0x7f96780d1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:13.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.035+0000 7f967559a640 1 -- 172.21.15.132:0/2122210920 >> v1:172.21.15.179:6789/0 conn(0x7f96780cfdf0 legacy=0x7f96780d2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:13.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.035+0000 7f967559a640 1 -- 172.21.15.132:0/2122210920 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9678163020 con 0x7f96780ba2a0 2024-04-16T15:53:13.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.035+0000 7f967559a640 1 -- 172.21.15.132:0/2122210920 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2803668828 0 0) 0x7f9660001670 con 0x7f96780ba2a0 2024-04-16T15:53:13.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.035+0000 7f967559a640 1 -- 172.21.15.132:0/2122210920 >> v1:172.21.15.132:6789/0 conn(0x7f96780ba2a0 legacy=0x7f96780cf6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:13.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.035+0000 7f967559a640 1 --2- 172.21.15.132:0/2122210920 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f96640039b0 0x7f9664003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:13.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.035+0000 7f967559a640 1 --2- 172.21.15.132:0/2122210920 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9664004800 0x7f9664004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:13.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.035+0000 7f967559a640 1 --2- 172.21.15.132:0/2122210920 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f96640051c0 0x7f966400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:13.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.035+0000 7f967559a640 1 -- 172.21.15.132:0/2122210920 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f9678162d40 con 0x7f9664004800 2024-04-16T15:53:13.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.035+0000 7f967559a640 1 -- 172.21.15.132:0/2122210920 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f966400c060 con 0x7f96640051c0 2024-04-16T15:53:13.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.035+0000 7f967559a640 1 -- 172.21.15.132:0/2122210920 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f966400c260 con 0x7f96640039b0 2024-04-16T15:53:13.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.036+0000 7f9675d9b640 1 --2- 172.21.15.132:0/2122210920 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9664004800 0x7f9664004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:13.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.036+0000 7f967659c640 1 --2- 172.21.15.132:0/2122210920 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f96640039b0 0x7f9664003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:13.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.036+0000 7f9676d9d640 1 --2- 172.21.15.132:0/2122210920 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f96640051c0 0x7f966400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:13.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.036+0000 7f9675d9b640 1 -- 172.21.15.132:0/2122210920 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f96640039b0 msgr2=0x7f9664003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:13.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.036+0000 7f9675d9b640 1 --2- 172.21.15.132:0/2122210920 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f96640039b0 0x7f9664003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:13.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.036+0000 7f9675d9b640 1 -- 172.21.15.132:0/2122210920 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f96640051c0 msgr2=0x7f966400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:13.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.036+0000 7f9675d9b640 1 --2- 172.21.15.132:0/2122210920 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f96640051c0 0x7f966400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:13.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.036+0000 7f9676d9d640 1 -- 172.21.15.132:0/2122210920 reap_dead start 2024-04-16T15:53:13.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.036+0000 7f9675d9b640 1 -- 172.21.15.132:0/2122210920 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9664003520 con 0x7f9664004800 2024-04-16T15:53:13.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.036+0000 7f9675d9b640 1 --2- 172.21.15.132:0/2122210920 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9664004800 0x7f9664004c80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f966000c240 tx=0x7f9664005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d3f13317b0fa986 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:13.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.037+0000 7f967559a640 1 -- 172.21.15.132:0/2122210920 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9660007d10 con 0x7f9664004800 2024-04-16T15:53:13.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.037+0000 7f967559a640 1 -- 172.21.15.132:0/2122210920 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9660030070 con 0x7f9664004800 2024-04-16T15:53:13.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.037+0000 7f967559a640 1 -- 172.21.15.132:0/2122210920 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f966002cda0 con 0x7f9664004800 2024-04-16T15:53:13.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.037+0000 7f967c9b5640 1 -- 172.21.15.132:0/2122210920 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9664004800 msgr2=0x7f9664004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:13.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.037+0000 7f967c9b5640 1 --2- 172.21.15.132:0/2122210920 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9664004800 0x7f9664004c80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f966000c240 tx=0x7f9664005830 comp rx=0 tx=0).stop 2024-04-16T15:53:13.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.037+0000 7f967c9b5640 1 -- 172.21.15.132:0/2122210920 shutdown_connections 2024-04-16T15:53:13.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.037+0000 7f967c9b5640 1 --2- 172.21.15.132:0/2122210920 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9664004800 0x7f9664004c80 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:13.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.037+0000 7f967c9b5640 1 -- 172.21.15.132:0/2122210920 >> 172.21.15.132:0/2122210920 conn(0x7f967806cea0 msgr2=0x7f967806d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:13.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.037+0000 7f967c9b5640 1 -- 172.21.15.132:0/2122210920 shutdown_connections 2024-04-16T15:53:13.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.037+0000 7f967c9b5640 1 -- 172.21.15.132:0/2122210920 wait complete. 2024-04-16T15:53:13.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.039+0000 7f967c9b5640 1 Processor -- start 2024-04-16T15:53:13.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.039+0000 7f967c9b5640 1 -- start start 2024-04-16T15:53:13.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.039+0000 7f967c9b5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9664004800 0x7f96781580e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:13.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.039+0000 7f967c9b5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9678152460 0x7f9678154380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:13.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.039+0000 7f967c9b5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9678152860 0x7f96780b7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:13.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.039+0000 7f967c9b5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f96780b7ab0 con 0x7f9678152460 2024-04-16T15:53:13.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.039+0000 7f967c9b5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f96781635e0 con 0x7f9678152860 2024-04-16T15:53:13.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.039+0000 7f967c9b5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9678162460 con 0x7f9664004800 2024-04-16T15:53:13.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.039+0000 7f9675d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9678152460 0x7f9678154380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:13.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.039+0000 7f9675d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9678152460 0x7f9678154380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57242/0 (socket says 172.21.15.132:57242) 2024-04-16T15:53:13.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.039+0000 7f9675d9b640 1 -- 172.21.15.132:0/3566453537 learned_addr learned my addr 172.21.15.132:0/3566453537 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:13.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.040+0000 7f967659c640 1 --2- 172.21.15.132:0/3566453537 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9664004800 0x7f96781580e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:13.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.040+0000 7f9676d9d640 1 --2- 172.21.15.132:0/3566453537 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9678152860 0x7f96780b7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:13.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.040+0000 7f9675d9b640 1 -- 172.21.15.132:0/3566453537 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9664004800 msgr2=0x7f96781580e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:13.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.040+0000 7f9675d9b640 1 --2- 172.21.15.132:0/3566453537 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9664004800 0x7f96781580e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:13.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.040+0000 7f9675d9b640 1 -- 172.21.15.132:0/3566453537 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9678152860 msgr2=0x7f96780b7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:13.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.040+0000 7f9675d9b640 1 --2- 172.21.15.132:0/3566453537 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9678152860 0x7f96780b7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:13.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.040+0000 7f9675d9b640 1 -- 172.21.15.132:0/3566453537 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9678154bb0 con 0x7f9678152460 2024-04-16T15:53:13.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.040+0000 7f967659c640 1 --2- 172.21.15.132:0/3566453537 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9664004800 0x7f96781580e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:53:13.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.040+0000 7f9676d9d640 1 --2- 172.21.15.132:0/3566453537 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9678152860 0x7f96780b7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:53:13.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.040+0000 7f9675d9b640 1 --2- 172.21.15.132:0/3566453537 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9678152460 0x7f9678154380 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f966000c360 tx=0x7f966002e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:13.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.040+0000 7f966effd640 1 -- 172.21.15.132:0/3566453537 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9660007d10 con 0x7f9678152460 2024-04-16T15:53:13.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.040+0000 7f966effd640 1 -- 172.21.15.132:0/3566453537 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9660004bf0 con 0x7f9678152460 2024-04-16T15:53:13.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.040+0000 7f967c9b5640 1 -- 172.21.15.132:0/3566453537 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9678154e90 con 0x7f9678152460 2024-04-16T15:53:13.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.040+0000 7f966effd640 1 -- 172.21.15.132:0/3566453537 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9660007070 con 0x7f9678152460 2024-04-16T15:53:13.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.040+0000 7f967c9b5640 1 -- 172.21.15.132:0/3566453537 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9678155660 con 0x7f9678152460 2024-04-16T15:53:13.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.041+0000 7f967c9b5640 1 -- 172.21.15.132:0/3566453537 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9678073c80 con 0x7f9678152460 2024-04-16T15:53:13.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.041+0000 7f966effd640 1 -- 172.21.15.132:0/3566453537 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9660048020 con 0x7f9678152460 2024-04-16T15:53:13.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.042+0000 7f966effd640 1 --2- 172.21.15.132:0/3566453537 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f965806c920 0x7f965806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:13.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.042+0000 7f966effd640 1 -- 172.21.15.132:0/3566453537 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f96600acc60 con 0x7f9678152460 2024-04-16T15:53:13.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.042+0000 7f967659c640 1 --2- 172.21.15.132:0/3566453537 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f965806c920 0x7f965806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:13.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.042+0000 7f967659c640 1 --2- 172.21.15.132:0/3566453537 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f965806c920 0x7f965806ede0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9678069150 tx=0x7f966800b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:13.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.046+0000 7f966effd640 1 -- 172.21.15.132:0/3566453537 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9678073c80 con 0x7f9678152460 2024-04-16T15:53:13.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.287+0000 7f967c9b5640 1 -- 172.21.15.132:0/3566453537 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f9678075510 con 0x7f9678152460 2024-04-16T15:53:13.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.289+0000 7f966effd640 1 -- 172.21.15.132:0/3566453537 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7f966007b470 con 0x7f9678152460 2024-04-16T15:53:13.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.291+0000 7f967c9b5640 1 -- 172.21.15.132:0/3566453537 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f965806c920 msgr2=0x7f965806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:13.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.291+0000 7f967c9b5640 1 --2- 172.21.15.132:0/3566453537 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f965806c920 0x7f965806ede0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9678069150 tx=0x7f966800b040 comp rx=0 tx=0).stop 2024-04-16T15:53:13.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.291+0000 7f967c9b5640 1 -- 172.21.15.132:0/3566453537 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9678152460 msgr2=0x7f9678154380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:13.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.291+0000 7f967c9b5640 1 --2- 172.21.15.132:0/3566453537 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9678152460 0x7f9678154380 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f966000c360 tx=0x7f966002e070 comp rx=0 tx=0).stop 2024-04-16T15:53:13.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.291+0000 7f967c9b5640 1 -- 172.21.15.132:0/3566453537 shutdown_connections 2024-04-16T15:53:13.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.291+0000 7f967c9b5640 1 --2- 172.21.15.132:0/3566453537 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f965806c920 0x7f965806ede0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:13.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.291+0000 7f967c9b5640 1 --2- 172.21.15.132:0/3566453537 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9678152860 0x7f96780b7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:13.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.291+0000 7f967c9b5640 1 --2- 172.21.15.132:0/3566453537 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9678152460 0x7f9678154380 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:13.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.291+0000 7f967c9b5640 1 --2- 172.21.15.132:0/3566453537 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9664004800 0x7f96781580e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:13.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.291+0000 7f967c9b5640 1 -- 172.21.15.132:0/3566453537 >> 172.21.15.132:0/3566453537 conn(0x7f967806cea0 msgr2=0x7f96780d3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:13.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.291+0000 7f967c9b5640 1 -- 172.21.15.132:0/3566453537 shutdown_connections 2024-04-16T15:53:13.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.291+0000 7f967c9b5640 1 -- 172.21.15.132:0/3566453537 wait complete. 2024-04-16T15:53:13.302 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-04-16T15:53:13.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.408+0000 7f2d66b82640 1 Processor -- start 2024-04-16T15:53:13.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.408+0000 7f2d66b82640 1 -- start start 2024-04-16T15:53:13.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.409+0000 7f2d66b82640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d600cfe40 0x7f2d600d0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:13.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.409+0000 7f2d66b82640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2d600cd340 0x7f2d600cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:13.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.409+0000 7f2d66b82640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d60160430 con 0x7f2d60067760 2024-04-16T15:53:13.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.409+0000 7f2d66b82640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f2d6015dea0 con 0x7f2d600cd340 2024-04-16T15:53:13.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.409+0000 7f2d66b82640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f2d600d0760 con 0x7f2d600cfe40 2024-04-16T15:53:13.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.409+0000 7f2d6511f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2d600cd340 0x7f2d600cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:13.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.409+0000 7f2d5ffff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f2d60067760 0x7f2d600cec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:38890/0 (socket says 172.21.15.132:38890) 2024-04-16T15:53:13.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.409+0000 7f2d6511f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2d600cd340 0x7f2d600cf330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57246/0 (socket says 172.21.15.132:57246) 2024-04-16T15:53:13.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.409+0000 7f2d5ffff640 1 -- 172.21.15.132:0/3720399191 learned_addr learned my addr 172.21.15.132:0/3720399191 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:53:13.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.409+0000 7f2d6511f640 1 -- 172.21.15.132:0/3720399191 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d600cfe40 msgr2=0x7f2d600d0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:13.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.409+0000 7f2d6511f640 1 --2- 172.21.15.132:0/3720399191 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d600cfe40 0x7f2d600d0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:13.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.409+0000 7f2d6511f640 1 -- 172.21.15.132:0/3720399191 >> v1:172.21.15.132:6789/0 conn(0x7f2d60067760 legacy=0x7f2d600cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:13.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.409+0000 7f2d6511f640 1 -- 172.21.15.132:0/3720399191 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d601606d0 con 0x7f2d600cd340 2024-04-16T15:53:13.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.409+0000 7f2d5f7fe640 1 -- 172.21.15.132:0/3720399191 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2304944299 0 0) 0x7f2d60160430 con 0x7f2d60067760 2024-04-16T15:53:13.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.410+0000 7f2d6511f640 1 --2- 172.21.15.132:0/3720399191 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d600cd340 0x7f2d600cf330 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f2d58009d90 tx=0x7f2d5802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53e18091a3fafb32 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:13.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.410+0000 7f2d5f7fe640 1 -- 172.21.15.132:0/3720399191 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d58039070 con 0x7f2d600cd340 2024-04-16T15:53:13.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.410+0000 7f2d5f7fe640 1 -- 172.21.15.132:0/3720399191 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d5802cc50 con 0x7f2d600cd340 2024-04-16T15:53:13.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.410+0000 7f2d5f7fe640 1 -- 172.21.15.132:0/3720399191 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d58034440 con 0x7f2d600cd340 2024-04-16T15:53:13.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.411+0000 7f2d66b82640 1 -- 172.21.15.132:0/3720399191 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d600cd340 msgr2=0x7f2d600cf330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:13.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.411+0000 7f2d66b82640 1 --2- 172.21.15.132:0/3720399191 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d600cd340 0x7f2d600cf330 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f2d58009d90 tx=0x7f2d5802bea0 comp rx=0 tx=0).stop 2024-04-16T15:53:13.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.411+0000 7f2d66b82640 1 -- 172.21.15.132:0/3720399191 shutdown_connections 2024-04-16T15:53:13.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.411+0000 7f2d66b82640 1 --2- 172.21.15.132:0/3720399191 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d600cd340 0x7f2d600cf330 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:13.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.411+0000 7f2d66b82640 1 --2- 172.21.15.132:0/3720399191 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d600cfe40 0x7f2d600d0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:13.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.411+0000 7f2d66b82640 1 -- 172.21.15.132:0/3720399191 >> 172.21.15.132:0/3720399191 conn(0x7f2d600cd7e0 msgr2=0x7f2d600cdbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:13.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.411+0000 7f2d66b82640 1 -- 172.21.15.132:0/3720399191 shutdown_connections 2024-04-16T15:53:13.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.411+0000 7f2d66b82640 1 -- 172.21.15.132:0/3720399191 wait complete. 2024-04-16T15:53:13.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.412+0000 7f2d66b82640 1 Processor -- start 2024-04-16T15:53:13.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.412+0000 7f2d66b82640 1 -- start start 2024-04-16T15:53:13.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.413+0000 7f2d66b82640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2d600cd340 0x7f2d600b2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:13.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.413+0000 7f2d66b82640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d600cfe40 0x7f2d60150c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:13.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.413+0000 7f2d66b82640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d600aedc0 0x7f2d600af250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:13.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.413+0000 7f2d66b82640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f2d60160f70 con 0x7f2d600cfe40 2024-04-16T15:53:13.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.413+0000 7f2d66b82640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2d60160c90 con 0x7f2d600cd340 2024-04-16T15:53:13.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.413+0000 7f2d66b82640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f2d6006ba20 con 0x7f2d600aedc0 2024-04-16T15:53:13.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.413+0000 7f2d5ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d600cfe40 0x7f2d60150c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:13.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.413+0000 7f2d5ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d600cfe40 0x7f2d60150c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57252/0 (socket says 172.21.15.132:57252) 2024-04-16T15:53:13.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.413+0000 7f2d5ffff640 1 -- 172.21.15.132:0/258683110 learned_addr learned my addr 172.21.15.132:0/258683110 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:13.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.413+0000 7f2d6511f640 1 --2- 172.21.15.132:0/258683110 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d600aedc0 0x7f2d600af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:13.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.413+0000 7f2d6491e640 1 --2- 172.21.15.132:0/258683110 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2d600cd340 0x7f2d600b2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:13.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.413+0000 7f2d5ffff640 1 -- 172.21.15.132:0/258683110 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d600aedc0 msgr2=0x7f2d600af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:13.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.413+0000 7f2d5ffff640 1 --2- 172.21.15.132:0/258683110 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d600aedc0 0x7f2d600af250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:13.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.413+0000 7f2d5ffff640 1 -- 172.21.15.132:0/258683110 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2d600cd340 msgr2=0x7f2d600b2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:13.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.413+0000 7f2d5ffff640 1 --2- 172.21.15.132:0/258683110 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2d600cd340 0x7f2d600b2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:13.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.413+0000 7f2d5ffff640 1 -- 172.21.15.132:0/258683110 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d601f69b0 con 0x7f2d600cfe40 2024-04-16T15:53:13.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.413+0000 7f2d6491e640 1 --2- 172.21.15.132:0/258683110 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2d600cd340 0x7f2d600b2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:53:13.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.414+0000 7f2d5ffff640 1 --2- 172.21.15.132:0/258683110 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d600cfe40 0x7f2d60150c50 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2d5400c500 tx=0x7f2d5400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:13.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.414+0000 7f2d5d7fa640 1 -- 172.21.15.132:0/258683110 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d54018070 con 0x7f2d600cfe40 2024-04-16T15:53:13.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.414+0000 7f2d5d7fa640 1 -- 172.21.15.132:0/258683110 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d54007580 con 0x7f2d600cfe40 2024-04-16T15:53:13.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.414+0000 7f2d66b82640 1 -- 172.21.15.132:0/258683110 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d601f66d0 con 0x7f2d600cfe40 2024-04-16T15:53:13.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.414+0000 7f2d5d7fa640 1 -- 172.21.15.132:0/258683110 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d54004a20 con 0x7f2d600cfe40 2024-04-16T15:53:13.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.414+0000 7f2d66b82640 1 -- 172.21.15.132:0/258683110 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d600b1c60 con 0x7f2d600cfe40 2024-04-16T15:53:13.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.415+0000 7f2d66b82640 1 -- 172.21.15.132:0/258683110 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d60075510 con 0x7f2d600cfe40 2024-04-16T15:53:13.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.415+0000 7f2d5d7fa640 1 -- 172.21.15.132:0/258683110 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2d5401b070 con 0x7f2d600cfe40 2024-04-16T15:53:13.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.416+0000 7f2d5d7fa640 1 --2- 172.21.15.132:0/258683110 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f2d4c06c8f0 0x7f2d4c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:13.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.416+0000 7f2d5d7fa640 1 -- 172.21.15.132:0/258683110 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f2d5408ab00 con 0x7f2d600cfe40 2024-04-16T15:53:13.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.416+0000 7f2d6491e640 1 --2- 172.21.15.132:0/258683110 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f2d4c06c8f0 0x7f2d4c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:13.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.416+0000 7f2d6491e640 1 --2- 172.21.15.132:0/258683110 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f2d4c06c8f0 0x7f2d4c06edb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2d5000a870 tx=0x7f2d50008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:13.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.420+0000 7f2d5d7fa640 1 -- 172.21.15.132:0/258683110 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2d54059280 con 0x7f2d600cfe40 2024-04-16T15:53:13.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.665+0000 7f2d66b82640 1 -- 172.21.15.132:0/258683110 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f2d60156080 con 0x7f2d600cfe40 2024-04-16T15:53:13.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.669+0000 7f2d5d7fa640 1 -- 172.21.15.132:0/258683110 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7f2d54058b80 con 0x7f2d600cfe40 2024-04-16T15:53:13.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.671+0000 7f2d66b82640 1 -- 172.21.15.132:0/258683110 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f2d4c06c8f0 msgr2=0x7f2d4c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:13.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.671+0000 7f2d66b82640 1 --2- 172.21.15.132:0/258683110 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f2d4c06c8f0 0x7f2d4c06edb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2d5000a870 tx=0x7f2d50008040 comp rx=0 tx=0).stop 2024-04-16T15:53:13.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.671+0000 7f2d66b82640 1 -- 172.21.15.132:0/258683110 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d600cfe40 msgr2=0x7f2d60150c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:13.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.671+0000 7f2d66b82640 1 --2- 172.21.15.132:0/258683110 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d600cfe40 0x7f2d60150c50 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2d5400c500 tx=0x7f2d5400c9c0 comp rx=0 tx=0).stop 2024-04-16T15:53:13.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.671+0000 7f2d66b82640 1 -- 172.21.15.132:0/258683110 shutdown_connections 2024-04-16T15:53:13.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.671+0000 7f2d66b82640 1 --2- 172.21.15.132:0/258683110 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f2d4c06c8f0 0x7f2d4c06edb0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:13.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.671+0000 7f2d66b82640 1 --2- 172.21.15.132:0/258683110 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d600aedc0 0x7f2d600af250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:13.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.671+0000 7f2d66b82640 1 --2- 172.21.15.132:0/258683110 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d600cfe40 0x7f2d60150c50 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:13.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.671+0000 7f2d66b82640 1 --2- 172.21.15.132:0/258683110 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2d600cd340 0x7f2d600b2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:13.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.671+0000 7f2d66b82640 1 -- 172.21.15.132:0/258683110 >> 172.21.15.132:0/258683110 conn(0x7f2d600cd7e0 msgr2=0x7f2d60156810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:13.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.671+0000 7f2d66b82640 1 -- 172.21.15.132:0/258683110 shutdown_connections 2024-04-16T15:53:13.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.671+0000 7f2d66b82640 1 -- 172.21.15.132:0/258683110 wait complete. 2024-04-16T15:53:13.681 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-04-16T15:53:13.785 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.786+0000 7f9fad31c640 1 Processor -- start 2024-04-16T15:53:13.786 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.786+0000 7f9fad31c640 1 -- start start 2024-04-16T15:53:13.790 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.787+0000 7f9fad31c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fa806cd40 0x7f9fa809ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:13.790 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.787+0000 7f9fad31c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fa80d0c30 con 0x7f9fa815e3a0 2024-04-16T15:53:13.790 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.787+0000 7f9fad31c640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fa80d0f10 con 0x7f9fa806d540 2024-04-16T15:53:13.790 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.787+0000 7f9fad31c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9fa809bfb0 con 0x7f9fa806cd40 2024-04-16T15:53:13.790 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.787+0000 7f9fa77fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f9fa815e3a0 0x7f9fa815e830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:38898/0 (socket says 172.21.15.132:38898) 2024-04-16T15:53:13.790 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.787+0000 7f9fa77fe640 1 -- 172.21.15.132:0/1895036442 learned_addr learned my addr 172.21.15.132:0/1895036442 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:53:13.791 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.788+0000 7f9fa5ffb640 1 -- 172.21.15.132:0/1895036442 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1244235456 0 0) 0x7f9fa80d0c30 con 0x7f9fa815e3a0 2024-04-16T15:53:13.791 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.788+0000 7f9fa67fc640 1 --2- 172.21.15.132:0/1895036442 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fa806cd40 0x7f9fa809ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:13.791 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.788+0000 7f9fa5ffb640 1 -- 172.21.15.132:0/1895036442 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f90003520 con 0x7f9fa815e3a0 2024-04-16T15:53:13.791 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.788+0000 7f9fa5ffb640 1 -- 172.21.15.132:0/1895036442 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 534281746 0 0) 0x7f9f90003520 con 0x7f9fa815e3a0 2024-04-16T15:53:13.791 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.788+0000 7f9fa5ffb640 1 -- 172.21.15.132:0/1895036442 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fa806cd40 msgr2=0x7f9fa809ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:13.791 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.788+0000 7f9fa5ffb640 1 --2- 172.21.15.132:0/1895036442 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fa806cd40 0x7f9fa809ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:13.791 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.788+0000 7f9fa5ffb640 1 -- 172.21.15.132:0/1895036442 >> v1:172.21.15.179:6789/0 conn(0x7f9fa806d540 legacy=0x7f9fa806d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:13.791 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.788+0000 7f9fa5ffb640 1 -- 172.21.15.132:0/1895036442 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fa80d11f0 con 0x7f9fa815e3a0 2024-04-16T15:53:13.791 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.788+0000 7f9fa5ffb640 1 -- 172.21.15.132:0/1895036442 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2803668828 0 0) 0x7f9fa00019f0 con 0x7f9fa815e3a0 2024-04-16T15:53:13.791 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.788+0000 7f9fa5ffb640 1 -- 172.21.15.132:0/1895036442 >> v1:172.21.15.132:6789/0 conn(0x7f9fa815e3a0 legacy=0x7f9fa815e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:13.791 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.788+0000 7f9fa5ffb640 1 --2- 172.21.15.132:0/1895036442 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9f900039e0 0x7f9f90003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:13.791 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.788+0000 7f9fa5ffb640 1 --2- 172.21.15.132:0/1895036442 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f90004800 0x7f9f90004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:13.791 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.788+0000 7f9fa5ffb640 1 --2- 172.21.15.132:0/1895036442 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fa806cd40 0x7f9f90005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:13.792 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.788+0000 7f9fa5ffb640 1 -- 172.21.15.132:0/1895036442 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f9f9000bac0 con 0x7f9f900039e0 2024-04-16T15:53:13.792 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.788+0000 7f9fa5ffb640 1 -- 172.21.15.132:0/1895036442 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9f9000bc70 con 0x7f9f90004800 2024-04-16T15:53:13.792 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.788+0000 7f9fa5ffb640 1 -- 172.21.15.132:0/1895036442 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9f9000be70 con 0x7f9fa806cd40 2024-04-16T15:53:13.792 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.788+0000 7f9fa6ffd640 1 --2- 172.21.15.132:0/1895036442 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9f900039e0 0x7f9f90003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:13.792 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.788+0000 7f9fa67fc640 1 --2- 172.21.15.132:0/1895036442 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f90004800 0x7f9f90004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:13.792 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.788+0000 7f9fa77fe640 1 --2- 172.21.15.132:0/1895036442 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fa806cd40 0x7f9f90005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:13.792 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.788+0000 7f9fa6ffd640 1 -- 172.21.15.132:0/1895036442 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fa806cd40 msgr2=0x7f9f90005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:13.792 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.788+0000 7f9fa6ffd640 1 --2- 172.21.15.132:0/1895036442 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fa806cd40 0x7f9f90005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:13.792 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.788+0000 7f9fa6ffd640 1 -- 172.21.15.132:0/1895036442 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f90004800 msgr2=0x7f9f90004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:13.792 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.788+0000 7f9fa6ffd640 1 --2- 172.21.15.132:0/1895036442 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f90004800 0x7f9f90004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:13.792 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.788+0000 7f9fa6ffd640 1 -- 172.21.15.132:0/1895036442 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f90003520 con 0x7f9f900039e0 2024-04-16T15:53:13.792 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.788+0000 7f9fa77fe640 1 --2- 172.21.15.132:0/1895036442 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fa806cd40 0x7f9f90005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:53:13.792 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.789+0000 7f9fa6ffd640 1 --2- 172.21.15.132:0/1895036442 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9f900039e0 0x7f9f90003e00 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f9f98001750 tx=0x7f9f90005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2da29a0ae5d4da4a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:13.792 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.789+0000 7f9fa5ffb640 1 -- 172.21.15.132:0/1895036442 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f98001370 con 0x7f9f900039e0 2024-04-16T15:53:13.792 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.789+0000 7f9fa5ffb640 1 -- 172.21.15.132:0/1895036442 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f980052d0 con 0x7f9f900039e0 2024-04-16T15:53:13.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.789+0000 7f9fa5ffb640 1 -- 172.21.15.132:0/1895036442 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f98003830 con 0x7f9f900039e0 2024-04-16T15:53:13.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.790+0000 7f9fad31c640 1 -- 172.21.15.132:0/1895036442 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9f900039e0 msgr2=0x7f9f90003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:13.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.790+0000 7f9fad31c640 1 --2- 172.21.15.132:0/1895036442 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9f900039e0 0x7f9f90003e00 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f9f98001750 tx=0x7f9f90005830 comp rx=0 tx=0).stop 2024-04-16T15:53:13.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.790+0000 7f9fa77fe640 1 -- 172.21.15.132:0/1895036442 reap_dead start 2024-04-16T15:53:13.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.790+0000 7f9fad31c640 1 -- 172.21.15.132:0/1895036442 shutdown_connections 2024-04-16T15:53:13.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.790+0000 7f9fad31c640 1 -- 172.21.15.132:0/1895036442 >> 172.21.15.132:0/1895036442 conn(0x7f9fa80b4220 msgr2=0x7f9fa80b4630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:13.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.790+0000 7f9fad31c640 1 -- 172.21.15.132:0/1895036442 shutdown_connections 2024-04-16T15:53:13.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.790+0000 7f9fad31c640 1 -- 172.21.15.132:0/1895036442 wait complete. 2024-04-16T15:53:13.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.791+0000 7f9fad31c640 1 Processor -- start 2024-04-16T15:53:13.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.791+0000 7f9fad31c640 1 -- start start 2024-04-16T15:53:13.796 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.792+0000 7f9fad31c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9f900039e0 0x7f9fa814bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:13.796 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.792+0000 7f9fad31c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9fa80b5580 0x7f9fa8158650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:13.796 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.792+0000 7f9fad31c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fa80b5a00 0x7f9fa8158b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:13.796 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.792+0000 7f9fad31c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa80d0850 con 0x7f9fa80b5580 2024-04-16T15:53:13.796 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.792+0000 7f9fad31c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa80cec00 con 0x7f9fa80b5a00 2024-04-16T15:53:13.796 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.792+0000 7f9fad31c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9fa80d09d0 con 0x7f9f900039e0 2024-04-16T15:53:13.796 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.792+0000 7f9fa67fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9fa80b5580 0x7f9fa8158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:13.796 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.792+0000 7f9fa67fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9fa80b5580 0x7f9fa8158650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57272/0 (socket says 172.21.15.132:57272) 2024-04-16T15:53:13.796 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.792+0000 7f9fa67fc640 1 -- 172.21.15.132:0/3845188633 learned_addr learned my addr 172.21.15.132:0/3845188633 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:13.796 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.792+0000 7f9fa6ffd640 1 --2- 172.21.15.132:0/3845188633 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9f900039e0 0x7f9fa814bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:13.796 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.792+0000 7f9fa77fe640 1 --2- 172.21.15.132:0/3845188633 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fa80b5a00 0x7f9fa8158b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:13.796 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.792+0000 7f9fa67fc640 1 -- 172.21.15.132:0/3845188633 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9f900039e0 msgr2=0x7f9fa814bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:13.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.792+0000 7f9fa67fc640 1 --2- 172.21.15.132:0/3845188633 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9f900039e0 0x7f9fa814bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:13.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.792+0000 7f9fa67fc640 1 -- 172.21.15.132:0/3845188633 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fa80b5a00 msgr2=0x7f9fa8158b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:13.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.792+0000 7f9fa67fc640 1 --2- 172.21.15.132:0/3845188633 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fa80b5a00 0x7f9fa8158b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:13.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.792+0000 7f9fa67fc640 1 -- 172.21.15.132:0/3845188633 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fa80cb260 con 0x7f9fa80b5580 2024-04-16T15:53:13.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.792+0000 7f9fa67fc640 1 --2- 172.21.15.132:0/3845188633 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9fa80b5580 0x7f9fa8158650 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c0119d0 tx=0x7f9f9c011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:13.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.793+0000 7f9f8f7fe640 1 -- 172.21.15.132:0/3845188633 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c00fb50 con 0x7f9fa80b5580 2024-04-16T15:53:13.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.793+0000 7f9f8f7fe640 1 -- 172.21.15.132:0/3845188633 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f9c00fcf0 con 0x7f9fa80b5580 2024-04-16T15:53:13.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.793+0000 7f9fad31c640 1 -- 172.21.15.132:0/3845188633 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fa80cb540 con 0x7f9fa80b5580 2024-04-16T15:53:13.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.793+0000 7f9f8f7fe640 1 -- 172.21.15.132:0/3845188633 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c00fea0 con 0x7f9fa80b5580 2024-04-16T15:53:13.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.793+0000 7f9fad31c640 1 -- 172.21.15.132:0/3845188633 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fa80cbb00 con 0x7f9fa80b5580 2024-04-16T15:53:13.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.794+0000 7f9fad31c640 1 -- 172.21.15.132:0/3845188633 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fa8075510 con 0x7f9fa80b5580 2024-04-16T15:53:13.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.794+0000 7f9f8f7fe640 1 -- 172.21.15.132:0/3845188633 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9f9c012040 con 0x7f9fa80b5580 2024-04-16T15:53:13.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.794+0000 7f9f8f7fe640 1 --2- 172.21.15.132:0/3845188633 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f9f9406c8f0 0x7f9f9406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:13.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.794+0000 7f9f8f7fe640 1 -- 172.21.15.132:0/3845188633 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f9f9c08be00 con 0x7f9fa80b5580 2024-04-16T15:53:13.798 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.795+0000 7f9fa6ffd640 1 --2- 172.21.15.132:0/3845188633 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f9f9406c8f0 0x7f9f9406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:13.798 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.795+0000 7f9fa6ffd640 1 --2- 172.21.15.132:0/3845188633 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f9f9406c8f0 0x7f9f9406edb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9f98033000 tx=0x7f9f98009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:13.798 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:13.799+0000 7f9f8f7fe640 1 -- 172.21.15.132:0/3845188633 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9f9c019030 con 0x7f9fa80b5580 2024-04-16T15:53:14.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.042+0000 7f9fad31c640 1 -- 172.21.15.132:0/3845188633 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f9fa80ced80 con 0x7f9fa80b5580 2024-04-16T15:53:14.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.046+0000 7f9f8f7fe640 1 -- 172.21.15.132:0/3845188633 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f9f9c05a580 con 0x7f9fa80b5580 2024-04-16T15:53:14.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.048+0000 7f9fad31c640 1 -- 172.21.15.132:0/3845188633 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f9f9406c8f0 msgr2=0x7f9f9406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:14.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.048+0000 7f9fad31c640 1 --2- 172.21.15.132:0/3845188633 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f9f9406c8f0 0x7f9f9406edb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9f98033000 tx=0x7f9f98009030 comp rx=0 tx=0).stop 2024-04-16T15:53:14.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.048+0000 7f9fad31c640 1 -- 172.21.15.132:0/3845188633 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9fa80b5580 msgr2=0x7f9fa8158650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:14.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.048+0000 7f9fad31c640 1 --2- 172.21.15.132:0/3845188633 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9fa80b5580 0x7f9fa8158650 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c0119d0 tx=0x7f9f9c011e90 comp rx=0 tx=0).stop 2024-04-16T15:53:14.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.048+0000 7f9fad31c640 1 -- 172.21.15.132:0/3845188633 shutdown_connections 2024-04-16T15:53:14.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.048+0000 7f9fad31c640 1 --2- 172.21.15.132:0/3845188633 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f9f9406c8f0 0x7f9f9406edb0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:14.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.048+0000 7f9fad31c640 1 --2- 172.21.15.132:0/3845188633 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fa80b5a00 0x7f9fa8158b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:14.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.048+0000 7f9fad31c640 1 --2- 172.21.15.132:0/3845188633 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9fa80b5580 0x7f9fa8158650 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:14.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.048+0000 7f9fad31c640 1 --2- 172.21.15.132:0/3845188633 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9f900039e0 0x7f9fa814bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:14.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.048+0000 7f9fad31c640 1 -- 172.21.15.132:0/3845188633 >> 172.21.15.132:0/3845188633 conn(0x7f9fa80b4220 msgr2=0x7f9fa80b4630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:14.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.048+0000 7f9fad31c640 1 -- 172.21.15.132:0/3845188633 shutdown_connections 2024-04-16T15:53:14.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.048+0000 7f9fad31c640 1 -- 172.21.15.132:0/3845188633 wait complete. 2024-04-16T15:53:14.058 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-04-16T15:53:14.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.163+0000 7f3f5438d640 1 Processor -- start 2024-04-16T15:53:14.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.163+0000 7f3f5438d640 1 -- start start 2024-04-16T15:53:14.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.164+0000 7f3f5438d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3f4c15b730 0x7f3f4c0b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:14.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.164+0000 7f3f5438d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3f4c06e930 0x7f3f4c06ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:14.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.164+0000 7f3f5438d640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f4c0b3a10 con 0x7f3f4c06bf60 2024-04-16T15:53:14.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.164+0000 7f3f5438d640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f3f4c06c3d0 con 0x7f3f4c15b730 2024-04-16T15:53:14.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.164+0000 7f3f5438d640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f3f4c15bb10 con 0x7f3f4c06e930 2024-04-16T15:53:14.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.164+0000 7f3f52129640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3f4c15b730 0x7f3f4c0b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:14.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.164+0000 7f3f52129640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3f4c15b730 0x7f3f4c0b34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57286/0 (socket says 172.21.15.132:57286) 2024-04-16T15:53:14.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.164+0000 7f3f52129640 1 -- 172.21.15.132:0/183122793 learned_addr learned my addr 172.21.15.132:0/183122793 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:14.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.164+0000 7f3f51928640 1 --2- 172.21.15.132:0/183122793 >> v2:172.21.15.179:3300/0 conn(0x7f3f4c06e930 0x7f3f4c06ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:14.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.164+0000 7f3f52129640 1 -- 172.21.15.132:0/183122793 >> v2:172.21.15.179:3300/0 conn(0x7f3f4c06e930 msgr2=0x7f3f4c06ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:14.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.164+0000 7f3f52129640 1 --2- 172.21.15.132:0/183122793 >> v2:172.21.15.179:3300/0 conn(0x7f3f4c06e930 0x7f3f4c06ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:14.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.164+0000 7f3f52129640 1 -- 172.21.15.132:0/183122793 >> v1:172.21.15.179:6789/0 conn(0x7f3f4c06bf60 legacy=0x7f3f4c0ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:14.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.164+0000 7f3f52129640 1 -- 172.21.15.132:0/183122793 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f4c0ce320 con 0x7f3f4c15b730 2024-04-16T15:53:14.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.165+0000 7f3f52129640 1 --2- 172.21.15.132:0/183122793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f4c15b730 0x7f3f4c0b34d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c06cb50 tx=0x7f3f4802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b023ae662c915d59 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:14.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.165+0000 7f3f51127640 1 -- 172.21.15.132:0/183122793 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f48035020 con 0x7f3f4c15b730 2024-04-16T15:53:14.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.165+0000 7f3f51127640 1 -- 172.21.15.132:0/183122793 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f48031870 con 0x7f3f4c15b730 2024-04-16T15:53:14.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.165+0000 7f3f51127640 1 -- 172.21.15.132:0/183122793 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f48031c40 con 0x7f3f4c15b730 2024-04-16T15:53:14.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.166+0000 7f3f5438d640 1 -- 172.21.15.132:0/183122793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f4c15b730 msgr2=0x7f3f4c0b34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:14.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.166+0000 7f3f5438d640 1 --2- 172.21.15.132:0/183122793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f4c15b730 0x7f3f4c0b34d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c06cb50 tx=0x7f3f4802b910 comp rx=0 tx=0).stop 2024-04-16T15:53:14.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.166+0000 7f3f5438d640 1 -- 172.21.15.132:0/183122793 shutdown_connections 2024-04-16T15:53:14.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.166+0000 7f3f5438d640 1 --2- 172.21.15.132:0/183122793 >> v2:172.21.15.179:3300/0 conn(0x7f3f4c06e930 0x7f3f4c06ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:14.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.166+0000 7f3f5438d640 1 --2- 172.21.15.132:0/183122793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f4c15b730 0x7f3f4c0b34d0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:14.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.166+0000 7f3f5438d640 1 -- 172.21.15.132:0/183122793 >> 172.21.15.132:0/183122793 conn(0x7f3f4c067ff0 msgr2=0x7f3f4c0b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:14.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.166+0000 7f3f5438d640 1 -- 172.21.15.132:0/183122793 shutdown_connections 2024-04-16T15:53:14.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.166+0000 7f3f5438d640 1 -- 172.21.15.132:0/183122793 wait complete. 2024-04-16T15:53:14.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.167+0000 7f3f5438d640 1 Processor -- start 2024-04-16T15:53:14.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.167+0000 7f3f5438d640 1 -- start start 2024-04-16T15:53:14.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.168+0000 7f3f5438d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f4c06bf60 0x7f3f4c14eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:14.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.168+0000 7f3f5438d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f4c06e930 0x7f3f4c143b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:14.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.168+0000 7f3f5438d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f4c15b730 0x7f3f4c168820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:14.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.168+0000 7f3f5438d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4c0b54b0 con 0x7f3f4c15b730 2024-04-16T15:53:14.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.168+0000 7f3f5438d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4c0b51d0 con 0x7f3f4c06bf60 2024-04-16T15:53:14.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.168+0000 7f3f5438d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f3f4c0b5790 con 0x7f3f4c06e930 2024-04-16T15:53:14.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.168+0000 7f3f5292a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f4c15b730 0x7f3f4c168820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:14.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.168+0000 7f3f5292a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f4c15b730 0x7f3f4c168820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57296/0 (socket says 172.21.15.132:57296) 2024-04-16T15:53:14.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.168+0000 7f3f5292a640 1 -- 172.21.15.132:0/2871630381 learned_addr learned my addr 172.21.15.132:0/2871630381 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:14.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.168+0000 7f3f52129640 1 --2- 172.21.15.132:0/2871630381 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f4c06bf60 0x7f3f4c14eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:14.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.168+0000 7f3f51928640 1 --2- 172.21.15.132:0/2871630381 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f4c06e930 0x7f3f4c143b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:14.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.168+0000 7f3f5292a640 1 -- 172.21.15.132:0/2871630381 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f4c06e930 msgr2=0x7f3f4c143b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:14.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.168+0000 7f3f5292a640 1 --2- 172.21.15.132:0/2871630381 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f4c06e930 0x7f3f4c143b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:14.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.168+0000 7f3f5292a640 1 -- 172.21.15.132:0/2871630381 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f4c06bf60 msgr2=0x7f3f4c14eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:14.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.168+0000 7f3f5292a640 1 --2- 172.21.15.132:0/2871630381 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f4c06bf60 0x7f3f4c14eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:14.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.168+0000 7f3f5292a640 1 -- 172.21.15.132:0/2871630381 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f4c14f410 con 0x7f3f4c15b730 2024-04-16T15:53:14.172 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.168+0000 7f3f5292a640 1 --2- 172.21.15.132:0/2871630381 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f4c15b730 0x7f3f4c168820 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3f4400c7d0 tx=0x7f3f4400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:14.172 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.168+0000 7f3f42ffd640 1 -- 172.21.15.132:0/2871630381 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f44003b70 con 0x7f3f4c15b730 2024-04-16T15:53:14.172 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.168+0000 7f3f42ffd640 1 -- 172.21.15.132:0/2871630381 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f44003d30 con 0x7f3f4c15b730 2024-04-16T15:53:14.172 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.168+0000 7f3f42ffd640 1 -- 172.21.15.132:0/2871630381 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f4400aa90 con 0x7f3f4c15b730 2024-04-16T15:53:14.172 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.168+0000 7f3f5438d640 1 -- 172.21.15.132:0/2871630381 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f4c169470 con 0x7f3f4c15b730 2024-04-16T15:53:14.172 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.169+0000 7f3f5438d640 1 -- 172.21.15.132:0/2871630381 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f4c149910 con 0x7f3f4c15b730 2024-04-16T15:53:14.172 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.169+0000 7f3f5438d640 1 -- 172.21.15.132:0/2871630381 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f4c06ed90 con 0x7f3f4c15b730 2024-04-16T15:53:14.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.170+0000 7f3f42ffd640 1 -- 172.21.15.132:0/2871630381 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3f4400ac30 con 0x7f3f4c15b730 2024-04-16T15:53:14.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.170+0000 7f3f42ffd640 1 --2- 172.21.15.132:0/2871630381 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f3f3006c920 0x7f3f3006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:14.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.170+0000 7f3f42ffd640 1 -- 172.21.15.132:0/2871630381 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f3f4408b600 con 0x7f3f4c15b730 2024-04-16T15:53:14.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.170+0000 7f3f52129640 1 --2- 172.21.15.132:0/2871630381 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f3f3006c920 0x7f3f3006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:14.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.171+0000 7f3f52129640 1 --2- 172.21.15.132:0/2871630381 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f3f3006c920 0x7f3f3006ede0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3f48036000 tx=0x7f3f4803c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:14.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.175+0000 7f3f42ffd640 1 -- 172.21.15.132:0/2871630381 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3f4c06ed90 con 0x7f3f4c15b730 2024-04-16T15:53:14.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.415+0000 7f3f5438d640 1 -- 172.21.15.132:0/2871630381 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f3f4c149420 con 0x7f3f4c15b730 2024-04-16T15:53:14.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.419+0000 7f3f42ffd640 1 -- 172.21.15.132:0/2871630381 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7f3f44059730 con 0x7f3f4c15b730 2024-04-16T15:53:14.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.421+0000 7f3f5438d640 1 -- 172.21.15.132:0/2871630381 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f3f3006c920 msgr2=0x7f3f3006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:14.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.421+0000 7f3f5438d640 1 --2- 172.21.15.132:0/2871630381 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f3f3006c920 0x7f3f3006ede0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3f48036000 tx=0x7f3f4803c040 comp rx=0 tx=0).stop 2024-04-16T15:53:14.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.421+0000 7f3f5438d640 1 -- 172.21.15.132:0/2871630381 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f4c15b730 msgr2=0x7f3f4c168820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:14.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.421+0000 7f3f5438d640 1 --2- 172.21.15.132:0/2871630381 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f4c15b730 0x7f3f4c168820 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3f4400c7d0 tx=0x7f3f4400cc90 comp rx=0 tx=0).stop 2024-04-16T15:53:14.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.421+0000 7f3f5438d640 1 -- 172.21.15.132:0/2871630381 shutdown_connections 2024-04-16T15:53:14.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.421+0000 7f3f5438d640 1 --2- 172.21.15.132:0/2871630381 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f3f3006c920 0x7f3f3006ede0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:14.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.421+0000 7f3f5438d640 1 --2- 172.21.15.132:0/2871630381 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f4c15b730 0x7f3f4c168820 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:14.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.421+0000 7f3f5438d640 1 --2- 172.21.15.132:0/2871630381 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f4c06e930 0x7f3f4c143b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:14.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.421+0000 7f3f5438d640 1 --2- 172.21.15.132:0/2871630381 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f4c06bf60 0x7f3f4c14eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:14.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.421+0000 7f3f5438d640 1 -- 172.21.15.132:0/2871630381 >> 172.21.15.132:0/2871630381 conn(0x7f3f4c067ff0 msgr2=0x7f3f4c15aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:14.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.421+0000 7f3f5438d640 1 -- 172.21.15.132:0/2871630381 shutdown_connections 2024-04-16T15:53:14.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.421+0000 7f3f5438d640 1 -- 172.21.15.132:0/2871630381 wait complete. 2024-04-16T15:53:14.432 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-04-16T15:53:14.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.537+0000 7f2f953b5640 1 Processor -- start 2024-04-16T15:53:14.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.537+0000 7f2f953b5640 1 -- start start 2024-04-16T15:53:14.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.537+0000 7f2f953b5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f9015e960 0x7f2f900cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:14.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.537+0000 7f2f953b5640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2f9015ed40 0x7f2f900b7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:14.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.537+0000 7f2f953b5640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2f90163100 0x7f2f900b6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:14.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.537+0000 7f2f953b5640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f2f900d2af0 con 0x7f2f90163100 2024-04-16T15:53:14.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.537+0000 7f2f953b5640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f2f900d3390 con 0x7f2f9015ed40 2024-04-16T15:53:14.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.537+0000 7f2f953b5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f2f900cffd0 con 0x7f2f9015e960 2024-04-16T15:53:14.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.538+0000 7f2f8f7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2f90163100 0x7f2f900b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:14.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.538+0000 7f2f8f7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2f90163100 0x7f2f900b6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57308/0 (socket says 172.21.15.132:57308) 2024-04-16T15:53:14.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.538+0000 7f2f8f7fe640 1 -- 172.21.15.132:0/2108722820 learned_addr learned my addr 172.21.15.132:0/2108722820 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:14.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.538+0000 7f2f8e7fc640 1 --2- 172.21.15.132:0/2108722820 >> v2:172.21.15.179:3300/0 conn(0x7f2f9015ed40 0x7f2f900b7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:14.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.538+0000 7f2f8effd640 1 --2- 172.21.15.132:0/2108722820 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f9015e960 0x7f2f900cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:14.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.538+0000 7f2f8f7fe640 1 -- 172.21.15.132:0/2108722820 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f9015e960 msgr2=0x7f2f900cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:14.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.538+0000 7f2f8f7fe640 1 --2- 172.21.15.132:0/2108722820 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f9015e960 0x7f2f900cf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:14.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.538+0000 7f2f8f7fe640 1 -- 172.21.15.132:0/2108722820 >> v2:172.21.15.179:3300/0 conn(0x7f2f9015ed40 msgr2=0x7f2f900b7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:14.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.538+0000 7f2f8f7fe640 1 --2- 172.21.15.132:0/2108722820 >> v2:172.21.15.179:3300/0 conn(0x7f2f9015ed40 0x7f2f900b7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:14.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.538+0000 7f2f8f7fe640 1 -- 172.21.15.132:0/2108722820 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f900d2d40 con 0x7f2f90163100 2024-04-16T15:53:14.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.538+0000 7f2f8e7fc640 1 --2- 172.21.15.132:0/2108722820 >> v2:172.21.15.179:3300/0 conn(0x7f2f9015ed40 0x7f2f900b7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:53:14.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.539+0000 7f2f8f7fe640 1 --2- 172.21.15.132:0/2108722820 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f90163100 0x7f2f900b6410 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f2f900d59f0 tx=0x7f2f8802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=133a4fb8e5a70bda server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:14.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.539+0000 7f2f8dffb640 1 -- 172.21.15.132:0/2108722820 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f8802c9e0 con 0x7f2f90163100 2024-04-16T15:53:14.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.539+0000 7f2f8dffb640 1 -- 172.21.15.132:0/2108722820 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f8802cb80 con 0x7f2f90163100 2024-04-16T15:53:14.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.539+0000 7f2f8dffb640 1 -- 172.21.15.132:0/2108722820 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f880343f0 con 0x7f2f90163100 2024-04-16T15:53:14.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.539+0000 7f2f953b5640 1 -- 172.21.15.132:0/2108722820 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f90163100 msgr2=0x7f2f900b6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:14.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.539+0000 7f2f953b5640 1 --2- 172.21.15.132:0/2108722820 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f90163100 0x7f2f900b6410 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f2f900d59f0 tx=0x7f2f8802be40 comp rx=0 tx=0).stop 2024-04-16T15:53:14.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.539+0000 7f2f953b5640 1 -- 172.21.15.132:0/2108722820 shutdown_connections 2024-04-16T15:53:14.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.539+0000 7f2f953b5640 1 --2- 172.21.15.132:0/2108722820 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f90163100 0x7f2f900b6410 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:14.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.539+0000 7f2f953b5640 1 --2- 172.21.15.132:0/2108722820 >> v2:172.21.15.179:3300/0 conn(0x7f2f9015ed40 0x7f2f900b7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:14.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.539+0000 7f2f953b5640 1 --2- 172.21.15.132:0/2108722820 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f9015e960 0x7f2f900cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:14.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.539+0000 7f2f953b5640 1 -- 172.21.15.132:0/2108722820 >> 172.21.15.132:0/2108722820 conn(0x7f2f900d1410 msgr2=0x7f2f900d1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:14.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.539+0000 7f2f953b5640 1 -- 172.21.15.132:0/2108722820 shutdown_connections 2024-04-16T15:53:14.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.539+0000 7f2f953b5640 1 -- 172.21.15.132:0/2108722820 wait complete. 2024-04-16T15:53:14.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.541+0000 7f2f953b5640 1 Processor -- start 2024-04-16T15:53:14.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.541+0000 7f2f953b5640 1 -- start start 2024-04-16T15:53:14.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.541+0000 7f2f953b5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f9015e960 0x7f2f901e8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:14.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.541+0000 7f2f953b5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f9015ed40 0x7f2f90160100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:14.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.541+0000 7f2f953b5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f90163100 0x7f2f90160db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:14.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.541+0000 7f2f953b5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f2f900b6950 con 0x7f2f9015e960 2024-04-16T15:53:14.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.541+0000 7f2f953b5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2f90163590 con 0x7f2f90163100 2024-04-16T15:53:14.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.541+0000 7f2f953b5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f2f900b6ad0 con 0x7f2f9015ed40 2024-04-16T15:53:14.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.542+0000 7f2f8effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f9015e960 0x7f2f901e8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:14.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.542+0000 7f2f8effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f9015e960 0x7f2f901e8420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57310/0 (socket says 172.21.15.132:57310) 2024-04-16T15:53:14.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.542+0000 7f2f8effd640 1 -- 172.21.15.132:0/2823744316 learned_addr learned my addr 172.21.15.132:0/2823744316 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:14.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.542+0000 7f2f8e7fc640 1 --2- 172.21.15.132:0/2823744316 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f9015ed40 0x7f2f90160100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:14.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.542+0000 7f2f8f7fe640 1 --2- 172.21.15.132:0/2823744316 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f90163100 0x7f2f90160db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:14.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.542+0000 7f2f8effd640 1 -- 172.21.15.132:0/2823744316 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f9015ed40 msgr2=0x7f2f90160100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:14.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.542+0000 7f2f8effd640 1 --2- 172.21.15.132:0/2823744316 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f9015ed40 0x7f2f90160100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:14.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.542+0000 7f2f8effd640 1 -- 172.21.15.132:0/2823744316 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f90163100 msgr2=0x7f2f90160db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:14.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.542+0000 7f2f8effd640 1 --2- 172.21.15.132:0/2823744316 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f90163100 0x7f2f90160db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:14.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.542+0000 7f2f8effd640 1 -- 172.21.15.132:0/2823744316 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f901e8ac0 con 0x7f2f9015e960 2024-04-16T15:53:14.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.542+0000 7f2f8f7fe640 1 --2- 172.21.15.132:0/2823744316 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f90163100 0x7f2f90160db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:53:14.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.542+0000 7f2f8e7fc640 1 --2- 172.21.15.132:0/2823744316 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f9015ed40 0x7f2f90160100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:53:14.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.542+0000 7f2f8effd640 1 --2- 172.21.15.132:0/2823744316 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f9015e960 0x7f2f901e8420 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f2f8000d800 tx=0x7f2f8000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:14.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.542+0000 7f2f777fe640 1 -- 172.21.15.132:0/2823744316 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f80018020 con 0x7f2f9015e960 2024-04-16T15:53:14.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.542+0000 7f2f777fe640 1 -- 172.21.15.132:0/2823744316 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f800096a0 con 0x7f2f9015e960 2024-04-16T15:53:14.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.542+0000 7f2f953b5640 1 -- 172.21.15.132:0/2823744316 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f901e8da0 con 0x7f2f9015e960 2024-04-16T15:53:14.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.542+0000 7f2f777fe640 1 -- 172.21.15.132:0/2823744316 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f80009a70 con 0x7f2f9015e960 2024-04-16T15:53:14.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.542+0000 7f2f953b5640 1 -- 172.21.15.132:0/2823744316 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f901e9360 con 0x7f2f9015e960 2024-04-16T15:53:14.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.543+0000 7f2f953b5640 1 -- 172.21.15.132:0/2823744316 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f90075510 con 0x7f2f9015e960 2024-04-16T15:53:14.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.544+0000 7f2f777fe640 1 -- 172.21.15.132:0/2823744316 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2f8001b020 con 0x7f2f9015e960 2024-04-16T15:53:14.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.544+0000 7f2f777fe640 1 --2- 172.21.15.132:0/2823744316 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f2f7c06c8f0 0x7f2f7c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:14.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.544+0000 7f2f8e7fc640 1 --2- 172.21.15.132:0/2823744316 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f2f7c06c8f0 0x7f2f7c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:14.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.544+0000 7f2f777fe640 1 -- 172.21.15.132:0/2823744316 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f2f8008ba90 con 0x7f2f9015e960 2024-04-16T15:53:14.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.545+0000 7f2f8e7fc640 1 --2- 172.21.15.132:0/2823744316 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f2f7c06c8f0 0x7f2f7c06edb0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2f84006fd0 tx=0x7f2f84008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:14.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.548+0000 7f2f777fe640 1 -- 172.21.15.132:0/2823744316 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2f80022030 con 0x7f2f9015e960 2024-04-16T15:53:14.642 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-04-16T15:53:14.795 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.796+0000 7f2f953b5640 1 -- 172.21.15.132:0/2823744316 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f2f900cf420 con 0x7f2f9015e960 2024-04-16T15:53:14.799 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.800+0000 7f2f777fe640 1 -- 172.21.15.132:0/2823744316 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) ==== 97+0+0 (secure 0 0 0) 0x7f2f8005a210 con 0x7f2f9015e960 2024-04-16T15:53:14.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.802+0000 7f2f953b5640 1 -- 172.21.15.132:0/2823744316 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f2f7c06c8f0 msgr2=0x7f2f7c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:14.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.802+0000 7f2f953b5640 1 --2- 172.21.15.132:0/2823744316 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f2f7c06c8f0 0x7f2f7c06edb0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2f84006fd0 tx=0x7f2f84008040 comp rx=0 tx=0).stop 2024-04-16T15:53:14.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.802+0000 7f2f953b5640 1 -- 172.21.15.132:0/2823744316 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f9015e960 msgr2=0x7f2f901e8420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:14.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.802+0000 7f2f953b5640 1 --2- 172.21.15.132:0/2823744316 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f9015e960 0x7f2f901e8420 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f2f8000d800 tx=0x7f2f8000dcc0 comp rx=0 tx=0).stop 2024-04-16T15:53:14.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.802+0000 7f2f953b5640 1 -- 172.21.15.132:0/2823744316 shutdown_connections 2024-04-16T15:53:14.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.802+0000 7f2f953b5640 1 --2- 172.21.15.132:0/2823744316 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f2f7c06c8f0 0x7f2f7c06edb0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:14.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.802+0000 7f2f953b5640 1 --2- 172.21.15.132:0/2823744316 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f90163100 0x7f2f90160db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:14.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.802+0000 7f2f953b5640 1 --2- 172.21.15.132:0/2823744316 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f9015ed40 0x7f2f90160100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:14.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.802+0000 7f2f953b5640 1 --2- 172.21.15.132:0/2823744316 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f9015e960 0x7f2f901e8420 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:14.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.802+0000 7f2f953b5640 1 -- 172.21.15.132:0/2823744316 >> 172.21.15.132:0/2823744316 conn(0x7f2f900d1410 msgr2=0x7f2f900d3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:14.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.803+0000 7f2f953b5640 1 -- 172.21.15.132:0/2823744316 shutdown_connections 2024-04-16T15:53:14.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.803+0000 7f2f953b5640 1 -- 172.21.15.132:0/2823744316 wait complete. 2024-04-16T15:53:14.813 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-04-16T15:53:14.867 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T15:53:14.870 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T15:53:14.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.920+0000 7f9e600f2640 1 Processor -- start 2024-04-16T15:53:14.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.920+0000 7f9e600f2640 1 -- start start 2024-04-16T15:53:14.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.921+0000 7f9e600f2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e5815efb0 0x7f9e580d0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:14.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.921+0000 7f9e600f2640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9e5815f390 0x7f9e5806cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:14.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.921+0000 7f9e600f2640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e580b8fe0 con 0x7f9e580d3d60 2024-04-16T15:53:14.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.921+0000 7f9e600f2640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f9e580d42b0 con 0x7f9e5815f390 2024-04-16T15:53:14.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.921+0000 7f9e600f2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9e580d4500 con 0x7f9e5815efb0 2024-04-16T15:53:14.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.921+0000 7f9e5d68d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9e5815f390 0x7f9e5806cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:14.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.921+0000 7f9e5de8e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e5815efb0 0x7f9e580d0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:14.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.921+0000 7f9e5e68f640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f9e580d3d60 0x7f9e58162cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.132:44336/0 (socket says 172.21.15.132:44336) 2024-04-16T15:53:14.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.921+0000 7f9e5e68f640 1 -- 172.21.15.132:0/3737928555 learned_addr learned my addr 172.21.15.132:0/3737928555 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:53:14.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.921+0000 7f9e5d68d640 1 -- 172.21.15.132:0/3737928555 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e5815efb0 msgr2=0x7f9e580d0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:14.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.921+0000 7f9e5d68d640 1 --2- 172.21.15.132:0/3737928555 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e5815efb0 0x7f9e580d0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:14.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.921+0000 7f9e5d68d640 1 -- 172.21.15.132:0/3737928555 >> v1:172.21.15.179:6789/0 conn(0x7f9e580d3d60 legacy=0x7f9e58162cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:14.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.921+0000 7f9e5d68d640 1 -- 172.21.15.132:0/3737928555 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e580d2520 con 0x7f9e5815f390 2024-04-16T15:53:14.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.921+0000 7f9e5ce8c640 1 -- 172.21.15.132:0/3737928555 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2271916824 0 0) 0x7f9e580b8fe0 con 0x7f9e580d3d60 2024-04-16T15:53:14.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.921+0000 7f9e5de8e640 1 --2- 172.21.15.132:0/3737928555 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e5815efb0 0x7f9e580d0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:53:14.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.922+0000 7f9e5d68d640 1 --2- 172.21.15.132:0/3737928555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e5815f390 0x7f9e5806cf50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9e480097d0 tx=0x7f9e4802b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a49207b04c501 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:14.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.922+0000 7f9e5ce8c640 1 -- 172.21.15.132:0/3737928555 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e48035020 con 0x7f9e5815f390 2024-04-16T15:53:14.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.922+0000 7f9e5ce8c640 1 -- 172.21.15.132:0/3737928555 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e48031800 con 0x7f9e5815f390 2024-04-16T15:53:14.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.922+0000 7f9e5ce8c640 1 -- 172.21.15.132:0/3737928555 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e48031bd0 con 0x7f9e5815f390 2024-04-16T15:53:14.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.923+0000 7f9e600f2640 1 -- 172.21.15.132:0/3737928555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e5815f390 msgr2=0x7f9e5806cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:14.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.923+0000 7f9e600f2640 1 --2- 172.21.15.132:0/3737928555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e5815f390 0x7f9e5806cf50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9e480097d0 tx=0x7f9e4802b8a0 comp rx=0 tx=0).stop 2024-04-16T15:53:14.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.923+0000 7f9e600f2640 1 -- 172.21.15.132:0/3737928555 shutdown_connections 2024-04-16T15:53:14.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.923+0000 7f9e600f2640 1 --2- 172.21.15.132:0/3737928555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e5815f390 0x7f9e5806cf50 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:14.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.923+0000 7f9e600f2640 1 --2- 172.21.15.132:0/3737928555 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e5815efb0 0x7f9e580d0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:14.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.923+0000 7f9e600f2640 1 -- 172.21.15.132:0/3737928555 >> 172.21.15.132:0/3737928555 conn(0x7f9e580d1460 msgr2=0x7f9e580d1870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:14.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.923+0000 7f9e600f2640 1 -- 172.21.15.132:0/3737928555 shutdown_connections 2024-04-16T15:53:14.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.923+0000 7f9e600f2640 1 -- 172.21.15.132:0/3737928555 wait complete. 2024-04-16T15:53:14.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.924+0000 7f9e600f2640 1 Processor -- start 2024-04-16T15:53:14.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.924+0000 7f9e600f2640 1 -- start start 2024-04-16T15:53:14.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.925+0000 7f9e600f2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e580d3d60 0x7f9e5815b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:14.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.925+0000 7f9e600f2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e5815efb0 0x7f9e58161300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:14.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.925+0000 7f9e600f2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e5815f390 0x7f9e580ac700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:14.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.925+0000 7f9e600f2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f9e580d2dc0 con 0x7f9e5815f390 2024-04-16T15:53:14.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.925+0000 7f9e600f2640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9e580d2ae0 con 0x7f9e5815efb0 2024-04-16T15:53:14.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.925+0000 7f9e600f2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9e580d3a90 con 0x7f9e580d3d60 2024-04-16T15:53:14.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.925+0000 7f9e5e68f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e5815f390 0x7f9e580ac700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:14.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.925+0000 7f9e5de8e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e580d3d60 0x7f9e5815b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:14.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.925+0000 7f9e5d68d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e5815efb0 0x7f9e58161300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:14.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.925+0000 7f9e5de8e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e580d3d60 0x7f9e5815b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.132:57496/0 (socket says 172.21.15.132:57496) 2024-04-16T15:53:14.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.925+0000 7f9e5de8e640 1 -- 172.21.15.132:0/3217370279 learned_addr learned my addr 172.21.15.132:0/3217370279 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:14.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.925+0000 7f9e5d68d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e5815efb0 0x7f9e58161300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.132:37344/0 (socket says 172.21.15.132:37344) 2024-04-16T15:53:14.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.925+0000 7f9e5e68f640 1 -- 172.21.15.132:0/3217370279 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e580d3d60 msgr2=0x7f9e5815b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:14.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.925+0000 7f9e5e68f640 1 --2- 172.21.15.132:0/3217370279 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e580d3d60 0x7f9e5815b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:14.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.925+0000 7f9e5e68f640 1 -- 172.21.15.132:0/3217370279 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e5815efb0 msgr2=0x7f9e58161300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:14.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.925+0000 7f9e5e68f640 1 --2- 172.21.15.132:0/3217370279 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e5815efb0 0x7f9e58161300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:14.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.925+0000 7f9e5e68f640 1 -- 172.21.15.132:0/3217370279 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e58161840 con 0x7f9e5815f390 2024-04-16T15:53:14.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.925+0000 7f9e5e68f640 1 --2- 172.21.15.132:0/3217370279 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e5815f390 0x7f9e580ac700 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f9e5000c6d0 tx=0x7f9e5000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:14.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.926+0000 7f9e4e7fc640 1 -- 172.21.15.132:0/3217370279 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e50018070 con 0x7f9e5815f390 2024-04-16T15:53:14.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.926+0000 7f9e4e7fc640 1 -- 172.21.15.132:0/3217370279 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e50004d60 con 0x7f9e5815f390 2024-04-16T15:53:14.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.926+0000 7f9e600f2640 1 -- 172.21.15.132:0/3217370279 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e580ab660 con 0x7f9e5815f390 2024-04-16T15:53:14.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.926+0000 7f9e4e7fc640 1 -- 172.21.15.132:0/3217370279 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e5000a880 con 0x7f9e5815f390 2024-04-16T15:53:14.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.926+0000 7f9e600f2640 1 -- 172.21.15.132:0/3217370279 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e580abc20 con 0x7f9e5815f390 2024-04-16T15:53:14.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.927+0000 7f9e600f2640 1 -- 172.21.15.132:0/3217370279 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e580d1cf0 con 0x7f9e5815f390 2024-04-16T15:53:14.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.927+0000 7f9e4e7fc640 1 -- 172.21.15.132:0/3217370279 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9e5001b070 con 0x7f9e5815f390 2024-04-16T15:53:14.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.927+0000 7f9e4e7fc640 1 --2- 172.21.15.132:0/3217370279 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f9e3c06c920 0x7f9e3c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:14.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.928+0000 7f9e4e7fc640 1 -- 172.21.15.132:0/3217370279 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f9e5008aed0 con 0x7f9e5815f390 2024-04-16T15:53:14.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.928+0000 7f9e5de8e640 1 --2- 172.21.15.132:0/3217370279 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f9e3c06c920 0x7f9e3c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:14.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.928+0000 7f9e5de8e640 1 --2- 172.21.15.132:0/3217370279 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f9e3c06c920 0x7f9e3c06ede0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9e58162b90 tx=0x7f9e54009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:14.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:14.932+0000 7f9e4e7fc640 1 -- 172.21.15.132:0/3217370279 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9e580d1cf0 con 0x7f9e5815f390 2024-04-16T15:53:15.174 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.175+0000 7f9e600f2640 1 -- 172.21.15.132:0/3217370279 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f9e58075510 con 0x7f9e5815f390 2024-04-16T15:53:15.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.178+0000 7f9e4e7fc640 1 -- 172.21.15.132:0/3217370279 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f9e50059000 con 0x7f9e5815f390 2024-04-16T15:53:15.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.181+0000 7f9e600f2640 1 -- 172.21.15.132:0/3217370279 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f9e3c06c920 msgr2=0x7f9e3c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:15.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.181+0000 7f9e600f2640 1 --2- 172.21.15.132:0/3217370279 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f9e3c06c920 0x7f9e3c06ede0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9e58162b90 tx=0x7f9e54009190 comp rx=0 tx=0).stop 2024-04-16T15:53:15.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.181+0000 7f9e600f2640 1 -- 172.21.15.132:0/3217370279 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e5815f390 msgr2=0x7f9e580ac700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:15.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.181+0000 7f9e600f2640 1 --2- 172.21.15.132:0/3217370279 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e5815f390 0x7f9e580ac700 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f9e5000c6d0 tx=0x7f9e5000cb90 comp rx=0 tx=0).stop 2024-04-16T15:53:15.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.181+0000 7f9e600f2640 1 -- 172.21.15.132:0/3217370279 shutdown_connections 2024-04-16T15:53:15.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.181+0000 7f9e600f2640 1 --2- 172.21.15.132:0/3217370279 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f9e3c06c920 0x7f9e3c06ede0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:15.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.181+0000 7f9e600f2640 1 --2- 172.21.15.132:0/3217370279 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e5815f390 0x7f9e580ac700 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:15.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.181+0000 7f9e600f2640 1 --2- 172.21.15.132:0/3217370279 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e5815efb0 0x7f9e58161300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:15.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.181+0000 7f9e600f2640 1 --2- 172.21.15.132:0/3217370279 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e580d3d60 0x7f9e5815b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:15.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.181+0000 7f9e600f2640 1 -- 172.21.15.132:0/3217370279 >> 172.21.15.132:0/3217370279 conn(0x7f9e580d1460 msgr2=0x7f9e5806cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:15.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.181+0000 7f9e600f2640 1 -- 172.21.15.132:0/3217370279 shutdown_connections 2024-04-16T15:53:15.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.181+0000 7f9e600f2640 1 -- 172.21.15.132:0/3217370279 wait complete. 2024-04-16T15:53:15.192 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:53:15.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.337+0000 7ff3aab9d640 1 Processor -- start 2024-04-16T15:53:15.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.337+0000 7ff3aab9d640 1 -- start start 2024-04-16T15:53:15.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.338+0000 7ff3aab9d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff3a4151e90 0x7ff3a40cf9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:15.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.338+0000 7ff3aab9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff3a40b5cc0 0x7ff3a40b6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:15.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.338+0000 7ff3aab9d640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3a40cec90 con 0x7ff3a406dc90 2024-04-16T15:53:15.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.338+0000 7ff3aab9d640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7ff3a40cf540 con 0x7ff3a40b5cc0 2024-04-16T15:53:15.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.338+0000 7ff3aab9d640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7ff3a40cef10 con 0x7ff3a4151e90 2024-04-16T15:53:15.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.338+0000 7ff3a3fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff3a40b5cc0 0x7ff3a40b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:15.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.338+0000 7ff3a913a640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7ff3a406dc90 0x7ff3a406e0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:38904/0 (socket says 172.21.15.132:38904) 2024-04-16T15:53:15.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.338+0000 7ff3a913a640 1 -- 172.21.15.132:0/2533902016 learned_addr learned my addr 172.21.15.132:0/2533902016 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:53:15.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.338+0000 7ff3a8939640 1 --2- 172.21.15.132:0/2533902016 >> v2:172.21.15.179:3300/0 conn(0x7ff3a4151e90 0x7ff3a40cf9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:15.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.338+0000 7ff3a3fff640 1 -- 172.21.15.132:0/2533902016 >> v2:172.21.15.179:3300/0 conn(0x7ff3a4151e90 msgr2=0x7ff3a40cf9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:15.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.338+0000 7ff3a3fff640 1 --2- 172.21.15.132:0/2533902016 >> v2:172.21.15.179:3300/0 conn(0x7ff3a4151e90 0x7ff3a40cf9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:15.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.338+0000 7ff3a3fff640 1 -- 172.21.15.132:0/2533902016 >> v1:172.21.15.132:6789/0 conn(0x7ff3a406dc90 legacy=0x7ff3a406e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:15.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.338+0000 7ff3a3fff640 1 -- 172.21.15.132:0/2533902016 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3a4152270 con 0x7ff3a40b5cc0 2024-04-16T15:53:15.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.339+0000 7ff3a3fff640 1 --2- 172.21.15.132:0/2533902016 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3a40b5cc0 0x7ff3a40b6150 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff3a40b38d0 tx=0x7ff39402bd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c042b50f35f25909 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:15.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.339+0000 7ff3a37fe640 1 -- 172.21.15.132:0/2533902016 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff394039070 con 0x7ff3a40b5cc0 2024-04-16T15:53:15.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.339+0000 7ff3a37fe640 1 -- 172.21.15.132:0/2533902016 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff39402ca30 con 0x7ff3a40b5cc0 2024-04-16T15:53:15.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.339+0000 7ff3a37fe640 1 -- 172.21.15.132:0/2533902016 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff39402ce00 con 0x7ff3a40b5cc0 2024-04-16T15:53:15.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.339+0000 7ff3aab9d640 1 -- 172.21.15.132:0/2533902016 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3a40b5cc0 msgr2=0x7ff3a40b6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:15.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.339+0000 7ff3aab9d640 1 --2- 172.21.15.132:0/2533902016 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3a40b5cc0 0x7ff3a40b6150 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff3a40b38d0 tx=0x7ff39402bd00 comp rx=0 tx=0).stop 2024-04-16T15:53:15.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.339+0000 7ff3aab9d640 1 -- 172.21.15.132:0/2533902016 shutdown_connections 2024-04-16T15:53:15.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.339+0000 7ff3aab9d640 1 --2- 172.21.15.132:0/2533902016 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3a40b5cc0 0x7ff3a40b6150 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:15.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.339+0000 7ff3aab9d640 1 --2- 172.21.15.132:0/2533902016 >> v2:172.21.15.179:3300/0 conn(0x7ff3a4151e90 0x7ff3a40cf9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:15.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.340+0000 7ff3aab9d640 1 -- 172.21.15.132:0/2533902016 >> 172.21.15.132:0/2533902016 conn(0x7ff3a40b2d50 msgr2=0x7ff3a406ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:15.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.340+0000 7ff3aab9d640 1 -- 172.21.15.132:0/2533902016 shutdown_connections 2024-04-16T15:53:15.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.340+0000 7ff3aab9d640 1 -- 172.21.15.132:0/2533902016 wait complete. 2024-04-16T15:53:15.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.341+0000 7ff3aab9d640 1 Processor -- start 2024-04-16T15:53:15.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.341+0000 7ff3aab9d640 1 -- start start 2024-04-16T15:53:15.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.342+0000 7ff3aab9d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3a406dc90 0x7ff3a41548c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:15.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.342+0000 7ff3aab9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3a40b5cc0 0x7ff3a41576c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:15.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.342+0000 7ff3aab9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3a4151e90 0x7ff3a41566d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:15.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.342+0000 7ff3aab9d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a40cff10 con 0x7ff3a4151e90 2024-04-16T15:53:15.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.342+0000 7ff3aab9d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a40cf1d0 con 0x7ff3a40b5cc0 2024-04-16T15:53:15.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.342+0000 7ff3aab9d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff3a40d0090 con 0x7ff3a406dc90 2024-04-16T15:53:15.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.342+0000 7ff3a913a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3a4151e90 0x7ff3a41566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:15.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.342+0000 7ff3a913a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3a4151e90 0x7ff3a41566d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57340/0 (socket says 172.21.15.132:57340) 2024-04-16T15:53:15.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.342+0000 7ff3a913a640 1 -- 172.21.15.132:0/1453185665 learned_addr learned my addr 172.21.15.132:0/1453185665 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:15.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.342+0000 7ff3a3fff640 1 --2- 172.21.15.132:0/1453185665 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3a40b5cc0 0x7ff3a41576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:15.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.342+0000 7ff3a8939640 1 --2- 172.21.15.132:0/1453185665 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3a406dc90 0x7ff3a41548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:15.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.342+0000 7ff3a913a640 1 -- 172.21.15.132:0/1453185665 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3a406dc90 msgr2=0x7ff3a41548c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:15.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.342+0000 7ff3a913a640 1 --2- 172.21.15.132:0/1453185665 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3a406dc90 0x7ff3a41548c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:15.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.342+0000 7ff3a913a640 1 -- 172.21.15.132:0/1453185665 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3a40b5cc0 msgr2=0x7ff3a41576c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:15.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.342+0000 7ff3a913a640 1 --2- 172.21.15.132:0/1453185665 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3a40b5cc0 0x7ff3a41576c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:15.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.342+0000 7ff3a913a640 1 -- 172.21.15.132:0/1453185665 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3a4158380 con 0x7ff3a4151e90 2024-04-16T15:53:15.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.342+0000 7ff3a8939640 1 --2- 172.21.15.132:0/1453185665 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3a406dc90 0x7ff3a41548c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:53:15.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.342+0000 7ff3a913a640 1 --2- 172.21.15.132:0/1453185665 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3a4151e90 0x7ff3a41566d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff38c00c7e0 tx=0x7ff38c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:15.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.342+0000 7ff3a17fa640 1 -- 172.21.15.132:0/1453185665 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff38c018070 con 0x7ff3a4151e90 2024-04-16T15:53:15.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.342+0000 7ff3a17fa640 1 -- 172.21.15.132:0/1453185665 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff38c0074e0 con 0x7ff3a4151e90 2024-04-16T15:53:15.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.342+0000 7ff3aab9d640 1 -- 172.21.15.132:0/1453185665 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3a41580a0 con 0x7ff3a4151e90 2024-04-16T15:53:15.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.342+0000 7ff3a17fa640 1 -- 172.21.15.132:0/1453185665 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff38c0049e0 con 0x7ff3a4151e90 2024-04-16T15:53:15.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.342+0000 7ff3aab9d640 1 -- 172.21.15.132:0/1453185665 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3a4155ed0 con 0x7ff3a4151e90 2024-04-16T15:53:15.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.343+0000 7ff3aab9d640 1 -- 172.21.15.132:0/1453185665 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3a4075510 con 0x7ff3a4151e90 2024-04-16T15:53:15.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.344+0000 7ff3a17fa640 1 -- 172.21.15.132:0/1453185665 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff38c01b070 con 0x7ff3a4151e90 2024-04-16T15:53:15.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.344+0000 7ff3a17fa640 1 --2- 172.21.15.132:0/1453185665 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7ff38406c8f0 0x7ff38406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:15.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.344+0000 7ff3a17fa640 1 -- 172.21.15.132:0/1453185665 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7ff38c08ade0 con 0x7ff3a4151e90 2024-04-16T15:53:15.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.344+0000 7ff3a8939640 1 --2- 172.21.15.132:0/1453185665 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7ff38406c8f0 0x7ff38406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:15.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.345+0000 7ff3a8939640 1 --2- 172.21.15.132:0/1453185665 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7ff38406c8f0 0x7ff38406edb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff39c006fd0 tx=0x7ff39c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:15.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.349+0000 7ff3a17fa640 1 -- 172.21.15.132:0/1453185665 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff3a4158380 con 0x7ff3a4151e90 2024-04-16T15:53:15.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.526+0000 7ff3aab9d640 1 -- 172.21.15.132:0/1453185665 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff3a4068de0 con 0x7ff3a4151e90 2024-04-16T15:53:15.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.527+0000 7ff3a17fa640 1 -- 172.21.15.132:0/1453185665 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) ==== 74+0+12891 (secure 0 0 0) 0x7ff3a40cec90 con 0x7ff3a4151e90 2024-04-16T15:53:15.527 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:53:15.527 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":30,"fsid":"6bdec5d9-f406-43ad-8584-0503b32f6f0d","created":"2024-04-16T15:51:51.073040+0000","modified":"2024-04-16T15:53:12.526300+0000","last_up_change":"2024-04-16T15:52:02.280496+0000","last_in_change":"2024-04-16T15:51:53.376468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:52:03.284927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d45908b-6e22-4619-b190-897af594b712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6801","nonce":1170594668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6803","nonce":1170594668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6807","nonce":1170594668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6805","nonce":1170594668}]},"public_addr":"172.21.15.132:6801/1170594668","cluster_addr":"172.21.15.132:6803/1170594668","heartbeat_back_addr":"172.21.15.132:6807/1170594668","heartbeat_front_addr":"172.21.15.132:6805/1170594668","state":["exists","up"]},{"osd":1,"uuid":"c88bf082-e51f-4ee6-815a-025f6ce0d67b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6809","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6811","nonce":2494780358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6815","nonce":2494780358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6823","nonce":2494780358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6819","nonce":2494780358}]},"public_addr":"172.21.15.132:6811/2494780358","cluster_addr":"172.21.15.132:6815/2494780358","heartbeat_back_addr":"172.21.15.132:6823/2494780358","heartbeat_front_addr":"172.21.15.132:6819/2494780358","state":["exists","up"]},{"osd":2,"uuid":"e5dbd6b4-4e7b-47e4-ad4e-35b4b81696c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6825","nonce":27655483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6827","nonce":27655483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6831","nonce":27655483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6829","nonce":27655483}]},"public_addr":"172.21.15.132:6825/27655483","cluster_addr":"172.21.15.132:6827/27655483","heartbeat_back_addr":"172.21.15.132:6831/27655483","heartbeat_front_addr":"172.21.15.132:6829/27655483","state":["exists","up"]},{"osd":3,"uuid":"9d75cd67-3b8a-4424-8884-5f3660e1f5f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6810","nonce":3100919191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6814","nonce":3100919191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6821","nonce":3100919191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6818","nonce":3100919191}]},"public_addr":"172.21.15.132:6810/3100919191","cluster_addr":"172.21.15.132:6814/3100919191","heartbeat_back_addr":"172.21.15.132:6821/3100919191","heartbeat_front_addr":"172.21.15.132:6818/3100919191","state":["exists","up"]},{"osd":4,"uuid":"83aea46a-8642-4777-912b-c130e5890da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6825","nonce":123637799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6827","nonce":123637799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6831","nonce":123637799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6829","nonce":123637799}]},"public_addr":"172.21.15.179:6825/123637799","cluster_addr":"172.21.15.179:6827/123637799","heartbeat_back_addr":"172.21.15.179:6831/123637799","heartbeat_front_addr":"172.21.15.179:6829/123637799","state":["exists","up"]},{"osd":5,"uuid":"534117c8-3317-48d6-b436-afd5709f71e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6801","nonce":2224750370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6803","nonce":2224750370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6807","nonce":2224750370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6805","nonce":2224750370}]},"public_addr":"172.21.15.179:6801/2224750370","cluster_addr":"172.21.15.179:6803/2224750370","heartbeat_back_addr":"172.21.15.179:6807/2224750370","heartbeat_front_addr":"172.21.15.179:6805/2224750370","state":["exists","up"]},{"osd":6,"uuid":"0ba363e7-fa9d-42b1-ae09-a6a0f57d41f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6809","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6811","nonce":101498164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6813","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6815","nonce":101498164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6823","nonce":101498164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6819","nonce":101498164}]},"public_addr":"172.21.15.179:6811/101498164","cluster_addr":"172.21.15.179:6815/101498164","heartbeat_back_addr":"172.21.15.179:6823/101498164","heartbeat_front_addr":"172.21.15.179:6819/101498164","state":["exists","up"]},{"osd":7,"uuid":"e6830c77-2f2d-4067-9866-ee7625afc1a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6810","nonce":872148365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6814","nonce":872148365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6822","nonce":872148365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6818","nonce":872148365}]},"public_addr":"172.21.15.179:6810/872148365","cluster_addr":"172.21.15.179:6814/872148365","heartbeat_back_addr":"172.21.15.179:6822/872148365","heartbeat_front_addr":"172.21.15.179:6818/872148365","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.535221+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.563769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.520765+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.526264+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.517058+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.500842+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.534332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.512486+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:53:15.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.529+0000 7ff3aab9d640 1 -- 172.21.15.132:0/1453185665 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7ff38406c8f0 msgr2=0x7ff38406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:15.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.529+0000 7ff3aab9d640 1 --2- 172.21.15.132:0/1453185665 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7ff38406c8f0 0x7ff38406edb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff39c006fd0 tx=0x7ff39c008040 comp rx=0 tx=0).stop 2024-04-16T15:53:15.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.529+0000 7ff3aab9d640 1 -- 172.21.15.132:0/1453185665 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3a4151e90 msgr2=0x7ff3a41566d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:15.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.529+0000 7ff3aab9d640 1 --2- 172.21.15.132:0/1453185665 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3a4151e90 0x7ff3a41566d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff38c00c7e0 tx=0x7ff38c00cca0 comp rx=0 tx=0).stop 2024-04-16T15:53:15.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.529+0000 7ff3aab9d640 1 -- 172.21.15.132:0/1453185665 shutdown_connections 2024-04-16T15:53:15.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.529+0000 7ff3aab9d640 1 --2- 172.21.15.132:0/1453185665 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7ff38406c8f0 0x7ff38406edb0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:15.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.529+0000 7ff3aab9d640 1 --2- 172.21.15.132:0/1453185665 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3a4151e90 0x7ff3a41566d0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:15.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.529+0000 7ff3aab9d640 1 --2- 172.21.15.132:0/1453185665 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3a40b5cc0 0x7ff3a41576c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:15.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.529+0000 7ff3aab9d640 1 --2- 172.21.15.132:0/1453185665 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3a406dc90 0x7ff3a41548c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:15.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.530+0000 7ff3aab9d640 1 -- 172.21.15.132:0/1453185665 >> 172.21.15.132:0/1453185665 conn(0x7ff3a40b2d50 msgr2=0x7ff3a40af840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:15.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.530+0000 7ff3aab9d640 1 -- 172.21.15.132:0/1453185665 shutdown_connections 2024-04-16T15:53:15.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.530+0000 7ff3aab9d640 1 -- 172.21.15.132:0/1453185665 wait complete. 2024-04-16T15:53:15.540 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T15:52:03.284927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T15:53:15.540 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T15:53:15.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.647+0000 7f12e7eb1640 1 Processor -- start 2024-04-16T15:53:15.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.647+0000 7f12e7eb1640 1 -- start start 2024-04-16T15:53:15.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.648+0000 7f12e7eb1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12e015ee80 0x7f12e00700f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:15.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.648+0000 7f12e7eb1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f12e0067a00 0x7f12e006ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:15.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.648+0000 7f12e7eb1640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12e006f050 con 0x7f12e015eaa0 2024-04-16T15:53:15.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.648+0000 7f12e7eb1640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f12e006fc60 con 0x7f12e0067a00 2024-04-16T15:53:15.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.648+0000 7f12e7eb1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f12e006f330 con 0x7f12e015ee80 2024-04-16T15:53:15.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.648+0000 7f12e644e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f12e0067a00 0x7f12e006ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:15.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.648+0000 7f12e5c4d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f12e015eaa0 0x7f12e006e870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:38914/0 (socket says 172.21.15.132:38914) 2024-04-16T15:53:15.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.648+0000 7f12e5c4d640 1 -- 172.21.15.132:0/483166842 learned_addr learned my addr 172.21.15.132:0/483166842 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:53:15.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.648+0000 7f12e544c640 1 --2- 172.21.15.132:0/483166842 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12e015ee80 0x7f12e00700f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:15.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.648+0000 7f12e644e640 1 -- 172.21.15.132:0/483166842 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12e015ee80 msgr2=0x7f12e00700f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:15.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.648+0000 7f12e644e640 1 --2- 172.21.15.132:0/483166842 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12e015ee80 0x7f12e00700f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:15.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.648+0000 7f12e644e640 1 -- 172.21.15.132:0/483166842 >> v1:172.21.15.132:6789/0 conn(0x7f12e015eaa0 legacy=0x7f12e006e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:15.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.648+0000 7f12e644e640 1 -- 172.21.15.132:0/483166842 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12e006f610 con 0x7f12e0067a00 2024-04-16T15:53:15.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.648+0000 7f12e4c4b640 1 -- 172.21.15.132:0/483166842 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2071253078 0 0) 0x7f12e006f050 con 0x7f12e015eaa0 2024-04-16T15:53:15.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.648+0000 7f12e544c640 1 --2- 172.21.15.132:0/483166842 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12e015ee80 0x7f12e00700f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:53:15.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.649+0000 7f12e644e640 1 --2- 172.21.15.132:0/483166842 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12e0067a00 0x7f12e006ca30 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f12d80097a0 tx=0x7f12d802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee67b7a77cf99399 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:15.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.649+0000 7f12e4c4b640 1 -- 172.21.15.132:0/483166842 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d8035020 con 0x7f12e0067a00 2024-04-16T15:53:15.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.649+0000 7f12e4c4b640 1 -- 172.21.15.132:0/483166842 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12d8031830 con 0x7f12e0067a00 2024-04-16T15:53:15.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.649+0000 7f12e4c4b640 1 -- 172.21.15.132:0/483166842 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d8031c00 con 0x7f12e0067a00 2024-04-16T15:53:15.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.650+0000 7f12e7eb1640 1 -- 172.21.15.132:0/483166842 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12e0067a00 msgr2=0x7f12e006ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:15.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.650+0000 7f12e7eb1640 1 --2- 172.21.15.132:0/483166842 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12e0067a00 0x7f12e006ca30 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f12d80097a0 tx=0x7f12d802b8d0 comp rx=0 tx=0).stop 2024-04-16T15:53:15.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.650+0000 7f12e7eb1640 1 -- 172.21.15.132:0/483166842 shutdown_connections 2024-04-16T15:53:15.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.650+0000 7f12e7eb1640 1 --2- 172.21.15.132:0/483166842 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12e0067a00 0x7f12e006ca30 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:15.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.650+0000 7f12e7eb1640 1 --2- 172.21.15.132:0/483166842 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12e015ee80 0x7f12e00700f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:15.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.650+0000 7f12e7eb1640 1 -- 172.21.15.132:0/483166842 >> 172.21.15.132:0/483166842 conn(0x7f12e0072810 msgr2=0x7f12e0072c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:15.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.650+0000 7f12e7eb1640 1 -- 172.21.15.132:0/483166842 shutdown_connections 2024-04-16T15:53:15.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.650+0000 7f12e7eb1640 1 -- 172.21.15.132:0/483166842 wait complete. 2024-04-16T15:53:15.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.651+0000 7f12e7eb1640 1 Processor -- start 2024-04-16T15:53:15.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.651+0000 7f12e7eb1640 1 -- start start 2024-04-16T15:53:15.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.651+0000 7f12e7eb1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12e0067a00 0x7f12e014c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:15.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.651+0000 7f12e7eb1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12e015eaa0 0x7f12e0162c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:15.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.652+0000 7f12e7eb1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12e015ee80 0x7f12e0158a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:15.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.652+0000 7f12e7eb1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f12e006cf70 con 0x7f12e0067a00 2024-04-16T15:53:15.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.652+0000 7f12e7eb1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f12e0070630 con 0x7f12e015ee80 2024-04-16T15:53:15.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.652+0000 7f12e7eb1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f12e006d0f0 con 0x7f12e015eaa0 2024-04-16T15:53:15.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.652+0000 7f12e5c4d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12e0067a00 0x7f12e014c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:15.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.652+0000 7f12e5c4d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12e0067a00 0x7f12e014c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57346/0 (socket says 172.21.15.132:57346) 2024-04-16T15:53:15.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.652+0000 7f12e5c4d640 1 -- 172.21.15.132:0/3366741962 learned_addr learned my addr 172.21.15.132:0/3366741962 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:15.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.652+0000 7f12e5c4d640 1 -- 172.21.15.132:0/3366741962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12e015eaa0 msgr2=0x7f12e0162c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:15.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.652+0000 7f12e544c640 1 --2- 172.21.15.132:0/3366741962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12e015eaa0 0x7f12e0162c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:15.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.652+0000 7f12e5c4d640 1 --2- 172.21.15.132:0/3366741962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12e015eaa0 0x7f12e0162c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:15.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.652+0000 7f12e5c4d640 1 -- 172.21.15.132:0/3366741962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12e015ee80 msgr2=0x7f12e0158a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:15.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.652+0000 7f12e5c4d640 1 --2- 172.21.15.132:0/3366741962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12e015ee80 0x7f12e0158a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:15.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.652+0000 7f12e5c4d640 1 -- 172.21.15.132:0/3366741962 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12e01631c0 con 0x7f12e0067a00 2024-04-16T15:53:15.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.652+0000 7f12e5c4d640 1 --2- 172.21.15.132:0/3366741962 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12e0067a00 0x7f12e014c940 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f12d000c890 tx=0x7f12d000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:15.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.652+0000 7f12de7fc640 1 -- 172.21.15.132:0/3366741962 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d0018070 con 0x7f12e0067a00 2024-04-16T15:53:15.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.652+0000 7f12de7fc640 1 -- 172.21.15.132:0/3366741962 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12d000a640 con 0x7f12e0067a00 2024-04-16T15:53:15.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.652+0000 7f12e7eb1640 1 -- 172.21.15.132:0/3366741962 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12e0161c60 con 0x7f12e0067a00 2024-04-16T15:53:15.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.652+0000 7f12de7fc640 1 -- 172.21.15.132:0/3366741962 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d000aa30 con 0x7f12e0067a00 2024-04-16T15:53:15.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.652+0000 7f12e7eb1640 1 -- 172.21.15.132:0/3366741962 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12e01621a0 con 0x7f12e0067a00 2024-04-16T15:53:15.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.653+0000 7f12e7eb1640 1 -- 172.21.15.132:0/3366741962 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12e01628c0 con 0x7f12e0067a00 2024-04-16T15:53:15.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.654+0000 7f12de7fc640 1 -- 172.21.15.132:0/3366741962 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f12d001b070 con 0x7f12e0067a00 2024-04-16T15:53:15.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.654+0000 7f12de7fc640 1 --2- 172.21.15.132:0/3366741962 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f12cc06c920 0x7f12cc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:15.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.654+0000 7f12de7fc640 1 -- 172.21.15.132:0/3366741962 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f12d008ae50 con 0x7f12e0067a00 2024-04-16T15:53:15.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.654+0000 7f12e544c640 1 --2- 172.21.15.132:0/3366741962 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f12cc06c920 0x7f12cc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:15.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.655+0000 7f12e544c640 1 --2- 172.21.15.132:0/3366741962 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f12cc06c920 0x7f12cc06ede0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f12d4006fd0 tx=0x7f12d4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:15.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.658+0000 7f12de7fc640 1 -- 172.21.15.132:0/3366741962 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f12d00595d0 con 0x7f12e0067a00 2024-04-16T15:53:15.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.832+0000 7f12e7eb1640 1 -- 172.21.15.132:0/3366741962 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f12e0075510 con 0x7f12e0067a00 2024-04-16T15:53:15.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.833+0000 7f12de7fc640 1 -- 172.21.15.132:0/3366741962 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) ==== 93+0+10 (secure 0 0 0) 0x7f12d0058ed0 con 0x7f12e0067a00 2024-04-16T15:53:15.832 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2024-04-16T15:53:15.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.834+0000 7f12e7eb1640 1 -- 172.21.15.132:0/3366741962 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f12cc06c920 msgr2=0x7f12cc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:15.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.834+0000 7f12e7eb1640 1 --2- 172.21.15.132:0/3366741962 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f12cc06c920 0x7f12cc06ede0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f12d4006fd0 tx=0x7f12d4008040 comp rx=0 tx=0).stop 2024-04-16T15:53:15.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.835+0000 7f12e7eb1640 1 -- 172.21.15.132:0/3366741962 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12e0067a00 msgr2=0x7f12e014c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:15.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.835+0000 7f12e7eb1640 1 --2- 172.21.15.132:0/3366741962 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12e0067a00 0x7f12e014c940 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f12d000c890 tx=0x7f12d000cd50 comp rx=0 tx=0).stop 2024-04-16T15:53:15.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.835+0000 7f12e7eb1640 1 -- 172.21.15.132:0/3366741962 shutdown_connections 2024-04-16T15:53:15.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.835+0000 7f12e7eb1640 1 --2- 172.21.15.132:0/3366741962 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f12cc06c920 0x7f12cc06ede0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:15.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.835+0000 7f12e7eb1640 1 --2- 172.21.15.132:0/3366741962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12e015ee80 0x7f12e0158a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:15.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.835+0000 7f12e7eb1640 1 --2- 172.21.15.132:0/3366741962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12e015eaa0 0x7f12e0162c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:15.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.835+0000 7f12e7eb1640 1 --2- 172.21.15.132:0/3366741962 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12e0067a00 0x7f12e014c940 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:15.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.835+0000 7f12e7eb1640 1 -- 172.21.15.132:0/3366741962 >> 172.21.15.132:0/3366741962 conn(0x7f12e0072810 msgr2=0x7f12e00b4450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:15.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.835+0000 7f12e7eb1640 1 -- 172.21.15.132:0/3366741962 shutdown_connections 2024-04-16T15:53:15.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.835+0000 7f12e7eb1640 1 -- 172.21.15.132:0/3366741962 wait complete. 2024-04-16T15:53:15.845 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-16T15:53:15.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.949+0000 7f49dcc88640 1 Processor -- start 2024-04-16T15:53:15.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.949+0000 7f49dcc88640 1 -- start start 2024-04-16T15:53:15.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.950+0000 7f49dcc88640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f49d8144f50 0x7f49d80b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:15.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.950+0000 7f49dcc88640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49d806f4b0 0x7f49d80cd730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:15.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.950+0000 7f49dcc88640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49d80cdd60 con 0x7f49d80cd2a0 2024-04-16T15:53:15.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.950+0000 7f49dcc88640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f49d80ce040 con 0x7f49d8144f50 2024-04-16T15:53:15.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.950+0000 7f49dcc88640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f49d80b3770 con 0x7f49d806f4b0 2024-04-16T15:53:15.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.950+0000 7f49d659c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f49d8144f50 0x7f49d80b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:15.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.950+0000 7f49d659c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f49d8144f50 0x7f49d80b4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57360/0 (socket says 172.21.15.132:57360) 2024-04-16T15:53:15.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.950+0000 7f49d659c640 1 -- 172.21.15.132:0/2015137076 learned_addr learned my addr 172.21.15.132:0/2015137076 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:15.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.951+0000 7f49d6d9d640 1 --2- 172.21.15.132:0/2015137076 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49d806f4b0 0x7f49d80cd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:15.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.951+0000 7f49d659c640 1 -- 172.21.15.132:0/2015137076 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49d806f4b0 msgr2=0x7f49d80cd730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:15.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.951+0000 7f49d659c640 1 --2- 172.21.15.132:0/2015137076 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49d806f4b0 0x7f49d80cd730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:15.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.951+0000 7f49d659c640 1 -- 172.21.15.132:0/2015137076 >> v1:172.21.15.179:6789/0 conn(0x7f49d80cd2a0 legacy=0x7f49d806eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:15.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.951+0000 7f49d659c640 1 -- 172.21.15.132:0/2015137076 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49d80b3a50 con 0x7f49d8144f50 2024-04-16T15:53:15.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.951+0000 7f49d659c640 1 --2- 172.21.15.132:0/2015137076 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49d8144f50 0x7f49d80b4250 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f49d80702f0 tx=0x7f49c802e010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7131f43448693108 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:15.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.951+0000 7f49d559a640 1 -- 172.21.15.132:0/2015137076 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c802e9b0 con 0x7f49d8144f50 2024-04-16T15:53:15.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.952+0000 7f49d559a640 1 -- 172.21.15.132:0/2015137076 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49c802eb50 con 0x7f49d8144f50 2024-04-16T15:53:15.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.952+0000 7f49d559a640 1 -- 172.21.15.132:0/2015137076 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c8009600 con 0x7f49d8144f50 2024-04-16T15:53:15.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.952+0000 7f49dcc88640 1 -- 172.21.15.132:0/2015137076 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49d8144f50 msgr2=0x7f49d80b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:15.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.952+0000 7f49dcc88640 1 --2- 172.21.15.132:0/2015137076 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49d8144f50 0x7f49d80b4250 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f49d80702f0 tx=0x7f49c802e010 comp rx=0 tx=0).stop 2024-04-16T15:53:15.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.952+0000 7f49dcc88640 1 -- 172.21.15.132:0/2015137076 shutdown_connections 2024-04-16T15:53:15.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.952+0000 7f49dcc88640 1 --2- 172.21.15.132:0/2015137076 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49d806f4b0 0x7f49d80cd730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:15.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.952+0000 7f49dcc88640 1 --2- 172.21.15.132:0/2015137076 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49d8144f50 0x7f49d80b4250 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:15.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.952+0000 7f49dcc88640 1 -- 172.21.15.132:0/2015137076 >> 172.21.15.132:0/2015137076 conn(0x7f49d80b2d50 msgr2=0x7f49d806ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:15.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.952+0000 7f49dcc88640 1 -- 172.21.15.132:0/2015137076 shutdown_connections 2024-04-16T15:53:15.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.952+0000 7f49dcc88640 1 -- 172.21.15.132:0/2015137076 wait complete. 2024-04-16T15:53:15.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.953+0000 7f49dcc88640 1 Processor -- start 2024-04-16T15:53:15.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.954+0000 7f49dcc88640 1 -- start start 2024-04-16T15:53:15.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.954+0000 7f49dcc88640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49d806f4b0 0x7f49d8141510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:15.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.954+0000 7f49dcc88640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49d80cd2a0 0x7f49d80ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:15.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.954+0000 7f49dcc88640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49d8144f50 0x7f49d81f44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:15.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.954+0000 7f49dcc88640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f49d8145330 con 0x7f49d80cd2a0 2024-04-16T15:53:15.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.954+0000 7f49dcc88640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f49d80afda0 con 0x7f49d806f4b0 2024-04-16T15:53:15.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.954+0000 7f49dcc88640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f49d80b4c60 con 0x7f49d8144f50 2024-04-16T15:53:15.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.954+0000 7f49d5d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49d80cd2a0 0x7f49d80ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:15.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.954+0000 7f49d5d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49d80cd2a0 0x7f49d80ae1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57374/0 (socket says 172.21.15.132:57374) 2024-04-16T15:53:15.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.954+0000 7f49d5d9b640 1 -- 172.21.15.132:0/3769409266 learned_addr learned my addr 172.21.15.132:0/3769409266 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:15.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.954+0000 7f49d6d9d640 1 --2- 172.21.15.132:0/3769409266 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49d8144f50 0x7f49d81f44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:15.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.954+0000 7f49d659c640 1 --2- 172.21.15.132:0/3769409266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49d806f4b0 0x7f49d8141510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:15.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.955+0000 7f49d5d9b640 1 -- 172.21.15.132:0/3769409266 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49d8144f50 msgr2=0x7f49d81f44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:15.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.955+0000 7f49d5d9b640 1 --2- 172.21.15.132:0/3769409266 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49d8144f50 0x7f49d81f44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:15.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.955+0000 7f49d5d9b640 1 -- 172.21.15.132:0/3769409266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49d806f4b0 msgr2=0x7f49d8141510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:15.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.955+0000 7f49d5d9b640 1 --2- 172.21.15.132:0/3769409266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49d806f4b0 0x7f49d8141510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:15.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.955+0000 7f49d5d9b640 1 -- 172.21.15.132:0/3769409266 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49d81f4ee0 con 0x7f49d80cd2a0 2024-04-16T15:53:15.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.955+0000 7f49d5d9b640 1 --2- 172.21.15.132:0/3769409266 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49d80cd2a0 0x7f49d80ae1d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f49cc00c460 tx=0x7f49cc00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:15.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.955+0000 7f49c6ffd640 1 -- 172.21.15.132:0/3769409266 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49cc016020 con 0x7f49d80cd2a0 2024-04-16T15:53:15.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.955+0000 7f49c6ffd640 1 -- 172.21.15.132:0/3769409266 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49cc012870 con 0x7f49d80cd2a0 2024-04-16T15:53:15.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.955+0000 7f49dcc88640 1 -- 172.21.15.132:0/3769409266 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49d81f51c0 con 0x7f49d80cd2a0 2024-04-16T15:53:15.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.955+0000 7f49c6ffd640 1 -- 172.21.15.132:0/3769409266 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49cc012c60 con 0x7f49d80cd2a0 2024-04-16T15:53:15.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.955+0000 7f49dcc88640 1 -- 172.21.15.132:0/3769409266 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49d80ae710 con 0x7f49d80cd2a0 2024-04-16T15:53:15.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.956+0000 7f49dcc88640 1 -- 172.21.15.132:0/3769409266 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49d8075510 con 0x7f49d80cd2a0 2024-04-16T15:53:15.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.956+0000 7f49c6ffd640 1 -- 172.21.15.132:0/3769409266 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f49cc019020 con 0x7f49d80cd2a0 2024-04-16T15:53:15.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.957+0000 7f49c6ffd640 1 --2- 172.21.15.132:0/3769409266 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f49b806c8f0 0x7f49b806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:15.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.957+0000 7f49d659c640 1 --2- 172.21.15.132:0/3769409266 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f49b806c8f0 0x7f49b806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:15.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.957+0000 7f49c6ffd640 1 -- 172.21.15.132:0/3769409266 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f49cc08b3c0 con 0x7f49d80cd2a0 2024-04-16T15:53:15.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.957+0000 7f49d659c640 1 --2- 172.21.15.132:0/3769409266 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f49b806c8f0 0x7f49b806edb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f49c8037000 tx=0x7f49c8032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:15.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:15.961+0000 7f49c6ffd640 1 -- 172.21.15.132:0/3769409266 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f49cc020030 con 0x7f49d80cd2a0 2024-04-16T15:53:16.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.137+0000 7f49dcc88640 1 -- 172.21.15.132:0/3769409266 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f49d8140d50 con 0x7f49d80cd2a0 2024-04-16T15:53:16.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.138+0000 7f49c6ffd640 1 -- 172.21.15.132:0/3769409266 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) ==== 84+0+65 (secure 0 0 0) 0x7f49cc059500 con 0x7f49d80cd2a0 2024-04-16T15:53:16.137 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:53:16.137 INFO:teuthology.orchestra.run.smithi132.stdout:[ 2024-04-16T15:53:16.138 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-16T15:53:16.138 INFO:teuthology.orchestra.run.smithi132.stdout: "poolnum": 1, 2024-04-16T15:53:16.138 INFO:teuthology.orchestra.run.smithi132.stdout: "poolname": ".mgr" 2024-04-16T15:53:16.138 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-16T15:53:16.138 INFO:teuthology.orchestra.run.smithi132.stdout:] 2024-04-16T15:53:16.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.140+0000 7f49dcc88640 1 -- 172.21.15.132:0/3769409266 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f49b806c8f0 msgr2=0x7f49b806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:16.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.140+0000 7f49dcc88640 1 --2- 172.21.15.132:0/3769409266 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f49b806c8f0 0x7f49b806edb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f49c8037000 tx=0x7f49c8032000 comp rx=0 tx=0).stop 2024-04-16T15:53:16.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.140+0000 7f49dcc88640 1 -- 172.21.15.132:0/3769409266 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49d80cd2a0 msgr2=0x7f49d80ae1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:16.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.140+0000 7f49dcc88640 1 --2- 172.21.15.132:0/3769409266 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49d80cd2a0 0x7f49d80ae1d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f49cc00c460 tx=0x7f49cc00c920 comp rx=0 tx=0).stop 2024-04-16T15:53:16.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.140+0000 7f49dcc88640 1 -- 172.21.15.132:0/3769409266 shutdown_connections 2024-04-16T15:53:16.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.140+0000 7f49dcc88640 1 --2- 172.21.15.132:0/3769409266 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f49b806c8f0 0x7f49b806edb0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:16.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.140+0000 7f49dcc88640 1 --2- 172.21.15.132:0/3769409266 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49d8144f50 0x7f49d81f44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:16.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.140+0000 7f49dcc88640 1 --2- 172.21.15.132:0/3769409266 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49d80cd2a0 0x7f49d80ae1d0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:16.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.140+0000 7f49dcc88640 1 --2- 172.21.15.132:0/3769409266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49d806f4b0 0x7f49d8141510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:16.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.140+0000 7f49dcc88640 1 -- 172.21.15.132:0/3769409266 >> 172.21.15.132:0/3769409266 conn(0x7f49d80b2d50 msgr2=0x7f49d80b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:16.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.140+0000 7f49dcc88640 1 -- 172.21.15.132:0/3769409266 shutdown_connections 2024-04-16T15:53:16.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.140+0000 7f49dcc88640 1 -- 172.21.15.132:0/3769409266 wait complete. 2024-04-16T15:53:16.150 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-16T15:53:16.150 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-16T15:53:16.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.260+0000 7fb62aa88640 1 Processor -- start 2024-04-16T15:53:16.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.260+0000 7fb62aa88640 1 -- start start 2024-04-16T15:53:16.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.261+0000 7fb62aa88640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb62415c860 0x7fb62406ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:16.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.261+0000 7fb62aa88640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb624161200 con 0x7fb6240708f0 2024-04-16T15:53:16.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.261+0000 7fb62aa88640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6240ce070 con 0x7fb624073a30 2024-04-16T15:53:16.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.261+0000 7fb62aa88640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fb6240cec80 con 0x7fb62415c860 2024-04-16T15:53:16.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.261+0000 7fb628824640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb62415c860 0x7fb62406ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:16.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.261+0000 7fb628824640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb62415c860 0x7fb62406ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57376/0 (socket says 172.21.15.132:57376) 2024-04-16T15:53:16.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.261+0000 7fb628824640 1 -- 172.21.15.132:0/1711767715 learned_addr learned my addr 172.21.15.132:0/1711767715 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:16.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.261+0000 7fb61bfff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fb6240708f0 0x7fb6241603e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:38926/0 (socket says 172.21.15.132:38926) 2024-04-16T15:53:16.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.261+0000 7fb628824640 1 -- 172.21.15.132:0/1711767715 >> v1:172.21.15.179:6789/0 conn(0x7fb624073a30 legacy=0x7fb624160af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:16.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.261+0000 7fb628824640 1 -- 172.21.15.132:0/1711767715 >> v1:172.21.15.132:6789/0 conn(0x7fb6240708f0 legacy=0x7fb6241603e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:16.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.261+0000 7fb628824640 1 -- 172.21.15.132:0/1711767715 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6240ce350 con 0x7fb62415c860 2024-04-16T15:53:16.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.261+0000 7fb61b7fe640 1 -- 172.21.15.132:0/1711767715 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3649954962 0 0) 0x7fb624161200 con 0x7fb6240708f0 2024-04-16T15:53:16.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.262+0000 7fb628824640 1 --2- 172.21.15.132:0/1711767715 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb62415c860 0x7fb62406ba20 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb620009870 tx=0x7fb62002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=926a6c6c48413e98 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:16.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.262+0000 7fb61b7fe640 1 -- 172.21.15.132:0/1711767715 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb62002e070 con 0x7fb62415c860 2024-04-16T15:53:16.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.262+0000 7fb61b7fe640 1 -- 172.21.15.132:0/1711767715 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb620037070 con 0x7fb62415c860 2024-04-16T15:53:16.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.262+0000 7fb61b7fe640 1 -- 172.21.15.132:0/1711767715 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb620031a00 con 0x7fb62415c860 2024-04-16T15:53:16.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.262+0000 7fb62aa88640 1 -- 172.21.15.132:0/1711767715 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb62415c860 msgr2=0x7fb62406ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:16.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.262+0000 7fb62aa88640 1 --2- 172.21.15.132:0/1711767715 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb62415c860 0x7fb62406ba20 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb620009870 tx=0x7fb62002b880 comp rx=0 tx=0).stop 2024-04-16T15:53:16.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.263+0000 7fb62aa88640 1 -- 172.21.15.132:0/1711767715 shutdown_connections 2024-04-16T15:53:16.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.263+0000 7fb62aa88640 1 --2- 172.21.15.132:0/1711767715 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb62415c860 0x7fb62406ba20 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:16.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.263+0000 7fb62aa88640 1 -- 172.21.15.132:0/1711767715 >> 172.21.15.132:0/1711767715 conn(0x7fb6240b33d0 msgr2=0x7fb6240b37b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:16.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.263+0000 7fb62aa88640 1 -- 172.21.15.132:0/1711767715 shutdown_connections 2024-04-16T15:53:16.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.263+0000 7fb62aa88640 1 -- 172.21.15.132:0/1711767715 wait complete. 2024-04-16T15:53:16.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.264+0000 7fb62aa88640 1 Processor -- start 2024-04-16T15:53:16.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.264+0000 7fb62aa88640 1 -- start start 2024-04-16T15:53:16.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.265+0000 7fb62aa88640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6240708f0 0x7fb6240b5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:16.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.265+0000 7fb62aa88640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb624073a30 0x7fb62414fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:16.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.265+0000 7fb62aa88640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb62415c860 0x7fb62414d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:16.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.265+0000 7fb62aa88640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fb62415cc40 con 0x7fb62415c860 2024-04-16T15:53:16.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.265+0000 7fb62aa88640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb6240ce910 con 0x7fb6240708f0 2024-04-16T15:53:16.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.265+0000 7fb62aa88640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb624071930 con 0x7fb624073a30 2024-04-16T15:53:16.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.265+0000 7fb629025640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb62415c860 0x7fb62414d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:16.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.265+0000 7fb629025640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb62415c860 0x7fb62414d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57382/0 (socket says 172.21.15.132:57382) 2024-04-16T15:53:16.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.265+0000 7fb629025640 1 -- 172.21.15.132:0/2476370976 learned_addr learned my addr 172.21.15.132:0/2476370976 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:16.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.265+0000 7fb628824640 1 --2- 172.21.15.132:0/2476370976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6240708f0 0x7fb6240b5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:16.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.265+0000 7fb61bfff640 1 --2- 172.21.15.132:0/2476370976 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb624073a30 0x7fb62414fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:16.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.265+0000 7fb629025640 1 -- 172.21.15.132:0/2476370976 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb624073a30 msgr2=0x7fb62414fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:16.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.265+0000 7fb629025640 1 --2- 172.21.15.132:0/2476370976 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb624073a30 0x7fb62414fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:16.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.265+0000 7fb629025640 1 -- 172.21.15.132:0/2476370976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6240708f0 msgr2=0x7fb6240b5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:16.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.265+0000 7fb629025640 1 --2- 172.21.15.132:0/2476370976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6240708f0 0x7fb6240b5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:16.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.265+0000 7fb629025640 1 -- 172.21.15.132:0/2476370976 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6240b5280 con 0x7fb62415c860 2024-04-16T15:53:16.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.265+0000 7fb61bfff640 1 --2- 172.21.15.132:0/2476370976 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb624073a30 0x7fb62414fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:53:16.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.265+0000 7fb628824640 1 --2- 172.21.15.132:0/2476370976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6240708f0 0x7fb6240b5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:53:16.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.265+0000 7fb629025640 1 --2- 172.21.15.132:0/2476370976 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb62415c860 0x7fb62414d390 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb61c00c780 tx=0x7fb61c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:16.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.265+0000 7fb6197fa640 1 -- 172.21.15.132:0/2476370976 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb61c017070 con 0x7fb62415c860 2024-04-16T15:53:16.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.265+0000 7fb6197fa640 1 -- 172.21.15.132:0/2476370976 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb61c003da0 con 0x7fb62415c860 2024-04-16T15:53:16.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.265+0000 7fb62aa88640 1 -- 172.21.15.132:0/2476370976 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb624151fe0 con 0x7fb62415c860 2024-04-16T15:53:16.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.265+0000 7fb6197fa640 1 -- 172.21.15.132:0/2476370976 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb61c0052b0 con 0x7fb62415c860 2024-04-16T15:53:16.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.265+0000 7fb62aa88640 1 -- 172.21.15.132:0/2476370976 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6241522c0 con 0x7fb62415c860 2024-04-16T15:53:16.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.266+0000 7fb62aa88640 1 -- 172.21.15.132:0/2476370976 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6240b5630 con 0x7fb62415c860 2024-04-16T15:53:16.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.267+0000 7fb6197fa640 1 -- 172.21.15.132:0/2476370976 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb61c01a070 con 0x7fb62415c860 2024-04-16T15:53:16.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.267+0000 7fb6197fa640 1 --2- 172.21.15.132:0/2476370976 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fb61006c8f0 0x7fb61006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:16.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.267+0000 7fb6197fa640 1 -- 172.21.15.132:0/2476370976 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7fb61c08ad70 con 0x7fb62415c860 2024-04-16T15:53:16.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.267+0000 7fb628824640 1 --2- 172.21.15.132:0/2476370976 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fb61006c8f0 0x7fb61006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:16.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.268+0000 7fb628824640 1 --2- 172.21.15.132:0/2476370976 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fb61006c8f0 0x7fb61006edb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb620036000 tx=0x7fb62003d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:16.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.272+0000 7fb6197fa640 1 -- 172.21.15.132:0/2476370976 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb61c059580 con 0x7fb62415c860 2024-04-16T15:53:16.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:16.447+0000 7fb62aa88640 1 -- 172.21.15.132:0/2476370976 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fb624068b80 con 0x7fb62415c860 2024-04-16T15:53:17.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.182+0000 7fb6197fa640 1 -- 172.21.15.132:0/2476370976 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) ==== 138+0+0 (secure 0 0 0) 0x7fb61c058e80 con 0x7fb62415c860 2024-04-16T15:53:17.181 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_metadata' created 2024-04-16T15:53:17.184 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.184+0000 7fb62aa88640 1 -- 172.21.15.132:0/2476370976 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fb61006c8f0 msgr2=0x7fb61006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:17.184 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.184+0000 7fb62aa88640 1 --2- 172.21.15.132:0/2476370976 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fb61006c8f0 0x7fb61006edb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb620036000 tx=0x7fb62003d040 comp rx=0 tx=0).stop 2024-04-16T15:53:17.184 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.184+0000 7fb62aa88640 1 -- 172.21.15.132:0/2476370976 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb62415c860 msgr2=0x7fb62414d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:17.184 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.184+0000 7fb62aa88640 1 --2- 172.21.15.132:0/2476370976 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb62415c860 0x7fb62414d390 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb61c00c780 tx=0x7fb61c00cc40 comp rx=0 tx=0).stop 2024-04-16T15:53:17.184 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.184+0000 7fb62aa88640 1 -- 172.21.15.132:0/2476370976 shutdown_connections 2024-04-16T15:53:17.184 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.184+0000 7fb62aa88640 1 --2- 172.21.15.132:0/2476370976 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fb61006c8f0 0x7fb61006edb0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:17.184 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.184+0000 7fb62aa88640 1 --2- 172.21.15.132:0/2476370976 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb62415c860 0x7fb62414d390 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:17.185 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.184+0000 7fb62aa88640 1 --2- 172.21.15.132:0/2476370976 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb624073a30 0x7fb62414fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:17.185 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.184+0000 7fb62aa88640 1 --2- 172.21.15.132:0/2476370976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6240708f0 0x7fb6240b5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:17.185 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.184+0000 7fb62aa88640 1 -- 172.21.15.132:0/2476370976 >> 172.21.15.132:0/2476370976 conn(0x7fb6240b33d0 msgr2=0x7fb6240d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:17.185 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.185+0000 7fb62aa88640 1 -- 172.21.15.132:0/2476370976 shutdown_connections 2024-04-16T15:53:17.185 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.185+0000 7fb62aa88640 1 -- 172.21.15.132:0/2476370976 wait complete. 2024-04-16T15:53:17.200 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-16T15:53:17.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.317+0000 7f60a5b9d640 1 Processor -- start 2024-04-16T15:53:17.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.317+0000 7f60a5b9d640 1 -- start start 2024-04-16T15:53:17.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.317+0000 7f60a5b9d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f60a015eb30 0x7f60a00b4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:17.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.317+0000 7f60a5b9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f60a00708f0 0x7f60a006ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:17.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.317+0000 7f60a5b9d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60a006bf60 0x7f60a006eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:17.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.317+0000 7f60a5b9d640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f60a00ae320 con 0x7f60a00708f0 2024-04-16T15:53:17.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.317+0000 7f60a5b9d640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f60a006c370 con 0x7f60a015eb30 2024-04-16T15:53:17.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.317+0000 7f60a5b9d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f60a0070df0 con 0x7f60a006bf60 2024-04-16T15:53:17.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.318+0000 7f609ffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f60a00708f0 0x7f60a006ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:17.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.318+0000 7f609ffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f60a00708f0 0x7f60a006ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57392/0 (socket says 172.21.15.132:57392) 2024-04-16T15:53:17.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.318+0000 7f609ffff640 1 -- 172.21.15.132:0/3681964504 learned_addr learned my addr 172.21.15.132:0/3681964504 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:17.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.318+0000 7f60a539c640 1 --2- 172.21.15.132:0/3681964504 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60a006bf60 0x7f60a006eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:17.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.318+0000 7f60a4b9b640 1 --2- 172.21.15.132:0/3681964504 >> v2:172.21.15.179:3300/0 conn(0x7f60a015eb30 0x7f60a00b4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:17.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.318+0000 7f609ffff640 1 -- 172.21.15.132:0/3681964504 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60a006bf60 msgr2=0x7f60a006eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:17.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.318+0000 7f609ffff640 1 --2- 172.21.15.132:0/3681964504 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60a006bf60 0x7f60a006eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:17.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.318+0000 7f609ffff640 1 -- 172.21.15.132:0/3681964504 >> v2:172.21.15.179:3300/0 conn(0x7f60a015eb30 msgr2=0x7f60a00b4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:17.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.318+0000 7f609ffff640 1 --2- 172.21.15.132:0/3681964504 >> v2:172.21.15.179:3300/0 conn(0x7f60a015eb30 0x7f60a00b4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:17.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.318+0000 7f609ffff640 1 -- 172.21.15.132:0/3681964504 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60a00b61f0 con 0x7f60a00708f0 2024-04-16T15:53:17.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.318+0000 7f60a539c640 1 --2- 172.21.15.132:0/3681964504 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60a006bf60 0x7f60a006eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:53:17.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.318+0000 7f60a4b9b640 1 --2- 172.21.15.132:0/3681964504 >> v2:172.21.15.179:3300/0 conn(0x7f60a015eb30 0x7f60a00b4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:53:17.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.319+0000 7f609ffff640 1 --2- 172.21.15.132:0/3681964504 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60a00708f0 0x7f60a006ba20 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f60a0072ab0 tx=0x7f608802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4217de6bd1b897f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:17.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.319+0000 7f609f7fe640 1 -- 172.21.15.132:0/3681964504 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f608802e070 con 0x7f60a00708f0 2024-04-16T15:53:17.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.319+0000 7f609f7fe640 1 -- 172.21.15.132:0/3681964504 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6088037070 con 0x7f60a00708f0 2024-04-16T15:53:17.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.319+0000 7f609f7fe640 1 -- 172.21.15.132:0/3681964504 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6088031a00 con 0x7f60a00708f0 2024-04-16T15:53:17.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.319+0000 7f60a5b9d640 1 -- 172.21.15.132:0/3681964504 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60a00708f0 msgr2=0x7f60a006ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:17.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.319+0000 7f60a5b9d640 1 --2- 172.21.15.132:0/3681964504 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60a00708f0 0x7f60a006ba20 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f60a0072ab0 tx=0x7f608802b880 comp rx=0 tx=0).stop 2024-04-16T15:53:17.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.319+0000 7f60a5b9d640 1 -- 172.21.15.132:0/3681964504 shutdown_connections 2024-04-16T15:53:17.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.319+0000 7f60a5b9d640 1 --2- 172.21.15.132:0/3681964504 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60a006bf60 0x7f60a006eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:17.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.319+0000 7f60a5b9d640 1 --2- 172.21.15.132:0/3681964504 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60a00708f0 0x7f60a006ba20 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:17.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.319+0000 7f60a5b9d640 1 --2- 172.21.15.132:0/3681964504 >> v2:172.21.15.179:3300/0 conn(0x7f60a015eb30 0x7f60a00b4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:17.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.319+0000 7f60a5b9d640 1 -- 172.21.15.132:0/3681964504 >> 172.21.15.132:0/3681964504 conn(0x7f60a00b6860 msgr2=0x7f60a00b6c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:17.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.319+0000 7f60a5b9d640 1 -- 172.21.15.132:0/3681964504 shutdown_connections 2024-04-16T15:53:17.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.319+0000 7f60a5b9d640 1 -- 172.21.15.132:0/3681964504 wait complete. 2024-04-16T15:53:17.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.321+0000 7f60a5b9d640 1 Processor -- start 2024-04-16T15:53:17.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.321+0000 7f60a5b9d640 1 -- start start 2024-04-16T15:53:17.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.321+0000 7f60a5b9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60a006bf60 0x7f60a0149dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:17.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.321+0000 7f60a5b9d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60a00708f0 0x7f60a0156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:17.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.321+0000 7f60a5b9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60a015eb30 0x7f60a00b27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:17.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.321+0000 7f60a5b9d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f60a00b4880 con 0x7f60a006bf60 2024-04-16T15:53:17.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.321+0000 7f60a5b9d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f60a00b5e10 con 0x7f60a015eb30 2024-04-16T15:53:17.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.321+0000 7f60a5b9d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f60a015ef10 con 0x7f60a00708f0 2024-04-16T15:53:17.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.322+0000 7f60a4b9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60a006bf60 0x7f60a0149dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:17.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.322+0000 7f60a4b9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60a006bf60 0x7f60a0149dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57406/0 (socket says 172.21.15.132:57406) 2024-04-16T15:53:17.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.322+0000 7f60a4b9b640 1 -- 172.21.15.132:0/46205002 learned_addr learned my addr 172.21.15.132:0/46205002 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:17.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.322+0000 7f609ffff640 1 --2- 172.21.15.132:0/46205002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60a00708f0 0x7f60a0156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:17.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.322+0000 7f60a539c640 1 --2- 172.21.15.132:0/46205002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60a015eb30 0x7f60a00b27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:17.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.322+0000 7f60a4b9b640 1 -- 172.21.15.132:0/46205002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60a00708f0 msgr2=0x7f60a0156180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:17.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.322+0000 7f60a4b9b640 1 --2- 172.21.15.132:0/46205002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60a00708f0 0x7f60a0156180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:17.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.322+0000 7f60a4b9b640 1 -- 172.21.15.132:0/46205002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60a015eb30 msgr2=0x7f60a00b27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:17.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.322+0000 7f60a4b9b640 1 --2- 172.21.15.132:0/46205002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60a015eb30 0x7f60a00b27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:17.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.322+0000 7f60a4b9b640 1 -- 172.21.15.132:0/46205002 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60a015f160 con 0x7f60a006bf60 2024-04-16T15:53:17.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.322+0000 7f60a4b9b640 1 --2- 172.21.15.132:0/46205002 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60a006bf60 0x7f60a0149dc0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f609000cf60 tx=0x7f609000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:17.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.322+0000 7f609d7fa640 1 -- 172.21.15.132:0/46205002 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f609001a070 con 0x7f60a006bf60 2024-04-16T15:53:17.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.322+0000 7f609d7fa640 1 -- 172.21.15.132:0/46205002 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f609000d840 con 0x7f60a006bf60 2024-04-16T15:53:17.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.322+0000 7f60a5b9d640 1 -- 172.21.15.132:0/46205002 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60a015f440 con 0x7f60a006bf60 2024-04-16T15:53:17.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.322+0000 7f609d7fa640 1 -- 172.21.15.132:0/46205002 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f609000dc10 con 0x7f60a006bf60 2024-04-16T15:53:17.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.322+0000 7f60a5b9d640 1 -- 172.21.15.132:0/46205002 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60a014a300 con 0x7f60a006bf60 2024-04-16T15:53:17.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.323+0000 7f60a5b9d640 1 -- 172.21.15.132:0/46205002 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60a004fe00 con 0x7f60a006bf60 2024-04-16T15:53:17.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.324+0000 7f609d7fa640 1 -- 172.21.15.132:0/46205002 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f609001d070 con 0x7f60a006bf60 2024-04-16T15:53:17.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.324+0000 7f609d7fa640 1 --2- 172.21.15.132:0/46205002 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f608006c8f0 0x7f608006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:17.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.324+0000 7f609d7fa640 1 -- 172.21.15.132:0/46205002 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5227+0+0 (secure 0 0 0) 0x7f609008c030 con 0x7f60a006bf60 2024-04-16T15:53:17.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.324+0000 7f609ffff640 1 --2- 172.21.15.132:0/46205002 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f608006c8f0 0x7f608006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:17.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.325+0000 7f609ffff640 1 --2- 172.21.15.132:0/46205002 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f608006c8f0 0x7f608006edb0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6088036000 tx=0x7f608803d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:17.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.329+0000 7f609d7fa640 1 -- 172.21.15.132:0/46205002 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f609005a080 con 0x7f60a006bf60 2024-04-16T15:53:17.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:17.506+0000 7f60a5b9d640 1 -- 172.21.15.132:0/46205002 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f60a00aeff0 con 0x7f60a006bf60 2024-04-16T15:53:18.188 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.188+0000 7f609d7fa640 1 -- 172.21.15.132:0/46205002 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) ==== 170+0+0 (secure 0 0 0) 0x7f609005e380 con 0x7f60a006bf60 2024-04-16T15:53:18.188 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_data' created 2024-04-16T15:53:18.191 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.191+0000 7f60a5b9d640 1 -- 172.21.15.132:0/46205002 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f608006c8f0 msgr2=0x7f608006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:18.191 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.191+0000 7f60a5b9d640 1 --2- 172.21.15.132:0/46205002 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f608006c8f0 0x7f608006edb0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6088036000 tx=0x7f608803d040 comp rx=0 tx=0).stop 2024-04-16T15:53:18.191 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.191+0000 7f60a5b9d640 1 -- 172.21.15.132:0/46205002 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60a006bf60 msgr2=0x7f60a0149dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:18.191 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.191+0000 7f60a5b9d640 1 --2- 172.21.15.132:0/46205002 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60a006bf60 0x7f60a0149dc0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f609000cf60 tx=0x7f609000cf90 comp rx=0 tx=0).stop 2024-04-16T15:53:18.192 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.191+0000 7f60a5b9d640 1 -- 172.21.15.132:0/46205002 shutdown_connections 2024-04-16T15:53:18.192 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.191+0000 7f60a5b9d640 1 --2- 172.21.15.132:0/46205002 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f608006c8f0 0x7f608006edb0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:18.192 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.191+0000 7f60a5b9d640 1 --2- 172.21.15.132:0/46205002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60a015eb30 0x7f60a00b27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:18.192 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.191+0000 7f60a5b9d640 1 --2- 172.21.15.132:0/46205002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60a00708f0 0x7f60a0156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:18.192 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.191+0000 7f60a5b9d640 1 --2- 172.21.15.132:0/46205002 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60a006bf60 0x7f60a0149dc0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:18.192 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.191+0000 7f60a5b9d640 1 -- 172.21.15.132:0/46205002 >> 172.21.15.132:0/46205002 conn(0x7f60a00b6860 msgr2=0x7f60a00b02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:18.192 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.191+0000 7f60a5b9d640 1 -- 172.21.15.132:0/46205002 shutdown_connections 2024-04-16T15:53:18.192 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.191+0000 7f60a5b9d640 1 -- 172.21.15.132:0/46205002 wait complete. 2024-04-16T15:53:18.212 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-16T15:53:18.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.320+0000 7f5232488640 1 Processor -- start 2024-04-16T15:53:18.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.320+0000 7f5232488640 1 -- start start 2024-04-16T15:53:18.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.320+0000 7f5232488640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f522c15ead0 0x7f522c0b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:18.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.320+0000 7f5232488640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f522c0d2010 0x7f522c0b4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:18.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.320+0000 7f5232488640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f522c0733e0 con 0x7f522c0ce440 2024-04-16T15:53:18.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.320+0000 7f5232488640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f522c0736c0 con 0x7f522c0d2010 2024-04-16T15:53:18.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.320+0000 7f5232488640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f522c0739a0 con 0x7f522c15ead0 2024-04-16T15:53:18.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.321+0000 7f5223fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f522c0ce440 0x7f522c0d1900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:38932/0 (socket says 172.21.15.132:38932) 2024-04-16T15:53:18.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.321+0000 7f5223fff640 1 -- 172.21.15.132:0/3969448478 learned_addr learned my addr 172.21.15.132:0/3969448478 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:53:18.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.321+0000 7f5230a25640 1 --2- 172.21.15.132:0/3969448478 >> v2:172.21.15.179:3300/0 conn(0x7f522c0d2010 0x7f522c0b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:18.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.321+0000 7f522bfff640 1 --2- 172.21.15.132:0/3969448478 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f522c15ead0 0x7f522c0b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:18.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.321+0000 7f522b7fe640 1 -- 172.21.15.132:0/3969448478 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3853802614 0 0) 0x7f522c0733e0 con 0x7f522c0ce440 2024-04-16T15:53:18.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.321+0000 7f522b7fe640 1 -- 172.21.15.132:0/3969448478 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5218003520 con 0x7f522c0ce440 2024-04-16T15:53:18.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.321+0000 7f522b7fe640 1 -- 172.21.15.132:0/3969448478 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 589542672 0 0) 0x7f5218003520 con 0x7f522c0ce440 2024-04-16T15:53:18.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.321+0000 7f522b7fe640 1 -- 172.21.15.132:0/3969448478 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f522c15ead0 msgr2=0x7f522c0b0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:18.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.321+0000 7f522b7fe640 1 --2- 172.21.15.132:0/3969448478 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f522c15ead0 0x7f522c0b0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:18.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.321+0000 7f522b7fe640 1 -- 172.21.15.132:0/3969448478 >> v2:172.21.15.179:3300/0 conn(0x7f522c0d2010 msgr2=0x7f522c0b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:18.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.321+0000 7f522b7fe640 1 --2- 172.21.15.132:0/3969448478 >> v2:172.21.15.179:3300/0 conn(0x7f522c0d2010 0x7f522c0b4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:18.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.321+0000 7f522b7fe640 1 -- 172.21.15.132:0/3969448478 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f522c073c80 con 0x7f522c0ce440 2024-04-16T15:53:18.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.321+0000 7f522b7fe640 1 -- 172.21.15.132:0/3969448478 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2803668828 0 0) 0x7f5214001670 con 0x7f522c0ce440 2024-04-16T15:53:18.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.321+0000 7f522b7fe640 1 -- 172.21.15.132:0/3969448478 >> v1:172.21.15.132:6789/0 conn(0x7f522c0ce440 legacy=0x7f522c0d1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:18.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.321+0000 7f522b7fe640 1 --2- 172.21.15.132:0/3969448478 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f522c15ead0 0x7f52180039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:18.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.321+0000 7f522b7fe640 1 --2- 172.21.15.132:0/3969448478 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5218003f30 0x7f5218004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:18.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.321+0000 7f522b7fe640 1 --2- 172.21.15.132:0/3969448478 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5218004d40 0x7f52180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:18.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.321+0000 7f522b7fe640 1 -- 172.21.15.132:0/3969448478 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f522c0736c0 con 0x7f5218003f30 2024-04-16T15:53:18.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.321+0000 7f522b7fe640 1 -- 172.21.15.132:0/3969448478 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f522c0739a0 con 0x7f5218004d40 2024-04-16T15:53:18.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.321+0000 7f522b7fe640 1 -- 172.21.15.132:0/3969448478 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f521800b9f0 con 0x7f522c15ead0 2024-04-16T15:53:18.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.321+0000 7f5223fff640 1 --2- 172.21.15.132:0/3969448478 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5218003f30 0x7f5218004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:18.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.321+0000 7f5230a25640 1 --2- 172.21.15.132:0/3969448478 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5218004d40 0x7f52180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:18.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.321+0000 7f522bfff640 1 --2- 172.21.15.132:0/3969448478 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f522c15ead0 0x7f52180039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:18.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.322+0000 7f5223fff640 1 -- 172.21.15.132:0/3969448478 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f522c15ead0 msgr2=0x7f52180039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:18.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.322+0000 7f5223fff640 1 --2- 172.21.15.132:0/3969448478 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f522c15ead0 0x7f52180039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:18.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.322+0000 7f5223fff640 1 -- 172.21.15.132:0/3969448478 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5218004d40 msgr2=0x7f52180051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:18.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.322+0000 7f5223fff640 1 --2- 172.21.15.132:0/3969448478 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5218004d40 0x7f52180051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:18.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.322+0000 7f5223fff640 1 -- 172.21.15.132:0/3969448478 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5218003520 con 0x7f5218003f30 2024-04-16T15:53:18.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.322+0000 7f5223fff640 1 --2- 172.21.15.132:0/3969448478 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5218003f30 0x7f5218004800 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f521400c210 tx=0x7f5218005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec4b94ca7b00668d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:18.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.322+0000 7f522b7fe640 1 -- 172.21.15.132:0/3969448478 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5214007d30 con 0x7f5218003f30 2024-04-16T15:53:18.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.322+0000 7f522b7fe640 1 -- 172.21.15.132:0/3969448478 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5214030070 con 0x7f5218003f30 2024-04-16T15:53:18.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.322+0000 7f522b7fe640 1 -- 172.21.15.132:0/3969448478 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5214005d70 con 0x7f5218003f30 2024-04-16T15:53:18.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.323+0000 7f5232488640 1 -- 172.21.15.132:0/3969448478 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5218003f30 msgr2=0x7f5218004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:18.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.323+0000 7f5232488640 1 --2- 172.21.15.132:0/3969448478 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5218003f30 0x7f5218004800 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f521400c210 tx=0x7f5218005830 comp rx=0 tx=0).stop 2024-04-16T15:53:18.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.323+0000 7f5230a25640 1 -- 172.21.15.132:0/3969448478 reap_dead start 2024-04-16T15:53:18.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.323+0000 7f5232488640 1 -- 172.21.15.132:0/3969448478 shutdown_connections 2024-04-16T15:53:18.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.323+0000 7f5232488640 1 -- 172.21.15.132:0/3969448478 >> 172.21.15.132:0/3969448478 conn(0x7f522c0b6b80 msgr2=0x7f522c0b6f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:18.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.323+0000 7f5232488640 1 -- 172.21.15.132:0/3969448478 shutdown_connections 2024-04-16T15:53:18.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.323+0000 7f5232488640 1 -- 172.21.15.132:0/3969448478 wait complete. 2024-04-16T15:53:18.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.324+0000 7f5232488640 1 Processor -- start 2024-04-16T15:53:18.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.324+0000 7f5232488640 1 -- start start 2024-04-16T15:53:18.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.325+0000 7f5232488640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5218003f30 0x7f522c0cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:18.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.325+0000 7f5232488640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f522c157bd0 0x7f522c158050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:18.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.325+0000 7f5232488640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f522c145810 0x7f522c145c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:18.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.325+0000 7f5232488640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f522c073f60 con 0x7f522c157bd0 2024-04-16T15:53:18.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.325+0000 7f5232488640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f522c073070 con 0x7f5218003f30 2024-04-16T15:53:18.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.325+0000 7f5232488640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f522c0cddb0 con 0x7f522c145810 2024-04-16T15:53:18.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.325+0000 7f5223fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f522c157bd0 0x7f522c158050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:18.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.325+0000 7f5223fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f522c157bd0 0x7f522c158050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57432/0 (socket says 172.21.15.132:57432) 2024-04-16T15:53:18.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.325+0000 7f5223fff640 1 -- 172.21.15.132:0/2385707633 learned_addr learned my addr 172.21.15.132:0/2385707633 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:18.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.325+0000 7f5230a25640 1 --2- 172.21.15.132:0/2385707633 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f522c145810 0x7f522c145c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:18.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.325+0000 7f522bfff640 1 --2- 172.21.15.132:0/2385707633 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5218003f30 0x7f522c0cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:18.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.326+0000 7f5223fff640 1 -- 172.21.15.132:0/2385707633 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f522c145810 msgr2=0x7f522c145c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:18.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.326+0000 7f5223fff640 1 --2- 172.21.15.132:0/2385707633 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f522c145810 0x7f522c145c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:18.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.326+0000 7f5223fff640 1 -- 172.21.15.132:0/2385707633 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5218003f30 msgr2=0x7f522c0cbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:18.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.326+0000 7f5223fff640 1 --2- 172.21.15.132:0/2385707633 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5218003f30 0x7f522c0cbca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:18.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.326+0000 7f5223fff640 1 -- 172.21.15.132:0/2385707633 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f522c156e10 con 0x7f522c157bd0 2024-04-16T15:53:18.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.326+0000 7f5223fff640 1 --2- 172.21.15.132:0/2385707633 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f522c157bd0 0x7f522c158050 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f521402c540 tx=0x7f522c0735b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:18.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.326+0000 7f52297fa640 1 -- 172.21.15.132:0/2385707633 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5214045070 con 0x7f522c157bd0 2024-04-16T15:53:18.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.326+0000 7f52297fa640 1 -- 172.21.15.132:0/2385707633 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5214000ed0 con 0x7f522c157bd0 2024-04-16T15:53:18.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.326+0000 7f5232488640 1 -- 172.21.15.132:0/2385707633 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f522c1570f0 con 0x7f522c157bd0 2024-04-16T15:53:18.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.326+0000 7f52297fa640 1 -- 172.21.15.132:0/2385707633 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5214001c70 con 0x7f522c157bd0 2024-04-16T15:53:18.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.326+0000 7f5232488640 1 -- 172.21.15.132:0/2385707633 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f522c1576b0 con 0x7f522c157bd0 2024-04-16T15:53:18.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.327+0000 7f5232488640 1 -- 172.21.15.132:0/2385707633 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f522c075510 con 0x7f522c157bd0 2024-04-16T15:53:18.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.328+0000 7f52297fa640 1 -- 172.21.15.132:0/2385707633 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5214007070 con 0x7f522c157bd0 2024-04-16T15:53:18.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.328+0000 7f52297fa640 1 --2- 172.21.15.132:0/2385707633 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f520c06c8f0 0x7f520c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:18.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.328+0000 7f52297fa640 1 -- 172.21.15.132:0/2385707633 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5609+0+0 (secure 0 0 0) 0x7f52140aca60 con 0x7f522c157bd0 2024-04-16T15:53:18.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.328+0000 7f522bfff640 1 --2- 172.21.15.132:0/2385707633 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f520c06c8f0 0x7f520c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:18.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.328+0000 7f522bfff640 1 --2- 172.21.15.132:0/2385707633 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f520c06c8f0 0x7f520c06edb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f521c009ae0 tx=0x7f521c009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:18.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.332+0000 7f52297fa640 1 -- 172.21.15.132:0/2385707633 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f521407aa40 con 0x7f522c157bd0 2024-04-16T15:53:18.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:18.545+0000 7f5232488640 1 -- 172.21.15.132:0/2385707633 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f522c15e010 con 0x7f522c157bd0 2024-04-16T15:53:19.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.202+0000 7f52297fa640 1 -- 172.21.15.132:0/2385707633 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) ==== 172+0+0 (secure 0 0 0) 0x7f521407ed40 con 0x7f522c157bd0 2024-04-16T15:53:19.202 INFO:teuthology.orchestra.run.smithi132.stderr:new fs with metadata pool 4 and data pool 5 2024-04-16T15:53:19.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.206+0000 7f5232488640 1 -- 172.21.15.132:0/2385707633 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f520c06c8f0 msgr2=0x7f520c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:19.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.206+0000 7f5232488640 1 --2- 172.21.15.132:0/2385707633 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f520c06c8f0 0x7f520c06edb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f521c009ae0 tx=0x7f521c009190 comp rx=0 tx=0).stop 2024-04-16T15:53:19.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.206+0000 7f5232488640 1 -- 172.21.15.132:0/2385707633 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f522c157bd0 msgr2=0x7f522c158050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:19.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.206+0000 7f5232488640 1 --2- 172.21.15.132:0/2385707633 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f522c157bd0 0x7f522c158050 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f521402c540 tx=0x7f522c0735b0 comp rx=0 tx=0).stop 2024-04-16T15:53:19.213 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.213+0000 7f5232488640 1 -- 172.21.15.132:0/2385707633 shutdown_connections 2024-04-16T15:53:19.213 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.213+0000 7f5232488640 1 --2- 172.21.15.132:0/2385707633 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f520c06c8f0 0x7f520c06edb0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:19.213 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.213+0000 7f5232488640 1 --2- 172.21.15.132:0/2385707633 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f522c145810 0x7f522c145c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:19.213 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.213+0000 7f5232488640 1 --2- 172.21.15.132:0/2385707633 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f522c157bd0 0x7f522c158050 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:19.213 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.213+0000 7f5232488640 1 --2- 172.21.15.132:0/2385707633 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5218003f30 0x7f522c0cbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:19.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.213+0000 7f5232488640 1 -- 172.21.15.132:0/2385707633 >> 172.21.15.132:0/2385707633 conn(0x7f522c0b6b80 msgr2=0x7f522c06f380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:19.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.214+0000 7f5232488640 1 -- 172.21.15.132:0/2385707633 shutdown_connections 2024-04-16T15:53:19.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.214+0000 7f5232488640 1 -- 172.21.15.132:0/2385707633 wait complete. 2024-04-16T15:53:19.233 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:53:19.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.340+0000 7f93bf437640 1 Processor -- start 2024-04-16T15:53:19.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.341+0000 7f93bf437640 1 -- start start 2024-04-16T15:53:19.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.341+0000 7f93bf437640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f93b815eaf0 0x7f93b80ba300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:19.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.341+0000 7f93bf437640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f93b815eed0 0x7f93b80b63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:19.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.341+0000 7f93bf437640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93b81627e0 0x7f93b80b6930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:19.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.341+0000 7f93bf437640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f93b80d2af0 con 0x7f93b815eed0 2024-04-16T15:53:19.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.341+0000 7f93bf437640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f93b8162cc0 con 0x7f93b815eaf0 2024-04-16T15:53:19.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.341+0000 7f93bf437640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f93b8162fa0 con 0x7f93b81627e0 2024-04-16T15:53:19.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.342+0000 7f93bc9d2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f93b815eed0 0x7f93b80b63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:19.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.342+0000 7f93bc9d2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f93b815eed0 0x7f93b80b63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57436/0 (socket says 172.21.15.132:57436) 2024-04-16T15:53:19.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.342+0000 7f93bc9d2640 1 -- 172.21.15.132:0/3666181427 learned_addr learned my addr 172.21.15.132:0/3666181427 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:19.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.342+0000 7f93bd9d4640 1 --2- 172.21.15.132:0/3666181427 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93b81627e0 0x7f93b80b6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:19.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.342+0000 7f93bd1d3640 1 --2- 172.21.15.132:0/3666181427 >> v2:172.21.15.179:3300/0 conn(0x7f93b815eaf0 0x7f93b80ba300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:19.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.342+0000 7f93bc9d2640 1 -- 172.21.15.132:0/3666181427 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93b81627e0 msgr2=0x7f93b80b6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:19.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.342+0000 7f93bc9d2640 1 --2- 172.21.15.132:0/3666181427 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93b81627e0 0x7f93b80b6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:19.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.342+0000 7f93bc9d2640 1 -- 172.21.15.132:0/3666181427 >> v2:172.21.15.179:3300/0 conn(0x7f93b815eaf0 msgr2=0x7f93b80ba300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:19.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.342+0000 7f93bc9d2640 1 --2- 172.21.15.132:0/3666181427 >> v2:172.21.15.179:3300/0 conn(0x7f93b815eaf0 0x7f93b80ba300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:19.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.342+0000 7f93bc9d2640 1 -- 172.21.15.132:0/3666181427 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93b8163280 con 0x7f93b815eed0 2024-04-16T15:53:19.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.342+0000 7f93bd1d3640 1 --2- 172.21.15.132:0/3666181427 >> v2:172.21.15.179:3300/0 conn(0x7f93b815eaf0 0x7f93b80ba300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:53:19.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.343+0000 7f93bc9d2640 1 --2- 172.21.15.132:0/3666181427 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93b815eed0 0x7f93b80b63f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f93b80d59f0 tx=0x7f93b402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccb092c506289e65 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:19.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.343+0000 7f93abfff640 1 -- 172.21.15.132:0/3666181427 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b4035020 con 0x7f93b815eed0 2024-04-16T15:53:19.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.343+0000 7f93abfff640 1 -- 172.21.15.132:0/3666181427 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93b4031870 con 0x7f93b815eed0 2024-04-16T15:53:19.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.343+0000 7f93abfff640 1 -- 172.21.15.132:0/3666181427 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b4031c40 con 0x7f93b815eed0 2024-04-16T15:53:19.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.343+0000 7f93bf437640 1 -- 172.21.15.132:0/3666181427 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93b815eed0 msgr2=0x7f93b80b63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:19.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.343+0000 7f93bf437640 1 --2- 172.21.15.132:0/3666181427 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93b815eed0 0x7f93b80b63f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f93b80d59f0 tx=0x7f93b402b910 comp rx=0 tx=0).stop 2024-04-16T15:53:19.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.343+0000 7f93bf437640 1 -- 172.21.15.132:0/3666181427 shutdown_connections 2024-04-16T15:53:19.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.343+0000 7f93bf437640 1 --2- 172.21.15.132:0/3666181427 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93b81627e0 0x7f93b80b6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:19.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.343+0000 7f93bf437640 1 --2- 172.21.15.132:0/3666181427 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93b815eed0 0x7f93b80b63f0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:19.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.343+0000 7f93bf437640 1 --2- 172.21.15.132:0/3666181427 >> v2:172.21.15.179:3300/0 conn(0x7f93b815eaf0 0x7f93b80ba300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:19.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.343+0000 7f93bf437640 1 -- 172.21.15.132:0/3666181427 >> 172.21.15.132:0/3666181427 conn(0x7f93b80d13f0 msgr2=0x7f93b80d1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:19.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.344+0000 7f93bf437640 1 -- 172.21.15.132:0/3666181427 shutdown_connections 2024-04-16T15:53:19.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.344+0000 7f93bf437640 1 -- 172.21.15.132:0/3666181427 wait complete. 2024-04-16T15:53:19.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.345+0000 7f93bf437640 1 Processor -- start 2024-04-16T15:53:19.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.345+0000 7f93bf437640 1 -- start start 2024-04-16T15:53:19.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.345+0000 7f93bf437640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93b815eaf0 0x7f93b80cc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:19.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.345+0000 7f93bf437640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93b815eed0 0x7f93b814ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:19.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.345+0000 7f93bf437640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93b81627e0 0x7f93b81608a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:19.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.345+0000 7f93bf437640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f93b8067760 con 0x7f93b815eed0 2024-04-16T15:53:19.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.345+0000 7f93bf437640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f93b80ba840 con 0x7f93b81627e0 2024-04-16T15:53:19.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.345+0000 7f93bf437640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f93b80678e0 con 0x7f93b815eaf0 2024-04-16T15:53:19.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.346+0000 7f93bc9d2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93b815eed0 0x7f93b814ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:19.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.346+0000 7f93bc9d2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93b815eed0 0x7f93b814ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57452/0 (socket says 172.21.15.132:57452) 2024-04-16T15:53:19.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.346+0000 7f93bc9d2640 1 -- 172.21.15.132:0/690174395 learned_addr learned my addr 172.21.15.132:0/690174395 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:19.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.346+0000 7f93bd1d3640 1 --2- 172.21.15.132:0/690174395 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93b815eaf0 0x7f93b80cc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:19.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.346+0000 7f93bd9d4640 1 --2- 172.21.15.132:0/690174395 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93b81627e0 0x7f93b81608a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:19.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.346+0000 7f93bc9d2640 1 -- 172.21.15.132:0/690174395 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93b815eaf0 msgr2=0x7f93b80cc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:19.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.346+0000 7f93bc9d2640 1 --2- 172.21.15.132:0/690174395 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93b815eaf0 0x7f93b80cc3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:19.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.346+0000 7f93bc9d2640 1 -- 172.21.15.132:0/690174395 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93b81627e0 msgr2=0x7f93b81608a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:19.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.346+0000 7f93bc9d2640 1 --2- 172.21.15.132:0/690174395 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93b81627e0 0x7f93b81608a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:19.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.346+0000 7f93bc9d2640 1 -- 172.21.15.132:0/690174395 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93b80cba40 con 0x7f93b815eed0 2024-04-16T15:53:19.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.346+0000 7f93bc9d2640 1 --2- 172.21.15.132:0/690174395 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93b815eed0 0x7f93b814ad00 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f93b4000c00 tx=0x7f93b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:19.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.346+0000 7f93a9ffb640 1 -- 172.21.15.132:0/690174395 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b4035040 con 0x7f93b815eed0 2024-04-16T15:53:19.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.346+0000 7f93a9ffb640 1 -- 172.21.15.132:0/690174395 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93b4030d00 con 0x7f93b815eed0 2024-04-16T15:53:19.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.346+0000 7f93bf437640 1 -- 172.21.15.132:0/690174395 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93b80cbd00 con 0x7f93b815eed0 2024-04-16T15:53:19.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.346+0000 7f93a9ffb640 1 -- 172.21.15.132:0/690174395 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b40456a0 con 0x7f93b815eed0 2024-04-16T15:53:19.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.346+0000 7f93bf437640 1 -- 172.21.15.132:0/690174395 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93b814c1b0 con 0x7f93b815eed0 2024-04-16T15:53:19.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.347+0000 7f93bf437640 1 -- 172.21.15.132:0/690174395 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93b8075510 con 0x7f93b815eed0 2024-04-16T15:53:19.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.348+0000 7f93a9ffb640 1 -- 172.21.15.132:0/690174395 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f93b4038020 con 0x7f93b815eed0 2024-04-16T15:53:19.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.348+0000 7f93a9ffb640 1 --2- 172.21.15.132:0/690174395 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f939c06c8f0 0x7f939c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:19.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.348+0000 7f93a9ffb640 1 -- 172.21.15.132:0/690174395 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f93b40adf20 con 0x7f93b815eed0 2024-04-16T15:53:19.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.348+0000 7f93bd1d3640 1 --2- 172.21.15.132:0/690174395 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f939c06c8f0 0x7f939c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:19.351 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.349+0000 7f93bd1d3640 1 --2- 172.21.15.132:0/690174395 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f939c06c8f0 0x7f939c06edb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f93ac006fd0 tx=0x7f93ac008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:19.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.353+0000 7f93a9ffb640 1 -- 172.21.15.132:0/690174395 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f93b407c2c0 con 0x7f93b815eed0 2024-04-16T15:53:19.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.531+0000 7f93bf437640 1 -- 172.21.15.132:0/690174395 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f93b80d2610 con 0x7f93b815eed0 2024-04-16T15:53:19.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.532+0000 7f93a9ffb640 1 -- 172.21.15.132:0/690174395 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16682 (secure 0 0 0) 0x7f93b407bbc0 con 0x7f93b815eed0 2024-04-16T15:53:19.531 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:53:19.531 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":33,"fsid":"6bdec5d9-f406-43ad-8584-0503b32f6f0d","created":"2024-04-16T15:51:51.073040+0000","modified":"2024-04-16T15:53:18.546521+0000","last_up_change":"2024-04-16T15:52:02.280496+0000","last_in_change":"2024-04-16T15:51:53.376468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:52:03.284927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:53:16.451607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-16T15:53:17.510579+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d45908b-6e22-4619-b190-897af594b712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6801","nonce":1170594668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6803","nonce":1170594668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6807","nonce":1170594668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6805","nonce":1170594668}]},"public_addr":"172.21.15.132:6801/1170594668","cluster_addr":"172.21.15.132:6803/1170594668","heartbeat_back_addr":"172.21.15.132:6807/1170594668","heartbeat_front_addr":"172.21.15.132:6805/1170594668","state":["exists","up"]},{"osd":1,"uuid":"c88bf082-e51f-4ee6-815a-025f6ce0d67b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6809","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6811","nonce":2494780358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6815","nonce":2494780358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6823","nonce":2494780358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6819","nonce":2494780358}]},"public_addr":"172.21.15.132:6811/2494780358","cluster_addr":"172.21.15.132:6815/2494780358","heartbeat_back_addr":"172.21.15.132:6823/2494780358","heartbeat_front_addr":"172.21.15.132:6819/2494780358","state":["exists","up"]},{"osd":2,"uuid":"e5dbd6b4-4e7b-47e4-ad4e-35b4b81696c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6825","nonce":27655483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6827","nonce":27655483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6831","nonce":27655483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6829","nonce":27655483}]},"public_addr":"172.21.15.132:6825/27655483","cluster_addr":"172.21.15.132:6827/27655483","heartbeat_back_addr":"172.21.15.132:6831/27655483","heartbeat_front_addr":"172.21.15.132:6829/27655483","state":["exists","up"]},{"osd":3,"uuid":"9d75cd67-3b8a-4424-8884-5f3660e1f5f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6810","nonce":3100919191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6814","nonce":3100919191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6821","nonce":3100919191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6818","nonce":3100919191}]},"public_addr":"172.21.15.132:6810/3100919191","cluster_addr":"172.21.15.132:6814/3100919191","heartbeat_back_addr":"172.21.15.132:6821/3100919191","heartbeat_front_addr":"172.21.15.132:6818/3100919191","state":["exists","up"]},{"osd":4,"uuid":"83aea46a-8642-4777-912b-c130e5890da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6825","nonce":123637799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6827","nonce":123637799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6831","nonce":123637799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6829","nonce":123637799}]},"public_addr":"172.21.15.179:6825/123637799","cluster_addr":"172.21.15.179:6827/123637799","heartbeat_back_addr":"172.21.15.179:6831/123637799","heartbeat_front_addr":"172.21.15.179:6829/123637799","state":["exists","up"]},{"osd":5,"uuid":"534117c8-3317-48d6-b436-afd5709f71e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6801","nonce":2224750370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6803","nonce":2224750370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6807","nonce":2224750370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6805","nonce":2224750370}]},"public_addr":"172.21.15.179:6801/2224750370","cluster_addr":"172.21.15.179:6803/2224750370","heartbeat_back_addr":"172.21.15.179:6807/2224750370","heartbeat_front_addr":"172.21.15.179:6805/2224750370","state":["exists","up"]},{"osd":6,"uuid":"0ba363e7-fa9d-42b1-ae09-a6a0f57d41f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6809","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6811","nonce":101498164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6813","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6815","nonce":101498164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6823","nonce":101498164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6819","nonce":101498164}]},"public_addr":"172.21.15.179:6811/101498164","cluster_addr":"172.21.15.179:6815/101498164","heartbeat_back_addr":"172.21.15.179:6823/101498164","heartbeat_front_addr":"172.21.15.179:6819/101498164","state":["exists","up"]},{"osd":7,"uuid":"e6830c77-2f2d-4067-9866-ee7625afc1a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6810","nonce":872148365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6814","nonce":872148365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6822","nonce":872148365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6818","nonce":872148365}]},"public_addr":"172.21.15.179:6810/872148365","cluster_addr":"172.21.15.179:6814/872148365","heartbeat_back_addr":"172.21.15.179:6822/872148365","heartbeat_front_addr":"172.21.15.179:6818/872148365","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.535221+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.563769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.520765+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.526264+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.517058+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.500842+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.534332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.512486+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:53:19.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.534+0000 7f93bf437640 1 -- 172.21.15.132:0/690174395 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f939c06c8f0 msgr2=0x7f939c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:19.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.534+0000 7f93bf437640 1 --2- 172.21.15.132:0/690174395 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f939c06c8f0 0x7f939c06edb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f93ac006fd0 tx=0x7f93ac008040 comp rx=0 tx=0).stop 2024-04-16T15:53:19.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.534+0000 7f93bf437640 1 -- 172.21.15.132:0/690174395 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93b815eed0 msgr2=0x7f93b814ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:19.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.534+0000 7f93bf437640 1 --2- 172.21.15.132:0/690174395 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93b815eed0 0x7f93b814ad00 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f93b4000c00 tx=0x7f93b40046c0 comp rx=0 tx=0).stop 2024-04-16T15:53:19.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.534+0000 7f93bf437640 1 -- 172.21.15.132:0/690174395 shutdown_connections 2024-04-16T15:53:19.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.534+0000 7f93bf437640 1 --2- 172.21.15.132:0/690174395 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f939c06c8f0 0x7f939c06edb0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:19.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.534+0000 7f93bf437640 1 --2- 172.21.15.132:0/690174395 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93b81627e0 0x7f93b81608a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:19.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.534+0000 7f93bf437640 1 --2- 172.21.15.132:0/690174395 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93b815eed0 0x7f93b814ad00 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:19.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.534+0000 7f93bf437640 1 --2- 172.21.15.132:0/690174395 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93b815eaf0 0x7f93b80cc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:19.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.534+0000 7f93bf437640 1 -- 172.21.15.132:0/690174395 >> 172.21.15.132:0/690174395 conn(0x7f93b80d13f0 msgr2=0x7f93b815d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:19.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.534+0000 7f93bf437640 1 -- 172.21.15.132:0/690174395 shutdown_connections 2024-04-16T15:53:19.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.534+0000 7f93bf437640 1 -- 172.21.15.132:0/690174395 wait complete. 2024-04-16T15:53:19.545 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:53:19.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.648+0000 7fa46f414640 1 Processor -- start 2024-04-16T15:53:19.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.649+0000 7fa46f414640 1 -- start start 2024-04-16T15:53:19.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.649+0000 7fa46f414640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa46815eaf0 0x7fa4680ba300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:19.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.649+0000 7fa46f414640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa46815eed0 0x7fa4680b63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:19.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.649+0000 7fa46f414640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa468162cc0 con 0x7fa4681627e0 2024-04-16T15:53:19.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.649+0000 7fa46f414640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fa4680d2af0 con 0x7fa46815eed0 2024-04-16T15:53:19.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.649+0000 7fa46f414640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fa468162fa0 con 0x7fa46815eaf0 2024-04-16T15:53:19.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.650+0000 7fa46d9b1640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fa4681627e0 0x7fa468067760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:38942/0 (socket says 172.21.15.132:38942) 2024-04-16T15:53:19.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.650+0000 7fa46d9b1640 1 -- 172.21.15.132:0/2846331060 learned_addr learned my addr 172.21.15.132:0/2846331060 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:53:19.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.650+0000 7fa46d1b0640 1 --2- 172.21.15.132:0/2846331060 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa46815eaf0 0x7fa4680ba300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:19.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.650+0000 7fa46c9af640 1 --2- 172.21.15.132:0/2846331060 >> v2:172.21.15.179:3300/0 conn(0x7fa46815eed0 0x7fa4680b63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:19.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.650+0000 7fa45bfff640 1 -- 172.21.15.132:0/2846331060 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2188357063 0 0) 0x7fa468162cc0 con 0x7fa4681627e0 2024-04-16T15:53:19.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.650+0000 7fa45bfff640 1 -- 172.21.15.132:0/2846331060 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa454003520 con 0x7fa4681627e0 2024-04-16T15:53:19.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.650+0000 7fa45bfff640 1 -- 172.21.15.132:0/2846331060 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2150256295 0 0) 0x7fa454003520 con 0x7fa4681627e0 2024-04-16T15:53:19.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.650+0000 7fa46d1b0640 1 -- 172.21.15.132:0/2846331060 >> v2:172.21.15.179:3300/0 conn(0x7fa46815eed0 msgr2=0x7fa4680b63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:19.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.650+0000 7fa46d1b0640 1 --2- 172.21.15.132:0/2846331060 >> v2:172.21.15.179:3300/0 conn(0x7fa46815eed0 0x7fa4680b63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:19.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.650+0000 7fa46d1b0640 1 -- 172.21.15.132:0/2846331060 >> v1:172.21.15.132:6789/0 conn(0x7fa4681627e0 legacy=0x7fa468067760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:19.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.650+0000 7fa46d1b0640 1 -- 172.21.15.132:0/2846331060 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa468163280 con 0x7fa46815eaf0 2024-04-16T15:53:19.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.651+0000 7fa46d1b0640 1 --2- 172.21.15.132:0/2846331060 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa46815eaf0 0x7fa4680ba300 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa4640097a0 tx=0x7fa46402b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b798b4bdb6a44270 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:19.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.651+0000 7fa45bfff640 1 -- 172.21.15.132:0/2846331060 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa464037070 con 0x7fa46815eaf0 2024-04-16T15:53:19.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.651+0000 7fa45bfff640 1 -- 172.21.15.132:0/2846331060 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa464030510 con 0x7fa46815eaf0 2024-04-16T15:53:19.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.651+0000 7fa45bfff640 1 -- 172.21.15.132:0/2846331060 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4600019f0 con 0x7fa46815eaf0 2024-04-16T15:53:19.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.652+0000 7fa46f414640 1 -- 172.21.15.132:0/2846331060 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa46815eaf0 msgr2=0x7fa4680ba300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:19.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.652+0000 7fa46f414640 1 --2- 172.21.15.132:0/2846331060 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa46815eaf0 0x7fa4680ba300 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa4640097a0 tx=0x7fa46402b790 comp rx=0 tx=0).stop 2024-04-16T15:53:19.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.652+0000 7fa46f414640 1 -- 172.21.15.132:0/2846331060 shutdown_connections 2024-04-16T15:53:19.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.652+0000 7fa46f414640 1 --2- 172.21.15.132:0/2846331060 >> v2:172.21.15.179:3300/0 conn(0x7fa46815eed0 0x7fa4680b63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:19.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.652+0000 7fa46f414640 1 --2- 172.21.15.132:0/2846331060 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa46815eaf0 0x7fa4680ba300 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:19.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.652+0000 7fa46f414640 1 -- 172.21.15.132:0/2846331060 >> 172.21.15.132:0/2846331060 conn(0x7fa4680d13f0 msgr2=0x7fa4680d1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:19.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.652+0000 7fa46f414640 1 -- 172.21.15.132:0/2846331060 shutdown_connections 2024-04-16T15:53:19.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.652+0000 7fa46f414640 1 -- 172.21.15.132:0/2846331060 wait complete. 2024-04-16T15:53:19.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.653+0000 7fa46f414640 1 Processor -- start 2024-04-16T15:53:19.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.653+0000 7fa46f414640 1 -- start start 2024-04-16T15:53:19.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.654+0000 7fa46f414640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa46815eaf0 0x7fa4681f8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:19.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.654+0000 7fa46f414640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa46815eed0 0x7fa4681f3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:19.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.654+0000 7fa46d1b0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa46815eaf0 0x7fa4681f8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:19.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.654+0000 7fa46f414640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4681627e0 0x7fa46815c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:19.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.654+0000 7fa46f414640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fa4680d3f90 con 0x7fa46815eaf0 2024-04-16T15:53:19.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.654+0000 7fa46f414640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa4680ba840 con 0x7fa4681627e0 2024-04-16T15:53:19.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.654+0000 7fa46f414640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fa4680d4110 con 0x7fa46815eed0 2024-04-16T15:53:19.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.654+0000 7fa46d1b0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa46815eaf0 0x7fa4681f8570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57466/0 (socket says 172.21.15.132:57466) 2024-04-16T15:53:19.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.654+0000 7fa46d1b0640 1 -- 172.21.15.132:0/2477809172 learned_addr learned my addr 172.21.15.132:0/2477809172 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:19.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.654+0000 7fa46c9af640 1 --2- 172.21.15.132:0/2477809172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa46815eed0 0x7fa4681f3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:19.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.654+0000 7fa46d9b1640 1 --2- 172.21.15.132:0/2477809172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4681627e0 0x7fa46815c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:19.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.654+0000 7fa46d1b0640 1 -- 172.21.15.132:0/2477809172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa46815eed0 msgr2=0x7fa4681f3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:19.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.654+0000 7fa46d1b0640 1 --2- 172.21.15.132:0/2477809172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa46815eed0 0x7fa4681f3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:19.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.654+0000 7fa46d1b0640 1 -- 172.21.15.132:0/2477809172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4681627e0 msgr2=0x7fa46815c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:19.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.654+0000 7fa46d1b0640 1 --2- 172.21.15.132:0/2477809172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4681627e0 0x7fa46815c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:19.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.654+0000 7fa46d1b0640 1 -- 172.21.15.132:0/2477809172 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4681f8ab0 con 0x7fa46815eaf0 2024-04-16T15:53:19.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.654+0000 7fa46d1b0640 1 --2- 172.21.15.132:0/2477809172 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa46815eaf0 0x7fa4681f8570 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa46402b7d0 tx=0x7fa4640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:19.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.654+0000 7fa459ffb640 1 -- 172.21.15.132:0/2477809172 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa464042020 con 0x7fa46815eaf0 2024-04-16T15:53:19.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.654+0000 7fa459ffb640 1 -- 172.21.15.132:0/2477809172 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4640044c0 con 0x7fa46815eaf0 2024-04-16T15:53:19.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.654+0000 7fa459ffb640 1 -- 172.21.15.132:0/2477809172 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa464037040 con 0x7fa46815eaf0 2024-04-16T15:53:19.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.654+0000 7fa46f414640 1 -- 172.21.15.132:0/2477809172 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4680cc450 con 0x7fa46815eaf0 2024-04-16T15:53:19.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.655+0000 7fa46f414640 1 -- 172.21.15.132:0/2477809172 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4680cc6f0 con 0x7fa46815eaf0 2024-04-16T15:53:19.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.656+0000 7fa46f414640 1 -- 172.21.15.132:0/2477809172 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa468075510 con 0x7fa46815eaf0 2024-04-16T15:53:19.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.656+0000 7fa459ffb640 1 -- 172.21.15.132:0/2477809172 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa464045020 con 0x7fa46815eaf0 2024-04-16T15:53:19.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.657+0000 7fa459ffb640 1 --2- 172.21.15.132:0/2477809172 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fa44c06c8f0 0x7fa44c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:19.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.657+0000 7fa459ffb640 1 -- 172.21.15.132:0/2477809172 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fa4640ad380 con 0x7fa46815eaf0 2024-04-16T15:53:19.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.657+0000 7fa46c9af640 1 --2- 172.21.15.132:0/2477809172 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fa44c06c8f0 0x7fa44c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:19.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.657+0000 7fa46c9af640 1 --2- 172.21.15.132:0/2477809172 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fa44c06c8f0 0x7fa44c06edb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa46815c760 tx=0x7fa45c009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:19.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.661+0000 7fa459ffb640 1 -- 172.21.15.132:0/2477809172 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa46404c070 con 0x7fa46815eaf0 2024-04-16T15:53:19.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.836+0000 7fa46f414640 1 -- 172.21.15.132:0/2477809172 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa4680d2610 con 0x7fa46815eaf0 2024-04-16T15:53:19.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.837+0000 7fa459ffb640 1 -- 172.21.15.132:0/2477809172 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16682 (secure 0 0 0) 0x7fa4681f8ab0 con 0x7fa46815eaf0 2024-04-16T15:53:19.836 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:53:19.837 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":33,"fsid":"6bdec5d9-f406-43ad-8584-0503b32f6f0d","created":"2024-04-16T15:51:51.073040+0000","modified":"2024-04-16T15:53:18.546521+0000","last_up_change":"2024-04-16T15:52:02.280496+0000","last_in_change":"2024-04-16T15:51:53.376468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:52:03.284927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:53:16.451607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-16T15:53:17.510579+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d45908b-6e22-4619-b190-897af594b712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6801","nonce":1170594668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6803","nonce":1170594668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6807","nonce":1170594668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6805","nonce":1170594668}]},"public_addr":"172.21.15.132:6801/1170594668","cluster_addr":"172.21.15.132:6803/1170594668","heartbeat_back_addr":"172.21.15.132:6807/1170594668","heartbeat_front_addr":"172.21.15.132:6805/1170594668","state":["exists","up"]},{"osd":1,"uuid":"c88bf082-e51f-4ee6-815a-025f6ce0d67b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6809","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6811","nonce":2494780358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6815","nonce":2494780358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6823","nonce":2494780358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6819","nonce":2494780358}]},"public_addr":"172.21.15.132:6811/2494780358","cluster_addr":"172.21.15.132:6815/2494780358","heartbeat_back_addr":"172.21.15.132:6823/2494780358","heartbeat_front_addr":"172.21.15.132:6819/2494780358","state":["exists","up"]},{"osd":2,"uuid":"e5dbd6b4-4e7b-47e4-ad4e-35b4b81696c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6825","nonce":27655483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6827","nonce":27655483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6831","nonce":27655483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6829","nonce":27655483}]},"public_addr":"172.21.15.132:6825/27655483","cluster_addr":"172.21.15.132:6827/27655483","heartbeat_back_addr":"172.21.15.132:6831/27655483","heartbeat_front_addr":"172.21.15.132:6829/27655483","state":["exists","up"]},{"osd":3,"uuid":"9d75cd67-3b8a-4424-8884-5f3660e1f5f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6810","nonce":3100919191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6814","nonce":3100919191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6821","nonce":3100919191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6818","nonce":3100919191}]},"public_addr":"172.21.15.132:6810/3100919191","cluster_addr":"172.21.15.132:6814/3100919191","heartbeat_back_addr":"172.21.15.132:6821/3100919191","heartbeat_front_addr":"172.21.15.132:6818/3100919191","state":["exists","up"]},{"osd":4,"uuid":"83aea46a-8642-4777-912b-c130e5890da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6825","nonce":123637799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6827","nonce":123637799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6831","nonce":123637799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6829","nonce":123637799}]},"public_addr":"172.21.15.179:6825/123637799","cluster_addr":"172.21.15.179:6827/123637799","heartbeat_back_addr":"172.21.15.179:6831/123637799","heartbeat_front_addr":"172.21.15.179:6829/123637799","state":["exists","up"]},{"osd":5,"uuid":"534117c8-3317-48d6-b436-afd5709f71e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6801","nonce":2224750370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6803","nonce":2224750370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6807","nonce":2224750370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6805","nonce":2224750370}]},"public_addr":"172.21.15.179:6801/2224750370","cluster_addr":"172.21.15.179:6803/2224750370","heartbeat_back_addr":"172.21.15.179:6807/2224750370","heartbeat_front_addr":"172.21.15.179:6805/2224750370","state":["exists","up"]},{"osd":6,"uuid":"0ba363e7-fa9d-42b1-ae09-a6a0f57d41f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6809","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6811","nonce":101498164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6813","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6815","nonce":101498164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6823","nonce":101498164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6819","nonce":101498164}]},"public_addr":"172.21.15.179:6811/101498164","cluster_addr":"172.21.15.179:6815/101498164","heartbeat_back_addr":"172.21.15.179:6823/101498164","heartbeat_front_addr":"172.21.15.179:6819/101498164","state":["exists","up"]},{"osd":7,"uuid":"e6830c77-2f2d-4067-9866-ee7625afc1a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6810","nonce":872148365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6814","nonce":872148365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6822","nonce":872148365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6818","nonce":872148365}]},"public_addr":"172.21.15.179:6810/872148365","cluster_addr":"172.21.15.179:6814/872148365","heartbeat_back_addr":"172.21.15.179:6822/872148365","heartbeat_front_addr":"172.21.15.179:6818/872148365","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.535221+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.563769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.520765+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.526264+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.517058+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.500842+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.534332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.512486+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:53:19.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.839+0000 7fa46f414640 1 -- 172.21.15.132:0/2477809172 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fa44c06c8f0 msgr2=0x7fa44c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:19.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.839+0000 7fa46f414640 1 --2- 172.21.15.132:0/2477809172 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fa44c06c8f0 0x7fa44c06edb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa46815c760 tx=0x7fa45c009190 comp rx=0 tx=0).stop 2024-04-16T15:53:19.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.839+0000 7fa46f414640 1 -- 172.21.15.132:0/2477809172 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa46815eaf0 msgr2=0x7fa4681f8570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:19.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.839+0000 7fa46f414640 1 --2- 172.21.15.132:0/2477809172 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa46815eaf0 0x7fa4681f8570 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa46402b7d0 tx=0x7fa4640046c0 comp rx=0 tx=0).stop 2024-04-16T15:53:19.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.839+0000 7fa46f414640 1 -- 172.21.15.132:0/2477809172 shutdown_connections 2024-04-16T15:53:19.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.839+0000 7fa46f414640 1 --2- 172.21.15.132:0/2477809172 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fa44c06c8f0 0x7fa44c06edb0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:19.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.839+0000 7fa46f414640 1 --2- 172.21.15.132:0/2477809172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4681627e0 0x7fa46815c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:19.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.839+0000 7fa46f414640 1 --2- 172.21.15.132:0/2477809172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa46815eed0 0x7fa4681f3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:19.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.839+0000 7fa46f414640 1 --2- 172.21.15.132:0/2477809172 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa46815eaf0 0x7fa4681f8570 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:19.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.839+0000 7fa46f414640 1 -- 172.21.15.132:0/2477809172 >> 172.21.15.132:0/2477809172 conn(0x7fa4680d13f0 msgr2=0x7fa4680b9c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:19.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.839+0000 7fa46f414640 1 -- 172.21.15.132:0/2477809172 shutdown_connections 2024-04-16T15:53:19.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.839+0000 7fa46f414640 1 -- 172.21.15.132:0/2477809172 wait complete. 2024-04-16T15:53:19.850 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-16T15:53:19.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.957+0000 7fb4edbd6640 1 Processor -- start 2024-04-16T15:53:19.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.957+0000 7fb4edbd6640 1 -- start start 2024-04-16T15:53:19.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.957+0000 7fb4edbd6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4e815cad0 0x7fb4e80ce3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:19.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.957+0000 7fb4edbd6640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb4e80ce8e0 0x7fb4e809aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:19.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.957+0000 7fb4edbd6640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4e815ceb0 con 0x7fb4e80710a0 2024-04-16T15:53:19.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.957+0000 7fb4edbd6640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fb4e80cd5e0 con 0x7fb4e80ce8e0 2024-04-16T15:53:19.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.957+0000 7fb4edbd6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb4e80cd8c0 con 0x7fb4e815cad0 2024-04-16T15:53:19.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.958+0000 7fb4e77fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4e815cad0 0x7fb4e80ce3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:19.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.958+0000 7fb4e6ffd640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb4e80ce8e0 0x7fb4e809aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:19.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.958+0000 7fb4e77fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4e815cad0 0x7fb4e80ce3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.132:57648/0 (socket says 172.21.15.132:57648) 2024-04-16T15:53:19.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.958+0000 7fb4e7fff640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fb4e80710a0 0x7fb4e80d05c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.132:44358/0 (socket says 172.21.15.132:44358) 2024-04-16T15:53:19.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.958+0000 7fb4e77fe640 1 -- 172.21.15.132:0/3847729423 learned_addr learned my addr 172.21.15.132:0/3847729423 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:19.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.958+0000 7fb4e77fe640 1 -- 172.21.15.132:0/3847729423 >> v2:172.21.15.179:3300/0 conn(0x7fb4e80ce8e0 msgr2=0x7fb4e809aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:19.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.958+0000 7fb4e77fe640 1 --2- 172.21.15.132:0/3847729423 >> v2:172.21.15.179:3300/0 conn(0x7fb4e80ce8e0 0x7fb4e809aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:19.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.958+0000 7fb4e77fe640 1 -- 172.21.15.132:0/3847729423 >> v1:172.21.15.179:6789/0 conn(0x7fb4e80710a0 legacy=0x7fb4e80d05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:19.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.958+0000 7fb4e67fc640 1 -- 172.21.15.132:0/3847729423 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2185181358 0 0) 0x7fb4e815ceb0 con 0x7fb4e80710a0 2024-04-16T15:53:19.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.958+0000 7fb4e77fe640 1 -- 172.21.15.132:0/3847729423 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4e80cdba0 con 0x7fb4e815cad0 2024-04-16T15:53:19.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.958+0000 7fb4e6ffd640 1 --2- 172.21.15.132:0/3847729423 >> v2:172.21.15.179:3300/0 conn(0x7fb4e80ce8e0 0x7fb4e809aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:53:19.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.959+0000 7fb4e77fe640 1 --2- 172.21.15.132:0/3847729423 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4e815cad0 0x7fb4e80ce3a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb4d0009870 tx=0x7fb4d002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c712177a4d4193f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:19.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.959+0000 7fb4e67fc640 1 -- 172.21.15.132:0/3847729423 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d0035020 con 0x7fb4e815cad0 2024-04-16T15:53:19.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.959+0000 7fb4e67fc640 1 -- 172.21.15.132:0/3847729423 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4d0031640 con 0x7fb4e815cad0 2024-04-16T15:53:19.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.959+0000 7fb4e67fc640 1 -- 172.21.15.132:0/3847729423 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d002d040 con 0x7fb4e815cad0 2024-04-16T15:53:19.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.960+0000 7fb4edbd6640 1 -- 172.21.15.132:0/3847729423 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4e815cad0 msgr2=0x7fb4e80ce3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:19.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.960+0000 7fb4edbd6640 1 --2- 172.21.15.132:0/3847729423 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4e815cad0 0x7fb4e80ce3a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb4d0009870 tx=0x7fb4d002b8f0 comp rx=0 tx=0).stop 2024-04-16T15:53:19.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.960+0000 7fb4edbd6640 1 -- 172.21.15.132:0/3847729423 shutdown_connections 2024-04-16T15:53:19.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.960+0000 7fb4edbd6640 1 --2- 172.21.15.132:0/3847729423 >> v2:172.21.15.179:3300/0 conn(0x7fb4e80ce8e0 0x7fb4e809aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:19.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.960+0000 7fb4edbd6640 1 --2- 172.21.15.132:0/3847729423 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4e815cad0 0x7fb4e80ce3a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:19.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.960+0000 7fb4edbd6640 1 -- 172.21.15.132:0/3847729423 >> 172.21.15.132:0/3847729423 conn(0x7fb4e80b41b0 msgr2=0x7fb4e80b45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:19.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.960+0000 7fb4edbd6640 1 -- 172.21.15.132:0/3847729423 shutdown_connections 2024-04-16T15:53:19.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.960+0000 7fb4edbd6640 1 -- 172.21.15.132:0/3847729423 wait complete. 2024-04-16T15:53:19.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.961+0000 7fb4edbd6640 1 Processor -- start 2024-04-16T15:53:19.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.961+0000 7fb4edbd6640 1 -- start start 2024-04-16T15:53:19.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.962+0000 7fb4edbd6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4e80710a0 0x7fb4e80c79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:19.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.962+0000 7fb4edbd6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4e80ce8e0 0x7fb4e8151870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:19.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.962+0000 7fb4edbd6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4e815cad0 0x7fb4e8151db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:19.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.962+0000 7fb4edbd6640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fb4e809b640 con 0x7fb4e815cad0 2024-04-16T15:53:19.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.962+0000 7fb4edbd6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb4e80cd2d0 con 0x7fb4e80710a0 2024-04-16T15:53:19.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.962+0000 7fb4edbd6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb4e809b7c0 con 0x7fb4e80ce8e0 2024-04-16T15:53:19.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.962+0000 7fb4e7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4e815cad0 0x7fb4e8151db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:19.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.962+0000 7fb4e7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4e815cad0 0x7fb4e8151db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57482/0 (socket says 172.21.15.132:57482) 2024-04-16T15:53:19.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.962+0000 7fb4e7fff640 1 -- 172.21.15.132:0/2878447820 learned_addr learned my addr 172.21.15.132:0/2878447820 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:19.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.962+0000 7fb4e77fe640 1 --2- 172.21.15.132:0/2878447820 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4e80710a0 0x7fb4e80c79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:19.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.962+0000 7fb4e6ffd640 1 --2- 172.21.15.132:0/2878447820 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4e80ce8e0 0x7fb4e8151870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:19.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.962+0000 7fb4e7fff640 1 -- 172.21.15.132:0/2878447820 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4e80ce8e0 msgr2=0x7fb4e8151870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:19.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.962+0000 7fb4e7fff640 1 --2- 172.21.15.132:0/2878447820 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4e80ce8e0 0x7fb4e8151870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:19.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.962+0000 7fb4e7fff640 1 -- 172.21.15.132:0/2878447820 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4e80710a0 msgr2=0x7fb4e80c79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:19.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.963+0000 7fb4e7fff640 1 --2- 172.21.15.132:0/2878447820 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4e80710a0 0x7fb4e80c79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:19.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.963+0000 7fb4e7fff640 1 -- 172.21.15.132:0/2878447820 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4e80c6560 con 0x7fb4e815cad0 2024-04-16T15:53:19.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.963+0000 7fb4e7fff640 1 --2- 172.21.15.132:0/2878447820 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4e815cad0 0x7fb4e8151db0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fb4e000c6d0 tx=0x7fb4e000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:19.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.963+0000 7fb4dffff640 1 -- 172.21.15.132:0/2878447820 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4e0018070 con 0x7fb4e815cad0 2024-04-16T15:53:19.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.963+0000 7fb4dffff640 1 -- 172.21.15.132:0/2878447820 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4e0004d60 con 0x7fb4e815cad0 2024-04-16T15:53:19.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.963+0000 7fb4dffff640 1 -- 172.21.15.132:0/2878447820 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4e000a880 con 0x7fb4e815cad0 2024-04-16T15:53:19.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.963+0000 7fb4edbd6640 1 -- 172.21.15.132:0/2878447820 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4e80c6840 con 0x7fb4e815cad0 2024-04-16T15:53:19.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.963+0000 7fb4edbd6640 1 -- 172.21.15.132:0/2878447820 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4e80c6e00 con 0x7fb4e815cad0 2024-04-16T15:53:19.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.964+0000 7fb4edbd6640 1 -- 172.21.15.132:0/2878447820 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4e80b4f10 con 0x7fb4e815cad0 2024-04-16T15:53:19.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.964+0000 7fb4dffff640 1 -- 172.21.15.132:0/2878447820 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb4e001b070 con 0x7fb4e815cad0 2024-04-16T15:53:19.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.965+0000 7fb4dffff640 1 --2- 172.21.15.132:0/2878447820 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fb4c806c8f0 0x7fb4c806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:19.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.965+0000 7fb4dffff640 1 -- 172.21.15.132:0/2878447820 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fb4e008b230 con 0x7fb4e815cad0 2024-04-16T15:53:19.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.965+0000 7fb4e77fe640 1 --2- 172.21.15.132:0/2878447820 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fb4c806c8f0 0x7fb4c806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:19.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.965+0000 7fb4e77fe640 1 --2- 172.21.15.132:0/2878447820 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fb4c806c8f0 0x7fb4c806edb0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb4d0036000 tx=0x7fb4d0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:19.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:19.969+0000 7fb4dffff640 1 -- 172.21.15.132:0/2878447820 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb4e0059010 con 0x7fb4e815cad0 2024-04-16T15:53:20.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.179+0000 7fb4edbd6640 1 -- 172.21.15.132:0/2878447820 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fb4e80754f0 con 0x7fb4e815cad0 2024-04-16T15:53:20.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.204+0000 7fb4dffff640 1 -- 172.21.15.132:0/2878447820 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v13) ==== 118+0+0 (secure 0 0 0) 0x7fb4e005d310 con 0x7fb4e815cad0 2024-04-16T15:53:20.206 INFO:tasks.ceph.mds.a.smithi132.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2868-gc3c87ed0/rpm/el9/BUILD/ceph-19.0.0-2868-gc3c87ed0/src/mds/MDLog.cc: In function 'void MDLog::trim()' thread 7fd96a0cf640 time 2024-04-16T15:53:20.207487+0000 2024-04-16T15:53:20.206 INFO:tasks.ceph.mds.a.smithi132.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2868-gc3c87ed0/rpm/el9/BUILD/ceph-19.0.0-2868-gc3c87ed0/src/mds/MDLog.cc: 688: FAILED ceph_assert(num_total_segments >= num_replayed_segments) 2024-04-16T15:53:20.207 INFO:tasks.ceph.mds.a.smithi132.stderr: ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev) 2024-04-16T15:53:20.207 INFO:tasks.ceph.mds.a.smithi132.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd974581f4c] 2024-04-16T15:53:20.207 INFO:tasks.ceph.mds.a.smithi132.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18210a) [0x7fd97458210a] 2024-04-16T15:53:20.207 INFO:tasks.ceph.mds.a.smithi132.stderr: 3: (MDLog::trim()+0xf2a) [0x55b2e9b001aa] 2024-04-16T15:53:20.207 INFO:tasks.ceph.mds.a.smithi132.stderr: 4: (MDLog::log_trim_upkeep()+0x339) [0x55b2e9b00559] 2024-04-16T15:53:20.207 INFO:tasks.ceph.mds.a.smithi132.stderr: 5: /lib64/libstdc++.so.6(+0xdb924) [0x7fd9740db924] 2024-04-16T15:53:20.208 INFO:tasks.ceph.mds.a.smithi132.stderr: 6: /lib64/libc.so.6(+0x9f802) [0x7fd973c9f802] 2024-04-16T15:53:20.208 INFO:tasks.ceph.mds.a.smithi132.stderr: 7: /lib64/libc.so.6(+0x3f450) [0x7fd973c3f450] 2024-04-16T15:53:20.208 INFO:tasks.ceph.mds.a.smithi132.stderr:*** Caught signal (Aborted) ** 2024-04-16T15:53:20.208 INFO:tasks.ceph.mds.a.smithi132.stderr: in thread 7fd96a0cf640 thread_name:ms_dispatch 2024-04-16T15:53:20.208 INFO:tasks.ceph.mds.a.smithi132.stderr:2024-04-16T15:53:20.206+0000 7fd96a0cf640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2868-gc3c87ed0/rpm/el9/BUILD/ceph-19.0.0-2868-gc3c87ed0/src/mds/MDLog.cc: In function 'void MDLog::trim()' thread 7fd96a0cf640 time 2024-04-16T15:53:20.207487+0000 2024-04-16T15:53:20.209 INFO:tasks.ceph.mds.a.smithi132.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2868-gc3c87ed0/rpm/el9/BUILD/ceph-19.0.0-2868-gc3c87ed0/src/mds/MDLog.cc: 688: FAILED ceph_assert(num_total_segments >= num_replayed_segments) 2024-04-16T15:53:20.209 INFO:tasks.ceph.mds.a.smithi132.stderr: 2024-04-16T15:53:20.209 INFO:tasks.ceph.mds.a.smithi132.stderr: ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev) 2024-04-16T15:53:20.209 INFO:tasks.ceph.mds.a.smithi132.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd974581f4c] 2024-04-16T15:53:20.209 INFO:tasks.ceph.mds.a.smithi132.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18210a) [0x7fd97458210a] 2024-04-16T15:53:20.209 INFO:tasks.ceph.mds.a.smithi132.stderr: 3: (MDLog::trim()+0xf2a) [0x55b2e9b001aa] 2024-04-16T15:53:20.210 INFO:tasks.ceph.mds.a.smithi132.stderr: 4: (MDLog::log_trim_upkeep()+0x339) [0x55b2e9b00559] 2024-04-16T15:53:20.210 INFO:tasks.ceph.mds.a.smithi132.stderr: 5: /lib64/libstdc++.so.6(+0xdb924) [0x7fd9740db924] 2024-04-16T15:53:20.210 INFO:tasks.ceph.mds.a.smithi132.stderr: 6: /lib64/libc.so.6(+0x9f802) [0x7fd973c9f802] 2024-04-16T15:53:20.210 INFO:tasks.ceph.mds.a.smithi132.stderr: 7: /lib64/libc.so.6(+0x3f450) [0x7fd973c3f450] 2024-04-16T15:53:20.210 INFO:tasks.ceph.mds.a.smithi132.stderr: 2024-04-16T15:53:20.210 INFO:tasks.ceph.mds.a.smithi132.stderr: ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev) 2024-04-16T15:53:20.211 INFO:tasks.ceph.mds.a.smithi132.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fd973c54db0] 2024-04-16T15:53:20.211 INFO:tasks.ceph.mds.a.smithi132.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fd973ca154c] 2024-04-16T15:53:20.211 INFO:tasks.ceph.mds.a.smithi132.stderr: 3: raise() 2024-04-16T15:53:20.211 INFO:tasks.ceph.mds.a.smithi132.stderr: 4: abort() 2024-04-16T15:53:20.211 INFO:tasks.ceph.mds.a.smithi132.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd974581fa6] 2024-04-16T15:53:20.212 INFO:tasks.ceph.mds.a.smithi132.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18210a) [0x7fd97458210a] 2024-04-16T15:53:20.212 INFO:tasks.ceph.mds.a.smithi132.stderr: 7: (MDLog::trim()+0xf2a) [0x55b2e9b001aa] 2024-04-16T15:53:20.212 INFO:tasks.ceph.mds.a.smithi132.stderr: 8: (MDLog::log_trim_upkeep()+0x339) [0x55b2e9b00559] 2024-04-16T15:53:20.212 INFO:tasks.ceph.mds.a.smithi132.stderr: 9: /lib64/libstdc++.so.6(+0xdb924) [0x7fd9740db924] 2024-04-16T15:53:20.212 INFO:tasks.ceph.mds.a.smithi132.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7fd973c9f802] 2024-04-16T15:53:20.212 INFO:tasks.ceph.mds.a.smithi132.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7fd973c3f450] 2024-04-16T15:53:20.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.207+0000 7fb4edbd6640 1 -- 172.21.15.132:0/2878447820 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fb4c806c8f0 msgr2=0x7fb4c806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:20.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.207+0000 7fb4edbd6640 1 --2- 172.21.15.132:0/2878447820 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fb4c806c8f0 0x7fb4c806edb0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb4d0036000 tx=0x7fb4d0008030 comp rx=0 tx=0).stop 2024-04-16T15:53:20.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.207+0000 7fb4edbd6640 1 -- 172.21.15.132:0/2878447820 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4e815cad0 msgr2=0x7fb4e8151db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:20.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.207+0000 7fb4edbd6640 1 --2- 172.21.15.132:0/2878447820 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4e815cad0 0x7fb4e8151db0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fb4e000c6d0 tx=0x7fb4e000cb90 comp rx=0 tx=0).stop 2024-04-16T15:53:20.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.207+0000 7fb4edbd6640 1 -- 172.21.15.132:0/2878447820 shutdown_connections 2024-04-16T15:53:20.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.207+0000 7fb4edbd6640 1 --2- 172.21.15.132:0/2878447820 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fb4c806c8f0 0x7fb4c806edb0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:20.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.207+0000 7fb4edbd6640 1 --2- 172.21.15.132:0/2878447820 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4e815cad0 0x7fb4e8151db0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:20.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.207+0000 7fb4edbd6640 1 --2- 172.21.15.132:0/2878447820 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4e80ce8e0 0x7fb4e8151870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:20.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.207+0000 7fb4edbd6640 1 --2- 172.21.15.132:0/2878447820 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4e80710a0 0x7fb4e80c79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:20.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.207+0000 7fb4edbd6640 1 -- 172.21.15.132:0/2878447820 >> 172.21.15.132:0/2878447820 conn(0x7fb4e80b41b0 msgr2=0x7fb4e81596a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:20.216 INFO:tasks.ceph.mds.a.smithi132.stderr:2024-04-16T15:53:20.207+0000 7fd96a0cf640 -1 *** Caught signal (Aborted) ** 2024-04-16T15:53:20.216 INFO:tasks.ceph.mds.a.smithi132.stderr: in thread 7fd96a0cf640 thread_name:ms_dispatch 2024-04-16T15:53:20.217 INFO:tasks.ceph.mds.a.smithi132.stderr: 2024-04-16T15:53:20.217 INFO:tasks.ceph.mds.a.smithi132.stderr: ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev) 2024-04-16T15:53:20.217 INFO:tasks.ceph.mds.a.smithi132.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fd973c54db0] 2024-04-16T15:53:20.217 INFO:tasks.ceph.mds.a.smithi132.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fd973ca154c] 2024-04-16T15:53:20.217 INFO:tasks.ceph.mds.a.smithi132.stderr: 3: raise() 2024-04-16T15:53:20.217 INFO:tasks.ceph.mds.a.smithi132.stderr: 4: abort() 2024-04-16T15:53:20.217 INFO:tasks.ceph.mds.a.smithi132.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd974581fa6] 2024-04-16T15:53:20.218 INFO:tasks.ceph.mds.a.smithi132.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18210a) [0x7fd97458210a] 2024-04-16T15:53:20.218 INFO:tasks.ceph.mds.a.smithi132.stderr: 7: (MDLog::trim()+0xf2a) [0x55b2e9b001aa] 2024-04-16T15:53:20.218 INFO:tasks.ceph.mds.a.smithi132.stderr: 8: (MDLog::log_trim_upkeep()+0x339) [0x55b2e9b00559] 2024-04-16T15:53:20.218 INFO:tasks.ceph.mds.a.smithi132.stderr: 9: /lib64/libstdc++.so.6(+0xdb924) [0x7fd9740db924] 2024-04-16T15:53:20.218 INFO:tasks.ceph.mds.a.smithi132.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7fd973c9f802] 2024-04-16T15:53:20.218 INFO:tasks.ceph.mds.a.smithi132.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7fd973c3f450] 2024-04-16T15:53:20.218 INFO:tasks.ceph.mds.a.smithi132.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-16T15:53:20.219 INFO:tasks.ceph.mds.a.smithi132.stderr: 2024-04-16T15:53:20.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.207+0000 7fb4edbd6640 1 -- 172.21.15.132:0/2878447820 shutdown_connections 2024-04-16T15:53:20.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.207+0000 7fb4edbd6640 1 -- 172.21.15.132:0/2878447820 wait complete. 2024-04-16T15:53:20.220 INFO:tasks.ceph.mds.a.smithi132.stderr: -1> 2024-04-16T15:53:20.206+0000 7fd96a0cf640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2868-gc3c87ed0/rpm/el9/BUILD/ceph-19.0.0-2868-gc3c87ed0/src/mds/MDLog.cc: In function 'void MDLog::trim()' thread 7fd96a0cf640 time 2024-04-16T15:53:20.207487+0000 2024-04-16T15:53:20.220 INFO:tasks.ceph.mds.a.smithi132.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2868-gc3c87ed0/rpm/el9/BUILD/ceph-19.0.0-2868-gc3c87ed0/src/mds/MDLog.cc: 688: FAILED ceph_assert(num_total_segments >= num_replayed_segments) 2024-04-16T15:53:20.221 INFO:tasks.ceph.mds.a.smithi132.stderr: 2024-04-16T15:53:20.221 INFO:tasks.ceph.mds.a.smithi132.stderr: ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev) 2024-04-16T15:53:20.221 INFO:tasks.ceph.mds.a.smithi132.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd974581f4c] 2024-04-16T15:53:20.221 INFO:tasks.ceph.mds.a.smithi132.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18210a) [0x7fd97458210a] 2024-04-16T15:53:20.221 INFO:tasks.ceph.mds.a.smithi132.stderr: 3: (MDLog::trim()+0xf2a) [0x55b2e9b001aa] 2024-04-16T15:53:20.221 INFO:tasks.ceph.mds.a.smithi132.stderr: 4: (MDLog::log_trim_upkeep()+0x339) [0x55b2e9b00559] 2024-04-16T15:53:20.221 INFO:tasks.ceph.mds.a.smithi132.stderr: 5: /lib64/libstdc++.so.6(+0xdb924) [0x7fd9740db924] 2024-04-16T15:53:20.221 INFO:tasks.ceph.mds.a.smithi132.stderr: 6: /lib64/libc.so.6(+0x9f802) [0x7fd973c9f802] 2024-04-16T15:53:20.221 INFO:tasks.ceph.mds.a.smithi132.stderr: 7: /lib64/libc.so.6(+0x3f450) [0x7fd973c3f450] 2024-04-16T15:53:20.221 INFO:tasks.ceph.mds.a.smithi132.stderr: 2024-04-16T15:53:20.221 INFO:tasks.ceph.mds.a.smithi132.stderr: 0> 2024-04-16T15:53:20.207+0000 7fd96a0cf640 -1 *** Caught signal (Aborted) ** 2024-04-16T15:53:20.221 INFO:tasks.ceph.mds.a.smithi132.stderr: in thread 7fd96a0cf640 thread_name:ms_dispatch 2024-04-16T15:53:20.221 INFO:tasks.ceph.mds.a.smithi132.stderr: 2024-04-16T15:53:20.222 INFO:tasks.ceph.mds.a.smithi132.stderr: ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev) 2024-04-16T15:53:20.222 INFO:tasks.ceph.mds.a.smithi132.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fd973c54db0] 2024-04-16T15:53:20.222 INFO:tasks.ceph.mds.a.smithi132.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fd973ca154c] 2024-04-16T15:53:20.222 INFO:tasks.ceph.mds.a.smithi132.stderr: 3: raise() 2024-04-16T15:53:20.222 INFO:tasks.ceph.mds.a.smithi132.stderr: 4: abort() 2024-04-16T15:53:20.222 INFO:tasks.ceph.mds.a.smithi132.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd974581fa6] 2024-04-16T15:53:20.222 INFO:tasks.ceph.mds.a.smithi132.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18210a) [0x7fd97458210a] 2024-04-16T15:53:20.223 INFO:tasks.ceph.mds.a.smithi132.stderr: 7: (MDLog::trim()+0xf2a) [0x55b2e9b001aa] 2024-04-16T15:53:20.223 INFO:tasks.ceph.mds.a.smithi132.stderr: 8: (MDLog::log_trim_upkeep()+0x339) [0x55b2e9b00559] 2024-04-16T15:53:20.223 INFO:tasks.ceph.mds.a.smithi132.stderr: 9: /lib64/libstdc++.so.6(+0xdb924) [0x7fd9740db924] 2024-04-16T15:53:20.223 INFO:tasks.ceph.mds.a.smithi132.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7fd973c9f802] 2024-04-16T15:53:20.223 INFO:tasks.ceph.mds.a.smithi132.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7fd973c3f450] 2024-04-16T15:53:20.223 INFO:tasks.ceph.mds.a.smithi132.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-16T15:53:20.223 INFO:tasks.ceph.mds.a.smithi132.stderr: 2024-04-16T15:53:20.223 INFO:tasks.ceph.mds.a.smithi132.stderr: -1> 2024-04-16T15:53:20.206+0000 7fd96a0cf640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2868-gc3c87ed0/rpm/el9/BUILD/ceph-19.0.0-2868-gc3c87ed0/src/mds/MDLog.cc: In function 'void MDLog::trim()' thread 7fd96a0cf640 time 2024-04-16T15:53:20.207487+0000 2024-04-16T15:53:20.223 INFO:tasks.ceph.mds.a.smithi132.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2868-gc3c87ed0/rpm/el9/BUILD/ceph-19.0.0-2868-gc3c87ed0/src/mds/MDLog.cc: 688: FAILED ceph_assert(num_total_segments >= num_replayed_segments) 2024-04-16T15:53:20.223 INFO:tasks.ceph.mds.a.smithi132.stderr: 2024-04-16T15:53:20.223 INFO:tasks.ceph.mds.a.smithi132.stderr: ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev) 2024-04-16T15:53:20.224 INFO:tasks.ceph.mds.a.smithi132.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd974581f4c] 2024-04-16T15:53:20.224 INFO:tasks.ceph.mds.a.smithi132.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18210a) [0x7fd97458210a] 2024-04-16T15:53:20.224 INFO:tasks.ceph.mds.a.smithi132.stderr: 3: (MDLog::trim()+0xf2a) [0x55b2e9b001aa] 2024-04-16T15:53:20.224 INFO:tasks.ceph.mds.a.smithi132.stderr: 4: (MDLog::log_trim_upkeep()+0x339) [0x55b2e9b00559] 2024-04-16T15:53:20.224 INFO:tasks.ceph.mds.a.smithi132.stderr: 5: /lib64/libstdc++.so.6(+0xdb924) [0x7fd9740db924] 2024-04-16T15:53:20.224 INFO:tasks.ceph.mds.a.smithi132.stderr: 6: /lib64/libc.so.6(+0x9f802) [0x7fd973c9f802] 2024-04-16T15:53:20.224 INFO:tasks.ceph.mds.a.smithi132.stderr: 7: /lib64/libc.so.6(+0x3f450) [0x7fd973c3f450] 2024-04-16T15:53:20.224 INFO:tasks.ceph.mds.a.smithi132.stderr: 2024-04-16T15:53:20.224 INFO:tasks.ceph.mds.a.smithi132.stderr: 0> 2024-04-16T15:53:20.207+0000 7fd96a0cf640 -1 *** Caught signal (Aborted) ** 2024-04-16T15:53:20.224 INFO:tasks.ceph.mds.a.smithi132.stderr: in thread 7fd96a0cf640 thread_name:ms_dispatch 2024-04-16T15:53:20.224 INFO:tasks.ceph.mds.a.smithi132.stderr: 2024-04-16T15:53:20.224 INFO:tasks.ceph.mds.a.smithi132.stderr: ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev) 2024-04-16T15:53:20.224 INFO:tasks.ceph.mds.a.smithi132.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fd973c54db0] 2024-04-16T15:53:20.224 INFO:tasks.ceph.mds.a.smithi132.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fd973ca154c] 2024-04-16T15:53:20.224 INFO:tasks.ceph.mds.a.smithi132.stderr: 3: raise() 2024-04-16T15:53:20.225 INFO:tasks.ceph.mds.a.smithi132.stderr: 4: abort() 2024-04-16T15:53:20.225 INFO:tasks.ceph.mds.a.smithi132.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd974581fa6] 2024-04-16T15:53:20.225 INFO:tasks.ceph.mds.a.smithi132.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18210a) [0x7fd97458210a] 2024-04-16T15:53:20.225 INFO:tasks.ceph.mds.a.smithi132.stderr: 7: (MDLog::trim()+0xf2a) [0x55b2e9b001aa] 2024-04-16T15:53:20.225 INFO:tasks.ceph.mds.a.smithi132.stderr: 8: (MDLog::log_trim_upkeep()+0x339) [0x55b2e9b00559] 2024-04-16T15:53:20.225 INFO:tasks.ceph.mds.a.smithi132.stderr: 9: /lib64/libstdc++.so.6(+0xdb924) [0x7fd9740db924] 2024-04-16T15:53:20.225 INFO:tasks.ceph.mds.a.smithi132.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7fd973c9f802] 2024-04-16T15:53:20.225 INFO:tasks.ceph.mds.a.smithi132.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7fd973c3f450] 2024-04-16T15:53:20.225 INFO:tasks.ceph.mds.a.smithi132.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-16T15:53:20.225 INFO:tasks.ceph.mds.a.smithi132.stderr: 2024-04-16T15:53:20.226 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-16T15:53:20.226 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-16T15:53:20.334 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.334+0000 7f2cdf59d640 1 Processor -- start 2024-04-16T15:53:20.334 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.334+0000 7f2cdf59d640 1 -- start start 2024-04-16T15:53:20.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.335+0000 7f2cdf59d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2cd815c740 0x7f2cd80cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:20.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.335+0000 7f2cdf59d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cd80d0d30 0x7f2cd806f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:20.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.335+0000 7f2cdf59d640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cd80d11a0 con 0x7f2cd806f3b0 2024-04-16T15:53:20.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.335+0000 7f2cdf59d640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f2cd806fd50 con 0x7f2cd815c740 2024-04-16T15:53:20.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.335+0000 7f2cdf59d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f2cd80d16f0 con 0x7f2cd80d0d30 2024-04-16T15:53:20.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.335+0000 7f2cdcb38640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f2cd806f3b0 0x7f2cd80d0620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:38944/0 (socket says 172.21.15.132:38944) 2024-04-16T15:53:20.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.335+0000 7f2cdcb38640 1 -- 172.21.15.132:0/1049398563 learned_addr learned my addr 172.21.15.132:0/1049398563 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:53:20.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.336+0000 7f2cddb3a640 1 --2- 172.21.15.132:0/1049398563 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cd80d0d30 0x7f2cd806f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:20.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.336+0000 7f2cdd339640 1 --2- 172.21.15.132:0/1049398563 >> v2:172.21.15.179:3300/0 conn(0x7f2cd815c740 0x7f2cd80cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:20.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.336+0000 7f2ccffff640 1 -- 172.21.15.132:0/1049398563 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1900791583 0 0) 0x7f2cd80d11a0 con 0x7f2cd806f3b0 2024-04-16T15:53:20.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.336+0000 7f2ccffff640 1 -- 172.21.15.132:0/1049398563 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2cc4003520 con 0x7f2cd806f3b0 2024-04-16T15:53:20.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.336+0000 7f2ccffff640 1 -- 172.21.15.132:0/1049398563 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3550862820 0 0) 0x7f2cc4003520 con 0x7f2cd806f3b0 2024-04-16T15:53:20.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.336+0000 7f2ccffff640 1 -- 172.21.15.132:0/1049398563 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cd80d0d30 msgr2=0x7f2cd806f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:20.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.336+0000 7f2ccffff640 1 --2- 172.21.15.132:0/1049398563 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cd80d0d30 0x7f2cd806f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:20.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.336+0000 7f2ccffff640 1 -- 172.21.15.132:0/1049398563 >> v2:172.21.15.179:3300/0 conn(0x7f2cd815c740 msgr2=0x7f2cd80cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:20.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.336+0000 7f2ccffff640 1 --2- 172.21.15.132:0/1049398563 >> v2:172.21.15.179:3300/0 conn(0x7f2cd815c740 0x7f2cd80cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:20.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.336+0000 7f2ccffff640 1 -- 172.21.15.132:0/1049398563 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cd815db30 con 0x7f2cd806f3b0 2024-04-16T15:53:20.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.336+0000 7f2ccffff640 1 -- 172.21.15.132:0/1049398563 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2803668828 0 0) 0x7f2cc8001670 con 0x7f2cd806f3b0 2024-04-16T15:53:20.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.336+0000 7f2ccffff640 1 -- 172.21.15.132:0/1049398563 >> v1:172.21.15.132:6789/0 conn(0x7f2cd806f3b0 legacy=0x7f2cd80d0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:20.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.336+0000 7f2ccffff640 1 --2- 172.21.15.132:0/1049398563 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2cc40039b0 0x7f2cc4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:20.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.336+0000 7f2ccffff640 1 --2- 172.21.15.132:0/1049398563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cc4004800 0x7f2cc4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:20.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.336+0000 7f2ccffff640 1 --2- 172.21.15.132:0/1049398563 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cd80d0d30 0x7f2cc40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:20.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.336+0000 7f2ccffff640 1 -- 172.21.15.132:0/1049398563 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd80d16f0 con 0x7f2cc40039b0 2024-04-16T15:53:20.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.336+0000 7f2ccffff640 1 -- 172.21.15.132:0/1049398563 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc400b9c0 con 0x7f2cc4004800 2024-04-16T15:53:20.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.336+0000 7f2ccffff640 1 -- 172.21.15.132:0/1049398563 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f2cc400bb40 con 0x7f2cd80d0d30 2024-04-16T15:53:20.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.336+0000 7f2cdd339640 1 --2- 172.21.15.132:0/1049398563 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2cc40039b0 0x7f2cc4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:20.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.336+0000 7f2cdcb38640 1 --2- 172.21.15.132:0/1049398563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cc4004800 0x7f2cc4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:20.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.336+0000 7f2cddb3a640 1 --2- 172.21.15.132:0/1049398563 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cd80d0d30 0x7f2cc40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:20.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.336+0000 7f2cdd339640 1 -- 172.21.15.132:0/1049398563 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cd80d0d30 msgr2=0x7f2cc40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:20.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.336+0000 7f2cdd339640 1 --2- 172.21.15.132:0/1049398563 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cd80d0d30 0x7f2cc40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:20.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.336+0000 7f2cdd339640 1 -- 172.21.15.132:0/1049398563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cc4004800 msgr2=0x7f2cc4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:20.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.336+0000 7f2cdd339640 1 --2- 172.21.15.132:0/1049398563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cc4004800 0x7f2cc4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:20.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.336+0000 7f2cdd339640 1 -- 172.21.15.132:0/1049398563 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cc4003520 con 0x7f2cc40039b0 2024-04-16T15:53:20.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.337+0000 7f2cdd339640 1 --2- 172.21.15.132:0/1049398563 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2cc40039b0 0x7f2cc4003dd0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f2cd4009af0 tx=0x7f2cc4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=611500d1cf812a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:20.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.337+0000 7f2ccffff640 1 -- 172.21.15.132:0/1049398563 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4039070 con 0x7f2cc40039b0 2024-04-16T15:53:20.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.337+0000 7f2ccffff640 1 -- 172.21.15.132:0/1049398563 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cd402c710 con 0x7f2cc40039b0 2024-04-16T15:53:20.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.337+0000 7f2ccffff640 1 -- 172.21.15.132:0/1049398563 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4009690 con 0x7f2cc40039b0 2024-04-16T15:53:20.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.338+0000 7f2cdf59d640 1 -- 172.21.15.132:0/1049398563 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2cc40039b0 msgr2=0x7f2cc4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:20.351 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.338+0000 7f2cdf59d640 1 --2- 172.21.15.132:0/1049398563 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2cc40039b0 0x7f2cc4003dd0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f2cd4009af0 tx=0x7f2cc4005830 comp rx=0 tx=0).stop 2024-04-16T15:53:20.351 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.338+0000 7f2cddb3a640 1 -- 172.21.15.132:0/1049398563 reap_dead start 2024-04-16T15:53:20.351 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.338+0000 7f2cdf59d640 1 -- 172.21.15.132:0/1049398563 shutdown_connections 2024-04-16T15:53:20.351 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.338+0000 7f2cdf59d640 1 -- 172.21.15.132:0/1049398563 >> 172.21.15.132:0/1049398563 conn(0x7f2cd80b6b80 msgr2=0x7f2cd80b6f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:20.351 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.338+0000 7f2cdf59d640 1 -- 172.21.15.132:0/1049398563 shutdown_connections 2024-04-16T15:53:20.351 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.338+0000 7f2cdf59d640 1 -- 172.21.15.132:0/1049398563 wait complete. 2024-04-16T15:53:20.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.339+0000 7f2cdf59d640 1 Processor -- start 2024-04-16T15:53:20.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.339+0000 7f2cdf59d640 1 -- start start 2024-04-16T15:53:20.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.340+0000 7f2cdf59d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cc40039b0 0x7f2cd81563d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:20.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.340+0000 7f2cdf59d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2cd814ecd0 0x7f2cd8154350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:20.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.340+0000 7f2cdf59d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cd81f2590 0x7f2cd81517c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:20.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.340+0000 7f2cdf59d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd80ce170 con 0x7f2cd814ecd0 2024-04-16T15:53:20.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.340+0000 7f2cdf59d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd80ce7c0 con 0x7f2cc40039b0 2024-04-16T15:53:20.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.340+0000 7f2cdf59d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f2cd80ce450 con 0x7f2cd81f2590 2024-04-16T15:53:20.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.340+0000 7f2cdcb38640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2cd814ecd0 0x7f2cd8154350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:20.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.340+0000 7f2cdcb38640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2cd814ecd0 0x7f2cd8154350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57502/0 (socket says 172.21.15.132:57502) 2024-04-16T15:53:20.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.340+0000 7f2cdcb38640 1 -- 172.21.15.132:0/3711163918 learned_addr learned my addr 172.21.15.132:0/3711163918 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:20.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.340+0000 7f2cdd339640 1 --2- 172.21.15.132:0/3711163918 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cc40039b0 0x7f2cd81563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:20.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.340+0000 7f2cddb3a640 1 --2- 172.21.15.132:0/3711163918 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cd81f2590 0x7f2cd81517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:20.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.340+0000 7f2cdcb38640 1 -- 172.21.15.132:0/3711163918 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cd81f2590 msgr2=0x7f2cd81517c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:20.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.340+0000 7f2cdcb38640 1 --2- 172.21.15.132:0/3711163918 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cd81f2590 0x7f2cd81517c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:20.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.340+0000 7f2cdcb38640 1 -- 172.21.15.132:0/3711163918 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cc40039b0 msgr2=0x7f2cd81563d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:20.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.340+0000 7f2cdcb38640 1 --2- 172.21.15.132:0/3711163918 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cc40039b0 0x7f2cd81563d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:20.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.340+0000 7f2cdcb38640 1 -- 172.21.15.132:0/3711163918 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cd8154890 con 0x7f2cd814ecd0 2024-04-16T15:53:20.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.340+0000 7f2cdcb38640 1 --2- 172.21.15.132:0/3711163918 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2cd814ecd0 0x7f2cd8154350 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8004fd0 tx=0x7f2cc80074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:20.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.340+0000 7f2ccdffb640 1 -- 172.21.15.132:0/3711163918 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc801a070 con 0x7f2cd814ecd0 2024-04-16T15:53:20.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.341+0000 7f2ccdffb640 1 -- 172.21.15.132:0/3711163918 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cc800f7b0 con 0x7f2cd814ecd0 2024-04-16T15:53:20.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.341+0000 7f2cdf59d640 1 -- 172.21.15.132:0/3711163918 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cd8154b10 con 0x7f2cd814ecd0 2024-04-16T15:53:20.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.341+0000 7f2ccdffb640 1 -- 172.21.15.132:0/3711163918 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc800fba0 con 0x7f2cd814ecd0 2024-04-16T15:53:20.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.341+0000 7f2cdf59d640 1 -- 172.21.15.132:0/3711163918 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cd80b2fd0 con 0x7f2cd814ecd0 2024-04-16T15:53:20.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.342+0000 7f2cdf59d640 1 -- 172.21.15.132:0/3711163918 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cd8075510 con 0x7f2cd814ecd0 2024-04-16T15:53:20.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.342+0000 7f2ccdffb640 1 -- 172.21.15.132:0/3711163918 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2cc801d070 con 0x7f2cd814ecd0 2024-04-16T15:53:20.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.342+0000 7f2ccdffb640 1 --2- 172.21.15.132:0/3711163918 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f2cbc06c8f0 0x7f2cbc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:20.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.343+0000 7f2ccdffb640 1 -- 172.21.15.132:0/3711163918 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f2cc808b330 con 0x7f2cd814ecd0 2024-04-16T15:53:20.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.343+0000 7f2cdd339640 1 --2- 172.21.15.132:0/3711163918 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f2cbc06c8f0 0x7f2cbc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:20.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.343+0000 7f2cdd339640 1 --2- 172.21.15.132:0/3711163918 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f2cbc06c8f0 0x7f2cbc06edb0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2cd4036000 tx=0x7f2cd4030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:20.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.347+0000 7f2ccdffb640 1 -- 172.21.15.132:0/3711163918 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2cd8154890 con 0x7f2cd814ecd0 2024-04-16T15:53:20.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:20.570+0000 7f2cdf59d640 1 -- 172.21.15.132:0/3711163918 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f2cd815e980 con 0x7f2cd814ecd0 2024-04-16T15:53:20.657 INFO:tasks.ceph.mds.a.smithi132.stderr:daemon-helper: command crashed with signal 6 2024-04-16T15:53:21.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.206+0000 7f2ccdffb640 1 -- 172.21.15.132:0/3711163918 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v14) ==== 122+0+0 (secure 0 0 0) 0x7f2cc8059110 con 0x7f2cd814ecd0 2024-04-16T15:53:21.207 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.208+0000 7f2cdf59d640 1 -- 172.21.15.132:0/3711163918 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f2cbc06c8f0 msgr2=0x7f2cbc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:21.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.208+0000 7f2cdf59d640 1 --2- 172.21.15.132:0/3711163918 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f2cbc06c8f0 0x7f2cbc06edb0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2cd4036000 tx=0x7f2cd4030000 comp rx=0 tx=0).stop 2024-04-16T15:53:21.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.208+0000 7f2cdf59d640 1 -- 172.21.15.132:0/3711163918 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2cd814ecd0 msgr2=0x7f2cd8154350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:21.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.208+0000 7f2cdf59d640 1 --2- 172.21.15.132:0/3711163918 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2cd814ecd0 0x7f2cd8154350 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8004fd0 tx=0x7f2cc80074f0 comp rx=0 tx=0).stop 2024-04-16T15:53:21.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.208+0000 7f2cdf59d640 1 -- 172.21.15.132:0/3711163918 shutdown_connections 2024-04-16T15:53:21.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.208+0000 7f2cdf59d640 1 --2- 172.21.15.132:0/3711163918 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f2cbc06c8f0 0x7f2cbc06edb0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:21.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.208+0000 7f2cdf59d640 1 --2- 172.21.15.132:0/3711163918 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cd81f2590 0x7f2cd81517c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:21.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.208+0000 7f2cdf59d640 1 --2- 172.21.15.132:0/3711163918 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2cd814ecd0 0x7f2cd8154350 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:21.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.208+0000 7f2cdf59d640 1 --2- 172.21.15.132:0/3711163918 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cc40039b0 0x7f2cd81563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:21.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.208+0000 7f2cdf59d640 1 -- 172.21.15.132:0/3711163918 >> 172.21.15.132:0/3711163918 conn(0x7f2cd80b6b80 msgr2=0x7f2cd815a030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:21.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.208+0000 7f2cdf59d640 1 -- 172.21.15.132:0/3711163918 shutdown_connections 2024-04-16T15:53:21.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.208+0000 7f2cdf59d640 1 -- 172.21.15.132:0/3711163918 wait complete. 2024-04-16T15:53:21.219 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-16T15:53:21.219 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T15:53:21.264 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-04-16T15:53:21.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.325+0000 7ff2af888640 1 Processor -- start 2024-04-16T15:53:21.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.325+0000 7ff2af888640 1 -- start start 2024-04-16T15:53:21.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.326+0000 7ff2af888640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff2a8151e90 0x7ff2a80cf9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:21.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.326+0000 7ff2af888640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2a806e3a0 0x7ff2a80b6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:21.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.326+0000 7ff2af888640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2a80cec90 con 0x7ff2a80b5cc0 2024-04-16T15:53:21.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.326+0000 7ff2af888640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7ff2a80cf540 con 0x7ff2a8151e90 2024-04-16T15:53:21.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.326+0000 7ff2af888640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff2a80cef10 con 0x7ff2a806e3a0 2024-04-16T15:53:21.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.326+0000 7ff2ace23640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7ff2a80b5cc0 0x7ff2a806dc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:38956/0 (socket says 172.21.15.132:38956) 2024-04-16T15:53:21.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.326+0000 7ff2ace23640 1 -- 172.21.15.132:0/1112414442 learned_addr learned my addr 172.21.15.132:0/1112414442 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:53:21.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.326+0000 7ff2ad624640 1 --2- 172.21.15.132:0/1112414442 >> v2:172.21.15.179:3300/0 conn(0x7ff2a8151e90 0x7ff2a80cf9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:21.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.326+0000 7ff2ade25640 1 --2- 172.21.15.132:0/1112414442 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2a806e3a0 0x7ff2a80b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:21.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.326+0000 7ff29bfff640 1 -- 172.21.15.132:0/1112414442 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2019443223 0 0) 0x7ff29c001110 con 0x7ff2a80b5cc0 2024-04-16T15:53:21.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.326+0000 7ff29bfff640 1 -- 172.21.15.132:0/1112414442 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff294003520 con 0x7ff2a80b5cc0 2024-04-16T15:53:21.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.326+0000 7ff29bfff640 1 -- 172.21.15.132:0/1112414442 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2829548760 0 0) 0x7ff294003520 con 0x7ff2a80b5cc0 2024-04-16T15:53:21.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.326+0000 7ff29bfff640 1 -- 172.21.15.132:0/1112414442 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2a806e3a0 msgr2=0x7ff2a80b6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:21.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.326+0000 7ff29bfff640 1 --2- 172.21.15.132:0/1112414442 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2a806e3a0 0x7ff2a80b6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:21.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.326+0000 7ff29bfff640 1 -- 172.21.15.132:0/1112414442 >> v2:172.21.15.179:3300/0 conn(0x7ff2a8151e90 msgr2=0x7ff2a80cf9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:21.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.326+0000 7ff29bfff640 1 --2- 172.21.15.132:0/1112414442 >> v2:172.21.15.179:3300/0 conn(0x7ff2a8151e90 0x7ff2a80cf9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:21.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.326+0000 7ff29bfff640 1 -- 172.21.15.132:0/1112414442 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2a8152270 con 0x7ff2a80b5cc0 2024-04-16T15:53:21.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.326+0000 7ff29bfff640 1 -- 172.21.15.132:0/1112414442 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2803668828 0 0) 0x7ff29c001840 con 0x7ff2a80b5cc0 2024-04-16T15:53:21.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.326+0000 7ff29bfff640 1 -- 172.21.15.132:0/1112414442 >> v1:172.21.15.132:6789/0 conn(0x7ff2a80b5cc0 legacy=0x7ff2a806dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:21.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.326+0000 7ff29bfff640 1 --2- 172.21.15.132:0/1112414442 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2a806e3a0 0x7ff2940039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:21.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.326+0000 7ff29bfff640 1 --2- 172.21.15.132:0/1112414442 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff294003f30 0x7ff294004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:21.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.326+0000 7ff29bfff640 1 --2- 172.21.15.132:0/1112414442 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff294004d40 0x7ff2940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:21.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.326+0000 7ff29bfff640 1 -- 172.21.15.132:0/1112414442 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a80cf540 con 0x7ff294003f30 2024-04-16T15:53:21.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.326+0000 7ff29bfff640 1 -- 172.21.15.132:0/1112414442 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a80cef10 con 0x7ff294004d40 2024-04-16T15:53:21.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.326+0000 7ff29bfff640 1 -- 172.21.15.132:0/1112414442 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff29400b9c0 con 0x7ff2a806e3a0 2024-04-16T15:53:21.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.326+0000 7ff2ad624640 1 --2- 172.21.15.132:0/1112414442 >> v2:172.21.15.179:3300/0 conn(0x7ff2a8151e90 0x7ff2a80cf9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:53:21.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.326+0000 7ff2ace23640 1 --2- 172.21.15.132:0/1112414442 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff294003f30 0x7ff294004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:21.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.327+0000 7ff2ade25640 1 --2- 172.21.15.132:0/1112414442 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff294004d40 0x7ff2940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:21.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.327+0000 7ff2ad624640 1 --2- 172.21.15.132:0/1112414442 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2a806e3a0 0x7ff2940039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:21.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.327+0000 7ff2ace23640 1 -- 172.21.15.132:0/1112414442 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2a806e3a0 msgr2=0x7ff2940039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:21.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.327+0000 7ff2ace23640 1 --2- 172.21.15.132:0/1112414442 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2a806e3a0 0x7ff2940039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:21.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.327+0000 7ff2ace23640 1 -- 172.21.15.132:0/1112414442 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff294004d40 msgr2=0x7ff2940051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:21.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.327+0000 7ff2ace23640 1 --2- 172.21.15.132:0/1112414442 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff294004d40 0x7ff2940051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:21.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.327+0000 7ff2ace23640 1 -- 172.21.15.132:0/1112414442 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff294003520 con 0x7ff294003f30 2024-04-16T15:53:21.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.327+0000 7ff2ade25640 1 --2- 172.21.15.132:0/1112414442 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff294004d40 0x7ff2940051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:53:21.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.327+0000 7ff2ad624640 1 --2- 172.21.15.132:0/1112414442 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2a806e3a0 0x7ff2940039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:53:21.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.327+0000 7ff2ace23640 1 --2- 172.21.15.132:0/1112414442 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff294003f30 0x7ff294004800 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff29c00c3e0 tx=0x7ff294005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7f67f73907c5fe6 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:21.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.328+0000 7ff29bfff640 1 -- 172.21.15.132:0/1112414442 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff29c00c0e0 con 0x7ff294003f30 2024-04-16T15:53:21.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.328+0000 7ff29bfff640 1 -- 172.21.15.132:0/1112414442 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff29c030070 con 0x7ff294003f30 2024-04-16T15:53:21.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.328+0000 7ff29bfff640 1 -- 172.21.15.132:0/1112414442 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff29c0058d0 con 0x7ff294003f30 2024-04-16T15:53:21.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.328+0000 7ff2af888640 1 -- 172.21.15.132:0/1112414442 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff294003f30 msgr2=0x7ff294004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:21.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.328+0000 7ff2af888640 1 --2- 172.21.15.132:0/1112414442 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff294003f30 0x7ff294004800 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff29c00c3e0 tx=0x7ff294005830 comp rx=0 tx=0).stop 2024-04-16T15:53:21.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.328+0000 7ff2ade25640 1 -- 172.21.15.132:0/1112414442 reap_dead start 2024-04-16T15:53:21.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.328+0000 7ff2af888640 1 -- 172.21.15.132:0/1112414442 shutdown_connections 2024-04-16T15:53:21.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.328+0000 7ff2af888640 1 -- 172.21.15.132:0/1112414442 >> 172.21.15.132:0/1112414442 conn(0x7ff2a80b2d50 msgr2=0x7ff2a806ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:21.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.328+0000 7ff2af888640 1 -- 172.21.15.132:0/1112414442 shutdown_connections 2024-04-16T15:53:21.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.328+0000 7ff2af888640 1 -- 172.21.15.132:0/1112414442 wait complete. 2024-04-16T15:53:21.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.329+0000 7ff2af888640 1 Processor -- start 2024-04-16T15:53:21.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.329+0000 7ff2af888640 1 -- start start 2024-04-16T15:53:21.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.330+0000 7ff2af888640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff294003f30 0x7ff2a8152440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:21.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.330+0000 7ff2af888640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2a8143830 0x7ff2a806e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:21.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.330+0000 7ff2af888640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2a8152980 0x7ff2a806ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:21.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.330+0000 7ff2af888640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a80cff10 con 0x7ff2a8143830 2024-04-16T15:53:21.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.330+0000 7ff2af888640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a80cf1d0 con 0x7ff294003f30 2024-04-16T15:53:21.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.330+0000 7ff2af888640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff2a80d0090 con 0x7ff2a8152980 2024-04-16T15:53:21.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.330+0000 7ff2ace23640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2a8143830 0x7ff2a806e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:21.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.330+0000 7ff2ace23640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2a8143830 0x7ff2a806e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57520/0 (socket says 172.21.15.132:57520) 2024-04-16T15:53:21.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.330+0000 7ff2ace23640 1 -- 172.21.15.132:0/3377091659 learned_addr learned my addr 172.21.15.132:0/3377091659 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:21.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.330+0000 7ff2ad624640 1 --2- 172.21.15.132:0/3377091659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff294003f30 0x7ff2a8152440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:21.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.330+0000 7ff2ade25640 1 --2- 172.21.15.132:0/3377091659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2a8152980 0x7ff2a806ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:21.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.330+0000 7ff2ace23640 1 -- 172.21.15.132:0/3377091659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2a8152980 msgr2=0x7ff2a806ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:21.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.330+0000 7ff2ace23640 1 --2- 172.21.15.132:0/3377091659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2a8152980 0x7ff2a806ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:21.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.330+0000 7ff2ace23640 1 -- 172.21.15.132:0/3377091659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff294003f30 msgr2=0x7ff2a8152440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:21.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.330+0000 7ff2ace23640 1 --2- 172.21.15.132:0/3377091659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff294003f30 0x7ff2a8152440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:21.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.330+0000 7ff2ace23640 1 -- 172.21.15.132:0/3377091659 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2a81542c0 con 0x7ff2a8143830 2024-04-16T15:53:21.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.331+0000 7ff2ace23640 1 --2- 172.21.15.132:0/3377091659 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2a8143830 0x7ff2a806e830 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff29c00c4d0 tx=0x7ff29c001c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:21.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.331+0000 7ff299ffb640 1 -- 172.21.15.132:0/3377091659 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff29c004bf0 con 0x7ff2a8143830 2024-04-16T15:53:21.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.331+0000 7ff299ffb640 1 -- 172.21.15.132:0/3377091659 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff29c004d90 con 0x7ff2a8143830 2024-04-16T15:53:21.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.331+0000 7ff2af888640 1 -- 172.21.15.132:0/3377091659 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2a81545a0 con 0x7ff2a8143830 2024-04-16T15:53:21.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.331+0000 7ff299ffb640 1 -- 172.21.15.132:0/3377091659 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff29c0072b0 con 0x7ff2a8143830 2024-04-16T15:53:21.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.331+0000 7ff2af888640 1 -- 172.21.15.132:0/3377091659 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2a8154b60 con 0x7ff2a8143830 2024-04-16T15:53:21.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.332+0000 7ff2af888640 1 -- 172.21.15.132:0/3377091659 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2a8075510 con 0x7ff2a8143830 2024-04-16T15:53:21.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.332+0000 7ff299ffb640 1 -- 172.21.15.132:0/3377091659 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff29c007450 con 0x7ff2a8143830 2024-04-16T15:53:21.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.333+0000 7ff299ffb640 1 --2- 172.21.15.132:0/3377091659 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7ff28c06c8f0 0x7ff28c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:21.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.333+0000 7ff299ffb640 1 -- 172.21.15.132:0/3377091659 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7ff29c0ad650 con 0x7ff2a8143830 2024-04-16T15:53:21.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.333+0000 7ff2ad624640 1 --2- 172.21.15.132:0/3377091659 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7ff28c06c8f0 0x7ff28c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:21.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.333+0000 7ff2ad624640 1 --2- 172.21.15.132:0/3377091659 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7ff28c06c8f0 0x7ff28c06edb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff2a400ad30 tx=0x7ff2a4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:21.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.337+0000 7ff299ffb640 1 -- 172.21.15.132:0/3377091659 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff2a80cec90 con 0x7ff2a8143830 2024-04-16T15:53:21.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.551+0000 7ff2af888640 1 -- 172.21.15.132:0/3377091659 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff2a8072710 con 0x7ff2a8143830 2024-04-16T15:53:21.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.552+0000 7ff299ffb640 1 -- 172.21.15.132:0/3377091659 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5192 (secure 0 0 0) 0x7ff29c0343d0 con 0x7ff2a8143830 2024-04-16T15:53:21.551 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:53:21.551 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/1515313270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1515313270},{"type":"v1","addr":"172.21.15.179:6833","nonce":1515313270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4790,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1873998575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1873998575},{"type":"v1","addr":"172.21.15.179:6835","nonce":1873998575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/1111207224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1111207224},{"type":"v1","addr":"172.21.15.132:6836","nonce":1111207224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T15:53:18.546482+0000","modified":"2024-04-16T15:53:20.571317+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5235":{"gid":5235,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":5,"addr":"172.21.15.132:6837/1743416273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":1743416273},{"type":"v1","addr":"172.21.15.132:6837","nonce":1743416273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5235,"qdb_cluster":[5235]},"id":2}]} 2024-04-16T15:53:21.552 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 14 2024-04-16T15:53:21.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.554+0000 7ff2af888640 1 -- 172.21.15.132:0/3377091659 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7ff28c06c8f0 msgr2=0x7ff28c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:21.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.554+0000 7ff2af888640 1 --2- 172.21.15.132:0/3377091659 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7ff28c06c8f0 0x7ff28c06edb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff2a400ad30 tx=0x7ff2a4008040 comp rx=0 tx=0).stop 2024-04-16T15:53:21.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.554+0000 7ff2af888640 1 -- 172.21.15.132:0/3377091659 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2a8143830 msgr2=0x7ff2a806e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:21.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.554+0000 7ff2af888640 1 --2- 172.21.15.132:0/3377091659 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2a8143830 0x7ff2a806e830 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff29c00c4d0 tx=0x7ff29c001c10 comp rx=0 tx=0).stop 2024-04-16T15:53:21.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.554+0000 7ff2af888640 1 -- 172.21.15.132:0/3377091659 shutdown_connections 2024-04-16T15:53:21.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.554+0000 7ff2af888640 1 --2- 172.21.15.132:0/3377091659 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7ff28c06c8f0 0x7ff28c06edb0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:21.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.554+0000 7ff2af888640 1 --2- 172.21.15.132:0/3377091659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2a8152980 0x7ff2a806ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:21.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.554+0000 7ff2af888640 1 --2- 172.21.15.132:0/3377091659 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2a8143830 0x7ff2a806e830 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:21.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.554+0000 7ff2af888640 1 --2- 172.21.15.132:0/3377091659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff294003f30 0x7ff2a8152440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:21.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.554+0000 7ff2af888640 1 -- 172.21.15.132:0/3377091659 >> 172.21.15.132:0/3377091659 conn(0x7ff2a80b2d50 msgr2=0x7ff2a81511c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:21.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.554+0000 7ff2af888640 1 -- 172.21.15.132:0/3377091659 shutdown_connections 2024-04-16T15:53:21.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.554+0000 7ff2af888640 1 -- 172.21.15.132:0/3377091659 wait complete. 2024-04-16T15:53:21.565 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:53:21.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.668+0000 7f71dbf46640 1 Processor -- start 2024-04-16T15:53:21.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.669+0000 7f71dbf46640 1 -- start start 2024-04-16T15:53:21.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.669+0000 7f71dbf46640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71d4144f50 0x7f71d40b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:21.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.669+0000 7f71dbf46640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f71d40cd2a0 0x7f71d40cd700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:21.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.669+0000 7f71dbf46640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71d40cdd60 con 0x7f71d406eda0 2024-04-16T15:53:21.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.669+0000 7f71dbf46640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f71d40ce040 con 0x7f71d40cd2a0 2024-04-16T15:53:21.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.670+0000 7f71dbf46640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f71d40b3770 con 0x7f71d4144f50 2024-04-16T15:53:21.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.670+0000 7f71d94e1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f71d40cd2a0 0x7f71d40cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:21.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.670+0000 7f71d94e1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f71d40cd2a0 0x7f71d40cd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41796/0 (socket says 172.21.15.132:41796) 2024-04-16T15:53:21.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.670+0000 7f71d94e1640 1 -- 172.21.15.132:0/708921341 learned_addr learned my addr 172.21.15.132:0/708921341 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:21.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.670+0000 7f71d9ce2640 1 --2- 172.21.15.132:0/708921341 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71d4144f50 0x7f71d40b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:21.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.670+0000 7f71d94e1640 1 -- 172.21.15.132:0/708921341 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71d4144f50 msgr2=0x7f71d40b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:21.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.670+0000 7f71d94e1640 1 --2- 172.21.15.132:0/708921341 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71d4144f50 0x7f71d40b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:21.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.670+0000 7f71d94e1640 1 -- 172.21.15.132:0/708921341 >> v1:172.21.15.179:6789/0 conn(0x7f71d406eda0 legacy=0x7f71d40b4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:21.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.670+0000 7f71d94e1640 1 -- 172.21.15.132:0/708921341 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71d40b3a50 con 0x7f71d40cd2a0 2024-04-16T15:53:21.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.671+0000 7f71d94e1640 1 --2- 172.21.15.132:0/708921341 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71d40cd2a0 0x7f71d40cd700 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f71c800bb10 tx=0x7f71c802e0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24963200ef01a01e server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:21.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.671+0000 7f71d8ce0640 1 -- 172.21.15.132:0/708921341 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c803b070 con 0x7f71d40cd2a0 2024-04-16T15:53:21.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.671+0000 7f71d8ce0640 1 -- 172.21.15.132:0/708921341 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71c8036440 con 0x7f71d40cd2a0 2024-04-16T15:53:21.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.671+0000 7f71d8ce0640 1 -- 172.21.15.132:0/708921341 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c8036810 con 0x7f71d40cd2a0 2024-04-16T15:53:21.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.671+0000 7f71dbf46640 1 -- 172.21.15.132:0/708921341 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71d40cd2a0 msgr2=0x7f71d40cd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:21.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.671+0000 7f71dbf46640 1 --2- 172.21.15.132:0/708921341 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71d40cd2a0 0x7f71d40cd700 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f71c800bb10 tx=0x7f71c802e0c0 comp rx=0 tx=0).stop 2024-04-16T15:53:21.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.671+0000 7f71dbf46640 1 -- 172.21.15.132:0/708921341 shutdown_connections 2024-04-16T15:53:21.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.671+0000 7f71dbf46640 1 --2- 172.21.15.132:0/708921341 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71d40cd2a0 0x7f71d40cd700 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:21.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.671+0000 7f71dbf46640 1 --2- 172.21.15.132:0/708921341 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71d4144f50 0x7f71d40b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:21.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.671+0000 7f71dbf46640 1 -- 172.21.15.132:0/708921341 >> 172.21.15.132:0/708921341 conn(0x7f71d40b2d50 msgr2=0x7f71d406ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:21.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.671+0000 7f71dbf46640 1 -- 172.21.15.132:0/708921341 shutdown_connections 2024-04-16T15:53:21.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.672+0000 7f71dbf46640 1 -- 172.21.15.132:0/708921341 wait complete. 2024-04-16T15:53:21.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.673+0000 7f71dbf46640 1 Processor -- start 2024-04-16T15:53:21.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.673+0000 7f71dbf46640 1 -- start start 2024-04-16T15:53:21.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.673+0000 7f71dbf46640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71d406eda0 0x7f71d413dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:21.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.673+0000 7f71dbf46640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71d40cd2a0 0x7f71d413f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:21.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.673+0000 7f71dbf46640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71d4144f50 0x7f71d41f05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:21.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.673+0000 7f71dbf46640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f71d4145330 con 0x7f71d406eda0 2024-04-16T15:53:21.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.673+0000 7f71dbf46640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f71d40afda0 con 0x7f71d4144f50 2024-04-16T15:53:21.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.673+0000 7f71dbf46640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f71d406f1d0 con 0x7f71d40cd2a0 2024-04-16T15:53:21.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.673+0000 7f71d9ce2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71d406eda0 0x7f71d413dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:21.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.673+0000 7f71d9ce2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71d406eda0 0x7f71d413dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41810/0 (socket says 172.21.15.132:41810) 2024-04-16T15:53:21.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.673+0000 7f71d9ce2640 1 -- 172.21.15.132:0/1500587517 learned_addr learned my addr 172.21.15.132:0/1500587517 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:21.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.674+0000 7f71d9ce2640 1 -- 172.21.15.132:0/1500587517 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71d40cd2a0 msgr2=0x7f71d413f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:21.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.674+0000 7f71d9ce2640 1 --2- 172.21.15.132:0/1500587517 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71d40cd2a0 0x7f71d413f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:21.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.674+0000 7f71d9ce2640 1 -- 172.21.15.132:0/1500587517 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71d4144f50 msgr2=0x7f71d41f05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:21.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.674+0000 7f71da4e3640 1 --2- 172.21.15.132:0/1500587517 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71d4144f50 0x7f71d41f05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:21.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.674+0000 7f71d9ce2640 1 --2- 172.21.15.132:0/1500587517 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71d4144f50 0x7f71d41f05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:21.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.674+0000 7f71d9ce2640 1 -- 172.21.15.132:0/1500587517 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71d413fea0 con 0x7f71d406eda0 2024-04-16T15:53:21.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.674+0000 7f71d9ce2640 1 --2- 172.21.15.132:0/1500587517 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71d406eda0 0x7f71d413dfe0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f71d000d5f0 tx=0x7f71d000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:21.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.674+0000 7f71c67fc640 1 -- 172.21.15.132:0/1500587517 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d00125f0 con 0x7f71d406eda0 2024-04-16T15:53:21.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.674+0000 7f71c67fc640 1 -- 172.21.15.132:0/1500587517 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71d0019070 con 0x7f71d406eda0 2024-04-16T15:53:21.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.674+0000 7f71c67fc640 1 -- 172.21.15.132:0/1500587517 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d00129d0 con 0x7f71d406eda0 2024-04-16T15:53:21.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.674+0000 7f71dbf46640 1 -- 172.21.15.132:0/1500587517 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71d4140a20 con 0x7f71d406eda0 2024-04-16T15:53:21.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.674+0000 7f71dbf46640 1 -- 172.21.15.132:0/1500587517 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71d4140fe0 con 0x7f71d406eda0 2024-04-16T15:53:21.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.675+0000 7f71dbf46640 1 -- 172.21.15.132:0/1500587517 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71d4075510 con 0x7f71d406eda0 2024-04-16T15:53:21.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.676+0000 7f71c67fc640 1 -- 172.21.15.132:0/1500587517 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f71d0012b70 con 0x7f71d406eda0 2024-04-16T15:53:21.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.676+0000 7f71c67fc640 1 --2- 172.21.15.132:0/1500587517 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f71b806c8f0 0x7f71b806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:21.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.676+0000 7f71d94e1640 1 --2- 172.21.15.132:0/1500587517 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f71b806c8f0 0x7f71b806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:21.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.676+0000 7f71c67fc640 1 -- 172.21.15.132:0/1500587517 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f71d008bec0 con 0x7f71d406eda0 2024-04-16T15:53:21.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.676+0000 7f71d94e1640 1 --2- 172.21.15.132:0/1500587517 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f71b806c8f0 0x7f71b806edb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f71c8038000 tx=0x7f71c8030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:21.680 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.680+0000 7f71c67fc640 1 -- 172.21.15.132:0/1500587517 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f71d005a380 con 0x7f71d406eda0 2024-04-16T15:53:21.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.857+0000 7f71dbf46640 1 -- 172.21.15.132:0/1500587517 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f71d415b6a0 con 0x7f71d406eda0 2024-04-16T15:53:21.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.858+0000 7f71c67fc640 1 -- 172.21.15.132:0/1500587517 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16669 (secure 0 0 0) 0x7f71d0059c80 con 0x7f71d406eda0 2024-04-16T15:53:21.857 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:53:21.857 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":34,"fsid":"6bdec5d9-f406-43ad-8584-0503b32f6f0d","created":"2024-04-16T15:51:51.073040+0000","modified":"2024-04-16T15:53:20.191244+0000","last_up_change":"2024-04-16T15:52:02.280496+0000","last_in_change":"2024-04-16T15:51:53.376468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:52:03.284927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:53:16.451607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-16T15:53:17.510579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d45908b-6e22-4619-b190-897af594b712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6801","nonce":1170594668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6803","nonce":1170594668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6807","nonce":1170594668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6805","nonce":1170594668}]},"public_addr":"172.21.15.132:6801/1170594668","cluster_addr":"172.21.15.132:6803/1170594668","heartbeat_back_addr":"172.21.15.132:6807/1170594668","heartbeat_front_addr":"172.21.15.132:6805/1170594668","state":["exists","up"]},{"osd":1,"uuid":"c88bf082-e51f-4ee6-815a-025f6ce0d67b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6809","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6811","nonce":2494780358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6815","nonce":2494780358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6823","nonce":2494780358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6819","nonce":2494780358}]},"public_addr":"172.21.15.132:6811/2494780358","cluster_addr":"172.21.15.132:6815/2494780358","heartbeat_back_addr":"172.21.15.132:6823/2494780358","heartbeat_front_addr":"172.21.15.132:6819/2494780358","state":["exists","up"]},{"osd":2,"uuid":"e5dbd6b4-4e7b-47e4-ad4e-35b4b81696c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6825","nonce":27655483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6827","nonce":27655483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6831","nonce":27655483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6829","nonce":27655483}]},"public_addr":"172.21.15.132:6825/27655483","cluster_addr":"172.21.15.132:6827/27655483","heartbeat_back_addr":"172.21.15.132:6831/27655483","heartbeat_front_addr":"172.21.15.132:6829/27655483","state":["exists","up"]},{"osd":3,"uuid":"9d75cd67-3b8a-4424-8884-5f3660e1f5f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6810","nonce":3100919191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6814","nonce":3100919191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6821","nonce":3100919191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6818","nonce":3100919191}]},"public_addr":"172.21.15.132:6810/3100919191","cluster_addr":"172.21.15.132:6814/3100919191","heartbeat_back_addr":"172.21.15.132:6821/3100919191","heartbeat_front_addr":"172.21.15.132:6818/3100919191","state":["exists","up"]},{"osd":4,"uuid":"83aea46a-8642-4777-912b-c130e5890da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6825","nonce":123637799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6827","nonce":123637799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6831","nonce":123637799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6829","nonce":123637799}]},"public_addr":"172.21.15.179:6825/123637799","cluster_addr":"172.21.15.179:6827/123637799","heartbeat_back_addr":"172.21.15.179:6831/123637799","heartbeat_front_addr":"172.21.15.179:6829/123637799","state":["exists","up"]},{"osd":5,"uuid":"534117c8-3317-48d6-b436-afd5709f71e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6801","nonce":2224750370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6803","nonce":2224750370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6807","nonce":2224750370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6805","nonce":2224750370}]},"public_addr":"172.21.15.179:6801/2224750370","cluster_addr":"172.21.15.179:6803/2224750370","heartbeat_back_addr":"172.21.15.179:6807/2224750370","heartbeat_front_addr":"172.21.15.179:6805/2224750370","state":["exists","up"]},{"osd":6,"uuid":"0ba363e7-fa9d-42b1-ae09-a6a0f57d41f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6809","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6811","nonce":101498164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6813","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6815","nonce":101498164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6823","nonce":101498164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6819","nonce":101498164}]},"public_addr":"172.21.15.179:6811/101498164","cluster_addr":"172.21.15.179:6815/101498164","heartbeat_back_addr":"172.21.15.179:6823/101498164","heartbeat_front_addr":"172.21.15.179:6819/101498164","state":["exists","up"]},{"osd":7,"uuid":"e6830c77-2f2d-4067-9866-ee7625afc1a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6810","nonce":872148365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6814","nonce":872148365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6822","nonce":872148365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6818","nonce":872148365}]},"public_addr":"172.21.15.179:6810/872148365","cluster_addr":"172.21.15.179:6814/872148365","heartbeat_back_addr":"172.21.15.179:6822/872148365","heartbeat_front_addr":"172.21.15.179:6818/872148365","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.535221+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.563769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.520765+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.526264+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.517058+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.500842+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.534332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.512486+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:53:21.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.860+0000 7f71dbf46640 1 -- 172.21.15.132:0/1500587517 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f71b806c8f0 msgr2=0x7f71b806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:21.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.860+0000 7f71dbf46640 1 --2- 172.21.15.132:0/1500587517 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f71b806c8f0 0x7f71b806edb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f71c8038000 tx=0x7f71c8030000 comp rx=0 tx=0).stop 2024-04-16T15:53:21.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.860+0000 7f71dbf46640 1 -- 172.21.15.132:0/1500587517 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71d406eda0 msgr2=0x7f71d413dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:21.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.860+0000 7f71dbf46640 1 --2- 172.21.15.132:0/1500587517 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71d406eda0 0x7f71d413dfe0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f71d000d5f0 tx=0x7f71d000dab0 comp rx=0 tx=0).stop 2024-04-16T15:53:21.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.860+0000 7f71dbf46640 1 -- 172.21.15.132:0/1500587517 shutdown_connections 2024-04-16T15:53:21.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.860+0000 7f71dbf46640 1 --2- 172.21.15.132:0/1500587517 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f71b806c8f0 0x7f71b806edb0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:21.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.860+0000 7f71dbf46640 1 --2- 172.21.15.132:0/1500587517 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71d4144f50 0x7f71d41f05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:21.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.860+0000 7f71dbf46640 1 --2- 172.21.15.132:0/1500587517 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71d40cd2a0 0x7f71d413f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:21.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.860+0000 7f71dbf46640 1 --2- 172.21.15.132:0/1500587517 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71d406eda0 0x7f71d413dfe0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:21.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.860+0000 7f71dbf46640 1 -- 172.21.15.132:0/1500587517 >> 172.21.15.132:0/1500587517 conn(0x7f71d40b2d50 msgr2=0x7f71d40b4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:21.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.860+0000 7f71dbf46640 1 -- 172.21.15.132:0/1500587517 shutdown_connections 2024-04-16T15:53:21.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.860+0000 7f71dbf46640 1 -- 172.21.15.132:0/1500587517 wait complete. 2024-04-16T15:53:21.871 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-16T15:53:21.871 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T15:53:21.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.974+0000 7fdb80932640 1 Processor -- start 2024-04-16T15:53:21.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.974+0000 7fdb80932640 1 -- start start 2024-04-16T15:53:21.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.975+0000 7fdb80932640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdb7c15e9d0 0x7fdb7c070cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:21.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.975+0000 7fdb80932640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb7c0b0460 0x7fdb7c0ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:21.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.975+0000 7fdb80932640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb7c0b66e0 con 0x7fdb7c06ba20 2024-04-16T15:53:21.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.975+0000 7fdb80932640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fdb7c0b08c0 con 0x7fdb7c15e9d0 2024-04-16T15:53:21.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.975+0000 7fdb80932640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fdb7c0b4840 con 0x7fdb7c0b0460 2024-04-16T15:53:21.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.975+0000 7fdb7a59c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdb7c15e9d0 0x7fdb7c070cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:21.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.975+0000 7fdb7a59c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdb7c15e9d0 0x7fdb7c070cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41818/0 (socket says 172.21.15.132:41818) 2024-04-16T15:53:21.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.975+0000 7fdb7a59c640 1 -- 172.21.15.132:0/4251504845 learned_addr learned my addr 172.21.15.132:0/4251504845 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:21.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.975+0000 7fdb71d9b640 1 --2- 172.21.15.132:0/4251504845 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb7c0b0460 0x7fdb7c0ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:21.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.975+0000 7fdb7a59c640 1 -- 172.21.15.132:0/4251504845 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb7c0b0460 msgr2=0x7fdb7c0ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:21.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.975+0000 7fdb7a59c640 1 --2- 172.21.15.132:0/4251504845 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb7c0b0460 0x7fdb7c0ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:21.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.975+0000 7fdb7a59c640 1 -- 172.21.15.132:0/4251504845 >> v1:172.21.15.179:6789/0 conn(0x7fdb7c06ba20 legacy=0x7fdb7c06fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:21.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.975+0000 7fdb7a59c640 1 -- 172.21.15.132:0/4251504845 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb7c0b6400 con 0x7fdb7c15e9d0 2024-04-16T15:53:21.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.976+0000 7fdb7a59c640 1 --2- 172.21.15.132:0/4251504845 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb7c15e9d0 0x7fdb7c070cf0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c009870 tx=0x7fdb6c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62841e9c15dc5a64 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:21.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.976+0000 7fdb79d9b640 1 -- 172.21.15.132:0/4251504845 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c035020 con 0x7fdb7c15e9d0 2024-04-16T15:53:21.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.976+0000 7fdb79d9b640 1 -- 172.21.15.132:0/4251504845 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb6c031640 con 0x7fdb7c15e9d0 2024-04-16T15:53:21.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.976+0000 7fdb79d9b640 1 -- 172.21.15.132:0/4251504845 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c02d040 con 0x7fdb7c15e9d0 2024-04-16T15:53:21.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.976+0000 7fdb80932640 1 -- 172.21.15.132:0/4251504845 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb7c15e9d0 msgr2=0x7fdb7c070cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:21.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.976+0000 7fdb80932640 1 --2- 172.21.15.132:0/4251504845 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb7c15e9d0 0x7fdb7c070cf0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c009870 tx=0x7fdb6c02b8f0 comp rx=0 tx=0).stop 2024-04-16T15:53:21.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.977+0000 7fdb80932640 1 -- 172.21.15.132:0/4251504845 shutdown_connections 2024-04-16T15:53:21.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.977+0000 7fdb80932640 1 --2- 172.21.15.132:0/4251504845 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb7c0b0460 0x7fdb7c0ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:21.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.977+0000 7fdb80932640 1 --2- 172.21.15.132:0/4251504845 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb7c15e9d0 0x7fdb7c070cf0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:21.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.977+0000 7fdb80932640 1 -- 172.21.15.132:0/4251504845 >> 172.21.15.132:0/4251504845 conn(0x7fdb7c09aa30 msgr2=0x7fdb7c0b6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:21.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.977+0000 7fdb80932640 1 -- 172.21.15.132:0/4251504845 shutdown_connections 2024-04-16T15:53:21.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.977+0000 7fdb80932640 1 -- 172.21.15.132:0/4251504845 wait complete. 2024-04-16T15:53:21.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.978+0000 7fdb80932640 1 Processor -- start 2024-04-16T15:53:21.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.978+0000 7fdb80932640 1 -- start start 2024-04-16T15:53:21.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.979+0000 7fdb80932640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb7c06ba20 0x7fdb7c154bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:21.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.979+0000 7fdb80932640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb7c0b0460 0x7fdb7c1f5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:21.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.979+0000 7fdb80932640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb7c15e9d0 0x7fdb7c15c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:21.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.979+0000 7fdb80932640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7c0b6020 con 0x7fdb7c06ba20 2024-04-16T15:53:21.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.979+0000 7fdb80932640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7c15edb0 con 0x7fdb7c15e9d0 2024-04-16T15:53:21.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.979+0000 7fdb80932640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fdb7c0b61a0 con 0x7fdb7c0b0460 2024-04-16T15:53:21.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.979+0000 7fdb7a59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb7c06ba20 0x7fdb7c154bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:21.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.979+0000 7fdb7a59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb7c06ba20 0x7fdb7c154bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41830/0 (socket says 172.21.15.132:41830) 2024-04-16T15:53:21.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.979+0000 7fdb7a59c640 1 -- 172.21.15.132:0/2046882278 learned_addr learned my addr 172.21.15.132:0/2046882278 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:21.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.979+0000 7fdb71d9b640 1 --2- 172.21.15.132:0/2046882278 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb7c0b0460 0x7fdb7c1f5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:21.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.979+0000 7fdb7ad9d640 1 --2- 172.21.15.132:0/2046882278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb7c15e9d0 0x7fdb7c15c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:21.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.979+0000 7fdb7a59c640 1 -- 172.21.15.132:0/2046882278 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb7c0b0460 msgr2=0x7fdb7c1f5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:21.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.979+0000 7fdb7a59c640 1 --2- 172.21.15.132:0/2046882278 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb7c0b0460 0x7fdb7c1f5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:21.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.979+0000 7fdb7a59c640 1 -- 172.21.15.132:0/2046882278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb7c15e9d0 msgr2=0x7fdb7c15c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:21.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.979+0000 7fdb7a59c640 1 --2- 172.21.15.132:0/2046882278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb7c15e9d0 0x7fdb7c15c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:21.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.979+0000 7fdb7a59c640 1 -- 172.21.15.132:0/2046882278 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb7c1f5b40 con 0x7fdb7c06ba20 2024-04-16T15:53:21.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.979+0000 7fdb71d9b640 1 --2- 172.21.15.132:0/2046882278 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb7c0b0460 0x7fdb7c1f5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:53:21.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.979+0000 7fdb7ad9d640 1 --2- 172.21.15.132:0/2046882278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb7c15e9d0 0x7fdb7c15c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:53:21.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.979+0000 7fdb7a59c640 1 --2- 172.21.15.132:0/2046882278 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb7c06ba20 0x7fdb7c154bc0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c000c00 tx=0x7fdb6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:21.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.979+0000 7fdb737fe640 1 -- 172.21.15.132:0/2046882278 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c040070 con 0x7fdb7c06ba20 2024-04-16T15:53:21.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.979+0000 7fdb737fe640 1 -- 172.21.15.132:0/2046882278 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb6c0399f0 con 0x7fdb7c06ba20 2024-04-16T15:53:21.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.979+0000 7fdb80932640 1 -- 172.21.15.132:0/2046882278 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb7c1551a0 con 0x7fdb7c06ba20 2024-04-16T15:53:21.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.979+0000 7fdb737fe640 1 -- 172.21.15.132:0/2046882278 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c035040 con 0x7fdb7c06ba20 2024-04-16T15:53:21.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.980+0000 7fdb80932640 1 -- 172.21.15.132:0/2046882278 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb7c155a40 con 0x7fdb7c06ba20 2024-04-16T15:53:21.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.981+0000 7fdb80932640 1 -- 172.21.15.132:0/2046882278 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb7c155590 con 0x7fdb7c06ba20 2024-04-16T15:53:21.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.981+0000 7fdb737fe640 1 -- 172.21.15.132:0/2046882278 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdb6c04b060 con 0x7fdb7c06ba20 2024-04-16T15:53:21.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.981+0000 7fdb737fe640 1 --2- 172.21.15.132:0/2046882278 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fdb5c06c8f0 0x7fdb5c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:21.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.981+0000 7fdb737fe640 1 -- 172.21.15.132:0/2046882278 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fdb6c0ad380 con 0x7fdb7c06ba20 2024-04-16T15:53:21.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.982+0000 7fdb71d9b640 1 --2- 172.21.15.132:0/2046882278 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fdb5c06c8f0 0x7fdb5c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:21.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.982+0000 7fdb71d9b640 1 --2- 172.21.15.132:0/2046882278 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fdb5c06c8f0 0x7fdb5c06edb0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdb64006fd0 tx=0x7fdb64008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:21.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:21.986+0000 7fdb737fe640 1 -- 172.21.15.132:0/2046882278 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdb7c1f5b40 con 0x7fdb7c06ba20 2024-04-16T15:53:22.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.160+0000 7fdb80932640 1 -- 172.21.15.132:0/2046882278 --> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdb7c075510 con 0x7fdb5c06c8f0 2024-04-16T15:53:22.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.166+0000 7fdb737fe640 1 -- 172.21.15.132:0/2046882278 <== mgr.4101 v2:172.21.15.132:6832/3896387465 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+241800 (secure 0 0 0) 0x7fdb7c075510 con 0x7fdb5c06c8f0 2024-04-16T15:53:22.167 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:53:22.168 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2024-04-16T15:53:22.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.169+0000 7fdb80932640 1 -- 172.21.15.132:0/2046882278 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fdb5c06c8f0 msgr2=0x7fdb5c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:22.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.169+0000 7fdb80932640 1 --2- 172.21.15.132:0/2046882278 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fdb5c06c8f0 0x7fdb5c06edb0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdb64006fd0 tx=0x7fdb64008040 comp rx=0 tx=0).stop 2024-04-16T15:53:22.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.169+0000 7fdb80932640 1 -- 172.21.15.132:0/2046882278 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb7c06ba20 msgr2=0x7fdb7c154bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:22.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.169+0000 7fdb80932640 1 --2- 172.21.15.132:0/2046882278 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb7c06ba20 0x7fdb7c154bc0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c000c00 tx=0x7fdb6c0046c0 comp rx=0 tx=0).stop 2024-04-16T15:53:22.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.169+0000 7fdb80932640 1 -- 172.21.15.132:0/2046882278 shutdown_connections 2024-04-16T15:53:22.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.169+0000 7fdb80932640 1 --2- 172.21.15.132:0/2046882278 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fdb5c06c8f0 0x7fdb5c06edb0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:22.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.169+0000 7fdb80932640 1 --2- 172.21.15.132:0/2046882278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb7c15e9d0 0x7fdb7c15c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:22.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.169+0000 7fdb80932640 1 --2- 172.21.15.132:0/2046882278 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb7c0b0460 0x7fdb7c1f5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:22.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.169+0000 7fdb80932640 1 --2- 172.21.15.132:0/2046882278 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb7c06ba20 0x7fdb7c154bc0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:22.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.169+0000 7fdb80932640 1 -- 172.21.15.132:0/2046882278 >> 172.21.15.132:0/2046882278 conn(0x7fdb7c09aa30 msgr2=0x7fdb7c0b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:22.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.169+0000 7fdb80932640 1 -- 172.21.15.132:0/2046882278 shutdown_connections 2024-04-16T15:53:22.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.169+0000 7fdb80932640 1 -- 172.21.15.132:0/2046882278 wait complete. 2024-04-16T15:53:22.179 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2024-04-16T15:53:21.281976+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":112,"acting":112,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224164,"kb_used_data":3832,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750556,"statfs":{"total":773094113280,"available":772864569344,"internally_reserved":0,"allocated":3923968,"data_stored":2218180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.098570"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.204545+0000","last_change":"2024-04-16T15:53:18.204545+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.204545+0000","last_undegraded":"2024-04-16T15:53:18.204545+0000","last_fullsized":"2024-04-16T15:53:18.204545+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.195522+0000","last_change":"2024-04-16T15:53:18.195522+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.195522+0000","last_undegraded":"2024-04-16T15:53:18.195522+0000","last_fullsized":"2024-04-16T15:53:18.195522+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.204209+0000","last_change":"2024-04-16T15:53:18.204209+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.204209+0000","last_undegraded":"2024-04-16T15:53:18.204209+0000","last_fullsized":"2024-04-16T15:53:18.204209+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.196409+0000","last_change":"2024-04-16T15:53:18.196409+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.196409+0000","last_undegraded":"2024-04-16T15:53:18.196409+0000","last_fullsized":"2024-04-16T15:53:18.196409+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.203805+0000","last_change":"2024-04-16T15:53:18.203805+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.203805+0000","last_undegraded":"2024-04-16T15:53:18.203805+0000","last_fullsized":"2024-04-16T15:53:18.203805+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.195390+0000","last_change":"2024-04-16T15:53:18.195390+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.195390+0000","last_undegraded":"2024-04-16T15:53:18.195390+0000","last_fullsized":"2024-04-16T15:53:18.195390+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.204995+0000","last_change":"2024-04-16T15:53:18.204995+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.204995+0000","last_undegraded":"2024-04-16T15:53:18.204995+0000","last_fullsized":"2024-04-16T15:53:18.204995+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.198148+0000","last_change":"2024-04-16T15:53:18.198148+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.198148+0000","last_undegraded":"2024-04-16T15:53:18.198148+0000","last_fullsized":"2024-04-16T15:53:18.198148+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.195941+0000","last_change":"2024-04-16T15:53:18.195941+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.195941+0000","last_undegraded":"2024-04-16T15:53:18.195941+0000","last_fullsized":"2024-04-16T15:53:18.195941+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.202957+0000","last_change":"2024-04-16T15:53:18.202957+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.202957+0000","last_undegraded":"2024-04-16T15:53:18.202957+0000","last_fullsized":"2024-04-16T15:53:18.202957+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-16T15:53:18.215810+0000","last_change":"2024-04-16T15:53:18.210743+0000","last_active":"2024-04-16T15:53:18.215810+0000","last_peered":"2024-04-16T15:53:18.215810+0000","last_clean":"2024-04-16T15:53:18.215810+0000","last_became_active":"2024-04-16T15:53:18.210466+0000","last_became_peered":"2024-04-16T15:53:18.210466+0000","last_unstale":"2024-04-16T15:53:18.215810+0000","last_undegraded":"2024-04-16T15:53:18.215810+0000","last_fullsized":"2024-04-16T15:53:18.215810+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:28:44.787593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.201904+0000","last_change":"2024-04-16T15:53:18.201904+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.201904+0000","last_undegraded":"2024-04-16T15:53:18.201904+0000","last_fullsized":"2024-04-16T15:53:18.201904+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T15:53:17.187572+0000","last_change":"2024-04-16T15:53:17.187572+0000","last_active":"2024-04-16T15:53:17.181152+0000","last_peered":"2024-04-16T15:53:17.181152+0000","last_clean":"2024-04-16T15:53:17.181152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:17.187572+0000","last_undegraded":"2024-04-16T15:53:17.187572+0000","last_fullsized":"2024-04-16T15:53:17.187572+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T15:53:17.190727+0000","last_change":"2024-04-16T15:53:17.190727+0000","last_active":"2024-04-16T15:53:17.181152+0000","last_peered":"2024-04-16T15:53:17.181152+0000","last_clean":"2024-04-16T15:53:17.181152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:17.190727+0000","last_undegraded":"2024-04-16T15:53:17.190727+0000","last_fullsized":"2024-04-16T15:53:17.190727+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-16T15:53:18.214654+0000","last_change":"2024-04-16T15:53:18.210644+0000","last_active":"2024-04-16T15:53:18.214654+0000","last_peered":"2024-04-16T15:53:18.214654+0000","last_clean":"2024-04-16T15:53:18.214654+0000","last_became_active":"2024-04-16T15:53:18.210390+0000","last_became_peered":"2024-04-16T15:53:18.210390+0000","last_unstale":"2024-04-16T15:53:18.214654+0000","last_undegraded":"2024-04-16T15:53:18.214654+0000","last_fullsized":"2024-04-16T15:53:18.214654+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:22:20.614026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T15:53:17.187376+0000","last_change":"2024-04-16T15:53:17.187376+0000","last_active":"2024-04-16T15:53:17.181152+0000","last_peered":"2024-04-16T15:53:17.181152+0000","last_clean":"2024-04-16T15:53:17.181152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:17.187376+0000","last_undegraded":"2024-04-16T15:53:17.187376+0000","last_fullsized":"2024-04-16T15:53:17.187376+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.195387+0000","last_change":"2024-04-16T15:53:18.195387+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.195387+0000","last_undegraded":"2024-04-16T15:53:18.195387+0000","last_fullsized":"2024-04-16T15:53:18.195387+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T15:53:17.185907+0000","last_change":"2024-04-16T15:53:17.185907+0000","last_active":"2024-04-16T15:53:17.181152+0000","last_peered":"2024-04-16T15:53:17.181152+0000","last_clean":"2024-04-16T15:53:17.181152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:17.185907+0000","last_undegraded":"2024-04-16T15:53:17.185907+0000","last_fullsized":"2024-04-16T15:53:17.185907+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T15:53:17.191332+0000","last_change":"2024-04-16T15:53:17.191332+0000","last_active":"2024-04-16T15:53:17.181152+0000","last_peered":"2024-04-16T15:53:17.181152+0000","last_clean":"2024-04-16T15:53:17.181152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:17.191332+0000","last_undegraded":"2024-04-16T15:53:17.191332+0000","last_fullsized":"2024-04-16T15:53:17.191332+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T15:53:17.186381+0000","last_change":"2024-04-16T15:53:17.186381+0000","last_active":"2024-04-16T15:53:17.181152+0000","last_peered":"2024-04-16T15:53:17.181152+0000","last_clean":"2024-04-16T15:53:17.181152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:17.186381+0000","last_undegraded":"2024-04-16T15:53:17.186381+0000","last_fullsized":"2024-04-16T15:53:17.186381+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.195456+0000","last_change":"2024-04-16T15:53:18.195456+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.195456+0000","last_undegraded":"2024-04-16T15:53:18.195456+0000","last_fullsized":"2024-04-16T15:53:18.195456+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T15:53:17.191157+0000","last_change":"2024-04-16T15:53:17.191157+0000","last_active":"2024-04-16T15:53:17.181152+0000","last_peered":"2024-04-16T15:53:17.181152+0000","last_clean":"2024-04-16T15:53:17.181152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:17.191157+0000","last_undegraded":"2024-04-16T15:53:17.191157+0000","last_fullsized":"2024-04-16T15:53:17.191157+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T15:53:17.187135+0000","last_change":"2024-04-16T15:53:17.187135+0000","last_active":"2024-04-16T15:53:17.181152+0000","last_peered":"2024-04-16T15:53:17.181152+0000","last_clean":"2024-04-16T15:53:17.181152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:17.187135+0000","last_undegraded":"2024-04-16T15:53:17.187135+0000","last_fullsized":"2024-04-16T15:53:17.187135+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-16T15:53:18.211370+0000","last_change":"2024-04-16T15:53:18.208880+0000","last_active":"2024-04-16T15:53:18.211370+0000","last_peered":"2024-04-16T15:53:18.211370+0000","last_clean":"2024-04-16T15:53:18.211370+0000","last_became_active":"2024-04-16T15:53:18.208317+0000","last_became_peered":"2024-04-16T15:53:18.208317+0000","last_unstale":"2024-04-16T15:53:18.211370+0000","last_undegraded":"2024-04-16T15:53:18.211370+0000","last_fullsized":"2024-04-16T15:53:18.211370+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:34:16.256486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.196587+0000","last_change":"2024-04-16T15:53:18.196587+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.196587+0000","last_undegraded":"2024-04-16T15:53:18.196587+0000","last_fullsized":"2024-04-16T15:53:18.196587+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T15:53:17.190756+0000","last_change":"2024-04-16T15:53:17.190756+0000","last_active":"2024-04-16T15:53:17.181152+0000","last_peered":"2024-04-16T15:53:17.181152+0000","last_clean":"2024-04-16T15:53:17.181152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:17.190756+0000","last_undegraded":"2024-04-16T15:53:17.190756+0000","last_fullsized":"2024-04-16T15:53:17.190756+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T15:53:17.186870+0000","last_change":"2024-04-16T15:53:17.186870+0000","last_active":"2024-04-16T15:53:17.181152+0000","last_peered":"2024-04-16T15:53:17.181152+0000","last_clean":"2024-04-16T15:53:17.181152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:17.186870+0000","last_undegraded":"2024-04-16T15:53:17.186870+0000","last_fullsized":"2024-04-16T15:53:17.186870+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T15:53:17.193361+0000","last_change":"2024-04-16T15:53:17.193361+0000","last_active":"2024-04-16T15:53:17.181152+0000","last_peered":"2024-04-16T15:53:17.181152+0000","last_clean":"2024-04-16T15:53:17.181152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:17.193361+0000","last_undegraded":"2024-04-16T15:53:17.193361+0000","last_fullsized":"2024-04-16T15:53:17.193361+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T15:53:17.190678+0000","last_change":"2024-04-16T15:53:17.190678+0000","last_active":"2024-04-16T15:53:17.181152+0000","last_peered":"2024-04-16T15:53:17.181152+0000","last_clean":"2024-04-16T15:53:17.181152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:17.190678+0000","last_undegraded":"2024-04-16T15:53:17.190678+0000","last_fullsized":"2024-04-16T15:53:17.190678+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.201914+0000","last_change":"2024-04-16T15:53:18.201914+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.201914+0000","last_undegraded":"2024-04-16T15:53:18.201914+0000","last_fullsized":"2024-04-16T15:53:18.201914+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T15:53:17.191068+0000","last_change":"2024-04-16T15:53:17.191068+0000","last_active":"2024-04-16T15:53:17.181152+0000","last_peered":"2024-04-16T15:53:17.181152+0000","last_clean":"2024-04-16T15:53:17.181152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:17.191068+0000","last_undegraded":"2024-04-16T15:53:17.191068+0000","last_fullsized":"2024-04-16T15:53:17.191068+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T15:53:17.193212+0000","last_change":"2024-04-16T15:53:17.193212+0000","last_active":"2024-04-16T15:53:17.181152+0000","last_peered":"2024-04-16T15:53:17.181152+0000","last_clean":"2024-04-16T15:53:17.181152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:17.193212+0000","last_undegraded":"2024-04-16T15:53:17.193212+0000","last_fullsized":"2024-04-16T15:53:17.193212+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.196955+0000","last_change":"2024-04-16T15:53:18.196955+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.196955+0000","last_undegraded":"2024-04-16T15:53:18.196955+0000","last_fullsized":"2024-04-16T15:53:18.196955+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T15:53:17.186675+0000","last_change":"2024-04-16T15:53:17.186675+0000","last_active":"2024-04-16T15:53:17.181152+0000","last_peered":"2024-04-16T15:53:17.181152+0000","last_clean":"2024-04-16T15:53:17.181152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:17.186675+0000","last_undegraded":"2024-04-16T15:53:17.186675+0000","last_fullsized":"2024-04-16T15:53:17.186675+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T15:53:17.186055+0000","last_change":"2024-04-16T15:53:17.186055+0000","last_active":"2024-04-16T15:53:17.181152+0000","last_peered":"2024-04-16T15:53:17.181152+0000","last_clean":"2024-04-16T15:53:17.181152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:17.186055+0000","last_undegraded":"2024-04-16T15:53:17.186055+0000","last_fullsized":"2024-04-16T15:53:17.186055+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.202993+0000","last_change":"2024-04-16T15:53:18.202993+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.202993+0000","last_undegraded":"2024-04-16T15:53:18.202993+0000","last_fullsized":"2024-04-16T15:53:18.202993+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T15:53:17.185897+0000","last_change":"2024-04-16T15:53:17.185897+0000","last_active":"2024-04-16T15:53:17.181152+0000","last_peered":"2024-04-16T15:53:17.181152+0000","last_clean":"2024-04-16T15:53:17.181152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:17.185897+0000","last_undegraded":"2024-04-16T15:53:17.185897+0000","last_fullsized":"2024-04-16T15:53:17.185897+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.202538+0000","last_change":"2024-04-16T15:53:18.202538+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.202538+0000","last_undegraded":"2024-04-16T15:53:18.202538+0000","last_fullsized":"2024-04-16T15:53:18.202538+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T15:53:17.187037+0000","last_change":"2024-04-16T15:53:17.187037+0000","last_active":"2024-04-16T15:53:17.181152+0000","last_peered":"2024-04-16T15:53:17.181152+0000","last_clean":"2024-04-16T15:53:17.181152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:17.187037+0000","last_undegraded":"2024-04-16T15:53:17.187037+0000","last_fullsized":"2024-04-16T15:53:17.187037+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.202082+0000","last_change":"2024-04-16T15:53:18.202082+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.202082+0000","last_undegraded":"2024-04-16T15:53:18.202082+0000","last_fullsized":"2024-04-16T15:53:18.202082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-16T15:53:18.215765+0000","last_change":"2024-04-16T15:53:18.210087+0000","last_active":"2024-04-16T15:53:18.215765+0000","last_peered":"2024-04-16T15:53:18.215765+0000","last_clean":"2024-04-16T15:53:18.215765+0000","last_became_active":"2024-04-16T15:53:18.209539+0000","last_became_peered":"2024-04-16T15:53:18.209539+0000","last_unstale":"2024-04-16T15:53:18.215765+0000","last_undegraded":"2024-04-16T15:53:18.215765+0000","last_fullsized":"2024-04-16T15:53:18.215765+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:01:02.783464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.201503+0000","last_change":"2024-04-16T15:53:18.201503+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.201503+0000","last_undegraded":"2024-04-16T15:53:18.201503+0000","last_fullsized":"2024-04-16T15:53:18.201503+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T15:53:17.187477+0000","last_change":"2024-04-16T15:53:17.187477+0000","last_active":"2024-04-16T15:53:17.181152+0000","last_peered":"2024-04-16T15:53:17.181152+0000","last_clean":"2024-04-16T15:53:17.181152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:17.187477+0000","last_undegraded":"2024-04-16T15:53:17.187477+0000","last_fullsized":"2024-04-16T15:53:17.187477+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-16T15:53:18.211359+0000","last_change":"2024-04-16T15:53:18.209377+0000","last_active":"2024-04-16T15:53:18.211359+0000","last_peered":"2024-04-16T15:53:18.211359+0000","last_clean":"2024-04-16T15:53:18.211359+0000","last_became_active":"2024-04-16T15:53:18.209092+0000","last_became_peered":"2024-04-16T15:53:18.209092+0000","last_unstale":"2024-04-16T15:53:18.211359+0000","last_undegraded":"2024-04-16T15:53:18.211359+0000","last_fullsized":"2024-04-16T15:53:18.211359+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:13:10.994891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.203401+0000","last_change":"2024-04-16T15:53:18.203401+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.203401+0000","last_undegraded":"2024-04-16T15:53:18.203401+0000","last_fullsized":"2024-04-16T15:53:18.203401+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T15:53:17.192754+0000","last_change":"2024-04-16T15:53:17.192754+0000","last_active":"2024-04-16T15:53:17.181152+0000","last_peered":"2024-04-16T15:53:17.181152+0000","last_clean":"2024-04-16T15:53:17.181152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:17.192754+0000","last_undegraded":"2024-04-16T15:53:17.192754+0000","last_fullsized":"2024-04-16T15:53:17.192754+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.195681+0000","last_change":"2024-04-16T15:53:18.195681+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.195681+0000","last_undegraded":"2024-04-16T15:53:18.195681+0000","last_fullsized":"2024-04-16T15:53:18.195681+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T15:53:17.186428+0000","last_change":"2024-04-16T15:53:17.186428+0000","last_active":"2024-04-16T15:53:17.181152+0000","last_peered":"2024-04-16T15:53:17.181152+0000","last_clean":"2024-04-16T15:53:17.181152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:17.186428+0000","last_undegraded":"2024-04-16T15:53:17.186428+0000","last_fullsized":"2024-04-16T15:53:17.186428+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T15:53:17.192347+0000","last_change":"2024-04-16T15:53:17.192347+0000","last_active":"2024-04-16T15:53:17.181152+0000","last_peered":"2024-04-16T15:53:17.181152+0000","last_clean":"2024-04-16T15:53:17.181152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:17.192347+0000","last_undegraded":"2024-04-16T15:53:17.192347+0000","last_fullsized":"2024-04-16T15:53:17.192347+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.203964+0000","last_change":"2024-04-16T15:53:18.203964+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.203964+0000","last_undegraded":"2024-04-16T15:53:18.203964+0000","last_fullsized":"2024-04-16T15:53:18.203964+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T15:53:17.186397+0000","last_change":"2024-04-16T15:53:17.186397+0000","last_active":"2024-04-16T15:53:17.181152+0000","last_peered":"2024-04-16T15:53:17.181152+0000","last_clean":"2024-04-16T15:53:17.181152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:17.186397+0000","last_undegraded":"2024-04-16T15:53:17.186397+0000","last_fullsized":"2024-04-16T15:53:17.186397+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T15:53:17.192763+0000","last_change":"2024-04-16T15:53:17.192763+0000","last_active":"2024-04-16T15:53:17.181152+0000","last_peered":"2024-04-16T15:53:17.181152+0000","last_clean":"2024-04-16T15:53:17.181152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:17.192763+0000","last_undegraded":"2024-04-16T15:53:17.192763+0000","last_fullsized":"2024-04-16T15:53:17.192763+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T15:53:17.186186+0000","last_change":"2024-04-16T15:53:17.186186+0000","last_active":"2024-04-16T15:53:17.181152+0000","last_peered":"2024-04-16T15:53:17.181152+0000","last_clean":"2024-04-16T15:53:17.181152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:17.186186+0000","last_undegraded":"2024-04-16T15:53:17.186186+0000","last_fullsized":"2024-04-16T15:53:17.186186+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T15:53:17.190575+0000","last_change":"2024-04-16T15:53:17.190575+0000","last_active":"2024-04-16T15:53:17.181152+0000","last_peered":"2024-04-16T15:53:17.181152+0000","last_clean":"2024-04-16T15:53:17.181152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:17.190575+0000","last_undegraded":"2024-04-16T15:53:17.190575+0000","last_fullsized":"2024-04-16T15:53:17.190575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-16T15:53:18.218640+0000","last_change":"2024-04-16T15:53:18.213907+0000","last_active":"2024-04-16T15:53:18.218640+0000","last_peered":"2024-04-16T15:53:18.218640+0000","last_clean":"2024-04-16T15:53:18.218640+0000","last_became_active":"2024-04-16T15:53:18.213572+0000","last_became_peered":"2024-04-16T15:53:18.213572+0000","last_unstale":"2024-04-16T15:53:18.218640+0000","last_undegraded":"2024-04-16T15:53:18.218640+0000","last_fullsized":"2024-04-16T15:53:18.218640+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:26:09.897432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":190,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-16T15:53:17.190924+0000","last_change":"2024-04-16T15:52:04.356095+0000","last_active":"2024-04-16T15:53:17.190924+0000","last_peered":"2024-04-16T15:53:17.190924+0000","last_clean":"2024-04-16T15:53:17.190924+0000","last_became_active":"2024-04-16T15:52:04.355126+0000","last_became_peered":"2024-04-16T15:52:04.355126+0000","last_unstale":"2024-04-16T15:53:17.190924+0000","last_undegraded":"2024-04-16T15:53:17.190924+0000","last_fullsized":"2024-04-16T15:53:17.190924+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:03.285037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:03.285037+0000","last_clean_scrub_stamp":"2024-04-16T15:52:03.285037+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:19.005024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":46,"acting":46,"num_store_stats":3},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":942080,"data_stored":722957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":348160,"data_stored":132589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":126772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":126772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":126772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":929792,"data_stored":717140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T15:53:22.183 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T15:53:22.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.323+0000 7fb0f25f4640 1 Processor -- start 2024-04-16T15:53:22.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.323+0000 7fb0f25f4640 1 -- start start 2024-04-16T15:53:22.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.324+0000 7fb0f25f4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0ec09b140 0x7fb0ec169710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:22.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.324+0000 7fb0f25f4640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0ec0ccee0 con 0x7fb0ec06cd40 2024-04-16T15:53:22.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.324+0000 7fb0f25f4640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0ec06dfe0 con 0x7fb0ec15ecc0 2024-04-16T15:53:22.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.324+0000 7fb0f25f4640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb0ec06dd00 con 0x7fb0ec09b140 2024-04-16T15:53:22.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.324+0000 7fb0eb7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fb0ec06cd40 0x7fb0ec09aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:41486/0 (socket says 172.21.15.132:41486) 2024-04-16T15:53:22.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.324+0000 7fb0eb7fe640 1 -- 172.21.15.132:0/1539591167 learned_addr learned my addr 172.21.15.132:0/1539591167 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:53:22.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.324+0000 7fb0eaffd640 1 -- 172.21.15.132:0/1539591167 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4043535317 0 0) 0x7fb0ec0ccee0 con 0x7fb0ec06cd40 2024-04-16T15:53:22.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.324+0000 7fb0f0b91640 1 --2- 172.21.15.132:0/1539591167 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0ec09b140 0x7fb0ec169710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:22.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.324+0000 7fb0eaffd640 1 -- 172.21.15.132:0/1539591167 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0d4003520 con 0x7fb0ec06cd40 2024-04-16T15:53:22.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.324+0000 7fb0eaffd640 1 -- 172.21.15.132:0/1539591167 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3169390972 0 0) 0x7fb0d4003520 con 0x7fb0ec06cd40 2024-04-16T15:53:22.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.324+0000 7fb0eaffd640 1 -- 172.21.15.132:0/1539591167 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0ec09b140 msgr2=0x7fb0ec169710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:22.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.324+0000 7fb0eaffd640 1 --2- 172.21.15.132:0/1539591167 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0ec09b140 0x7fb0ec169710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:22.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.324+0000 7fb0eaffd640 1 -- 172.21.15.132:0/1539591167 >> v1:172.21.15.179:6789/0 conn(0x7fb0ec15ecc0 legacy=0x7fb0ec06d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:22.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.324+0000 7fb0eaffd640 1 -- 172.21.15.132:0/1539591167 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0ec0cd180 con 0x7fb0ec06cd40 2024-04-16T15:53:22.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.324+0000 7fb0eaffd640 1 -- 172.21.15.132:0/1539591167 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2803668828 0 0) 0x7fb0e0001670 con 0x7fb0ec06cd40 2024-04-16T15:53:22.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.324+0000 7fb0eaffd640 1 -- 172.21.15.132:0/1539591167 >> v1:172.21.15.132:6789/0 conn(0x7fb0ec06cd40 legacy=0x7fb0ec09aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:22.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.325+0000 7fb0eaffd640 1 --2- 172.21.15.132:0/1539591167 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0ec09b140 0x7fb0d40039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:22.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.325+0000 7fb0eaffd640 1 --2- 172.21.15.132:0/1539591167 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0d4003f60 0x7fb0d4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:22.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.325+0000 7fb0eaffd640 1 --2- 172.21.15.132:0/1539591167 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0d4004d40 0x7fb0d40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:22.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.325+0000 7fb0eaffd640 1 -- 172.21.15.132:0/1539591167 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fb0ec06dd00 con 0x7fb0d4003f60 2024-04-16T15:53:22.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.325+0000 7fb0eaffd640 1 -- 172.21.15.132:0/1539591167 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d400baa0 con 0x7fb0d4004d40 2024-04-16T15:53:22.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.325+0000 7fb0eaffd640 1 -- 172.21.15.132:0/1539591167 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb0d400bca0 con 0x7fb0ec09b140 2024-04-16T15:53:22.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.325+0000 7fb0eb7fe640 1 --2- 172.21.15.132:0/1539591167 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0d4003f60 0x7fb0d4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:22.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.325+0000 7fb0ebfff640 1 --2- 172.21.15.132:0/1539591167 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0ec09b140 0x7fb0d40039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:22.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.325+0000 7fb0f0b91640 1 --2- 172.21.15.132:0/1539591167 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0d4004d40 0x7fb0d40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:22.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.325+0000 7fb0eb7fe640 1 -- 172.21.15.132:0/1539591167 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0ec09b140 msgr2=0x7fb0d40039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:22.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.325+0000 7fb0eb7fe640 1 --2- 172.21.15.132:0/1539591167 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0ec09b140 0x7fb0d40039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:22.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.325+0000 7fb0eb7fe640 1 -- 172.21.15.132:0/1539591167 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0d4004d40 msgr2=0x7fb0d40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:22.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.325+0000 7fb0eb7fe640 1 --2- 172.21.15.132:0/1539591167 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0d4004d40 0x7fb0d40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:22.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.325+0000 7fb0eb7fe640 1 -- 172.21.15.132:0/1539591167 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0d4003520 con 0x7fb0d4003f60 2024-04-16T15:53:22.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.325+0000 7fb0f0b91640 1 --2- 172.21.15.132:0/1539591167 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0d4004d40 0x7fb0d40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:53:22.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.326+0000 7fb0eb7fe640 1 --2- 172.21.15.132:0/1539591167 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0d4003f60 0x7fb0d4004800 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fb0e000c210 tx=0x7fb0d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35800ad87c90a642 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:22.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.326+0000 7fb0eaffd640 1 -- 172.21.15.132:0/1539591167 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e0007d30 con 0x7fb0d4003f60 2024-04-16T15:53:22.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.326+0000 7fb0eaffd640 1 -- 172.21.15.132:0/1539591167 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0e0030070 con 0x7fb0d4003f60 2024-04-16T15:53:22.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.326+0000 7fb0eaffd640 1 -- 172.21.15.132:0/1539591167 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e002cda0 con 0x7fb0d4003f60 2024-04-16T15:53:22.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.326+0000 7fb0f25f4640 1 -- 172.21.15.132:0/1539591167 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0d4003f60 msgr2=0x7fb0d4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:22.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.326+0000 7fb0f25f4640 1 --2- 172.21.15.132:0/1539591167 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0d4003f60 0x7fb0d4004800 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fb0e000c210 tx=0x7fb0d4005830 comp rx=0 tx=0).stop 2024-04-16T15:53:22.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.326+0000 7fb0f0b91640 1 -- 172.21.15.132:0/1539591167 reap_dead start 2024-04-16T15:53:22.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.326+0000 7fb0f25f4640 1 -- 172.21.15.132:0/1539591167 shutdown_connections 2024-04-16T15:53:22.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.326+0000 7fb0f25f4640 1 -- 172.21.15.132:0/1539591167 >> 172.21.15.132:0/1539591167 conn(0x7fb0ec0b41e0 msgr2=0x7fb0ec0b45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:22.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.326+0000 7fb0f25f4640 1 -- 172.21.15.132:0/1539591167 shutdown_connections 2024-04-16T15:53:22.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.326+0000 7fb0f25f4640 1 -- 172.21.15.132:0/1539591167 wait complete. 2024-04-16T15:53:22.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.327+0000 7fb0f25f4640 1 Processor -- start 2024-04-16T15:53:22.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.328+0000 7fb0f25f4640 1 -- start start 2024-04-16T15:53:22.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.328+0000 7fb0f25f4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0d4003f60 0x7fb0ec153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:22.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.328+0000 7fb0f25f4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0ec0c97c0 0x7fb0ec15fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:22.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.328+0000 7fb0f25f4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0ec15d960 0x7fb0ec15dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:22.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.328+0000 7fb0f25f4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fb0ec0ceb10 con 0x7fb0ec15d960 2024-04-16T15:53:22.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.328+0000 7fb0f25f4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb0ec0ce990 con 0x7fb0ec0c97c0 2024-04-16T15:53:22.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.328+0000 7fb0f25f4640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb0ec167700 con 0x7fb0d4003f60 2024-04-16T15:53:22.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.329+0000 7fb0f0b91640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0ec15d960 0x7fb0ec15dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:22.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.329+0000 7fb0f0b91640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0ec15d960 0x7fb0ec15dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41848/0 (socket says 172.21.15.132:41848) 2024-04-16T15:53:22.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.329+0000 7fb0f0b91640 1 -- 172.21.15.132:0/597970193 learned_addr learned my addr 172.21.15.132:0/597970193 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:22.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.329+0000 7fb0eb7fe640 1 --2- 172.21.15.132:0/597970193 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0ec0c97c0 0x7fb0ec15fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:22.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.329+0000 7fb0ebfff640 1 --2- 172.21.15.132:0/597970193 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0d4003f60 0x7fb0ec153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:22.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.329+0000 7fb0f0b91640 1 -- 172.21.15.132:0/597970193 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0d4003f60 msgr2=0x7fb0ec153520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:22.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.329+0000 7fb0f0b91640 1 --2- 172.21.15.132:0/597970193 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0d4003f60 0x7fb0ec153520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:22.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.329+0000 7fb0f0b91640 1 -- 172.21.15.132:0/597970193 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0ec0c97c0 msgr2=0x7fb0ec15fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:22.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.329+0000 7fb0f0b91640 1 --2- 172.21.15.132:0/597970193 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0ec0c97c0 0x7fb0ec15fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:22.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.329+0000 7fb0f0b91640 1 -- 172.21.15.132:0/597970193 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0ec159930 con 0x7fb0ec15d960 2024-04-16T15:53:22.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.329+0000 7fb0eb7fe640 1 --2- 172.21.15.132:0/597970193 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0ec0c97c0 0x7fb0ec15fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:53:22.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.329+0000 7fb0f0b91640 1 --2- 172.21.15.132:0/597970193 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0ec15d960 0x7fb0ec15dde0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec073e10 tx=0x7fb0e4010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:22.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.329+0000 7fb0e8ff9640 1 -- 172.21.15.132:0/597970193 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e4010e00 con 0x7fb0ec15d960 2024-04-16T15:53:22.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.329+0000 7fb0e8ff9640 1 -- 172.21.15.132:0/597970193 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0e4003990 con 0x7fb0ec15d960 2024-04-16T15:53:22.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.329+0000 7fb0f25f4640 1 -- 172.21.15.132:0/597970193 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0ec157b90 con 0x7fb0ec15d960 2024-04-16T15:53:22.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.329+0000 7fb0e8ff9640 1 -- 172.21.15.132:0/597970193 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e4003dc0 con 0x7fb0ec15d960 2024-04-16T15:53:22.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.329+0000 7fb0f25f4640 1 -- 172.21.15.132:0/597970193 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0ec15fff0 con 0x7fb0ec15d960 2024-04-16T15:53:22.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.330+0000 7fb0f25f4640 1 -- 172.21.15.132:0/597970193 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0ec0694f0 con 0x7fb0ec15d960 2024-04-16T15:53:22.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.331+0000 7fb0e8ff9640 1 -- 172.21.15.132:0/597970193 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb0e4005d10 con 0x7fb0ec15d960 2024-04-16T15:53:22.334 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.331+0000 7fb0e8ff9640 1 --2- 172.21.15.132:0/597970193 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fb0d806c8f0 0x7fb0d806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:22.334 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.331+0000 7fb0ebfff640 1 --2- 172.21.15.132:0/597970193 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fb0d806c8f0 0x7fb0d806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:22.334 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.331+0000 7fb0e8ff9640 1 -- 172.21.15.132:0/597970193 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fb0e408c370 con 0x7fb0ec15d960 2024-04-16T15:53:22.334 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.332+0000 7fb0ebfff640 1 --2- 172.21.15.132:0/597970193 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fb0d806c8f0 0x7fb0d806edb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc0035f0 tx=0x7fb0dc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:22.334 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.335+0000 7fb0e8ff9640 1 -- 172.21.15.132:0/597970193 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb0e4025020 con 0x7fb0ec15d960 2024-04-16T15:53:22.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.509+0000 7fb0f25f4640 1 -- 172.21.15.132:0/597970193 --> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb0ec15e320 con 0x7fb0d806c8f0 2024-04-16T15:53:22.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.514+0000 7fb0e8ff9640 1 -- 172.21.15.132:0/597970193 <== mgr.4101 v2:172.21.15.132:6832/3896387465 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+241800 (secure 0 0 0) 0x7fb0ec15e320 con 0x7fb0d806c8f0 2024-04-16T15:53:22.515 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:53:22.519 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2024-04-16T15:53:23.062 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.517+0000 7fb0f25f4640 1 -- 172.21.15.132:0/597970193 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fb0d806c8f0 msgr2=0x7fb0d806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:23.063 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.517+0000 7fb0f25f4640 1 --2- 172.21.15.132:0/597970193 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fb0d806c8f0 0x7fb0d806edb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc0035f0 tx=0x7fb0dc009040 comp rx=0 tx=0).stop 2024-04-16T15:53:23.063 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.517+0000 7fb0f25f4640 1 -- 172.21.15.132:0/597970193 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0ec15d960 msgr2=0x7fb0ec15dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:23.063 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.517+0000 7fb0f25f4640 1 --2- 172.21.15.132:0/597970193 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0ec15d960 0x7fb0ec15dde0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec073e10 tx=0x7fb0e4010590 comp rx=0 tx=0).stop 2024-04-16T15:53:23.063 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.517+0000 7fb0f25f4640 1 -- 172.21.15.132:0/597970193 shutdown_connections 2024-04-16T15:53:23.063 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.517+0000 7fb0f25f4640 1 --2- 172.21.15.132:0/597970193 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fb0d806c8f0 0x7fb0d806edb0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:23.063 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.517+0000 7fb0f25f4640 1 --2- 172.21.15.132:0/597970193 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0ec15d960 0x7fb0ec15dde0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:23.063 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.517+0000 7fb0f25f4640 1 --2- 172.21.15.132:0/597970193 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0ec0c97c0 0x7fb0ec15fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:23.063 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.517+0000 7fb0f25f4640 1 --2- 172.21.15.132:0/597970193 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0d4003f60 0x7fb0ec153520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:23.063 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.517+0000 7fb0f25f4640 1 -- 172.21.15.132:0/597970193 >> 172.21.15.132:0/597970193 conn(0x7fb0ec0b41e0 msgr2=0x7fb0ec0d1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:23.063 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.517+0000 7fb0f25f4640 1 -- 172.21.15.132:0/597970193 shutdown_connections 2024-04-16T15:53:23.063 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:22.517+0000 7fb0f25f4640 1 -- 172.21.15.132:0/597970193 wait complete. 2024-04-16T15:53:23.064 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2024-04-16T15:53:21.281976+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":112,"acting":112,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224164,"kb_used_data":3832,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750556,"statfs":{"total":773094113280,"available":772864569344,"internally_reserved":0,"allocated":3923968,"data_stored":2218180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.098570"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.204545+0000","last_change":"2024-04-16T15:53:18.204545+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.204545+0000","last_undegraded":"2024-04-16T15:53:18.204545+0000","last_fullsized":"2024-04-16T15:53:18.204545+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.195522+0000","last_change":"2024-04-16T15:53:18.195522+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.195522+0000","last_undegraded":"2024-04-16T15:53:18.195522+0000","last_fullsized":"2024-04-16T15:53:18.195522+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.204209+0000","last_change":"2024-04-16T15:53:18.204209+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.204209+0000","last_undegraded":"2024-04-16T15:53:18.204209+0000","last_fullsized":"2024-04-16T15:53:18.204209+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.196409+0000","last_change":"2024-04-16T15:53:18.196409+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.196409+0000","last_undegraded":"2024-04-16T15:53:18.196409+0000","last_fullsized":"2024-04-16T15:53:18.196409+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.203805+0000","last_change":"2024-04-16T15:53:18.203805+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.203805+0000","last_undegraded":"2024-04-16T15:53:18.203805+0000","last_fullsized":"2024-04-16T15:53:18.203805+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.195390+0000","last_change":"2024-04-16T15:53:18.195390+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.195390+0000","last_undegraded":"2024-04-16T15:53:18.195390+0000","last_fullsized":"2024-04-16T15:53:18.195390+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.204995+0000","last_change":"2024-04-16T15:53:18.204995+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.204995+0000","last_undegraded":"2024-04-16T15:53:18.204995+0000","last_fullsized":"2024-04-16T15:53:18.204995+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.198148+0000","last_change":"2024-04-16T15:53:18.198148+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.198148+0000","last_undegraded":"2024-04-16T15:53:18.198148+0000","last_fullsized":"2024-04-16T15:53:18.198148+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.195941+0000","last_change":"2024-04-16T15:53:18.195941+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.195941+0000","last_undegraded":"2024-04-16T15:53:18.195941+0000","last_fullsized":"2024-04-16T15:53:18.195941+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.202957+0000","last_change":"2024-04-16T15:53:18.202957+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.202957+0000","last_undegraded":"2024-04-16T15:53:18.202957+0000","last_fullsized":"2024-04-16T15:53:18.202957+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-16T15:53:18.215810+0000","last_change":"2024-04-16T15:53:18.210743+0000","last_active":"2024-04-16T15:53:18.215810+0000","last_peered":"2024-04-16T15:53:18.215810+0000","last_clean":"2024-04-16T15:53:18.215810+0000","last_became_active":"2024-04-16T15:53:18.210466+0000","last_became_peered":"2024-04-16T15:53:18.210466+0000","last_unstale":"2024-04-16T15:53:18.215810+0000","last_undegraded":"2024-04-16T15:53:18.215810+0000","last_fullsized":"2024-04-16T15:53:18.215810+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:28:44.787593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.201904+0000","last_change":"2024-04-16T15:53:18.201904+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.201904+0000","last_undegraded":"2024-04-16T15:53:18.201904+0000","last_fullsized":"2024-04-16T15:53:18.201904+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T15:53:17.187572+0000","last_change":"2024-04-16T15:53:17.187572+0000","last_active":"2024-04-16T15:53:17.181152+0000","last_peered":"2024-04-16T15:53:17.181152+0000","last_clean":"2024-04-16T15:53:17.181152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:17.187572+0000","last_undegraded":"2024-04-16T15:53:17.187572+0000","last_fullsized":"2024-04-16T15:53:17.187572+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T15:53:17.190727+0000","last_change":"2024-04-16T15:53:17.190727+0000","last_active":"2024-04-16T15:53:17.181152+0000","last_peered":"2024-04-16T15:53:17.181152+0000","last_clean":"2024-04-16T15:53:17.181152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:17.190727+0000","last_undegraded":"2024-04-16T15:53:17.190727+0000","last_fullsized":"2024-04-16T15:53:17.190727+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-16T15:53:18.214654+0000","last_change":"2024-04-16T15:53:18.210644+0000","last_active":"2024-04-16T15:53:18.214654+0000","last_peered":"2024-04-16T15:53:18.214654+0000","last_clean":"2024-04-16T15:53:18.214654+0000","last_became_active":"2024-04-16T15:53:18.210390+0000","last_became_peered":"2024-04-16T15:53:18.210390+0000","last_unstale":"2024-04-16T15:53:18.214654+0000","last_undegraded":"2024-04-16T15:53:18.214654+0000","last_fullsized":"2024-04-16T15:53:18.214654+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:22:20.614026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T15:53:17.187376+0000","last_change":"2024-04-16T15:53:17.187376+0000","last_active":"2024-04-16T15:53:17.181152+0000","last_peered":"2024-04-16T15:53:17.181152+0000","last_clean":"2024-04-16T15:53:17.181152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:17.187376+0000","last_undegraded":"2024-04-16T15:53:17.187376+0000","last_fullsized":"2024-04-16T15:53:17.187376+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.195387+0000","last_change":"2024-04-16T15:53:18.195387+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.195387+0000","last_undegraded":"2024-04-16T15:53:18.195387+0000","last_fullsized":"2024-04-16T15:53:18.195387+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T15:53:17.185907+0000","last_change":"2024-04-16T15:53:17.185907+0000","last_active":"2024-04-16T15:53:17.181152+0000","last_peered":"2024-04-16T15:53:17.181152+0000","last_clean":"2024-04-16T15:53:17.181152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:17.185907+0000","last_undegraded":"2024-04-16T15:53:17.185907+0000","last_fullsized":"2024-04-16T15:53:17.185907+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T15:53:17.191332+0000","last_change":"2024-04-16T15:53:17.191332+0000","last_active":"2024-04-16T15:53:17.181152+0000","last_peered":"2024-04-16T15:53:17.181152+0000","last_clean":"2024-04-16T15:53:17.181152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:17.191332+0000","last_undegraded":"2024-04-16T15:53:17.191332+0000","last_fullsized":"2024-04-16T15:53:17.191332+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T15:53:17.186381+0000","last_change":"2024-04-16T15:53:17.186381+0000","last_active":"2024-04-16T15:53:17.181152+0000","last_peered":"2024-04-16T15:53:17.181152+0000","last_clean":"2024-04-16T15:53:17.181152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:17.186381+0000","last_undegraded":"2024-04-16T15:53:17.186381+0000","last_fullsized":"2024-04-16T15:53:17.186381+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.195456+0000","last_change":"2024-04-16T15:53:18.195456+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.195456+0000","last_undegraded":"2024-04-16T15:53:18.195456+0000","last_fullsized":"2024-04-16T15:53:18.195456+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T15:53:17.191157+0000","last_change":"2024-04-16T15:53:17.191157+0000","last_active":"2024-04-16T15:53:17.181152+0000","last_peered":"2024-04-16T15:53:17.181152+0000","last_clean":"2024-04-16T15:53:17.181152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:17.191157+0000","last_undegraded":"2024-04-16T15:53:17.191157+0000","last_fullsized":"2024-04-16T15:53:17.191157+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T15:53:17.187135+0000","last_change":"2024-04-16T15:53:17.187135+0000","last_active":"2024-04-16T15:53:17.181152+0000","last_peered":"2024-04-16T15:53:17.181152+0000","last_clean":"2024-04-16T15:53:17.181152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:17.187135+0000","last_undegraded":"2024-04-16T15:53:17.187135+0000","last_fullsized":"2024-04-16T15:53:17.187135+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-16T15:53:18.211370+0000","last_change":"2024-04-16T15:53:18.208880+0000","last_active":"2024-04-16T15:53:18.211370+0000","last_peered":"2024-04-16T15:53:18.211370+0000","last_clean":"2024-04-16T15:53:18.211370+0000","last_became_active":"2024-04-16T15:53:18.208317+0000","last_became_peered":"2024-04-16T15:53:18.208317+0000","last_unstale":"2024-04-16T15:53:18.211370+0000","last_undegraded":"2024-04-16T15:53:18.211370+0000","last_fullsized":"2024-04-16T15:53:18.211370+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:34:16.256486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.196587+0000","last_change":"2024-04-16T15:53:18.196587+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.196587+0000","last_undegraded":"2024-04-16T15:53:18.196587+0000","last_fullsized":"2024-04-16T15:53:18.196587+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T15:53:17.190756+0000","last_change":"2024-04-16T15:53:17.190756+0000","last_active":"2024-04-16T15:53:17.181152+0000","last_peered":"2024-04-16T15:53:17.181152+0000","last_clean":"2024-04-16T15:53:17.181152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:17.190756+0000","last_undegraded":"2024-04-16T15:53:17.190756+0000","last_fullsized":"2024-04-16T15:53:17.190756+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T15:53:17.186870+0000","last_change":"2024-04-16T15:53:17.186870+0000","last_active":"2024-04-16T15:53:17.181152+0000","last_peered":"2024-04-16T15:53:17.181152+0000","last_clean":"2024-04-16T15:53:17.181152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:17.186870+0000","last_undegraded":"2024-04-16T15:53:17.186870+0000","last_fullsized":"2024-04-16T15:53:17.186870+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T15:53:17.193361+0000","last_change":"2024-04-16T15:53:17.193361+0000","last_active":"2024-04-16T15:53:17.181152+0000","last_peered":"2024-04-16T15:53:17.181152+0000","last_clean":"2024-04-16T15:53:17.181152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:17.193361+0000","last_undegraded":"2024-04-16T15:53:17.193361+0000","last_fullsized":"2024-04-16T15:53:17.193361+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T15:53:17.190678+0000","last_change":"2024-04-16T15:53:17.190678+0000","last_active":"2024-04-16T15:53:17.181152+0000","last_peered":"2024-04-16T15:53:17.181152+0000","last_clean":"2024-04-16T15:53:17.181152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:17.190678+0000","last_undegraded":"2024-04-16T15:53:17.190678+0000","last_fullsized":"2024-04-16T15:53:17.190678+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.201914+0000","last_change":"2024-04-16T15:53:18.201914+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.201914+0000","last_undegraded":"2024-04-16T15:53:18.201914+0000","last_fullsized":"2024-04-16T15:53:18.201914+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T15:53:17.191068+0000","last_change":"2024-04-16T15:53:17.191068+0000","last_active":"2024-04-16T15:53:17.181152+0000","last_peered":"2024-04-16T15:53:17.181152+0000","last_clean":"2024-04-16T15:53:17.181152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:17.191068+0000","last_undegraded":"2024-04-16T15:53:17.191068+0000","last_fullsized":"2024-04-16T15:53:17.191068+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T15:53:17.193212+0000","last_change":"2024-04-16T15:53:17.193212+0000","last_active":"2024-04-16T15:53:17.181152+0000","last_peered":"2024-04-16T15:53:17.181152+0000","last_clean":"2024-04-16T15:53:17.181152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:17.193212+0000","last_undegraded":"2024-04-16T15:53:17.193212+0000","last_fullsized":"2024-04-16T15:53:17.193212+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.196955+0000","last_change":"2024-04-16T15:53:18.196955+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.196955+0000","last_undegraded":"2024-04-16T15:53:18.196955+0000","last_fullsized":"2024-04-16T15:53:18.196955+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T15:53:17.186675+0000","last_change":"2024-04-16T15:53:17.186675+0000","last_active":"2024-04-16T15:53:17.181152+0000","last_peered":"2024-04-16T15:53:17.181152+0000","last_clean":"2024-04-16T15:53:17.181152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:17.186675+0000","last_undegraded":"2024-04-16T15:53:17.186675+0000","last_fullsized":"2024-04-16T15:53:17.186675+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T15:53:17.186055+0000","last_change":"2024-04-16T15:53:17.186055+0000","last_active":"2024-04-16T15:53:17.181152+0000","last_peered":"2024-04-16T15:53:17.181152+0000","last_clean":"2024-04-16T15:53:17.181152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:17.186055+0000","last_undegraded":"2024-04-16T15:53:17.186055+0000","last_fullsized":"2024-04-16T15:53:17.186055+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.202993+0000","last_change":"2024-04-16T15:53:18.202993+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.202993+0000","last_undegraded":"2024-04-16T15:53:18.202993+0000","last_fullsized":"2024-04-16T15:53:18.202993+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T15:53:17.185897+0000","last_change":"2024-04-16T15:53:17.185897+0000","last_active":"2024-04-16T15:53:17.181152+0000","last_peered":"2024-04-16T15:53:17.181152+0000","last_clean":"2024-04-16T15:53:17.181152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:17.185897+0000","last_undegraded":"2024-04-16T15:53:17.185897+0000","last_fullsized":"2024-04-16T15:53:17.185897+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.202538+0000","last_change":"2024-04-16T15:53:18.202538+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.202538+0000","last_undegraded":"2024-04-16T15:53:18.202538+0000","last_fullsized":"2024-04-16T15:53:18.202538+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T15:53:17.187037+0000","last_change":"2024-04-16T15:53:17.187037+0000","last_active":"2024-04-16T15:53:17.181152+0000","last_peered":"2024-04-16T15:53:17.181152+0000","last_clean":"2024-04-16T15:53:17.181152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:17.187037+0000","last_undegraded":"2024-04-16T15:53:17.187037+0000","last_fullsized":"2024-04-16T15:53:17.187037+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.202082+0000","last_change":"2024-04-16T15:53:18.202082+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.202082+0000","last_undegraded":"2024-04-16T15:53:18.202082+0000","last_fullsized":"2024-04-16T15:53:18.202082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-16T15:53:18.215765+0000","last_change":"2024-04-16T15:53:18.210087+0000","last_active":"2024-04-16T15:53:18.215765+0000","last_peered":"2024-04-16T15:53:18.215765+0000","last_clean":"2024-04-16T15:53:18.215765+0000","last_became_active":"2024-04-16T15:53:18.209539+0000","last_became_peered":"2024-04-16T15:53:18.209539+0000","last_unstale":"2024-04-16T15:53:18.215765+0000","last_undegraded":"2024-04-16T15:53:18.215765+0000","last_fullsized":"2024-04-16T15:53:18.215765+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:01:02.783464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.201503+0000","last_change":"2024-04-16T15:53:18.201503+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.201503+0000","last_undegraded":"2024-04-16T15:53:18.201503+0000","last_fullsized":"2024-04-16T15:53:18.201503+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T15:53:17.187477+0000","last_change":"2024-04-16T15:53:17.187477+0000","last_active":"2024-04-16T15:53:17.181152+0000","last_peered":"2024-04-16T15:53:17.181152+0000","last_clean":"2024-04-16T15:53:17.181152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:17.187477+0000","last_undegraded":"2024-04-16T15:53:17.187477+0000","last_fullsized":"2024-04-16T15:53:17.187477+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-16T15:53:18.211359+0000","last_change":"2024-04-16T15:53:18.209377+0000","last_active":"2024-04-16T15:53:18.211359+0000","last_peered":"2024-04-16T15:53:18.211359+0000","last_clean":"2024-04-16T15:53:18.211359+0000","last_became_active":"2024-04-16T15:53:18.209092+0000","last_became_peered":"2024-04-16T15:53:18.209092+0000","last_unstale":"2024-04-16T15:53:18.211359+0000","last_undegraded":"2024-04-16T15:53:18.211359+0000","last_fullsized":"2024-04-16T15:53:18.211359+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:13:10.994891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.203401+0000","last_change":"2024-04-16T15:53:18.203401+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.203401+0000","last_undegraded":"2024-04-16T15:53:18.203401+0000","last_fullsized":"2024-04-16T15:53:18.203401+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T15:53:17.192754+0000","last_change":"2024-04-16T15:53:17.192754+0000","last_active":"2024-04-16T15:53:17.181152+0000","last_peered":"2024-04-16T15:53:17.181152+0000","last_clean":"2024-04-16T15:53:17.181152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:17.192754+0000","last_undegraded":"2024-04-16T15:53:17.192754+0000","last_fullsized":"2024-04-16T15:53:17.192754+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.195681+0000","last_change":"2024-04-16T15:53:18.195681+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.195681+0000","last_undegraded":"2024-04-16T15:53:18.195681+0000","last_fullsized":"2024-04-16T15:53:18.195681+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T15:53:17.186428+0000","last_change":"2024-04-16T15:53:17.186428+0000","last_active":"2024-04-16T15:53:17.181152+0000","last_peered":"2024-04-16T15:53:17.181152+0000","last_clean":"2024-04-16T15:53:17.181152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:17.186428+0000","last_undegraded":"2024-04-16T15:53:17.186428+0000","last_fullsized":"2024-04-16T15:53:17.186428+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T15:53:17.192347+0000","last_change":"2024-04-16T15:53:17.192347+0000","last_active":"2024-04-16T15:53:17.181152+0000","last_peered":"2024-04-16T15:53:17.181152+0000","last_clean":"2024-04-16T15:53:17.181152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:17.192347+0000","last_undegraded":"2024-04-16T15:53:17.192347+0000","last_fullsized":"2024-04-16T15:53:17.192347+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.203964+0000","last_change":"2024-04-16T15:53:18.203964+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.203964+0000","last_undegraded":"2024-04-16T15:53:18.203964+0000","last_fullsized":"2024-04-16T15:53:18.203964+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T15:53:17.186397+0000","last_change":"2024-04-16T15:53:17.186397+0000","last_active":"2024-04-16T15:53:17.181152+0000","last_peered":"2024-04-16T15:53:17.181152+0000","last_clean":"2024-04-16T15:53:17.181152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:17.186397+0000","last_undegraded":"2024-04-16T15:53:17.186397+0000","last_fullsized":"2024-04-16T15:53:17.186397+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T15:53:17.192763+0000","last_change":"2024-04-16T15:53:17.192763+0000","last_active":"2024-04-16T15:53:17.181152+0000","last_peered":"2024-04-16T15:53:17.181152+0000","last_clean":"2024-04-16T15:53:17.181152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:17.192763+0000","last_undegraded":"2024-04-16T15:53:17.192763+0000","last_fullsized":"2024-04-16T15:53:17.192763+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T15:53:17.186186+0000","last_change":"2024-04-16T15:53:17.186186+0000","last_active":"2024-04-16T15:53:17.181152+0000","last_peered":"2024-04-16T15:53:17.181152+0000","last_clean":"2024-04-16T15:53:17.181152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:17.186186+0000","last_undegraded":"2024-04-16T15:53:17.186186+0000","last_fullsized":"2024-04-16T15:53:17.186186+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-04-16T15:53:17.190575+0000","last_change":"2024-04-16T15:53:17.190575+0000","last_active":"2024-04-16T15:53:17.181152+0000","last_peered":"2024-04-16T15:53:17.181152+0000","last_clean":"2024-04-16T15:53:17.181152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:17.190575+0000","last_undegraded":"2024-04-16T15:53:17.190575+0000","last_fullsized":"2024-04-16T15:53:17.190575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:53:18.183405+0000","last_change":"2024-04-16T15:53:18.183405+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.183405+0000","last_undegraded":"2024-04-16T15:53:18.183405+0000","last_fullsized":"2024-04-16T15:53:18.183405+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-16T15:53:18.218640+0000","last_change":"2024-04-16T15:53:18.213907+0000","last_active":"2024-04-16T15:53:18.218640+0000","last_peered":"2024-04-16T15:53:18.218640+0000","last_clean":"2024-04-16T15:53:18.218640+0000","last_became_active":"2024-04-16T15:53:18.213572+0000","last_became_peered":"2024-04-16T15:53:18.213572+0000","last_unstale":"2024-04-16T15:53:18.218640+0000","last_undegraded":"2024-04-16T15:53:18.218640+0000","last_fullsized":"2024-04-16T15:53:18.218640+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:26:09.897432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":190,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-16T15:53:17.190924+0000","last_change":"2024-04-16T15:52:04.356095+0000","last_active":"2024-04-16T15:53:17.190924+0000","last_peered":"2024-04-16T15:53:17.190924+0000","last_clean":"2024-04-16T15:53:17.190924+0000","last_became_active":"2024-04-16T15:52:04.355126+0000","last_became_peered":"2024-04-16T15:52:04.355126+0000","last_unstale":"2024-04-16T15:53:17.190924+0000","last_undegraded":"2024-04-16T15:53:17.190924+0000","last_fullsized":"2024-04-16T15:53:17.190924+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:03.285037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:03.285037+0000","last_clean_scrub_stamp":"2024-04-16T15:52:03.285037+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:19.005024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":46,"acting":46,"num_store_stats":3},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":942080,"data_stored":722957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":348160,"data_stored":132589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":126772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":126772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":126772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":929792,"data_stored":717140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T15:53:23.068 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T15:53:23.210 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.210+0000 7f458c2e4640 1 Processor -- start 2024-04-16T15:53:23.210 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.211+0000 7f458c2e4640 1 -- start start 2024-04-16T15:53:23.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.212+0000 7f458c2e4640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4584144f50 0x7f45840b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:23.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.212+0000 7f458c2e4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45840cd2a0 0x7f45840cd700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:23.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.212+0000 7f458c2e4640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45840cdd60 con 0x7f458406eda0 2024-04-16T15:53:23.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.212+0000 7f458c2e4640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f45840ce040 con 0x7f4584144f50 2024-04-16T15:53:23.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.212+0000 7f458c2e4640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f45840b3770 con 0x7f45840cd2a0 2024-04-16T15:53:23.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.212+0000 7f458987f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45840cd2a0 0x7f45840cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:23.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.212+0000 7f458a080640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4584144f50 0x7f45840b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:23.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.212+0000 7f458987f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45840cd2a0 0x7f45840cd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.132:49294/0 (socket says 172.21.15.132:49294) 2024-04-16T15:53:23.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.212+0000 7f458a080640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4584144f50 0x7f45840b4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.132:33222/0 (socket says 172.21.15.132:33222) 2024-04-16T15:53:23.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.212+0000 7f458987f640 1 -- 172.21.15.132:0/167973100 learned_addr learned my addr 172.21.15.132:0/167973100 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:23.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.212+0000 7f458a881640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f458406eda0 0x7f45840b4c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.132:33488/0 (socket says 172.21.15.132:33488) 2024-04-16T15:53:23.213 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.212+0000 7f458a080640 1 -- 172.21.15.132:0/167973100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45840cd2a0 msgr2=0x7f45840cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:23.213 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.212+0000 7f458a080640 1 --2- 172.21.15.132:0/167973100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45840cd2a0 0x7f45840cd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:23.213 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.212+0000 7f458a080640 1 -- 172.21.15.132:0/167973100 >> v1:172.21.15.179:6789/0 conn(0x7f458406eda0 legacy=0x7f45840b4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:23.213 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.212+0000 7f458a080640 1 -- 172.21.15.132:0/167973100 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45840b3a50 con 0x7f4584144f50 2024-04-16T15:53:23.213 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.213+0000 7f458a080640 1 --2- 172.21.15.132:0/167973100 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4584144f50 0x7f45840b4250 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f45800097a0 tx=0x7f458002b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a46691bc02529b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:23.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.214+0000 7f458907e640 1 -- 172.21.15.132:0/167973100 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45800315a0 con 0x7f4584144f50 2024-04-16T15:53:23.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.214+0000 7f458907e640 1 -- 172.21.15.132:0/167973100 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4580037070 con 0x7f4584144f50 2024-04-16T15:53:23.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.214+0000 7f458907e640 1 -- 172.21.15.132:0/167973100 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4580031960 con 0x7f4584144f50 2024-04-16T15:53:23.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.215+0000 7f458c2e4640 1 -- 172.21.15.132:0/167973100 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4584144f50 msgr2=0x7f45840b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:23.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.215+0000 7f458c2e4640 1 --2- 172.21.15.132:0/167973100 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4584144f50 0x7f45840b4250 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f45800097a0 tx=0x7f458002b840 comp rx=0 tx=0).stop 2024-04-16T15:53:23.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.215+0000 7f458c2e4640 1 -- 172.21.15.132:0/167973100 shutdown_connections 2024-04-16T15:53:23.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.215+0000 7f458c2e4640 1 --2- 172.21.15.132:0/167973100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45840cd2a0 0x7f45840cd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:23.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.215+0000 7f458c2e4640 1 --2- 172.21.15.132:0/167973100 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4584144f50 0x7f45840b4250 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:23.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.215+0000 7f458c2e4640 1 -- 172.21.15.132:0/167973100 >> 172.21.15.132:0/167973100 conn(0x7f45840b2d50 msgr2=0x7f458406ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:23.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.215+0000 7f458c2e4640 1 -- 172.21.15.132:0/167973100 shutdown_connections 2024-04-16T15:53:23.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.215+0000 7f458c2e4640 1 -- 172.21.15.132:0/167973100 wait complete. 2024-04-16T15:53:23.218 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.216+0000 7f458c2e4640 1 Processor -- start 2024-04-16T15:53:23.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.216+0000 7f458c2e4640 1 -- start start 2024-04-16T15:53:23.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.217+0000 7f458c2e4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f458406eda0 0x7f4584144030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:23.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.217+0000 7f458c2e4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45840cd2a0 0x7f45841e9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:23.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.217+0000 7f458c2e4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4584144f50 0x7f45841e9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:23.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.217+0000 7f458c2e4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f4584145330 con 0x7f458406eda0 2024-04-16T15:53:23.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.217+0000 7f458c2e4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f45840afda0 con 0x7f4584144f50 2024-04-16T15:53:23.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.217+0000 7f458c2e4640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f458406f1d0 con 0x7f45840cd2a0 2024-04-16T15:53:23.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.217+0000 7f458a080640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f458406eda0 0x7f4584144030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:23.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.217+0000 7f458a080640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f458406eda0 0x7f4584144030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41858/0 (socket says 172.21.15.132:41858) 2024-04-16T15:53:23.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.217+0000 7f458a080640 1 -- 172.21.15.132:0/3891168664 learned_addr learned my addr 172.21.15.132:0/3891168664 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:23.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.217+0000 7f458987f640 1 --2- 172.21.15.132:0/3891168664 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45840cd2a0 0x7f45841e9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:23.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.217+0000 7f458a881640 1 --2- 172.21.15.132:0/3891168664 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4584144f50 0x7f45841e9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:23.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.217+0000 7f458a080640 1 -- 172.21.15.132:0/3891168664 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45840cd2a0 msgr2=0x7f45841e9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:23.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.217+0000 7f458a080640 1 --2- 172.21.15.132:0/3891168664 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45840cd2a0 0x7f45841e9ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:23.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.217+0000 7f458a080640 1 -- 172.21.15.132:0/3891168664 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4584144f50 msgr2=0x7f45841e9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:23.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.217+0000 7f458a080640 1 --2- 172.21.15.132:0/3891168664 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4584144f50 0x7f45841e9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:23.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.217+0000 7f458a080640 1 -- 172.21.15.132:0/3891168664 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45841f47f0 con 0x7f458406eda0 2024-04-16T15:53:23.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.217+0000 7f458a881640 1 --2- 172.21.15.132:0/3891168664 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4584144f50 0x7f45841e9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:53:23.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.218+0000 7f458a080640 1 --2- 172.21.15.132:0/3891168664 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f458406eda0 0x7f4584144030 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f4580034040 tx=0x7f45800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:23.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.218+0000 7f457affd640 1 -- 172.21.15.132:0/3891168664 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4580032630 con 0x7f458406eda0 2024-04-16T15:53:23.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.218+0000 7f457affd640 1 -- 172.21.15.132:0/3891168664 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45800327f0 con 0x7f458406eda0 2024-04-16T15:53:23.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.218+0000 7f457affd640 1 -- 172.21.15.132:0/3891168664 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4580032be0 con 0x7f458406eda0 2024-04-16T15:53:23.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.218+0000 7f458c2e4640 1 -- 172.21.15.132:0/3891168664 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4584144570 con 0x7f458406eda0 2024-04-16T15:53:23.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.218+0000 7f458c2e4640 1 -- 172.21.15.132:0/3891168664 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45841e87d0 con 0x7f458406eda0 2024-04-16T15:53:23.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.219+0000 7f458c2e4640 1 -- 172.21.15.132:0/3891168664 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4584075510 con 0x7f458406eda0 2024-04-16T15:53:23.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.219+0000 7f457affd640 1 -- 172.21.15.132:0/3891168664 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f458004e430 con 0x7f458406eda0 2024-04-16T15:53:23.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.219+0000 7f457affd640 1 --2- 172.21.15.132:0/3891168664 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f456806c8f0 0x7f456806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:23.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.220+0000 7f457affd640 1 -- 172.21.15.132:0/3891168664 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f458002f030 con 0x7f458406eda0 2024-04-16T15:53:23.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.220+0000 7f458987f640 1 --2- 172.21.15.132:0/3891168664 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f456806c8f0 0x7f456806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:23.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.220+0000 7f458987f640 1 --2- 172.21.15.132:0/3891168664 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f456806c8f0 0x7f456806edb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f45841e7170 tx=0x7f457400b450 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:23.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.224+0000 7f457affd640 1 -- 172.21.15.132:0/3891168664 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4580040070 con 0x7f458406eda0 2024-04-16T15:53:23.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.397+0000 7f458c2e4640 1 -- 172.21.15.132:0/3891168664 --> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f45840b01b0 con 0x7f456806c8f0 2024-04-16T15:53:23.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.403+0000 7f457affd640 1 -- 172.21.15.132:0/3891168664 <== mgr.4101 v2:172.21.15.132:6832/3896387465 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250057 (secure 0 0 0) 0x7f45840b01b0 con 0x7f456806c8f0 2024-04-16T15:53:23.405 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:53:23.406 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2024-04-16T15:53:23.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.406+0000 7f458c2e4640 1 -- 172.21.15.132:0/3891168664 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f456806c8f0 msgr2=0x7f456806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:23.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.406+0000 7f458c2e4640 1 --2- 172.21.15.132:0/3891168664 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f456806c8f0 0x7f456806edb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f45841e7170 tx=0x7f457400b450 comp rx=0 tx=0).stop 2024-04-16T15:53:23.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.406+0000 7f458c2e4640 1 -- 172.21.15.132:0/3891168664 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f458406eda0 msgr2=0x7f4584144030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:23.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.406+0000 7f458c2e4640 1 --2- 172.21.15.132:0/3891168664 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f458406eda0 0x7f4584144030 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f4580034040 tx=0x7f45800046c0 comp rx=0 tx=0).stop 2024-04-16T15:53:23.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.406+0000 7f458c2e4640 1 -- 172.21.15.132:0/3891168664 shutdown_connections 2024-04-16T15:53:23.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.406+0000 7f458c2e4640 1 --2- 172.21.15.132:0/3891168664 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f456806c8f0 0x7f456806edb0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:23.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.406+0000 7f458c2e4640 1 --2- 172.21.15.132:0/3891168664 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4584144f50 0x7f45841e9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:23.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.406+0000 7f458c2e4640 1 --2- 172.21.15.132:0/3891168664 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45840cd2a0 0x7f45841e9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:23.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.406+0000 7f458c2e4640 1 --2- 172.21.15.132:0/3891168664 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f458406eda0 0x7f4584144030 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:23.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.406+0000 7f458c2e4640 1 -- 172.21.15.132:0/3891168664 >> 172.21.15.132:0/3891168664 conn(0x7f45840b2d50 msgr2=0x7f45840b15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:23.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.406+0000 7f458c2e4640 1 -- 172.21.15.132:0/3891168664 shutdown_connections 2024-04-16T15:53:23.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.406+0000 7f458c2e4640 1 -- 172.21.15.132:0/3891168664 wait complete. 2024-04-16T15:53:23.416 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2024-04-16T15:53:23.282262+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592106,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":192,"num_write_kb":2428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":146,"ondisk_log_size":146,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":105,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224452,"kb_used_data":4104,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750268,"statfs":{"total":773094113280,"available":772864274432,"internally_reserved":0,"allocated":4202496,"data_stored":2341620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1738,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000941"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.204545+0000","last_change":"2024-04-16T15:53:18.204545+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.204545+0000","last_undegraded":"2024-04-16T15:53:18.204545+0000","last_fullsized":"2024-04-16T15:53:18.204545+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195457+0000","last_change":"2024-04-16T15:53:19.226148+0000","last_active":"2024-04-16T15:53:20.195457+0000","last_peered":"2024-04-16T15:53:20.195457+0000","last_clean":"2024-04-16T15:53:20.195457+0000","last_became_active":"2024-04-16T15:53:19.225869+0000","last_became_peered":"2024-04-16T15:53:19.225869+0000","last_unstale":"2024-04-16T15:53:20.195457+0000","last_undegraded":"2024-04-16T15:53:20.195457+0000","last_fullsized":"2024-04-16T15:53:20.195457+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:00:13.986513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.195522+0000","last_change":"2024-04-16T15:53:18.195522+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.195522+0000","last_undegraded":"2024-04-16T15:53:18.195522+0000","last_fullsized":"2024-04-16T15:53:18.195522+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277237+0000","last_change":"2024-04-16T15:53:19.214711+0000","last_active":"2024-04-16T15:53:20.277237+0000","last_peered":"2024-04-16T15:53:20.277237+0000","last_clean":"2024-04-16T15:53:20.277237+0000","last_became_active":"2024-04-16T15:53:19.214414+0000","last_became_peered":"2024-04-16T15:53:19.214414+0000","last_unstale":"2024-04-16T15:53:20.277237+0000","last_undegraded":"2024-04-16T15:53:20.277237+0000","last_fullsized":"2024-04-16T15:53:20.277237+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:09:09.369395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.204209+0000","last_change":"2024-04-16T15:53:18.204209+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.204209+0000","last_undegraded":"2024-04-16T15:53:18.204209+0000","last_fullsized":"2024-04-16T15:53:18.204209+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195195+0000","last_change":"2024-04-16T15:53:19.214250+0000","last_active":"2024-04-16T15:53:20.195195+0000","last_peered":"2024-04-16T15:53:20.195195+0000","last_clean":"2024-04-16T15:53:20.195195+0000","last_became_active":"2024-04-16T15:53:19.213980+0000","last_became_peered":"2024-04-16T15:53:19.213980+0000","last_unstale":"2024-04-16T15:53:20.195195+0000","last_undegraded":"2024-04-16T15:53:20.195195+0000","last_fullsized":"2024-04-16T15:53:20.195195+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:55:20.146233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197135+0000","last_change":"2024-04-16T15:53:19.221453+0000","last_active":"2024-04-16T15:53:20.197135+0000","last_peered":"2024-04-16T15:53:20.197135+0000","last_clean":"2024-04-16T15:53:20.197135+0000","last_became_active":"2024-04-16T15:53:19.221101+0000","last_became_peered":"2024-04-16T15:53:19.221101+0000","last_unstale":"2024-04-16T15:53:20.197135+0000","last_undegraded":"2024-04-16T15:53:20.197135+0000","last_fullsized":"2024-04-16T15:53:20.197135+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:47:53.262802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197388+0000","last_change":"2024-04-16T15:53:19.214371+0000","last_active":"2024-04-16T15:53:20.197388+0000","last_peered":"2024-04-16T15:53:20.197388+0000","last_clean":"2024-04-16T15:53:20.197388+0000","last_became_active":"2024-04-16T15:53:19.213544+0000","last_became_peered":"2024-04-16T15:53:19.213544+0000","last_unstale":"2024-04-16T15:53:20.197388+0000","last_undegraded":"2024-04-16T15:53:20.197388+0000","last_fullsized":"2024-04-16T15:53:20.197388+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:55:20.146233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197066+0000","last_change":"2024-04-16T15:53:19.207377+0000","last_active":"2024-04-16T15:53:20.197066+0000","last_peered":"2024-04-16T15:53:20.197066+0000","last_clean":"2024-04-16T15:53:20.197066+0000","last_became_active":"2024-04-16T15:53:19.206972+0000","last_became_peered":"2024-04-16T15:53:19.206972+0000","last_unstale":"2024-04-16T15:53:20.197066+0000","last_undegraded":"2024-04-16T15:53:20.197066+0000","last_fullsized":"2024-04-16T15:53:20.197066+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:41:40.266044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277465+0000","last_change":"2024-04-16T15:53:19.216192+0000","last_active":"2024-04-16T15:53:20.277465+0000","last_peered":"2024-04-16T15:53:20.277465+0000","last_clean":"2024-04-16T15:53:20.277465+0000","last_became_active":"2024-04-16T15:53:19.215441+0000","last_became_peered":"2024-04-16T15:53:19.215441+0000","last_unstale":"2024-04-16T15:53:20.277465+0000","last_undegraded":"2024-04-16T15:53:20.277465+0000","last_fullsized":"2024-04-16T15:53:20.277465+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:41:40.266044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196998+0000","last_change":"2024-04-16T15:53:19.219404+0000","last_active":"2024-04-16T15:53:20.196998+0000","last_peered":"2024-04-16T15:53:20.196998+0000","last_clean":"2024-04-16T15:53:20.196998+0000","last_became_active":"2024-04-16T15:53:19.219142+0000","last_became_peered":"2024-04-16T15:53:19.219142+0000","last_unstale":"2024-04-16T15:53:20.196998+0000","last_undegraded":"2024-04-16T15:53:20.196998+0000","last_fullsized":"2024-04-16T15:53:20.196998+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:40:00.074304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.196409+0000","last_change":"2024-04-16T15:53:18.196409+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.196409+0000","last_undegraded":"2024-04-16T15:53:18.196409+0000","last_fullsized":"2024-04-16T15:53:18.196409+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.203805+0000","last_change":"2024-04-16T15:53:18.203805+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.203805+0000","last_undegraded":"2024-04-16T15:53:18.203805+0000","last_fullsized":"2024-04-16T15:53:18.203805+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195100+0000","last_change":"2024-04-16T15:53:19.214790+0000","last_active":"2024-04-16T15:53:20.195100+0000","last_peered":"2024-04-16T15:53:20.195100+0000","last_clean":"2024-04-16T15:53:20.195100+0000","last_became_active":"2024-04-16T15:53:19.214539+0000","last_became_peered":"2024-04-16T15:53:19.214539+0000","last_unstale":"2024-04-16T15:53:20.195100+0000","last_undegraded":"2024-04-16T15:53:20.195100+0000","last_fullsized":"2024-04-16T15:53:20.195100+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:09:12.444137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.195390+0000","last_change":"2024-04-16T15:53:18.195390+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.195390+0000","last_undegraded":"2024-04-16T15:53:18.195390+0000","last_fullsized":"2024-04-16T15:53:18.195390+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196790+0000","last_change":"2024-04-16T15:53:19.226607+0000","last_active":"2024-04-16T15:53:20.196790+0000","last_peered":"2024-04-16T15:53:20.196790+0000","last_clean":"2024-04-16T15:53:20.196790+0000","last_became_active":"2024-04-16T15:53:19.226349+0000","last_became_peered":"2024-04-16T15:53:19.226349+0000","last_unstale":"2024-04-16T15:53:20.196790+0000","last_undegraded":"2024-04-16T15:53:20.196790+0000","last_fullsized":"2024-04-16T15:53:20.196790+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:19.727876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197376+0000","last_change":"2024-04-16T15:53:19.222520+0000","last_active":"2024-04-16T15:53:20.197376+0000","last_peered":"2024-04-16T15:53:20.197376+0000","last_clean":"2024-04-16T15:53:20.197376+0000","last_became_active":"2024-04-16T15:53:19.222235+0000","last_became_peered":"2024-04-16T15:53:19.222235+0000","last_unstale":"2024-04-16T15:53:20.197376+0000","last_undegraded":"2024-04-16T15:53:20.197376+0000","last_fullsized":"2024-04-16T15:53:20.197376+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:26:17.244174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195538+0000","last_change":"2024-04-16T15:53:19.218035+0000","last_active":"2024-04-16T15:53:20.195538+0000","last_peered":"2024-04-16T15:53:20.195538+0000","last_clean":"2024-04-16T15:53:20.195538+0000","last_became_active":"2024-04-16T15:53:19.217745+0000","last_became_peered":"2024-04-16T15:53:19.217745+0000","last_unstale":"2024-04-16T15:53:20.195538+0000","last_undegraded":"2024-04-16T15:53:20.195538+0000","last_fullsized":"2024-04-16T15:53:20.195538+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:15:31.542491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195338+0000","last_change":"2024-04-16T15:53:19.217634+0000","last_active":"2024-04-16T15:53:20.195338+0000","last_peered":"2024-04-16T15:53:20.195338+0000","last_clean":"2024-04-16T15:53:20.195338+0000","last_became_active":"2024-04-16T15:53:19.217373+0000","last_became_peered":"2024-04-16T15:53:19.217373+0000","last_unstale":"2024-04-16T15:53:20.195338+0000","last_undegraded":"2024-04-16T15:53:20.195338+0000","last_fullsized":"2024-04-16T15:53:20.195338+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:48:31.729009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.204995+0000","last_change":"2024-04-16T15:53:18.204995+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.204995+0000","last_undegraded":"2024-04-16T15:53:18.204995+0000","last_fullsized":"2024-04-16T15:53:18.204995+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196930+0000","last_change":"2024-04-16T15:53:19.199390+0000","last_active":"2024-04-16T15:53:20.196930+0000","last_peered":"2024-04-16T15:53:20.196930+0000","last_clean":"2024-04-16T15:53:20.196930+0000","last_became_active":"2024-04-16T15:53:19.199066+0000","last_became_peered":"2024-04-16T15:53:19.199066+0000","last_unstale":"2024-04-16T15:53:20.196930+0000","last_undegraded":"2024-04-16T15:53:20.196930+0000","last_fullsized":"2024-04-16T15:53:20.196930+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:01:01.640923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197022+0000","last_change":"2024-04-16T15:53:19.219587+0000","last_active":"2024-04-16T15:53:20.197022+0000","last_peered":"2024-04-16T15:53:20.197022+0000","last_clean":"2024-04-16T15:53:20.197022+0000","last_became_active":"2024-04-16T15:53:19.219150+0000","last_became_peered":"2024-04-16T15:53:19.219150+0000","last_unstale":"2024-04-16T15:53:20.197022+0000","last_undegraded":"2024-04-16T15:53:20.197022+0000","last_fullsized":"2024-04-16T15:53:20.197022+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:09:09.369395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463763+0000","last_change":"2024-04-16T15:53:19.211517+0000","last_active":"2024-04-16T15:53:20.463763+0000","last_peered":"2024-04-16T15:53:20.463763+0000","last_clean":"2024-04-16T15:53:20.463763+0000","last_became_active":"2024-04-16T15:53:19.211260+0000","last_became_peered":"2024-04-16T15:53:19.211260+0000","last_unstale":"2024-04-16T15:53:20.463763+0000","last_undegraded":"2024-04-16T15:53:20.463763+0000","last_fullsized":"2024-04-16T15:53:20.463763+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:54:25.966875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.198148+0000","last_change":"2024-04-16T15:53:18.198148+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.198148+0000","last_undegraded":"2024-04-16T15:53:18.198148+0000","last_fullsized":"2024-04-16T15:53:18.198148+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277504+0000","last_change":"2024-04-16T15:53:19.214478+0000","last_active":"2024-04-16T15:53:20.277504+0000","last_peered":"2024-04-16T15:53:20.277504+0000","last_clean":"2024-04-16T15:53:20.277504+0000","last_became_active":"2024-04-16T15:53:19.214199+0000","last_became_peered":"2024-04-16T15:53:19.214199+0000","last_unstale":"2024-04-16T15:53:20.277504+0000","last_undegraded":"2024-04-16T15:53:20.277504+0000","last_fullsized":"2024-04-16T15:53:20.277504+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:38:12.802270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195587+0000","last_change":"2024-04-16T15:53:19.223834+0000","last_active":"2024-04-16T15:53:20.195587+0000","last_peered":"2024-04-16T15:53:20.195587+0000","last_clean":"2024-04-16T15:53:20.195587+0000","last_became_active":"2024-04-16T15:53:19.223467+0000","last_became_peered":"2024-04-16T15:53:19.223467+0000","last_unstale":"2024-04-16T15:53:20.195587+0000","last_undegraded":"2024-04-16T15:53:20.195587+0000","last_fullsized":"2024-04-16T15:53:20.195587+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:20:36.722580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277601+0000","last_change":"2024-04-16T15:53:19.215061+0000","last_active":"2024-04-16T15:53:20.277601+0000","last_peered":"2024-04-16T15:53:20.277601+0000","last_clean":"2024-04-16T15:53:20.277601+0000","last_became_active":"2024-04-16T15:53:19.214786+0000","last_became_peered":"2024-04-16T15:53:19.214786+0000","last_unstale":"2024-04-16T15:53:20.277601+0000","last_undegraded":"2024-04-16T15:53:20.277601+0000","last_fullsized":"2024-04-16T15:53:20.277601+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:24:52.885269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.195941+0000","last_change":"2024-04-16T15:53:18.195941+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.195941+0000","last_undegraded":"2024-04-16T15:53:18.195941+0000","last_fullsized":"2024-04-16T15:53:18.195941+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197108+0000","last_change":"2024-04-16T15:53:19.218009+0000","last_active":"2024-04-16T15:53:20.197108+0000","last_peered":"2024-04-16T15:53:20.197108+0000","last_clean":"2024-04-16T15:53:20.197108+0000","last_became_active":"2024-04-16T15:53:19.217749+0000","last_became_peered":"2024-04-16T15:53:19.217749+0000","last_unstale":"2024-04-16T15:53:20.197108+0000","last_undegraded":"2024-04-16T15:53:20.197108+0000","last_fullsized":"2024-04-16T15:53:20.197108+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:38:12.802270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196284+0000","last_change":"2024-04-16T15:53:19.215554+0000","last_active":"2024-04-16T15:53:20.196284+0000","last_peered":"2024-04-16T15:53:20.196284+0000","last_clean":"2024-04-16T15:53:20.196284+0000","last_became_active":"2024-04-16T15:53:19.215243+0000","last_became_peered":"2024-04-16T15:53:19.215243+0000","last_unstale":"2024-04-16T15:53:20.196284+0000","last_undegraded":"2024-04-16T15:53:20.196284+0000","last_fullsized":"2024-04-16T15:53:20.196284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:24:52.885269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.202957+0000","last_change":"2024-04-16T15:53:18.202957+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.202957+0000","last_undegraded":"2024-04-16T15:53:18.202957+0000","last_fullsized":"2024-04-16T15:53:18.202957+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196294+0000","last_change":"2024-04-16T15:53:19.212569+0000","last_active":"2024-04-16T15:53:20.196294+0000","last_peered":"2024-04-16T15:53:20.196294+0000","last_clean":"2024-04-16T15:53:20.196294+0000","last_became_active":"2024-04-16T15:53:19.212198+0000","last_became_peered":"2024-04-16T15:53:19.212198+0000","last_unstale":"2024-04-16T15:53:20.196294+0000","last_undegraded":"2024-04-16T15:53:20.196294+0000","last_fullsized":"2024-04-16T15:53:20.196294+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:27:57.263921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463687+0000","last_change":"2024-04-16T15:53:19.212160+0000","last_active":"2024-04-16T15:53:20.463687+0000","last_peered":"2024-04-16T15:53:20.463687+0000","last_clean":"2024-04-16T15:53:20.463687+0000","last_became_active":"2024-04-16T15:53:19.211902+0000","last_became_peered":"2024-04-16T15:53:19.211902+0000","last_unstale":"2024-04-16T15:53:20.463687+0000","last_undegraded":"2024-04-16T15:53:20.463687+0000","last_fullsized":"2024-04-16T15:53:20.463687+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:14:20.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-16T15:53:18.215810+0000","last_change":"2024-04-16T15:53:18.210743+0000","last_active":"2024-04-16T15:53:18.215810+0000","last_peered":"2024-04-16T15:53:18.215810+0000","last_clean":"2024-04-16T15:53:18.215810+0000","last_became_active":"2024-04-16T15:53:18.210466+0000","last_became_peered":"2024-04-16T15:53:18.210466+0000","last_unstale":"2024-04-16T15:53:18.215810+0000","last_undegraded":"2024-04-16T15:53:18.215810+0000","last_fullsized":"2024-04-16T15:53:18.215810+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:28:44.787593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.201904+0000","last_change":"2024-04-16T15:53:18.201904+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.201904+0000","last_undegraded":"2024-04-16T15:53:18.201904+0000","last_fullsized":"2024-04-16T15:53:18.201904+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463629+0000","last_change":"2024-04-16T15:53:18.213622+0000","last_active":"2024-04-16T15:53:20.463629+0000","last_peered":"2024-04-16T15:53:20.463629+0000","last_clean":"2024-04-16T15:53:20.463629+0000","last_became_active":"2024-04-16T15:53:18.213368+0000","last_became_peered":"2024-04-16T15:53:18.213368+0000","last_unstale":"2024-04-16T15:53:20.463629+0000","last_undegraded":"2024-04-16T15:53:20.463629+0000","last_fullsized":"2024-04-16T15:53:20.463629+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:31:41.162544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196775+0000","last_change":"2024-04-16T15:53:19.217908+0000","last_active":"2024-04-16T15:53:20.196775+0000","last_peered":"2024-04-16T15:53:20.196775+0000","last_clean":"2024-04-16T15:53:20.196775+0000","last_became_active":"2024-04-16T15:53:19.217659+0000","last_became_peered":"2024-04-16T15:53:19.217659+0000","last_unstale":"2024-04-16T15:53:20.196775+0000","last_undegraded":"2024-04-16T15:53:20.196775+0000","last_fullsized":"2024-04-16T15:53:20.196775+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:18:05.482765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195229+0000","last_change":"2024-04-16T15:53:18.206967+0000","last_active":"2024-04-16T15:53:20.195229+0000","last_peered":"2024-04-16T15:53:20.195229+0000","last_clean":"2024-04-16T15:53:20.195229+0000","last_became_active":"2024-04-16T15:53:18.206684+0000","last_became_peered":"2024-04-16T15:53:18.206684+0000","last_unstale":"2024-04-16T15:53:20.195229+0000","last_undegraded":"2024-04-16T15:53:20.195229+0000","last_fullsized":"2024-04-16T15:53:20.195229+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:14:19.341087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277619+0000","last_change":"2024-04-16T15:53:19.214612+0000","last_active":"2024-04-16T15:53:20.277619+0000","last_peered":"2024-04-16T15:53:20.277619+0000","last_clean":"2024-04-16T15:53:20.277619+0000","last_became_active":"2024-04-16T15:53:19.214331+0000","last_became_peered":"2024-04-16T15:53:19.214331+0000","last_unstale":"2024-04-16T15:53:20.277619+0000","last_undegraded":"2024-04-16T15:53:20.277619+0000","last_fullsized":"2024-04-16T15:53:20.277619+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:27:57.263921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-16T15:53:18.214654+0000","last_change":"2024-04-16T15:53:18.210644+0000","last_active":"2024-04-16T15:53:18.214654+0000","last_peered":"2024-04-16T15:53:18.214654+0000","last_clean":"2024-04-16T15:53:18.214654+0000","last_became_active":"2024-04-16T15:53:18.210390+0000","last_became_peered":"2024-04-16T15:53:18.210390+0000","last_unstale":"2024-04-16T15:53:18.214654+0000","last_undegraded":"2024-04-16T15:53:18.214654+0000","last_fullsized":"2024-04-16T15:53:18.214654+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:22:20.614026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196471+0000","last_change":"2024-04-16T15:53:19.218628+0000","last_active":"2024-04-16T15:53:20.196471+0000","last_peered":"2024-04-16T15:53:20.196471+0000","last_clean":"2024-04-16T15:53:20.196471+0000","last_became_active":"2024-04-16T15:53:19.218185+0000","last_became_peered":"2024-04-16T15:53:19.218185+0000","last_unstale":"2024-04-16T15:53:20.196471+0000","last_undegraded":"2024-04-16T15:53:20.196471+0000","last_fullsized":"2024-04-16T15:53:20.196471+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:20:34.974674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197176+0000","last_change":"2024-04-16T15:53:18.210540+0000","last_active":"2024-04-16T15:53:20.197176+0000","last_peered":"2024-04-16T15:53:20.197176+0000","last_clean":"2024-04-16T15:53:20.197176+0000","last_became_active":"2024-04-16T15:53:18.210271+0000","last_became_peered":"2024-04-16T15:53:18.210271+0000","last_unstale":"2024-04-16T15:53:20.197176+0000","last_undegraded":"2024-04-16T15:53:20.197176+0000","last_fullsized":"2024-04-16T15:53:20.197176+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:08:37.253061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.195387+0000","last_change":"2024-04-16T15:53:18.195387+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.195387+0000","last_undegraded":"2024-04-16T15:53:18.195387+0000","last_fullsized":"2024-04-16T15:53:18.195387+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196830+0000","last_change":"2024-04-16T15:53:18.210491+0000","last_active":"2024-04-16T15:53:20.196830+0000","last_peered":"2024-04-16T15:53:20.196830+0000","last_clean":"2024-04-16T15:53:20.196830+0000","last_became_active":"2024-04-16T15:53:18.210234+0000","last_became_peered":"2024-04-16T15:53:18.210234+0000","last_unstale":"2024-04-16T15:53:20.196830+0000","last_undegraded":"2024-04-16T15:53:20.196830+0000","last_fullsized":"2024-04-16T15:53:20.196830+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:28:44.787593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196717+0000","last_change":"2024-04-16T15:53:19.210713+0000","last_active":"2024-04-16T15:53:20.196717+0000","last_peered":"2024-04-16T15:53:20.196717+0000","last_clean":"2024-04-16T15:53:20.196717+0000","last_became_active":"2024-04-16T15:53:19.210425+0000","last_became_peered":"2024-04-16T15:53:19.210425+0000","last_unstale":"2024-04-16T15:53:20.196717+0000","last_undegraded":"2024-04-16T15:53:20.196717+0000","last_fullsized":"2024-04-16T15:53:20.196717+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:42:06.870549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.194850+0000","last_change":"2024-04-16T15:53:18.210535+0000","last_active":"2024-04-16T15:53:20.194850+0000","last_peered":"2024-04-16T15:53:20.194850+0000","last_clean":"2024-04-16T15:53:20.194850+0000","last_became_active":"2024-04-16T15:53:18.210282+0000","last_became_peered":"2024-04-16T15:53:18.210282+0000","last_unstale":"2024-04-16T15:53:20.194850+0000","last_undegraded":"2024-04-16T15:53:20.194850+0000","last_fullsized":"2024-04-16T15:53:20.194850+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:09:56.208391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277154+0000","last_change":"2024-04-16T15:53:19.212496+0000","last_active":"2024-04-16T15:53:20.277154+0000","last_peered":"2024-04-16T15:53:20.277154+0000","last_clean":"2024-04-16T15:53:20.277154+0000","last_became_active":"2024-04-16T15:53:19.212239+0000","last_became_peered":"2024-04-16T15:53:19.212239+0000","last_unstale":"2024-04-16T15:53:20.277154+0000","last_undegraded":"2024-04-16T15:53:20.277154+0000","last_fullsized":"2024-04-16T15:53:20.277154+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:18:05.482765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195756+0000","last_change":"2024-04-16T15:53:18.208530+0000","last_active":"2024-04-16T15:53:20.195756+0000","last_peered":"2024-04-16T15:53:20.195756+0000","last_clean":"2024-04-16T15:53:20.195756+0000","last_became_active":"2024-04-16T15:53:18.208225+0000","last_became_peered":"2024-04-16T15:53:18.208225+0000","last_unstale":"2024-04-16T15:53:20.195756+0000","last_undegraded":"2024-04-16T15:53:20.195756+0000","last_fullsized":"2024-04-16T15:53:20.195756+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:01:02.783464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.195456+0000","last_change":"2024-04-16T15:53:18.195456+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.195456+0000","last_undegraded":"2024-04-16T15:53:18.195456+0000","last_fullsized":"2024-04-16T15:53:18.195456+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195485+0000","last_change":"2024-04-16T15:53:18.209410+0000","last_active":"2024-04-16T15:53:20.195485+0000","last_peered":"2024-04-16T15:53:20.195485+0000","last_clean":"2024-04-16T15:53:20.195485+0000","last_became_active":"2024-04-16T15:53:18.209128+0000","last_became_peered":"2024-04-16T15:53:18.209128+0000","last_unstale":"2024-04-16T15:53:20.195485+0000","last_undegraded":"2024-04-16T15:53:20.195485+0000","last_fullsized":"2024-04-16T15:53:20.195485+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:18:04.480511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195481+0000","last_change":"2024-04-16T15:53:19.218196+0000","last_active":"2024-04-16T15:53:20.195481+0000","last_peered":"2024-04-16T15:53:20.195481+0000","last_clean":"2024-04-16T15:53:20.195481+0000","last_became_active":"2024-04-16T15:53:19.217938+0000","last_became_peered":"2024-04-16T15:53:19.217938+0000","last_unstale":"2024-04-16T15:53:20.195481+0000","last_undegraded":"2024-04-16T15:53:20.195481+0000","last_fullsized":"2024-04-16T15:53:20.195481+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:15:54.665161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463743+0000","last_change":"2024-04-16T15:53:18.212761+0000","last_active":"2024-04-16T15:53:20.463743+0000","last_peered":"2024-04-16T15:53:20.463743+0000","last_clean":"2024-04-16T15:53:20.463743+0000","last_became_active":"2024-04-16T15:53:18.212427+0000","last_became_peered":"2024-04-16T15:53:18.212427+0000","last_unstale":"2024-04-16T15:53:20.463743+0000","last_undegraded":"2024-04-16T15:53:20.463743+0000","last_fullsized":"2024-04-16T15:53:20.463743+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:46:28.763927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195317+0000","last_change":"2024-04-16T15:53:19.223760+0000","last_active":"2024-04-16T15:53:20.195317+0000","last_peered":"2024-04-16T15:53:20.195317+0000","last_clean":"2024-04-16T15:53:20.195317+0000","last_became_active":"2024-04-16T15:53:19.223461+0000","last_became_peered":"2024-04-16T15:53:19.223461+0000","last_unstale":"2024-04-16T15:53:20.195317+0000","last_undegraded":"2024-04-16T15:53:20.195317+0000","last_fullsized":"2024-04-16T15:53:20.195317+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:19:47.160288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-16T15:53:18.211370+0000","last_change":"2024-04-16T15:53:18.208880+0000","last_active":"2024-04-16T15:53:18.211370+0000","last_peered":"2024-04-16T15:53:18.211370+0000","last_clean":"2024-04-16T15:53:18.211370+0000","last_became_active":"2024-04-16T15:53:18.208317+0000","last_became_peered":"2024-04-16T15:53:18.208317+0000","last_unstale":"2024-04-16T15:53:18.211370+0000","last_undegraded":"2024-04-16T15:53:18.211370+0000","last_fullsized":"2024-04-16T15:53:18.211370+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:34:16.256486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.196587+0000","last_change":"2024-04-16T15:53:18.196587+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.196587+0000","last_undegraded":"2024-04-16T15:53:18.196587+0000","last_fullsized":"2024-04-16T15:53:18.196587+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195193+0000","last_change":"2024-04-16T15:53:18.206853+0000","last_active":"2024-04-16T15:53:20.195193+0000","last_peered":"2024-04-16T15:53:20.195193+0000","last_clean":"2024-04-16T15:53:20.195193+0000","last_became_active":"2024-04-16T15:53:18.206613+0000","last_became_peered":"2024-04-16T15:53:18.206613+0000","last_unstale":"2024-04-16T15:53:20.195193+0000","last_undegraded":"2024-04-16T15:53:20.195193+0000","last_fullsized":"2024-04-16T15:53:20.195193+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:54:24.964622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277187+0000","last_change":"2024-04-16T15:53:19.222111+0000","last_active":"2024-04-16T15:53:20.277187+0000","last_peered":"2024-04-16T15:53:20.277187+0000","last_clean":"2024-04-16T15:53:20.277187+0000","last_became_active":"2024-04-16T15:53:19.221536+0000","last_became_peered":"2024-04-16T15:53:19.221536+0000","last_unstale":"2024-04-16T15:53:20.277187+0000","last_undegraded":"2024-04-16T15:53:20.277187+0000","last_fullsized":"2024-04-16T15:53:20.277187+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:01:01.640923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197189+0000","last_change":"2024-04-16T15:53:18.207932+0000","last_active":"2024-04-16T15:53:20.197189+0000","last_peered":"2024-04-16T15:53:20.197189+0000","last_clean":"2024-04-16T15:53:20.197189+0000","last_became_active":"2024-04-16T15:53:18.207445+0000","last_became_peered":"2024-04-16T15:53:18.207445+0000","last_unstale":"2024-04-16T15:53:20.197189+0000","last_undegraded":"2024-04-16T15:53:20.197189+0000","last_fullsized":"2024-04-16T15:53:20.197189+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:26:09.897432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195254+0000","last_change":"2024-04-16T15:53:19.215660+0000","last_active":"2024-04-16T15:53:20.195254+0000","last_peered":"2024-04-16T15:53:20.195254+0000","last_clean":"2024-04-16T15:53:20.195254+0000","last_became_active":"2024-04-16T15:53:19.215415+0000","last_became_peered":"2024-04-16T15:53:19.215415+0000","last_unstale":"2024-04-16T15:53:20.195254+0000","last_undegraded":"2024-04-16T15:53:20.195254+0000","last_fullsized":"2024-04-16T15:53:20.195254+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:26:17.244174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277262+0000","last_change":"2024-04-16T15:53:18.207023+0000","last_active":"2024-04-16T15:53:20.277262+0000","last_peered":"2024-04-16T15:53:20.277262+0000","last_clean":"2024-04-16T15:53:20.277262+0000","last_became_active":"2024-04-16T15:53:18.206764+0000","last_became_peered":"2024-04-16T15:53:18.206764+0000","last_unstale":"2024-04-16T15:53:20.277262+0000","last_undegraded":"2024-04-16T15:53:20.277262+0000","last_fullsized":"2024-04-16T15:53:20.277262+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:49:24.686045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196471+0000","last_change":"2024-04-16T15:53:19.218507+0000","last_active":"2024-04-16T15:53:20.196471+0000","last_peered":"2024-04-16T15:53:20.196471+0000","last_clean":"2024-04-16T15:53:20.196471+0000","last_became_active":"2024-04-16T15:53:19.218250+0000","last_became_peered":"2024-04-16T15:53:19.218250+0000","last_unstale":"2024-04-16T15:53:20.196471+0000","last_undegraded":"2024-04-16T15:53:20.196471+0000","last_fullsized":"2024-04-16T15:53:20.196471+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:12:25.656341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.194904+0000","last_change":"2024-04-16T15:53:18.207895+0000","last_active":"2024-04-16T15:53:20.194904+0000","last_peered":"2024-04-16T15:53:20.194904+0000","last_clean":"2024-04-16T15:53:20.194904+0000","last_became_active":"2024-04-16T15:53:18.207633+0000","last_became_peered":"2024-04-16T15:53:18.207633+0000","last_unstale":"2024-04-16T15:53:20.194904+0000","last_undegraded":"2024-04-16T15:53:20.194904+0000","last_fullsized":"2024-04-16T15:53:20.194904+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:42:05.868295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.201914+0000","last_change":"2024-04-16T15:53:18.201914+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.201914+0000","last_undegraded":"2024-04-16T15:53:18.201914+0000","last_fullsized":"2024-04-16T15:53:18.201914+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.194904+0000","last_change":"2024-04-16T15:53:18.207615+0000","last_active":"2024-04-16T15:53:20.194904+0000","last_peered":"2024-04-16T15:53:20.194904+0000","last_clean":"2024-04-16T15:53:20.194904+0000","last_became_active":"2024-04-16T15:53:18.207332+0000","last_became_peered":"2024-04-16T15:53:18.207332+0000","last_unstale":"2024-04-16T15:53:20.194904+0000","last_undegraded":"2024-04-16T15:53:20.194904+0000","last_fullsized":"2024-04-16T15:53:20.194904+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:01:00.638669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196700+0000","last_change":"2024-04-16T15:53:19.202791+0000","last_active":"2024-04-16T15:53:20.196700+0000","last_peered":"2024-04-16T15:53:20.196700+0000","last_clean":"2024-04-16T15:53:20.196700+0000","last_became_active":"2024-04-16T15:53:19.202414+0000","last_became_peered":"2024-04-16T15:53:19.202414+0000","last_unstale":"2024-04-16T15:53:20.196700+0000","last_undegraded":"2024-04-16T15:53:20.196700+0000","last_fullsized":"2024-04-16T15:53:20.196700+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:09:57.210644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277536+0000","last_change":"2024-04-16T15:53:18.211975+0000","last_active":"2024-04-16T15:53:20.277536+0000","last_peered":"2024-04-16T15:53:20.277536+0000","last_clean":"2024-04-16T15:53:20.277536+0000","last_became_active":"2024-04-16T15:53:18.211709+0000","last_became_peered":"2024-04-16T15:53:18.211709+0000","last_unstale":"2024-04-16T15:53:20.277536+0000","last_undegraded":"2024-04-16T15:53:20.277536+0000","last_fullsized":"2024-04-16T15:53:20.277536+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:03:51.897303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.196955+0000","last_change":"2024-04-16T15:53:18.196955+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.196955+0000","last_undegraded":"2024-04-16T15:53:18.196955+0000","last_fullsized":"2024-04-16T15:53:18.196955+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196884+0000","last_change":"2024-04-16T15:53:18.208018+0000","last_active":"2024-04-16T15:53:20.196884+0000","last_peered":"2024-04-16T15:53:20.196884+0000","last_clean":"2024-04-16T15:53:20.196884+0000","last_became_active":"2024-04-16T15:53:18.207596+0000","last_became_peered":"2024-04-16T15:53:18.207596+0000","last_unstale":"2024-04-16T15:53:20.196884+0000","last_undegraded":"2024-04-16T15:53:20.196884+0000","last_fullsized":"2024-04-16T15:53:20.196884+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:03:51.897303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277265+0000","last_change":"2024-04-16T15:53:19.215051+0000","last_active":"2024-04-16T15:53:20.277265+0000","last_peered":"2024-04-16T15:53:20.277265+0000","last_clean":"2024-04-16T15:53:20.277265+0000","last_became_active":"2024-04-16T15:53:19.214161+0000","last_became_peered":"2024-04-16T15:53:19.214161+0000","last_unstale":"2024-04-16T15:53:20.277265+0000","last_undegraded":"2024-04-16T15:53:20.277265+0000","last_fullsized":"2024-04-16T15:53:20.277265+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:21:33.438988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196677+0000","last_change":"2024-04-16T15:53:18.210890+0000","last_active":"2024-04-16T15:53:20.196677+0000","last_peered":"2024-04-16T15:53:20.196677+0000","last_clean":"2024-04-16T15:53:20.196677+0000","last_became_active":"2024-04-16T15:53:18.210498+0000","last_became_peered":"2024-04-16T15:53:18.210498+0000","last_unstale":"2024-04-16T15:53:20.196677+0000","last_undegraded":"2024-04-16T15:53:20.196677+0000","last_fullsized":"2024-04-16T15:53:20.196677+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:31:41.162544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.202993+0000","last_change":"2024-04-16T15:53:18.202993+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.202993+0000","last_undegraded":"2024-04-16T15:53:18.202993+0000","last_fullsized":"2024-04-16T15:53:18.202993+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196432+0000","last_change":"2024-04-16T15:53:18.212722+0000","last_active":"2024-04-16T15:53:20.196432+0000","last_peered":"2024-04-16T15:53:20.196432+0000","last_clean":"2024-04-16T15:53:20.196432+0000","last_became_active":"2024-04-16T15:53:18.212434+0000","last_became_peered":"2024-04-16T15:53:18.212434+0000","last_unstale":"2024-04-16T15:53:20.196432+0000","last_undegraded":"2024-04-16T15:53:20.196432+0000","last_fullsized":"2024-04-16T15:53:20.196432+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:46:28.763927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.202538+0000","last_change":"2024-04-16T15:53:18.202538+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.202538+0000","last_undegraded":"2024-04-16T15:53:18.202538+0000","last_fullsized":"2024-04-16T15:53:18.202538+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464047+0000","last_change":"2024-04-16T15:53:18.210794+0000","last_active":"2024-04-16T15:53:20.464047+0000","last_peered":"2024-04-16T15:53:20.464047+0000","last_clean":"2024-04-16T15:53:20.464047+0000","last_became_active":"2024-04-16T15:53:18.210087+0000","last_became_peered":"2024-04-16T15:53:18.210087+0000","last_unstale":"2024-04-16T15:53:20.464047+0000","last_undegraded":"2024-04-16T15:53:20.464047+0000","last_fullsized":"2024-04-16T15:53:20.464047+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:03:51.897303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.202082+0000","last_change":"2024-04-16T15:53:18.202082+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.202082+0000","last_undegraded":"2024-04-16T15:53:18.202082+0000","last_fullsized":"2024-04-16T15:53:18.202082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-16T15:53:18.215765+0000","last_change":"2024-04-16T15:53:18.210087+0000","last_active":"2024-04-16T15:53:18.215765+0000","last_peered":"2024-04-16T15:53:18.215765+0000","last_clean":"2024-04-16T15:53:18.215765+0000","last_became_active":"2024-04-16T15:53:18.209539+0000","last_became_peered":"2024-04-16T15:53:18.209539+0000","last_unstale":"2024-04-16T15:53:18.215765+0000","last_undegraded":"2024-04-16T15:53:18.215765+0000","last_fullsized":"2024-04-16T15:53:18.215765+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:01:02.783464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.201503+0000","last_change":"2024-04-16T15:53:18.201503+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.201503+0000","last_undegraded":"2024-04-16T15:53:18.201503+0000","last_fullsized":"2024-04-16T15:53:18.201503+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195767+0000","last_change":"2024-04-16T15:53:18.204767+0000","last_active":"2024-04-16T15:53:20.195767+0000","last_peered":"2024-04-16T15:53:20.195767+0000","last_clean":"2024-04-16T15:53:20.195767+0000","last_became_active":"2024-04-16T15:53:18.204142+0000","last_became_peered":"2024-04-16T15:53:18.204142+0000","last_unstale":"2024-04-16T15:53:20.195767+0000","last_undegraded":"2024-04-16T15:53:20.195767+0000","last_fullsized":"2024-04-16T15:53:20.195767+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:27:13.923490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197141+0000","last_change":"2024-04-16T15:53:19.215530+0000","last_active":"2024-04-16T15:53:20.197141+0000","last_peered":"2024-04-16T15:53:20.197141+0000","last_clean":"2024-04-16T15:53:20.197141+0000","last_became_active":"2024-04-16T15:53:19.215227+0000","last_became_peered":"2024-04-16T15:53:19.215227+0000","last_unstale":"2024-04-16T15:53:20.197141+0000","last_undegraded":"2024-04-16T15:53:20.197141+0000","last_fullsized":"2024-04-16T15:53:20.197141+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:09:12.444137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-16T15:53:18.211359+0000","last_change":"2024-04-16T15:53:18.209377+0000","last_active":"2024-04-16T15:53:18.211359+0000","last_peered":"2024-04-16T15:53:18.211359+0000","last_clean":"2024-04-16T15:53:18.211359+0000","last_became_active":"2024-04-16T15:53:18.209092+0000","last_became_peered":"2024-04-16T15:53:18.209092+0000","last_unstale":"2024-04-16T15:53:18.211359+0000","last_undegraded":"2024-04-16T15:53:18.211359+0000","last_fullsized":"2024-04-16T15:53:18.211359+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:13:10.994891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.203401+0000","last_change":"2024-04-16T15:53:18.203401+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.203401+0000","last_undegraded":"2024-04-16T15:53:18.203401+0000","last_fullsized":"2024-04-16T15:53:18.203401+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277554+0000","last_change":"2024-04-16T15:53:18.204255+0000","last_active":"2024-04-16T15:53:20.277554+0000","last_peered":"2024-04-16T15:53:20.277554+0000","last_clean":"2024-04-16T15:53:20.277554+0000","last_became_active":"2024-04-16T15:53:18.203960+0000","last_became_peered":"2024-04-16T15:53:18.203960+0000","last_unstale":"2024-04-16T15:53:20.277554+0000","last_undegraded":"2024-04-16T15:53:20.277554+0000","last_fullsized":"2024-04-16T15:53:20.277554+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:46:28.763927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.195681+0000","last_change":"2024-04-16T15:53:18.195681+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.195681+0000","last_undegraded":"2024-04-16T15:53:18.195681+0000","last_fullsized":"2024-04-16T15:53:18.195681+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463839+0000","last_change":"2024-04-16T15:53:18.208864+0000","last_active":"2024-04-16T15:53:20.463839+0000","last_peered":"2024-04-16T15:53:20.463839+0000","last_clean":"2024-04-16T15:53:20.463839+0000","last_became_active":"2024-04-16T15:53:18.208576+0000","last_became_peered":"2024-04-16T15:53:18.208576+0000","last_unstale":"2024-04-16T15:53:20.463839+0000","last_undegraded":"2024-04-16T15:53:20.463839+0000","last_fullsized":"2024-04-16T15:53:20.463839+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:49:24.686045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463570+0000","last_change":"2024-04-16T15:53:19.220923+0000","last_active":"2024-04-16T15:53:20.463570+0000","last_peered":"2024-04-16T15:53:20.463570+0000","last_clean":"2024-04-16T15:53:20.463570+0000","last_became_active":"2024-04-16T15:53:19.218050+0000","last_became_peered":"2024-04-16T15:53:19.218050+0000","last_unstale":"2024-04-16T15:53:20.463570+0000","last_undegraded":"2024-04-16T15:53:20.463570+0000","last_fullsized":"2024-04-16T15:53:20.463570+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:13:11.997144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277301+0000","last_change":"2024-04-16T15:53:18.211328+0000","last_active":"2024-04-16T15:53:20.277301+0000","last_peered":"2024-04-16T15:53:20.277301+0000","last_clean":"2024-04-16T15:53:20.277301+0000","last_became_active":"2024-04-16T15:53:18.211063+0000","last_became_peered":"2024-04-16T15:53:18.211063+0000","last_unstale":"2024-04-16T15:53:20.277301+0000","last_undegraded":"2024-04-16T15:53:20.277301+0000","last_fullsized":"2024-04-16T15:53:20.277301+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:27:13.923490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.203964+0000","last_change":"2024-04-16T15:53:18.203964+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.203964+0000","last_undegraded":"2024-04-16T15:53:18.203964+0000","last_fullsized":"2024-04-16T15:53:18.203964+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464213+0000","last_change":"2024-04-16T15:53:18.204297+0000","last_active":"2024-04-16T15:53:20.464213+0000","last_peered":"2024-04-16T15:53:20.464213+0000","last_clean":"2024-04-16T15:53:20.464213+0000","last_became_active":"2024-04-16T15:53:18.204054+0000","last_became_peered":"2024-04-16T15:53:18.204054+0000","last_unstale":"2024-04-16T15:53:20.464213+0000","last_undegraded":"2024-04-16T15:53:20.464213+0000","last_fullsized":"2024-04-16T15:53:20.464213+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:27:13.923490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463987+0000","last_change":"2024-04-16T15:53:19.211221+0000","last_active":"2024-04-16T15:53:20.463987+0000","last_peered":"2024-04-16T15:53:20.463987+0000","last_clean":"2024-04-16T15:53:20.463987+0000","last_became_active":"2024-04-16T15:53:19.210969+0000","last_became_peered":"2024-04-16T15:53:19.210969+0000","last_unstale":"2024-04-16T15:53:20.463987+0000","last_undegraded":"2024-04-16T15:53:20.463987+0000","last_fullsized":"2024-04-16T15:53:20.463987+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:09:57.210644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277362+0000","last_change":"2024-04-16T15:53:18.204310+0000","last_active":"2024-04-16T15:53:20.277362+0000","last_peered":"2024-04-16T15:53:20.277362+0000","last_clean":"2024-04-16T15:53:20.277362+0000","last_became_active":"2024-04-16T15:53:18.204031+0000","last_became_peered":"2024-04-16T15:53:18.204031+0000","last_unstale":"2024-04-16T15:53:20.277362+0000","last_undegraded":"2024-04-16T15:53:20.277362+0000","last_fullsized":"2024-04-16T15:53:20.277362+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:20:16.994654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.194938+0000","last_change":"2024-04-16T15:53:19.218748+0000","last_active":"2024-04-16T15:53:20.194938+0000","last_peered":"2024-04-16T15:53:20.194938+0000","last_clean":"2024-04-16T15:53:20.194938+0000","last_became_active":"2024-04-16T15:53:19.218474+0000","last_became_peered":"2024-04-16T15:53:19.218474+0000","last_unstale":"2024-04-16T15:53:20.194938+0000","last_undegraded":"2024-04-16T15:53:20.194938+0000","last_fullsized":"2024-04-16T15:53:20.194938+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:47:53.262802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195914+0000","last_change":"2024-04-16T15:53:18.204483+0000","last_active":"2024-04-16T15:53:20.195914+0000","last_peered":"2024-04-16T15:53:20.195914+0000","last_clean":"2024-04-16T15:53:20.195914+0000","last_became_active":"2024-04-16T15:53:18.203790+0000","last_became_peered":"2024-04-16T15:53:18.203790+0000","last_unstale":"2024-04-16T15:53:20.195914+0000","last_undegraded":"2024-04-16T15:53:20.195914+0000","last_fullsized":"2024-04-16T15:53:20.195914+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:49:24.686045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197045+0000","last_change":"2024-04-16T15:53:19.218646+0000","last_active":"2024-04-16T15:53:20.197045+0000","last_peered":"2024-04-16T15:53:20.197045+0000","last_clean":"2024-04-16T15:53:20.197045+0000","last_became_active":"2024-04-16T15:53:19.218379+0000","last_became_peered":"2024-04-16T15:53:19.218379+0000","last_unstale":"2024-04-16T15:53:20.197045+0000","last_undegraded":"2024-04-16T15:53:20.197045+0000","last_fullsized":"2024-04-16T15:53:20.197045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:21:33.438988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.194988+0000","last_change":"2024-04-16T15:53:18.211846+0000","last_active":"2024-04-16T15:53:20.194988+0000","last_peered":"2024-04-16T15:53:20.194988+0000","last_clean":"2024-04-16T15:53:20.194988+0000","last_became_active":"2024-04-16T15:53:18.211604+0000","last_became_peered":"2024-04-16T15:53:18.211604+0000","last_unstale":"2024-04-16T15:53:20.194988+0000","last_undegraded":"2024-04-16T15:53:20.194988+0000","last_fullsized":"2024-04-16T15:53:20.194988+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:09:08.367141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196459+0000","last_change":"2024-04-16T15:53:19.213036+0000","last_active":"2024-04-16T15:53:20.196459+0000","last_peered":"2024-04-16T15:53:20.196459+0000","last_clean":"2024-04-16T15:53:20.196459+0000","last_became_active":"2024-04-16T15:53:19.212758+0000","last_became_peered":"2024-04-16T15:53:19.212758+0000","last_unstale":"2024-04-16T15:53:20.196459+0000","last_undegraded":"2024-04-16T15:53:20.196459+0000","last_fullsized":"2024-04-16T15:53:20.196459+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:32:14.472011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-16T15:53:18.218640+0000","last_change":"2024-04-16T15:53:18.213907+0000","last_active":"2024-04-16T15:53:18.218640+0000","last_peered":"2024-04-16T15:53:18.218640+0000","last_clean":"2024-04-16T15:53:18.218640+0000","last_became_active":"2024-04-16T15:53:18.213572+0000","last_became_peered":"2024-04-16T15:53:18.213572+0000","last_unstale":"2024-04-16T15:53:18.218640+0000","last_undegraded":"2024-04-16T15:53:18.218640+0000","last_fullsized":"2024-04-16T15:53:18.218640+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:26:09.897432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":196,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196856+0000","last_change":"2024-04-16T15:52:04.356095+0000","last_active":"2024-04-16T15:53:20.196856+0000","last_peered":"2024-04-16T15:53:20.196856+0000","last_clean":"2024-04-16T15:53:20.196856+0000","last_became_active":"2024-04-16T15:52:04.355126+0000","last_became_peered":"2024-04-16T15:52:04.355126+0000","last_unstale":"2024-04-16T15:53:20.196856+0000","last_undegraded":"2024-04-16T15:53:20.196856+0000","last_fullsized":"2024-04-16T15:53:20.196856+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:03.285037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:03.285037+0000","last_clean_scrub_stamp":"2024-04-16T15:52:03.285037+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:19.005024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1738,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":983040,"data_stored":742389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":348160,"data_stored":132589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":152035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":401408,"data_stored":153565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":401408,"data_stored":153565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":978944,"data_stored":742299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T15:53:23.420 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2024-04-16T15:53:23.420 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-16T15:53:18.204545+0000', 'last_change': '2024-04-16T15:53:18.204545+0000', 'last_active': '2024-04-16T15:53:18.183405+0000', 'last_peered': '2024-04-16T15:53:18.183405+0000', 'last_clean': '2024-04-16T15:53:18.183405+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:53:18.204545+0000', 'last_undegraded': '2024-04-16T15:53:18.204545+0000', 'last_fullsized': '2024-04-16T15:53:18.204545+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'last_clean_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-16T15:53:23.420 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2024-04-16T15:53:23.420 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-16T15:53:18.195522+0000', 'last_change': '2024-04-16T15:53:18.195522+0000', 'last_active': '2024-04-16T15:53:18.183405+0000', 'last_peered': '2024-04-16T15:53:18.183405+0000', 'last_clean': '2024-04-16T15:53:18.183405+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:53:18.195522+0000', 'last_undegraded': '2024-04-16T15:53:18.195522+0000', 'last_fullsized': '2024-04-16T15:53:18.195522+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'last_clean_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-16T15:53:23.420 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2024-04-16T15:53:23.420 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-16T15:53:18.204209+0000', 'last_change': '2024-04-16T15:53:18.204209+0000', 'last_active': '2024-04-16T15:53:18.183405+0000', 'last_peered': '2024-04-16T15:53:18.183405+0000', 'last_clean': '2024-04-16T15:53:18.183405+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:53:18.204209+0000', 'last_undegraded': '2024-04-16T15:53:18.204209+0000', 'last_fullsized': '2024-04-16T15:53:18.204209+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'last_clean_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-16T15:53:23.421 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2024-04-16T15:53:23.421 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-16T15:53:18.196409+0000', 'last_change': '2024-04-16T15:53:18.196409+0000', 'last_active': '2024-04-16T15:53:18.183405+0000', 'last_peered': '2024-04-16T15:53:18.183405+0000', 'last_clean': '2024-04-16T15:53:18.183405+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:53:18.196409+0000', 'last_undegraded': '2024-04-16T15:53:18.196409+0000', 'last_fullsized': '2024-04-16T15:53:18.196409+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'last_clean_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-16T15:53:23.421 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2024-04-16T15:53:23.421 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-16T15:53:18.203805+0000', 'last_change': '2024-04-16T15:53:18.203805+0000', 'last_active': '2024-04-16T15:53:18.183405+0000', 'last_peered': '2024-04-16T15:53:18.183405+0000', 'last_clean': '2024-04-16T15:53:18.183405+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:53:18.203805+0000', 'last_undegraded': '2024-04-16T15:53:18.203805+0000', 'last_fullsized': '2024-04-16T15:53:18.203805+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'last_clean_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-16T15:53:23.421 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2024-04-16T15:53:23.421 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-16T15:53:18.195390+0000', 'last_change': '2024-04-16T15:53:18.195390+0000', 'last_active': '2024-04-16T15:53:18.183405+0000', 'last_peered': '2024-04-16T15:53:18.183405+0000', 'last_clean': '2024-04-16T15:53:18.183405+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:53:18.195390+0000', 'last_undegraded': '2024-04-16T15:53:18.195390+0000', 'last_fullsized': '2024-04-16T15:53:18.195390+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'last_clean_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-16T15:53:23.421 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2024-04-16T15:53:23.421 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-16T15:53:18.204995+0000', 'last_change': '2024-04-16T15:53:18.204995+0000', 'last_active': '2024-04-16T15:53:18.183405+0000', 'last_peered': '2024-04-16T15:53:18.183405+0000', 'last_clean': '2024-04-16T15:53:18.183405+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:53:18.204995+0000', 'last_undegraded': '2024-04-16T15:53:18.204995+0000', 'last_fullsized': '2024-04-16T15:53:18.204995+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'last_clean_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-16T15:53:23.421 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2024-04-16T15:53:23.421 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-16T15:53:18.198148+0000', 'last_change': '2024-04-16T15:53:18.198148+0000', 'last_active': '2024-04-16T15:53:18.183405+0000', 'last_peered': '2024-04-16T15:53:18.183405+0000', 'last_clean': '2024-04-16T15:53:18.183405+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:53:18.198148+0000', 'last_undegraded': '2024-04-16T15:53:18.198148+0000', 'last_fullsized': '2024-04-16T15:53:18.198148+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'last_clean_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-16T15:53:23.421 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2024-04-16T15:53:23.422 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-16T15:53:18.195941+0000', 'last_change': '2024-04-16T15:53:18.195941+0000', 'last_active': '2024-04-16T15:53:18.183405+0000', 'last_peered': '2024-04-16T15:53:18.183405+0000', 'last_clean': '2024-04-16T15:53:18.183405+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:53:18.195941+0000', 'last_undegraded': '2024-04-16T15:53:18.195941+0000', 'last_fullsized': '2024-04-16T15:53:18.195941+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'last_clean_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-16T15:53:23.422 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2024-04-16T15:53:23.422 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-16T15:53:18.202957+0000', 'last_change': '2024-04-16T15:53:18.202957+0000', 'last_active': '2024-04-16T15:53:18.183405+0000', 'last_peered': '2024-04-16T15:53:18.183405+0000', 'last_clean': '2024-04-16T15:53:18.183405+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:53:18.202957+0000', 'last_undegraded': '2024-04-16T15:53:18.202957+0000', 'last_fullsized': '2024-04-16T15:53:18.202957+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'last_clean_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-16T15:53:23.422 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2024-04-16T15:53:23.422 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-16T15:53:18.201904+0000', 'last_change': '2024-04-16T15:53:18.201904+0000', 'last_active': '2024-04-16T15:53:18.183405+0000', 'last_peered': '2024-04-16T15:53:18.183405+0000', 'last_clean': '2024-04-16T15:53:18.183405+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:53:18.201904+0000', 'last_undegraded': '2024-04-16T15:53:18.201904+0000', 'last_fullsized': '2024-04-16T15:53:18.201904+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'last_clean_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-16T15:53:23.422 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2024-04-16T15:53:23.422 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-16T15:53:18.195387+0000', 'last_change': '2024-04-16T15:53:18.195387+0000', 'last_active': '2024-04-16T15:53:18.183405+0000', 'last_peered': '2024-04-16T15:53:18.183405+0000', 'last_clean': '2024-04-16T15:53:18.183405+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:53:18.195387+0000', 'last_undegraded': '2024-04-16T15:53:18.195387+0000', 'last_fullsized': '2024-04-16T15:53:18.195387+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'last_clean_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-16T15:53:23.422 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2024-04-16T15:53:23.422 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-16T15:53:18.195456+0000', 'last_change': '2024-04-16T15:53:18.195456+0000', 'last_active': '2024-04-16T15:53:18.183405+0000', 'last_peered': '2024-04-16T15:53:18.183405+0000', 'last_clean': '2024-04-16T15:53:18.183405+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:53:18.195456+0000', 'last_undegraded': '2024-04-16T15:53:18.195456+0000', 'last_fullsized': '2024-04-16T15:53:18.195456+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'last_clean_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-16T15:53:23.422 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2024-04-16T15:53:23.422 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-16T15:53:18.196587+0000', 'last_change': '2024-04-16T15:53:18.196587+0000', 'last_active': '2024-04-16T15:53:18.183405+0000', 'last_peered': '2024-04-16T15:53:18.183405+0000', 'last_clean': '2024-04-16T15:53:18.183405+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:53:18.196587+0000', 'last_undegraded': '2024-04-16T15:53:18.196587+0000', 'last_fullsized': '2024-04-16T15:53:18.196587+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'last_clean_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-16T15:53:23.423 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2024-04-16T15:53:23.423 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-16T15:53:18.201914+0000', 'last_change': '2024-04-16T15:53:18.201914+0000', 'last_active': '2024-04-16T15:53:18.183405+0000', 'last_peered': '2024-04-16T15:53:18.183405+0000', 'last_clean': '2024-04-16T15:53:18.183405+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:53:18.201914+0000', 'last_undegraded': '2024-04-16T15:53:18.201914+0000', 'last_fullsized': '2024-04-16T15:53:18.201914+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'last_clean_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-16T15:53:23.423 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2024-04-16T15:53:23.423 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-16T15:53:18.196955+0000', 'last_change': '2024-04-16T15:53:18.196955+0000', 'last_active': '2024-04-16T15:53:18.183405+0000', 'last_peered': '2024-04-16T15:53:18.183405+0000', 'last_clean': '2024-04-16T15:53:18.183405+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:53:18.196955+0000', 'last_undegraded': '2024-04-16T15:53:18.196955+0000', 'last_fullsized': '2024-04-16T15:53:18.196955+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'last_clean_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-16T15:53:23.423 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2024-04-16T15:53:23.423 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-16T15:53:18.202993+0000', 'last_change': '2024-04-16T15:53:18.202993+0000', 'last_active': '2024-04-16T15:53:18.183405+0000', 'last_peered': '2024-04-16T15:53:18.183405+0000', 'last_clean': '2024-04-16T15:53:18.183405+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:53:18.202993+0000', 'last_undegraded': '2024-04-16T15:53:18.202993+0000', 'last_fullsized': '2024-04-16T15:53:18.202993+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'last_clean_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-16T15:53:23.423 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2024-04-16T15:53:23.423 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-16T15:53:18.202538+0000', 'last_change': '2024-04-16T15:53:18.202538+0000', 'last_active': '2024-04-16T15:53:18.183405+0000', 'last_peered': '2024-04-16T15:53:18.183405+0000', 'last_clean': '2024-04-16T15:53:18.183405+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:53:18.202538+0000', 'last_undegraded': '2024-04-16T15:53:18.202538+0000', 'last_fullsized': '2024-04-16T15:53:18.202538+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'last_clean_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-16T15:53:23.423 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2024-04-16T15:53:23.423 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-16T15:53:18.202082+0000', 'last_change': '2024-04-16T15:53:18.202082+0000', 'last_active': '2024-04-16T15:53:18.183405+0000', 'last_peered': '2024-04-16T15:53:18.183405+0000', 'last_clean': '2024-04-16T15:53:18.183405+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:53:18.202082+0000', 'last_undegraded': '2024-04-16T15:53:18.202082+0000', 'last_fullsized': '2024-04-16T15:53:18.202082+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'last_clean_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-16T15:53:23.423 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2024-04-16T15:53:23.424 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-16T15:53:18.201503+0000', 'last_change': '2024-04-16T15:53:18.201503+0000', 'last_active': '2024-04-16T15:53:18.183405+0000', 'last_peered': '2024-04-16T15:53:18.183405+0000', 'last_clean': '2024-04-16T15:53:18.183405+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:53:18.201503+0000', 'last_undegraded': '2024-04-16T15:53:18.201503+0000', 'last_fullsized': '2024-04-16T15:53:18.201503+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'last_clean_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-16T15:53:23.424 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2024-04-16T15:53:23.424 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-16T15:53:18.203401+0000', 'last_change': '2024-04-16T15:53:18.203401+0000', 'last_active': '2024-04-16T15:53:18.183405+0000', 'last_peered': '2024-04-16T15:53:18.183405+0000', 'last_clean': '2024-04-16T15:53:18.183405+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:53:18.203401+0000', 'last_undegraded': '2024-04-16T15:53:18.203401+0000', 'last_fullsized': '2024-04-16T15:53:18.203401+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'last_clean_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-16T15:53:23.424 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2024-04-16T15:53:23.424 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-16T15:53:18.195681+0000', 'last_change': '2024-04-16T15:53:18.195681+0000', 'last_active': '2024-04-16T15:53:18.183405+0000', 'last_peered': '2024-04-16T15:53:18.183405+0000', 'last_clean': '2024-04-16T15:53:18.183405+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:53:18.195681+0000', 'last_undegraded': '2024-04-16T15:53:18.195681+0000', 'last_fullsized': '2024-04-16T15:53:18.195681+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'last_clean_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-16T15:53:23.424 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2024-04-16T15:53:23.424 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-16T15:53:18.203964+0000', 'last_change': '2024-04-16T15:53:18.203964+0000', 'last_active': '2024-04-16T15:53:18.183405+0000', 'last_peered': '2024-04-16T15:53:18.183405+0000', 'last_clean': '2024-04-16T15:53:18.183405+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:53:18.203964+0000', 'last_undegraded': '2024-04-16T15:53:18.203964+0000', 'last_fullsized': '2024-04-16T15:53:18.203964+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'last_clean_scrub_stamp': '2024-04-16T15:53:18.183405+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-16T15:53:23.425 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-16T15:53:23.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.560+0000 7f0c65b40640 1 Processor -- start 2024-04-16T15:53:23.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.560+0000 7f0c65b40640 1 -- start start 2024-04-16T15:53:23.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.561+0000 7f0c65b40640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0c600b5cc0 0x7f0c600b6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:23.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.561+0000 7f0c65b40640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c6006dc90 0x7f0c6006e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:23.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.561+0000 7f0c65b40640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c600cec90 con 0x7f0c60151e90 2024-04-16T15:53:23.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.561+0000 7f0c65b40640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f0c600d00e0 con 0x7f0c600b5cc0 2024-04-16T15:53:23.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.561+0000 7f0c65b40640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f0c600cf540 con 0x7f0c6006dc90 2024-04-16T15:53:23.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.561+0000 7f0c5effd640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0c600b5cc0 0x7f0c600b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:23.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.561+0000 7f0c5ffff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c6006dc90 0x7f0c6006e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:23.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.561+0000 7f0c5f7fe640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f0c60151e90 0x7f0c600cf9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.132:33498/0 (socket says 172.21.15.132:33498) 2024-04-16T15:53:23.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.561+0000 7f0c5effd640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0c600b5cc0 0x7f0c600b6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.132:33252/0 (socket says 172.21.15.132:33252) 2024-04-16T15:53:23.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.561+0000 7f0c5f7fe640 1 -- 172.21.15.132:0/1405084571 learned_addr learned my addr 172.21.15.132:0/1405084571 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:53:23.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.562+0000 7f0c5effd640 1 -- 172.21.15.132:0/1405084571 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c6006dc90 msgr2=0x7f0c6006e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:23.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.562+0000 7f0c5effd640 1 --2- 172.21.15.132:0/1405084571 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c6006dc90 0x7f0c6006e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:23.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.562+0000 7f0c5effd640 1 -- 172.21.15.132:0/1405084571 >> v1:172.21.15.179:6789/0 conn(0x7f0c60151e90 legacy=0x7f0c600cf9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:23.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.562+0000 7f0c5effd640 1 -- 172.21.15.132:0/1405084571 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c600cef10 con 0x7f0c600b5cc0 2024-04-16T15:53:23.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.562+0000 7f0c5effd640 1 --2- 172.21.15.132:0/1405084571 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c600b5cc0 0x7f0c600b6150 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0c54009d90 tx=0x7f0c5402bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c08431f0cbc7d6fb server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:23.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.563+0000 7f0c5e7fc640 1 -- 172.21.15.132:0/1405084571 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c54039070 con 0x7f0c600b5cc0 2024-04-16T15:53:23.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.563+0000 7f0c5e7fc640 1 -- 172.21.15.132:0/1405084571 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c5402cc50 con 0x7f0c600b5cc0 2024-04-16T15:53:23.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.563+0000 7f0c5e7fc640 1 -- 172.21.15.132:0/1405084571 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c54034440 con 0x7f0c600b5cc0 2024-04-16T15:53:23.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.563+0000 7f0c65b40640 1 -- 172.21.15.132:0/1405084571 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c600b5cc0 msgr2=0x7f0c600b6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:23.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.563+0000 7f0c65b40640 1 --2- 172.21.15.132:0/1405084571 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c600b5cc0 0x7f0c600b6150 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0c54009d90 tx=0x7f0c5402bea0 comp rx=0 tx=0).stop 2024-04-16T15:53:23.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.563+0000 7f0c65b40640 1 -- 172.21.15.132:0/1405084571 shutdown_connections 2024-04-16T15:53:23.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.563+0000 7f0c65b40640 1 --2- 172.21.15.132:0/1405084571 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c6006dc90 0x7f0c6006e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:23.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.563+0000 7f0c65b40640 1 --2- 172.21.15.132:0/1405084571 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c600b5cc0 0x7f0c600b6150 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:23.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.563+0000 7f0c65b40640 1 -- 172.21.15.132:0/1405084571 >> 172.21.15.132:0/1405084571 conn(0x7f0c600b2d50 msgr2=0x7f0c6006ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:23.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.563+0000 7f0c65b40640 1 -- 172.21.15.132:0/1405084571 shutdown_connections 2024-04-16T15:53:23.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.563+0000 7f0c65b40640 1 -- 172.21.15.132:0/1405084571 wait complete. 2024-04-16T15:53:23.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.564+0000 7f0c65b40640 1 Processor -- start 2024-04-16T15:53:23.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.565+0000 7f0c65b40640 1 -- start start 2024-04-16T15:53:23.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.565+0000 7f0c65b40640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c6006dc90 0x7f0c601f68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:23.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.565+0000 7f0c65b40640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0c600b5cc0 0x7f0c601f2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:23.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.565+0000 7f0c65b40640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c60151e90 0x7f0c60143930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:23.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.565+0000 7f0c65b40640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f0c600cf1d0 con 0x7f0c600b5cc0 2024-04-16T15:53:23.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.565+0000 7f0c65b40640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0c6015c130 con 0x7f0c6006dc90 2024-04-16T15:53:23.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.565+0000 7f0c65b40640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f0c6006e660 con 0x7f0c60151e90 2024-04-16T15:53:23.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.565+0000 7f0c5effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0c600b5cc0 0x7f0c601f2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:23.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.565+0000 7f0c5effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0c600b5cc0 0x7f0c601f2970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41868/0 (socket says 172.21.15.132:41868) 2024-04-16T15:53:23.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.565+0000 7f0c5effd640 1 -- 172.21.15.132:0/2633072052 learned_addr learned my addr 172.21.15.132:0/2633072052 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:23.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.566+0000 7f0c5ffff640 1 --2- 172.21.15.132:0/2633072052 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c60151e90 0x7f0c60143930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:23.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.566+0000 7f0c5f7fe640 1 --2- 172.21.15.132:0/2633072052 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c6006dc90 0x7f0c601f68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:23.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.566+0000 7f0c5effd640 1 -- 172.21.15.132:0/2633072052 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c60151e90 msgr2=0x7f0c60143930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:23.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.566+0000 7f0c5effd640 1 --2- 172.21.15.132:0/2633072052 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c60151e90 0x7f0c60143930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:23.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.566+0000 7f0c5effd640 1 -- 172.21.15.132:0/2633072052 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c6006dc90 msgr2=0x7f0c601f68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:23.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.566+0000 7f0c5effd640 1 --2- 172.21.15.132:0/2633072052 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c6006dc90 0x7f0c601f68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:23.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.566+0000 7f0c5effd640 1 -- 172.21.15.132:0/2633072052 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c601431a0 con 0x7f0c600b5cc0 2024-04-16T15:53:23.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.566+0000 7f0c5effd640 1 --2- 172.21.15.132:0/2633072052 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0c600b5cc0 0x7f0c601f2970 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f0c54037040 tx=0x7f0c54004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:23.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.566+0000 7f0c47fff640 1 -- 172.21.15.132:0/2633072052 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c54039050 con 0x7f0c600b5cc0 2024-04-16T15:53:23.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.566+0000 7f0c47fff640 1 -- 172.21.15.132:0/2633072052 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c54045070 con 0x7f0c600b5cc0 2024-04-16T15:53:23.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.566+0000 7f0c65b40640 1 -- 172.21.15.132:0/2633072052 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c601f3210 con 0x7f0c600b5cc0 2024-04-16T15:53:23.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.566+0000 7f0c47fff640 1 -- 172.21.15.132:0/2633072052 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c54009450 con 0x7f0c600b5cc0 2024-04-16T15:53:23.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.566+0000 7f0c65b40640 1 -- 172.21.15.132:0/2633072052 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c601f2eb0 con 0x7f0c600b5cc0 2024-04-16T15:53:23.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.567+0000 7f0c65b40640 1 -- 172.21.15.132:0/2633072052 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c600d02f0 con 0x7f0c600b5cc0 2024-04-16T15:53:23.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.568+0000 7f0c47fff640 1 -- 172.21.15.132:0/2633072052 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0c5403e610 con 0x7f0c600b5cc0 2024-04-16T15:53:23.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.568+0000 7f0c47fff640 1 --2- 172.21.15.132:0/2633072052 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f0c4c06c8f0 0x7f0c4c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:23.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.568+0000 7f0c47fff640 1 -- 172.21.15.132:0/2633072052 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f0c540ae4f0 con 0x7f0c600b5cc0 2024-04-16T15:53:23.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.568+0000 7f0c5f7fe640 1 --2- 172.21.15.132:0/2633072052 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f0c4c06c8f0 0x7f0c4c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:23.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.568+0000 7f0c5f7fe640 1 --2- 172.21.15.132:0/2633072052 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f0c4c06c8f0 0x7f0c4c06edb0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0c60068df0 tx=0x7f0c50007e80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:23.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.572+0000 7f0c47fff640 1 -- 172.21.15.132:0/2633072052 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0c600d02f0 con 0x7f0c600b5cc0 2024-04-16T15:53:23.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.814+0000 7f0c65b40640 1 -- 172.21.15.132:0/2633072052 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f0c60075510 con 0x7f0c600b5cc0 2024-04-16T15:53:23.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.815+0000 7f0c47fff640 1 -- 172.21.15.132:0/2633072052 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1656 (secure 0 0 0) 0x7f0c5407c2d0 con 0x7f0c600b5cc0 2024-04-16T15:53:23.814 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:53:23.814 INFO:teuthology.orchestra.run.smithi132.stdout:{"fsid":"6bdec5d9-f406-43ad-8584-0503b32f6f0d","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":92,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":34,"num_osds":8,"num_up_osds":8,"osd_up_since":1713282722,"num_in_osds":8,"osd_in_since":1713282713,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":49},{"state_name":"unknown","count":41},{"state_name":"active+clean","count":7}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":229543936,"bytes_avail":772864569344,"bytes_total":773094113280,"unknown_pgs_ratio":0.42268040776252747,"inactive_pgs_ratio":0.50515460968017578},"fsmap":{"epoch":14,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":5235}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-04-16T15:53:05.279414+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-16T15:53:23.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.817+0000 7f0c65b40640 1 -- 172.21.15.132:0/2633072052 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f0c4c06c8f0 msgr2=0x7f0c4c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:23.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.817+0000 7f0c65b40640 1 --2- 172.21.15.132:0/2633072052 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f0c4c06c8f0 0x7f0c4c06edb0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0c60068df0 tx=0x7f0c50007e80 comp rx=0 tx=0).stop 2024-04-16T15:53:23.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.817+0000 7f0c65b40640 1 -- 172.21.15.132:0/2633072052 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0c600b5cc0 msgr2=0x7f0c601f2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:23.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.817+0000 7f0c65b40640 1 --2- 172.21.15.132:0/2633072052 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0c600b5cc0 0x7f0c601f2970 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f0c54037040 tx=0x7f0c54004a40 comp rx=0 tx=0).stop 2024-04-16T15:53:23.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.817+0000 7f0c65b40640 1 -- 172.21.15.132:0/2633072052 shutdown_connections 2024-04-16T15:53:23.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.817+0000 7f0c65b40640 1 --2- 172.21.15.132:0/2633072052 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f0c4c06c8f0 0x7f0c4c06edb0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:23.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.817+0000 7f0c65b40640 1 --2- 172.21.15.132:0/2633072052 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c60151e90 0x7f0c60143930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:23.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.817+0000 7f0c65b40640 1 --2- 172.21.15.132:0/2633072052 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0c600b5cc0 0x7f0c601f2970 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:23.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.817+0000 7f0c65b40640 1 --2- 172.21.15.132:0/2633072052 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c6006dc90 0x7f0c601f68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:23.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.817+0000 7f0c65b40640 1 -- 172.21.15.132:0/2633072052 >> 172.21.15.132:0/2633072052 conn(0x7f0c600b2d50 msgr2=0x7f0c6014ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:23.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.817+0000 7f0c65b40640 1 -- 172.21.15.132:0/2633072052 shutdown_connections 2024-04-16T15:53:23.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.817+0000 7f0c65b40640 1 -- 172.21.15.132:0/2633072052 wait complete. 2024-04-16T15:53:23.827 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-16T15:53:23.828 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T15:53:23.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.931+0000 7f67b99aa640 1 Processor -- start 2024-04-16T15:53:23.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.931+0000 7f67b99aa640 1 -- start start 2024-04-16T15:53:23.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.932+0000 7f67b99aa640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f67b415e9d0 0x7f67b4070cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:23.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.932+0000 7f67b99aa640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f67b40b0460 0x7f67b40ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:23.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.932+0000 7f67b99aa640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67b40b66e0 con 0x7f67b406ba20 2024-04-16T15:53:23.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.932+0000 7f67b99aa640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f67b40b08c0 con 0x7f67b40b0460 2024-04-16T15:53:23.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.932+0000 7f67b99aa640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f67b40b4840 con 0x7f67b415e9d0 2024-04-16T15:53:23.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.932+0000 7f67aa7fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f67b40b0460 0x7f67b40ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:23.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.932+0000 7f67aa7fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f67b40b0460 0x7f67b40ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41872/0 (socket says 172.21.15.132:41872) 2024-04-16T15:53:23.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.932+0000 7f67aa7fc640 1 -- 172.21.15.132:0/2173780443 learned_addr learned my addr 172.21.15.132:0/2173780443 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:23.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.932+0000 7f67b2ffd640 1 --2- 172.21.15.132:0/2173780443 >> v2:172.21.15.179:3300/0 conn(0x7f67b415e9d0 0x7f67b4070cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:23.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.932+0000 7f67aa7fc640 1 -- 172.21.15.132:0/2173780443 >> v2:172.21.15.179:3300/0 conn(0x7f67b415e9d0 msgr2=0x7f67b4070cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:23.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.932+0000 7f67aa7fc640 1 --2- 172.21.15.132:0/2173780443 >> v2:172.21.15.179:3300/0 conn(0x7f67b415e9d0 0x7f67b4070cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:23.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.932+0000 7f67aa7fc640 1 -- 172.21.15.132:0/2173780443 >> v1:172.21.15.179:6789/0 conn(0x7f67b406ba20 legacy=0x7f67b406fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:23.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.933+0000 7f67aa7fc640 1 -- 172.21.15.132:0/2173780443 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67b40b6400 con 0x7f67b40b0460 2024-04-16T15:53:23.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.933+0000 7f67aa7fc640 1 --2- 172.21.15.132:0/2173780443 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67b40b0460 0x7f67b40ae410 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f67b40d2660 tx=0x7f679c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d040983740a7085 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:23.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.933+0000 7f67b27fc640 1 -- 172.21.15.132:0/2173780443 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f679c035020 con 0x7f67b40b0460 2024-04-16T15:53:23.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.933+0000 7f67b27fc640 1 -- 172.21.15.132:0/2173780443 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f679c031870 con 0x7f67b40b0460 2024-04-16T15:53:23.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.933+0000 7f67b27fc640 1 -- 172.21.15.132:0/2173780443 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f679c031c40 con 0x7f67b40b0460 2024-04-16T15:53:23.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.934+0000 7f67b99aa640 1 -- 172.21.15.132:0/2173780443 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67b40b0460 msgr2=0x7f67b40ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:23.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.934+0000 7f67b99aa640 1 --2- 172.21.15.132:0/2173780443 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67b40b0460 0x7f67b40ae410 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f67b40d2660 tx=0x7f679c02b910 comp rx=0 tx=0).stop 2024-04-16T15:53:23.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.934+0000 7f67b99aa640 1 -- 172.21.15.132:0/2173780443 shutdown_connections 2024-04-16T15:53:23.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.934+0000 7f67b99aa640 1 --2- 172.21.15.132:0/2173780443 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67b40b0460 0x7f67b40ae410 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:23.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.934+0000 7f67b99aa640 1 --2- 172.21.15.132:0/2173780443 >> v2:172.21.15.179:3300/0 conn(0x7f67b415e9d0 0x7f67b4070cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:23.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.934+0000 7f67b99aa640 1 -- 172.21.15.132:0/2173780443 >> 172.21.15.132:0/2173780443 conn(0x7f67b409aa30 msgr2=0x7f67b40b6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:23.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.934+0000 7f67b99aa640 1 -- 172.21.15.132:0/2173780443 shutdown_connections 2024-04-16T15:53:23.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.934+0000 7f67b99aa640 1 -- 172.21.15.132:0/2173780443 wait complete. 2024-04-16T15:53:23.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.935+0000 7f67b99aa640 1 Processor -- start 2024-04-16T15:53:23.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.935+0000 7f67b99aa640 1 -- start start 2024-04-16T15:53:23.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.936+0000 7f67b99aa640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67b406ba20 0x7f67b4157520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:23.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.936+0000 7f67b99aa640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67b40b0460 0x7f67b4154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:23.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.936+0000 7f67b99aa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f67b415e9d0 0x7f67b414afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:23.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.936+0000 7f67b99aa640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f67b40b6020 con 0x7f67b40b0460 2024-04-16T15:53:23.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.936+0000 7f67b99aa640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f67b415edb0 con 0x7f67b406ba20 2024-04-16T15:53:23.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.936+0000 7f67b99aa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f67b40b61a0 con 0x7f67b415e9d0 2024-04-16T15:53:23.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.936+0000 7f67aa7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67b40b0460 0x7f67b4154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:23.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.936+0000 7f67aa7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67b40b0460 0x7f67b4154b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41878/0 (socket says 172.21.15.132:41878) 2024-04-16T15:53:23.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.936+0000 7f67aa7fc640 1 -- 172.21.15.132:0/984028215 learned_addr learned my addr 172.21.15.132:0/984028215 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:23.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.936+0000 7f67b2ffd640 1 --2- 172.21.15.132:0/984028215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67b406ba20 0x7f67b4157520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:23.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.936+0000 7f67b37fe640 1 --2- 172.21.15.132:0/984028215 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f67b415e9d0 0x7f67b414afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:23.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.936+0000 7f67aa7fc640 1 -- 172.21.15.132:0/984028215 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f67b415e9d0 msgr2=0x7f67b414afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:23.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.936+0000 7f67aa7fc640 1 --2- 172.21.15.132:0/984028215 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f67b415e9d0 0x7f67b414afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:23.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.937+0000 7f67aa7fc640 1 -- 172.21.15.132:0/984028215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67b406ba20 msgr2=0x7f67b4157520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:23.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.937+0000 7f67aa7fc640 1 --2- 172.21.15.132:0/984028215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67b406ba20 0x7f67b4157520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:23.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.937+0000 7f67aa7fc640 1 -- 172.21.15.132:0/984028215 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67b4155270 con 0x7f67b40b0460 2024-04-16T15:53:23.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.937+0000 7f67b37fe640 1 --2- 172.21.15.132:0/984028215 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f67b415e9d0 0x7f67b414afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:53:23.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.937+0000 7f67aa7fc640 1 --2- 172.21.15.132:0/984028215 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67b40b0460 0x7f67b4154b00 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f679c02b950 tx=0x7f679c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:23.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.937+0000 7f67b0ff9640 1 -- 172.21.15.132:0/984028215 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f679c040070 con 0x7f67b40b0460 2024-04-16T15:53:23.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.937+0000 7f67b0ff9640 1 -- 172.21.15.132:0/984028215 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f679c030d00 con 0x7f67b40b0460 2024-04-16T15:53:23.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.937+0000 7f67b99aa640 1 -- 172.21.15.132:0/984028215 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67b4155550 con 0x7f67b40b0460 2024-04-16T15:53:23.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.937+0000 7f67b0ff9640 1 -- 172.21.15.132:0/984028215 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f679c035040 con 0x7f67b40b0460 2024-04-16T15:53:23.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.937+0000 7f67b99aa640 1 -- 172.21.15.132:0/984028215 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67b4155b10 con 0x7f67b40b0460 2024-04-16T15:53:23.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.938+0000 7f67b99aa640 1 -- 172.21.15.132:0/984028215 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67b4075510 con 0x7f67b40b0460 2024-04-16T15:53:23.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.938+0000 7f67b0ff9640 1 -- 172.21.15.132:0/984028215 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f679c04b060 con 0x7f67b40b0460 2024-04-16T15:53:23.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.939+0000 7f67b0ff9640 1 --2- 172.21.15.132:0/984028215 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f679406c8f0 0x7f679406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:23.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.939+0000 7f67b0ff9640 1 -- 172.21.15.132:0/984028215 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f679c0ad770 con 0x7f67b40b0460 2024-04-16T15:53:23.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.939+0000 7f67b2ffd640 1 --2- 172.21.15.132:0/984028215 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f679406c8f0 0x7f679406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:23.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.939+0000 7f67b2ffd640 1 --2- 172.21.15.132:0/984028215 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f679406c8f0 0x7f679406edb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f67a4009aa0 tx=0x7f67a4009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:23.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:23.943+0000 7f67b0ff9640 1 -- 172.21.15.132:0/984028215 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f679c07bc30 con 0x7f67b40b0460 2024-04-16T15:53:24.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:24.116+0000 7f67b99aa640 1 -- 172.21.15.132:0/984028215 --> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f67b406c620 con 0x7f679406c8f0 2024-04-16T15:53:24.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:24.121+0000 7f67b0ff9640 1 -- 172.21.15.132:0/984028215 <== mgr.4101 v2:172.21.15.132:6832/3896387465 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250057 (secure 0 0 0) 0x7f67b406c620 con 0x7f679406c8f0 2024-04-16T15:53:24.123 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:53:24.124 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2024-04-16T15:53:24.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:24.124+0000 7f67b99aa640 1 -- 172.21.15.132:0/984028215 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f679406c8f0 msgr2=0x7f679406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:24.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:24.124+0000 7f67b99aa640 1 --2- 172.21.15.132:0/984028215 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f679406c8f0 0x7f679406edb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f67a4009aa0 tx=0x7f67a4009190 comp rx=0 tx=0).stop 2024-04-16T15:53:24.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:24.124+0000 7f67b99aa640 1 -- 172.21.15.132:0/984028215 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67b40b0460 msgr2=0x7f67b4154b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:24.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:24.124+0000 7f67b99aa640 1 --2- 172.21.15.132:0/984028215 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67b40b0460 0x7f67b4154b00 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f679c02b950 tx=0x7f679c0046c0 comp rx=0 tx=0).stop 2024-04-16T15:53:24.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:24.124+0000 7f67b99aa640 1 -- 172.21.15.132:0/984028215 shutdown_connections 2024-04-16T15:53:24.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:24.124+0000 7f67b99aa640 1 --2- 172.21.15.132:0/984028215 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f679406c8f0 0x7f679406edb0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:24.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:24.124+0000 7f67b99aa640 1 --2- 172.21.15.132:0/984028215 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f67b415e9d0 0x7f67b414afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:24.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:24.124+0000 7f67b99aa640 1 --2- 172.21.15.132:0/984028215 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67b40b0460 0x7f67b4154b00 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:24.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:24.124+0000 7f67b99aa640 1 --2- 172.21.15.132:0/984028215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67b406ba20 0x7f67b4157520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:24.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:24.124+0000 7f67b99aa640 1 -- 172.21.15.132:0/984028215 >> 172.21.15.132:0/984028215 conn(0x7f67b409aa30 msgr2=0x7f67b41613e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:24.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:24.125+0000 7f67b99aa640 1 -- 172.21.15.132:0/984028215 shutdown_connections 2024-04-16T15:53:24.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:24.125+0000 7f67b99aa640 1 -- 172.21.15.132:0/984028215 wait complete. 2024-04-16T15:53:24.135 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2024-04-16T15:53:23.282262+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592106,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":192,"num_write_kb":2428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":146,"ondisk_log_size":146,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":105,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224452,"kb_used_data":4104,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750268,"statfs":{"total":773094113280,"available":772864274432,"internally_reserved":0,"allocated":4202496,"data_stored":2341620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1738,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000941"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.204545+0000","last_change":"2024-04-16T15:53:18.204545+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.204545+0000","last_undegraded":"2024-04-16T15:53:18.204545+0000","last_fullsized":"2024-04-16T15:53:18.204545+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195457+0000","last_change":"2024-04-16T15:53:19.226148+0000","last_active":"2024-04-16T15:53:20.195457+0000","last_peered":"2024-04-16T15:53:20.195457+0000","last_clean":"2024-04-16T15:53:20.195457+0000","last_became_active":"2024-04-16T15:53:19.225869+0000","last_became_peered":"2024-04-16T15:53:19.225869+0000","last_unstale":"2024-04-16T15:53:20.195457+0000","last_undegraded":"2024-04-16T15:53:20.195457+0000","last_fullsized":"2024-04-16T15:53:20.195457+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:00:13.986513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.195522+0000","last_change":"2024-04-16T15:53:18.195522+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.195522+0000","last_undegraded":"2024-04-16T15:53:18.195522+0000","last_fullsized":"2024-04-16T15:53:18.195522+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277237+0000","last_change":"2024-04-16T15:53:19.214711+0000","last_active":"2024-04-16T15:53:20.277237+0000","last_peered":"2024-04-16T15:53:20.277237+0000","last_clean":"2024-04-16T15:53:20.277237+0000","last_became_active":"2024-04-16T15:53:19.214414+0000","last_became_peered":"2024-04-16T15:53:19.214414+0000","last_unstale":"2024-04-16T15:53:20.277237+0000","last_undegraded":"2024-04-16T15:53:20.277237+0000","last_fullsized":"2024-04-16T15:53:20.277237+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:09:09.369395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.204209+0000","last_change":"2024-04-16T15:53:18.204209+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.204209+0000","last_undegraded":"2024-04-16T15:53:18.204209+0000","last_fullsized":"2024-04-16T15:53:18.204209+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195195+0000","last_change":"2024-04-16T15:53:19.214250+0000","last_active":"2024-04-16T15:53:20.195195+0000","last_peered":"2024-04-16T15:53:20.195195+0000","last_clean":"2024-04-16T15:53:20.195195+0000","last_became_active":"2024-04-16T15:53:19.213980+0000","last_became_peered":"2024-04-16T15:53:19.213980+0000","last_unstale":"2024-04-16T15:53:20.195195+0000","last_undegraded":"2024-04-16T15:53:20.195195+0000","last_fullsized":"2024-04-16T15:53:20.195195+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:55:20.146233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197135+0000","last_change":"2024-04-16T15:53:19.221453+0000","last_active":"2024-04-16T15:53:20.197135+0000","last_peered":"2024-04-16T15:53:20.197135+0000","last_clean":"2024-04-16T15:53:20.197135+0000","last_became_active":"2024-04-16T15:53:19.221101+0000","last_became_peered":"2024-04-16T15:53:19.221101+0000","last_unstale":"2024-04-16T15:53:20.197135+0000","last_undegraded":"2024-04-16T15:53:20.197135+0000","last_fullsized":"2024-04-16T15:53:20.197135+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:47:53.262802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197388+0000","last_change":"2024-04-16T15:53:19.214371+0000","last_active":"2024-04-16T15:53:20.197388+0000","last_peered":"2024-04-16T15:53:20.197388+0000","last_clean":"2024-04-16T15:53:20.197388+0000","last_became_active":"2024-04-16T15:53:19.213544+0000","last_became_peered":"2024-04-16T15:53:19.213544+0000","last_unstale":"2024-04-16T15:53:20.197388+0000","last_undegraded":"2024-04-16T15:53:20.197388+0000","last_fullsized":"2024-04-16T15:53:20.197388+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:55:20.146233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197066+0000","last_change":"2024-04-16T15:53:19.207377+0000","last_active":"2024-04-16T15:53:20.197066+0000","last_peered":"2024-04-16T15:53:20.197066+0000","last_clean":"2024-04-16T15:53:20.197066+0000","last_became_active":"2024-04-16T15:53:19.206972+0000","last_became_peered":"2024-04-16T15:53:19.206972+0000","last_unstale":"2024-04-16T15:53:20.197066+0000","last_undegraded":"2024-04-16T15:53:20.197066+0000","last_fullsized":"2024-04-16T15:53:20.197066+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:41:40.266044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277465+0000","last_change":"2024-04-16T15:53:19.216192+0000","last_active":"2024-04-16T15:53:20.277465+0000","last_peered":"2024-04-16T15:53:20.277465+0000","last_clean":"2024-04-16T15:53:20.277465+0000","last_became_active":"2024-04-16T15:53:19.215441+0000","last_became_peered":"2024-04-16T15:53:19.215441+0000","last_unstale":"2024-04-16T15:53:20.277465+0000","last_undegraded":"2024-04-16T15:53:20.277465+0000","last_fullsized":"2024-04-16T15:53:20.277465+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:41:40.266044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196998+0000","last_change":"2024-04-16T15:53:19.219404+0000","last_active":"2024-04-16T15:53:20.196998+0000","last_peered":"2024-04-16T15:53:20.196998+0000","last_clean":"2024-04-16T15:53:20.196998+0000","last_became_active":"2024-04-16T15:53:19.219142+0000","last_became_peered":"2024-04-16T15:53:19.219142+0000","last_unstale":"2024-04-16T15:53:20.196998+0000","last_undegraded":"2024-04-16T15:53:20.196998+0000","last_fullsized":"2024-04-16T15:53:20.196998+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:40:00.074304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.196409+0000","last_change":"2024-04-16T15:53:18.196409+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.196409+0000","last_undegraded":"2024-04-16T15:53:18.196409+0000","last_fullsized":"2024-04-16T15:53:18.196409+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.203805+0000","last_change":"2024-04-16T15:53:18.203805+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.203805+0000","last_undegraded":"2024-04-16T15:53:18.203805+0000","last_fullsized":"2024-04-16T15:53:18.203805+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195100+0000","last_change":"2024-04-16T15:53:19.214790+0000","last_active":"2024-04-16T15:53:20.195100+0000","last_peered":"2024-04-16T15:53:20.195100+0000","last_clean":"2024-04-16T15:53:20.195100+0000","last_became_active":"2024-04-16T15:53:19.214539+0000","last_became_peered":"2024-04-16T15:53:19.214539+0000","last_unstale":"2024-04-16T15:53:20.195100+0000","last_undegraded":"2024-04-16T15:53:20.195100+0000","last_fullsized":"2024-04-16T15:53:20.195100+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:09:12.444137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.195390+0000","last_change":"2024-04-16T15:53:18.195390+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.195390+0000","last_undegraded":"2024-04-16T15:53:18.195390+0000","last_fullsized":"2024-04-16T15:53:18.195390+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196790+0000","last_change":"2024-04-16T15:53:19.226607+0000","last_active":"2024-04-16T15:53:20.196790+0000","last_peered":"2024-04-16T15:53:20.196790+0000","last_clean":"2024-04-16T15:53:20.196790+0000","last_became_active":"2024-04-16T15:53:19.226349+0000","last_became_peered":"2024-04-16T15:53:19.226349+0000","last_unstale":"2024-04-16T15:53:20.196790+0000","last_undegraded":"2024-04-16T15:53:20.196790+0000","last_fullsized":"2024-04-16T15:53:20.196790+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:19.727876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197376+0000","last_change":"2024-04-16T15:53:19.222520+0000","last_active":"2024-04-16T15:53:20.197376+0000","last_peered":"2024-04-16T15:53:20.197376+0000","last_clean":"2024-04-16T15:53:20.197376+0000","last_became_active":"2024-04-16T15:53:19.222235+0000","last_became_peered":"2024-04-16T15:53:19.222235+0000","last_unstale":"2024-04-16T15:53:20.197376+0000","last_undegraded":"2024-04-16T15:53:20.197376+0000","last_fullsized":"2024-04-16T15:53:20.197376+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:26:17.244174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195538+0000","last_change":"2024-04-16T15:53:19.218035+0000","last_active":"2024-04-16T15:53:20.195538+0000","last_peered":"2024-04-16T15:53:20.195538+0000","last_clean":"2024-04-16T15:53:20.195538+0000","last_became_active":"2024-04-16T15:53:19.217745+0000","last_became_peered":"2024-04-16T15:53:19.217745+0000","last_unstale":"2024-04-16T15:53:20.195538+0000","last_undegraded":"2024-04-16T15:53:20.195538+0000","last_fullsized":"2024-04-16T15:53:20.195538+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:15:31.542491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195338+0000","last_change":"2024-04-16T15:53:19.217634+0000","last_active":"2024-04-16T15:53:20.195338+0000","last_peered":"2024-04-16T15:53:20.195338+0000","last_clean":"2024-04-16T15:53:20.195338+0000","last_became_active":"2024-04-16T15:53:19.217373+0000","last_became_peered":"2024-04-16T15:53:19.217373+0000","last_unstale":"2024-04-16T15:53:20.195338+0000","last_undegraded":"2024-04-16T15:53:20.195338+0000","last_fullsized":"2024-04-16T15:53:20.195338+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:48:31.729009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.204995+0000","last_change":"2024-04-16T15:53:18.204995+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.204995+0000","last_undegraded":"2024-04-16T15:53:18.204995+0000","last_fullsized":"2024-04-16T15:53:18.204995+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196930+0000","last_change":"2024-04-16T15:53:19.199390+0000","last_active":"2024-04-16T15:53:20.196930+0000","last_peered":"2024-04-16T15:53:20.196930+0000","last_clean":"2024-04-16T15:53:20.196930+0000","last_became_active":"2024-04-16T15:53:19.199066+0000","last_became_peered":"2024-04-16T15:53:19.199066+0000","last_unstale":"2024-04-16T15:53:20.196930+0000","last_undegraded":"2024-04-16T15:53:20.196930+0000","last_fullsized":"2024-04-16T15:53:20.196930+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:01:01.640923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197022+0000","last_change":"2024-04-16T15:53:19.219587+0000","last_active":"2024-04-16T15:53:20.197022+0000","last_peered":"2024-04-16T15:53:20.197022+0000","last_clean":"2024-04-16T15:53:20.197022+0000","last_became_active":"2024-04-16T15:53:19.219150+0000","last_became_peered":"2024-04-16T15:53:19.219150+0000","last_unstale":"2024-04-16T15:53:20.197022+0000","last_undegraded":"2024-04-16T15:53:20.197022+0000","last_fullsized":"2024-04-16T15:53:20.197022+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:09:09.369395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463763+0000","last_change":"2024-04-16T15:53:19.211517+0000","last_active":"2024-04-16T15:53:20.463763+0000","last_peered":"2024-04-16T15:53:20.463763+0000","last_clean":"2024-04-16T15:53:20.463763+0000","last_became_active":"2024-04-16T15:53:19.211260+0000","last_became_peered":"2024-04-16T15:53:19.211260+0000","last_unstale":"2024-04-16T15:53:20.463763+0000","last_undegraded":"2024-04-16T15:53:20.463763+0000","last_fullsized":"2024-04-16T15:53:20.463763+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:54:25.966875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.198148+0000","last_change":"2024-04-16T15:53:18.198148+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.198148+0000","last_undegraded":"2024-04-16T15:53:18.198148+0000","last_fullsized":"2024-04-16T15:53:18.198148+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277504+0000","last_change":"2024-04-16T15:53:19.214478+0000","last_active":"2024-04-16T15:53:20.277504+0000","last_peered":"2024-04-16T15:53:20.277504+0000","last_clean":"2024-04-16T15:53:20.277504+0000","last_became_active":"2024-04-16T15:53:19.214199+0000","last_became_peered":"2024-04-16T15:53:19.214199+0000","last_unstale":"2024-04-16T15:53:20.277504+0000","last_undegraded":"2024-04-16T15:53:20.277504+0000","last_fullsized":"2024-04-16T15:53:20.277504+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:38:12.802270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195587+0000","last_change":"2024-04-16T15:53:19.223834+0000","last_active":"2024-04-16T15:53:20.195587+0000","last_peered":"2024-04-16T15:53:20.195587+0000","last_clean":"2024-04-16T15:53:20.195587+0000","last_became_active":"2024-04-16T15:53:19.223467+0000","last_became_peered":"2024-04-16T15:53:19.223467+0000","last_unstale":"2024-04-16T15:53:20.195587+0000","last_undegraded":"2024-04-16T15:53:20.195587+0000","last_fullsized":"2024-04-16T15:53:20.195587+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:20:36.722580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277601+0000","last_change":"2024-04-16T15:53:19.215061+0000","last_active":"2024-04-16T15:53:20.277601+0000","last_peered":"2024-04-16T15:53:20.277601+0000","last_clean":"2024-04-16T15:53:20.277601+0000","last_became_active":"2024-04-16T15:53:19.214786+0000","last_became_peered":"2024-04-16T15:53:19.214786+0000","last_unstale":"2024-04-16T15:53:20.277601+0000","last_undegraded":"2024-04-16T15:53:20.277601+0000","last_fullsized":"2024-04-16T15:53:20.277601+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:24:52.885269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.195941+0000","last_change":"2024-04-16T15:53:18.195941+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.195941+0000","last_undegraded":"2024-04-16T15:53:18.195941+0000","last_fullsized":"2024-04-16T15:53:18.195941+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197108+0000","last_change":"2024-04-16T15:53:19.218009+0000","last_active":"2024-04-16T15:53:20.197108+0000","last_peered":"2024-04-16T15:53:20.197108+0000","last_clean":"2024-04-16T15:53:20.197108+0000","last_became_active":"2024-04-16T15:53:19.217749+0000","last_became_peered":"2024-04-16T15:53:19.217749+0000","last_unstale":"2024-04-16T15:53:20.197108+0000","last_undegraded":"2024-04-16T15:53:20.197108+0000","last_fullsized":"2024-04-16T15:53:20.197108+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:38:12.802270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196284+0000","last_change":"2024-04-16T15:53:19.215554+0000","last_active":"2024-04-16T15:53:20.196284+0000","last_peered":"2024-04-16T15:53:20.196284+0000","last_clean":"2024-04-16T15:53:20.196284+0000","last_became_active":"2024-04-16T15:53:19.215243+0000","last_became_peered":"2024-04-16T15:53:19.215243+0000","last_unstale":"2024-04-16T15:53:20.196284+0000","last_undegraded":"2024-04-16T15:53:20.196284+0000","last_fullsized":"2024-04-16T15:53:20.196284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:24:52.885269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.202957+0000","last_change":"2024-04-16T15:53:18.202957+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.202957+0000","last_undegraded":"2024-04-16T15:53:18.202957+0000","last_fullsized":"2024-04-16T15:53:18.202957+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196294+0000","last_change":"2024-04-16T15:53:19.212569+0000","last_active":"2024-04-16T15:53:20.196294+0000","last_peered":"2024-04-16T15:53:20.196294+0000","last_clean":"2024-04-16T15:53:20.196294+0000","last_became_active":"2024-04-16T15:53:19.212198+0000","last_became_peered":"2024-04-16T15:53:19.212198+0000","last_unstale":"2024-04-16T15:53:20.196294+0000","last_undegraded":"2024-04-16T15:53:20.196294+0000","last_fullsized":"2024-04-16T15:53:20.196294+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:27:57.263921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463687+0000","last_change":"2024-04-16T15:53:19.212160+0000","last_active":"2024-04-16T15:53:20.463687+0000","last_peered":"2024-04-16T15:53:20.463687+0000","last_clean":"2024-04-16T15:53:20.463687+0000","last_became_active":"2024-04-16T15:53:19.211902+0000","last_became_peered":"2024-04-16T15:53:19.211902+0000","last_unstale":"2024-04-16T15:53:20.463687+0000","last_undegraded":"2024-04-16T15:53:20.463687+0000","last_fullsized":"2024-04-16T15:53:20.463687+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:14:20.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-16T15:53:18.215810+0000","last_change":"2024-04-16T15:53:18.210743+0000","last_active":"2024-04-16T15:53:18.215810+0000","last_peered":"2024-04-16T15:53:18.215810+0000","last_clean":"2024-04-16T15:53:18.215810+0000","last_became_active":"2024-04-16T15:53:18.210466+0000","last_became_peered":"2024-04-16T15:53:18.210466+0000","last_unstale":"2024-04-16T15:53:18.215810+0000","last_undegraded":"2024-04-16T15:53:18.215810+0000","last_fullsized":"2024-04-16T15:53:18.215810+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:28:44.787593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.201904+0000","last_change":"2024-04-16T15:53:18.201904+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.201904+0000","last_undegraded":"2024-04-16T15:53:18.201904+0000","last_fullsized":"2024-04-16T15:53:18.201904+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463629+0000","last_change":"2024-04-16T15:53:18.213622+0000","last_active":"2024-04-16T15:53:20.463629+0000","last_peered":"2024-04-16T15:53:20.463629+0000","last_clean":"2024-04-16T15:53:20.463629+0000","last_became_active":"2024-04-16T15:53:18.213368+0000","last_became_peered":"2024-04-16T15:53:18.213368+0000","last_unstale":"2024-04-16T15:53:20.463629+0000","last_undegraded":"2024-04-16T15:53:20.463629+0000","last_fullsized":"2024-04-16T15:53:20.463629+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:31:41.162544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196775+0000","last_change":"2024-04-16T15:53:19.217908+0000","last_active":"2024-04-16T15:53:20.196775+0000","last_peered":"2024-04-16T15:53:20.196775+0000","last_clean":"2024-04-16T15:53:20.196775+0000","last_became_active":"2024-04-16T15:53:19.217659+0000","last_became_peered":"2024-04-16T15:53:19.217659+0000","last_unstale":"2024-04-16T15:53:20.196775+0000","last_undegraded":"2024-04-16T15:53:20.196775+0000","last_fullsized":"2024-04-16T15:53:20.196775+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:18:05.482765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195229+0000","last_change":"2024-04-16T15:53:18.206967+0000","last_active":"2024-04-16T15:53:20.195229+0000","last_peered":"2024-04-16T15:53:20.195229+0000","last_clean":"2024-04-16T15:53:20.195229+0000","last_became_active":"2024-04-16T15:53:18.206684+0000","last_became_peered":"2024-04-16T15:53:18.206684+0000","last_unstale":"2024-04-16T15:53:20.195229+0000","last_undegraded":"2024-04-16T15:53:20.195229+0000","last_fullsized":"2024-04-16T15:53:20.195229+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:14:19.341087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277619+0000","last_change":"2024-04-16T15:53:19.214612+0000","last_active":"2024-04-16T15:53:20.277619+0000","last_peered":"2024-04-16T15:53:20.277619+0000","last_clean":"2024-04-16T15:53:20.277619+0000","last_became_active":"2024-04-16T15:53:19.214331+0000","last_became_peered":"2024-04-16T15:53:19.214331+0000","last_unstale":"2024-04-16T15:53:20.277619+0000","last_undegraded":"2024-04-16T15:53:20.277619+0000","last_fullsized":"2024-04-16T15:53:20.277619+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:27:57.263921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-16T15:53:18.214654+0000","last_change":"2024-04-16T15:53:18.210644+0000","last_active":"2024-04-16T15:53:18.214654+0000","last_peered":"2024-04-16T15:53:18.214654+0000","last_clean":"2024-04-16T15:53:18.214654+0000","last_became_active":"2024-04-16T15:53:18.210390+0000","last_became_peered":"2024-04-16T15:53:18.210390+0000","last_unstale":"2024-04-16T15:53:18.214654+0000","last_undegraded":"2024-04-16T15:53:18.214654+0000","last_fullsized":"2024-04-16T15:53:18.214654+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:22:20.614026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196471+0000","last_change":"2024-04-16T15:53:19.218628+0000","last_active":"2024-04-16T15:53:20.196471+0000","last_peered":"2024-04-16T15:53:20.196471+0000","last_clean":"2024-04-16T15:53:20.196471+0000","last_became_active":"2024-04-16T15:53:19.218185+0000","last_became_peered":"2024-04-16T15:53:19.218185+0000","last_unstale":"2024-04-16T15:53:20.196471+0000","last_undegraded":"2024-04-16T15:53:20.196471+0000","last_fullsized":"2024-04-16T15:53:20.196471+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:20:34.974674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197176+0000","last_change":"2024-04-16T15:53:18.210540+0000","last_active":"2024-04-16T15:53:20.197176+0000","last_peered":"2024-04-16T15:53:20.197176+0000","last_clean":"2024-04-16T15:53:20.197176+0000","last_became_active":"2024-04-16T15:53:18.210271+0000","last_became_peered":"2024-04-16T15:53:18.210271+0000","last_unstale":"2024-04-16T15:53:20.197176+0000","last_undegraded":"2024-04-16T15:53:20.197176+0000","last_fullsized":"2024-04-16T15:53:20.197176+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:08:37.253061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.195387+0000","last_change":"2024-04-16T15:53:18.195387+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.195387+0000","last_undegraded":"2024-04-16T15:53:18.195387+0000","last_fullsized":"2024-04-16T15:53:18.195387+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196830+0000","last_change":"2024-04-16T15:53:18.210491+0000","last_active":"2024-04-16T15:53:20.196830+0000","last_peered":"2024-04-16T15:53:20.196830+0000","last_clean":"2024-04-16T15:53:20.196830+0000","last_became_active":"2024-04-16T15:53:18.210234+0000","last_became_peered":"2024-04-16T15:53:18.210234+0000","last_unstale":"2024-04-16T15:53:20.196830+0000","last_undegraded":"2024-04-16T15:53:20.196830+0000","last_fullsized":"2024-04-16T15:53:20.196830+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:28:44.787593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196717+0000","last_change":"2024-04-16T15:53:19.210713+0000","last_active":"2024-04-16T15:53:20.196717+0000","last_peered":"2024-04-16T15:53:20.196717+0000","last_clean":"2024-04-16T15:53:20.196717+0000","last_became_active":"2024-04-16T15:53:19.210425+0000","last_became_peered":"2024-04-16T15:53:19.210425+0000","last_unstale":"2024-04-16T15:53:20.196717+0000","last_undegraded":"2024-04-16T15:53:20.196717+0000","last_fullsized":"2024-04-16T15:53:20.196717+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:42:06.870549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.194850+0000","last_change":"2024-04-16T15:53:18.210535+0000","last_active":"2024-04-16T15:53:20.194850+0000","last_peered":"2024-04-16T15:53:20.194850+0000","last_clean":"2024-04-16T15:53:20.194850+0000","last_became_active":"2024-04-16T15:53:18.210282+0000","last_became_peered":"2024-04-16T15:53:18.210282+0000","last_unstale":"2024-04-16T15:53:20.194850+0000","last_undegraded":"2024-04-16T15:53:20.194850+0000","last_fullsized":"2024-04-16T15:53:20.194850+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:09:56.208391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277154+0000","last_change":"2024-04-16T15:53:19.212496+0000","last_active":"2024-04-16T15:53:20.277154+0000","last_peered":"2024-04-16T15:53:20.277154+0000","last_clean":"2024-04-16T15:53:20.277154+0000","last_became_active":"2024-04-16T15:53:19.212239+0000","last_became_peered":"2024-04-16T15:53:19.212239+0000","last_unstale":"2024-04-16T15:53:20.277154+0000","last_undegraded":"2024-04-16T15:53:20.277154+0000","last_fullsized":"2024-04-16T15:53:20.277154+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:18:05.482765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195756+0000","last_change":"2024-04-16T15:53:18.208530+0000","last_active":"2024-04-16T15:53:20.195756+0000","last_peered":"2024-04-16T15:53:20.195756+0000","last_clean":"2024-04-16T15:53:20.195756+0000","last_became_active":"2024-04-16T15:53:18.208225+0000","last_became_peered":"2024-04-16T15:53:18.208225+0000","last_unstale":"2024-04-16T15:53:20.195756+0000","last_undegraded":"2024-04-16T15:53:20.195756+0000","last_fullsized":"2024-04-16T15:53:20.195756+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:01:02.783464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.195456+0000","last_change":"2024-04-16T15:53:18.195456+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.195456+0000","last_undegraded":"2024-04-16T15:53:18.195456+0000","last_fullsized":"2024-04-16T15:53:18.195456+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195485+0000","last_change":"2024-04-16T15:53:18.209410+0000","last_active":"2024-04-16T15:53:20.195485+0000","last_peered":"2024-04-16T15:53:20.195485+0000","last_clean":"2024-04-16T15:53:20.195485+0000","last_became_active":"2024-04-16T15:53:18.209128+0000","last_became_peered":"2024-04-16T15:53:18.209128+0000","last_unstale":"2024-04-16T15:53:20.195485+0000","last_undegraded":"2024-04-16T15:53:20.195485+0000","last_fullsized":"2024-04-16T15:53:20.195485+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:18:04.480511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195481+0000","last_change":"2024-04-16T15:53:19.218196+0000","last_active":"2024-04-16T15:53:20.195481+0000","last_peered":"2024-04-16T15:53:20.195481+0000","last_clean":"2024-04-16T15:53:20.195481+0000","last_became_active":"2024-04-16T15:53:19.217938+0000","last_became_peered":"2024-04-16T15:53:19.217938+0000","last_unstale":"2024-04-16T15:53:20.195481+0000","last_undegraded":"2024-04-16T15:53:20.195481+0000","last_fullsized":"2024-04-16T15:53:20.195481+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:15:54.665161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463743+0000","last_change":"2024-04-16T15:53:18.212761+0000","last_active":"2024-04-16T15:53:20.463743+0000","last_peered":"2024-04-16T15:53:20.463743+0000","last_clean":"2024-04-16T15:53:20.463743+0000","last_became_active":"2024-04-16T15:53:18.212427+0000","last_became_peered":"2024-04-16T15:53:18.212427+0000","last_unstale":"2024-04-16T15:53:20.463743+0000","last_undegraded":"2024-04-16T15:53:20.463743+0000","last_fullsized":"2024-04-16T15:53:20.463743+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:46:28.763927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195317+0000","last_change":"2024-04-16T15:53:19.223760+0000","last_active":"2024-04-16T15:53:20.195317+0000","last_peered":"2024-04-16T15:53:20.195317+0000","last_clean":"2024-04-16T15:53:20.195317+0000","last_became_active":"2024-04-16T15:53:19.223461+0000","last_became_peered":"2024-04-16T15:53:19.223461+0000","last_unstale":"2024-04-16T15:53:20.195317+0000","last_undegraded":"2024-04-16T15:53:20.195317+0000","last_fullsized":"2024-04-16T15:53:20.195317+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:19:47.160288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-16T15:53:18.211370+0000","last_change":"2024-04-16T15:53:18.208880+0000","last_active":"2024-04-16T15:53:18.211370+0000","last_peered":"2024-04-16T15:53:18.211370+0000","last_clean":"2024-04-16T15:53:18.211370+0000","last_became_active":"2024-04-16T15:53:18.208317+0000","last_became_peered":"2024-04-16T15:53:18.208317+0000","last_unstale":"2024-04-16T15:53:18.211370+0000","last_undegraded":"2024-04-16T15:53:18.211370+0000","last_fullsized":"2024-04-16T15:53:18.211370+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:34:16.256486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.196587+0000","last_change":"2024-04-16T15:53:18.196587+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.196587+0000","last_undegraded":"2024-04-16T15:53:18.196587+0000","last_fullsized":"2024-04-16T15:53:18.196587+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195193+0000","last_change":"2024-04-16T15:53:18.206853+0000","last_active":"2024-04-16T15:53:20.195193+0000","last_peered":"2024-04-16T15:53:20.195193+0000","last_clean":"2024-04-16T15:53:20.195193+0000","last_became_active":"2024-04-16T15:53:18.206613+0000","last_became_peered":"2024-04-16T15:53:18.206613+0000","last_unstale":"2024-04-16T15:53:20.195193+0000","last_undegraded":"2024-04-16T15:53:20.195193+0000","last_fullsized":"2024-04-16T15:53:20.195193+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:54:24.964622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277187+0000","last_change":"2024-04-16T15:53:19.222111+0000","last_active":"2024-04-16T15:53:20.277187+0000","last_peered":"2024-04-16T15:53:20.277187+0000","last_clean":"2024-04-16T15:53:20.277187+0000","last_became_active":"2024-04-16T15:53:19.221536+0000","last_became_peered":"2024-04-16T15:53:19.221536+0000","last_unstale":"2024-04-16T15:53:20.277187+0000","last_undegraded":"2024-04-16T15:53:20.277187+0000","last_fullsized":"2024-04-16T15:53:20.277187+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:01:01.640923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197189+0000","last_change":"2024-04-16T15:53:18.207932+0000","last_active":"2024-04-16T15:53:20.197189+0000","last_peered":"2024-04-16T15:53:20.197189+0000","last_clean":"2024-04-16T15:53:20.197189+0000","last_became_active":"2024-04-16T15:53:18.207445+0000","last_became_peered":"2024-04-16T15:53:18.207445+0000","last_unstale":"2024-04-16T15:53:20.197189+0000","last_undegraded":"2024-04-16T15:53:20.197189+0000","last_fullsized":"2024-04-16T15:53:20.197189+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:26:09.897432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195254+0000","last_change":"2024-04-16T15:53:19.215660+0000","last_active":"2024-04-16T15:53:20.195254+0000","last_peered":"2024-04-16T15:53:20.195254+0000","last_clean":"2024-04-16T15:53:20.195254+0000","last_became_active":"2024-04-16T15:53:19.215415+0000","last_became_peered":"2024-04-16T15:53:19.215415+0000","last_unstale":"2024-04-16T15:53:20.195254+0000","last_undegraded":"2024-04-16T15:53:20.195254+0000","last_fullsized":"2024-04-16T15:53:20.195254+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:26:17.244174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277262+0000","last_change":"2024-04-16T15:53:18.207023+0000","last_active":"2024-04-16T15:53:20.277262+0000","last_peered":"2024-04-16T15:53:20.277262+0000","last_clean":"2024-04-16T15:53:20.277262+0000","last_became_active":"2024-04-16T15:53:18.206764+0000","last_became_peered":"2024-04-16T15:53:18.206764+0000","last_unstale":"2024-04-16T15:53:20.277262+0000","last_undegraded":"2024-04-16T15:53:20.277262+0000","last_fullsized":"2024-04-16T15:53:20.277262+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:49:24.686045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196471+0000","last_change":"2024-04-16T15:53:19.218507+0000","last_active":"2024-04-16T15:53:20.196471+0000","last_peered":"2024-04-16T15:53:20.196471+0000","last_clean":"2024-04-16T15:53:20.196471+0000","last_became_active":"2024-04-16T15:53:19.218250+0000","last_became_peered":"2024-04-16T15:53:19.218250+0000","last_unstale":"2024-04-16T15:53:20.196471+0000","last_undegraded":"2024-04-16T15:53:20.196471+0000","last_fullsized":"2024-04-16T15:53:20.196471+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:12:25.656341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.194904+0000","last_change":"2024-04-16T15:53:18.207895+0000","last_active":"2024-04-16T15:53:20.194904+0000","last_peered":"2024-04-16T15:53:20.194904+0000","last_clean":"2024-04-16T15:53:20.194904+0000","last_became_active":"2024-04-16T15:53:18.207633+0000","last_became_peered":"2024-04-16T15:53:18.207633+0000","last_unstale":"2024-04-16T15:53:20.194904+0000","last_undegraded":"2024-04-16T15:53:20.194904+0000","last_fullsized":"2024-04-16T15:53:20.194904+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:42:05.868295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.201914+0000","last_change":"2024-04-16T15:53:18.201914+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.201914+0000","last_undegraded":"2024-04-16T15:53:18.201914+0000","last_fullsized":"2024-04-16T15:53:18.201914+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.194904+0000","last_change":"2024-04-16T15:53:18.207615+0000","last_active":"2024-04-16T15:53:20.194904+0000","last_peered":"2024-04-16T15:53:20.194904+0000","last_clean":"2024-04-16T15:53:20.194904+0000","last_became_active":"2024-04-16T15:53:18.207332+0000","last_became_peered":"2024-04-16T15:53:18.207332+0000","last_unstale":"2024-04-16T15:53:20.194904+0000","last_undegraded":"2024-04-16T15:53:20.194904+0000","last_fullsized":"2024-04-16T15:53:20.194904+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:01:00.638669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196700+0000","last_change":"2024-04-16T15:53:19.202791+0000","last_active":"2024-04-16T15:53:20.196700+0000","last_peered":"2024-04-16T15:53:20.196700+0000","last_clean":"2024-04-16T15:53:20.196700+0000","last_became_active":"2024-04-16T15:53:19.202414+0000","last_became_peered":"2024-04-16T15:53:19.202414+0000","last_unstale":"2024-04-16T15:53:20.196700+0000","last_undegraded":"2024-04-16T15:53:20.196700+0000","last_fullsized":"2024-04-16T15:53:20.196700+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:09:57.210644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277536+0000","last_change":"2024-04-16T15:53:18.211975+0000","last_active":"2024-04-16T15:53:20.277536+0000","last_peered":"2024-04-16T15:53:20.277536+0000","last_clean":"2024-04-16T15:53:20.277536+0000","last_became_active":"2024-04-16T15:53:18.211709+0000","last_became_peered":"2024-04-16T15:53:18.211709+0000","last_unstale":"2024-04-16T15:53:20.277536+0000","last_undegraded":"2024-04-16T15:53:20.277536+0000","last_fullsized":"2024-04-16T15:53:20.277536+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:03:51.897303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.196955+0000","last_change":"2024-04-16T15:53:18.196955+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.196955+0000","last_undegraded":"2024-04-16T15:53:18.196955+0000","last_fullsized":"2024-04-16T15:53:18.196955+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196884+0000","last_change":"2024-04-16T15:53:18.208018+0000","last_active":"2024-04-16T15:53:20.196884+0000","last_peered":"2024-04-16T15:53:20.196884+0000","last_clean":"2024-04-16T15:53:20.196884+0000","last_became_active":"2024-04-16T15:53:18.207596+0000","last_became_peered":"2024-04-16T15:53:18.207596+0000","last_unstale":"2024-04-16T15:53:20.196884+0000","last_undegraded":"2024-04-16T15:53:20.196884+0000","last_fullsized":"2024-04-16T15:53:20.196884+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:03:51.897303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277265+0000","last_change":"2024-04-16T15:53:19.215051+0000","last_active":"2024-04-16T15:53:20.277265+0000","last_peered":"2024-04-16T15:53:20.277265+0000","last_clean":"2024-04-16T15:53:20.277265+0000","last_became_active":"2024-04-16T15:53:19.214161+0000","last_became_peered":"2024-04-16T15:53:19.214161+0000","last_unstale":"2024-04-16T15:53:20.277265+0000","last_undegraded":"2024-04-16T15:53:20.277265+0000","last_fullsized":"2024-04-16T15:53:20.277265+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:21:33.438988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196677+0000","last_change":"2024-04-16T15:53:18.210890+0000","last_active":"2024-04-16T15:53:20.196677+0000","last_peered":"2024-04-16T15:53:20.196677+0000","last_clean":"2024-04-16T15:53:20.196677+0000","last_became_active":"2024-04-16T15:53:18.210498+0000","last_became_peered":"2024-04-16T15:53:18.210498+0000","last_unstale":"2024-04-16T15:53:20.196677+0000","last_undegraded":"2024-04-16T15:53:20.196677+0000","last_fullsized":"2024-04-16T15:53:20.196677+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:31:41.162544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.202993+0000","last_change":"2024-04-16T15:53:18.202993+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.202993+0000","last_undegraded":"2024-04-16T15:53:18.202993+0000","last_fullsized":"2024-04-16T15:53:18.202993+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196432+0000","last_change":"2024-04-16T15:53:18.212722+0000","last_active":"2024-04-16T15:53:20.196432+0000","last_peered":"2024-04-16T15:53:20.196432+0000","last_clean":"2024-04-16T15:53:20.196432+0000","last_became_active":"2024-04-16T15:53:18.212434+0000","last_became_peered":"2024-04-16T15:53:18.212434+0000","last_unstale":"2024-04-16T15:53:20.196432+0000","last_undegraded":"2024-04-16T15:53:20.196432+0000","last_fullsized":"2024-04-16T15:53:20.196432+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:46:28.763927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.202538+0000","last_change":"2024-04-16T15:53:18.202538+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.202538+0000","last_undegraded":"2024-04-16T15:53:18.202538+0000","last_fullsized":"2024-04-16T15:53:18.202538+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464047+0000","last_change":"2024-04-16T15:53:18.210794+0000","last_active":"2024-04-16T15:53:20.464047+0000","last_peered":"2024-04-16T15:53:20.464047+0000","last_clean":"2024-04-16T15:53:20.464047+0000","last_became_active":"2024-04-16T15:53:18.210087+0000","last_became_peered":"2024-04-16T15:53:18.210087+0000","last_unstale":"2024-04-16T15:53:20.464047+0000","last_undegraded":"2024-04-16T15:53:20.464047+0000","last_fullsized":"2024-04-16T15:53:20.464047+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:03:51.897303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.202082+0000","last_change":"2024-04-16T15:53:18.202082+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.202082+0000","last_undegraded":"2024-04-16T15:53:18.202082+0000","last_fullsized":"2024-04-16T15:53:18.202082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-16T15:53:18.215765+0000","last_change":"2024-04-16T15:53:18.210087+0000","last_active":"2024-04-16T15:53:18.215765+0000","last_peered":"2024-04-16T15:53:18.215765+0000","last_clean":"2024-04-16T15:53:18.215765+0000","last_became_active":"2024-04-16T15:53:18.209539+0000","last_became_peered":"2024-04-16T15:53:18.209539+0000","last_unstale":"2024-04-16T15:53:18.215765+0000","last_undegraded":"2024-04-16T15:53:18.215765+0000","last_fullsized":"2024-04-16T15:53:18.215765+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:01:02.783464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.201503+0000","last_change":"2024-04-16T15:53:18.201503+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.201503+0000","last_undegraded":"2024-04-16T15:53:18.201503+0000","last_fullsized":"2024-04-16T15:53:18.201503+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195767+0000","last_change":"2024-04-16T15:53:18.204767+0000","last_active":"2024-04-16T15:53:20.195767+0000","last_peered":"2024-04-16T15:53:20.195767+0000","last_clean":"2024-04-16T15:53:20.195767+0000","last_became_active":"2024-04-16T15:53:18.204142+0000","last_became_peered":"2024-04-16T15:53:18.204142+0000","last_unstale":"2024-04-16T15:53:20.195767+0000","last_undegraded":"2024-04-16T15:53:20.195767+0000","last_fullsized":"2024-04-16T15:53:20.195767+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:27:13.923490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197141+0000","last_change":"2024-04-16T15:53:19.215530+0000","last_active":"2024-04-16T15:53:20.197141+0000","last_peered":"2024-04-16T15:53:20.197141+0000","last_clean":"2024-04-16T15:53:20.197141+0000","last_became_active":"2024-04-16T15:53:19.215227+0000","last_became_peered":"2024-04-16T15:53:19.215227+0000","last_unstale":"2024-04-16T15:53:20.197141+0000","last_undegraded":"2024-04-16T15:53:20.197141+0000","last_fullsized":"2024-04-16T15:53:20.197141+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:09:12.444137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-16T15:53:18.211359+0000","last_change":"2024-04-16T15:53:18.209377+0000","last_active":"2024-04-16T15:53:18.211359+0000","last_peered":"2024-04-16T15:53:18.211359+0000","last_clean":"2024-04-16T15:53:18.211359+0000","last_became_active":"2024-04-16T15:53:18.209092+0000","last_became_peered":"2024-04-16T15:53:18.209092+0000","last_unstale":"2024-04-16T15:53:18.211359+0000","last_undegraded":"2024-04-16T15:53:18.211359+0000","last_fullsized":"2024-04-16T15:53:18.211359+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:13:10.994891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.203401+0000","last_change":"2024-04-16T15:53:18.203401+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.203401+0000","last_undegraded":"2024-04-16T15:53:18.203401+0000","last_fullsized":"2024-04-16T15:53:18.203401+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277554+0000","last_change":"2024-04-16T15:53:18.204255+0000","last_active":"2024-04-16T15:53:20.277554+0000","last_peered":"2024-04-16T15:53:20.277554+0000","last_clean":"2024-04-16T15:53:20.277554+0000","last_became_active":"2024-04-16T15:53:18.203960+0000","last_became_peered":"2024-04-16T15:53:18.203960+0000","last_unstale":"2024-04-16T15:53:20.277554+0000","last_undegraded":"2024-04-16T15:53:20.277554+0000","last_fullsized":"2024-04-16T15:53:20.277554+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:46:28.763927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.195681+0000","last_change":"2024-04-16T15:53:18.195681+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.195681+0000","last_undegraded":"2024-04-16T15:53:18.195681+0000","last_fullsized":"2024-04-16T15:53:18.195681+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463839+0000","last_change":"2024-04-16T15:53:18.208864+0000","last_active":"2024-04-16T15:53:20.463839+0000","last_peered":"2024-04-16T15:53:20.463839+0000","last_clean":"2024-04-16T15:53:20.463839+0000","last_became_active":"2024-04-16T15:53:18.208576+0000","last_became_peered":"2024-04-16T15:53:18.208576+0000","last_unstale":"2024-04-16T15:53:20.463839+0000","last_undegraded":"2024-04-16T15:53:20.463839+0000","last_fullsized":"2024-04-16T15:53:20.463839+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:49:24.686045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463570+0000","last_change":"2024-04-16T15:53:19.220923+0000","last_active":"2024-04-16T15:53:20.463570+0000","last_peered":"2024-04-16T15:53:20.463570+0000","last_clean":"2024-04-16T15:53:20.463570+0000","last_became_active":"2024-04-16T15:53:19.218050+0000","last_became_peered":"2024-04-16T15:53:19.218050+0000","last_unstale":"2024-04-16T15:53:20.463570+0000","last_undegraded":"2024-04-16T15:53:20.463570+0000","last_fullsized":"2024-04-16T15:53:20.463570+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:13:11.997144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277301+0000","last_change":"2024-04-16T15:53:18.211328+0000","last_active":"2024-04-16T15:53:20.277301+0000","last_peered":"2024-04-16T15:53:20.277301+0000","last_clean":"2024-04-16T15:53:20.277301+0000","last_became_active":"2024-04-16T15:53:18.211063+0000","last_became_peered":"2024-04-16T15:53:18.211063+0000","last_unstale":"2024-04-16T15:53:20.277301+0000","last_undegraded":"2024-04-16T15:53:20.277301+0000","last_fullsized":"2024-04-16T15:53:20.277301+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:27:13.923490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-16T15:53:18.203964+0000","last_change":"2024-04-16T15:53:18.203964+0000","last_active":"2024-04-16T15:53:18.183405+0000","last_peered":"2024-04-16T15:53:18.183405+0000","last_clean":"2024-04-16T15:53:18.183405+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:53:18.203964+0000","last_undegraded":"2024-04-16T15:53:18.203964+0000","last_fullsized":"2024-04-16T15:53:18.203964+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464213+0000","last_change":"2024-04-16T15:53:18.204297+0000","last_active":"2024-04-16T15:53:20.464213+0000","last_peered":"2024-04-16T15:53:20.464213+0000","last_clean":"2024-04-16T15:53:20.464213+0000","last_became_active":"2024-04-16T15:53:18.204054+0000","last_became_peered":"2024-04-16T15:53:18.204054+0000","last_unstale":"2024-04-16T15:53:20.464213+0000","last_undegraded":"2024-04-16T15:53:20.464213+0000","last_fullsized":"2024-04-16T15:53:20.464213+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:27:13.923490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463987+0000","last_change":"2024-04-16T15:53:19.211221+0000","last_active":"2024-04-16T15:53:20.463987+0000","last_peered":"2024-04-16T15:53:20.463987+0000","last_clean":"2024-04-16T15:53:20.463987+0000","last_became_active":"2024-04-16T15:53:19.210969+0000","last_became_peered":"2024-04-16T15:53:19.210969+0000","last_unstale":"2024-04-16T15:53:20.463987+0000","last_undegraded":"2024-04-16T15:53:20.463987+0000","last_fullsized":"2024-04-16T15:53:20.463987+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:09:57.210644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277362+0000","last_change":"2024-04-16T15:53:18.204310+0000","last_active":"2024-04-16T15:53:20.277362+0000","last_peered":"2024-04-16T15:53:20.277362+0000","last_clean":"2024-04-16T15:53:20.277362+0000","last_became_active":"2024-04-16T15:53:18.204031+0000","last_became_peered":"2024-04-16T15:53:18.204031+0000","last_unstale":"2024-04-16T15:53:20.277362+0000","last_undegraded":"2024-04-16T15:53:20.277362+0000","last_fullsized":"2024-04-16T15:53:20.277362+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:20:16.994654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.194938+0000","last_change":"2024-04-16T15:53:19.218748+0000","last_active":"2024-04-16T15:53:20.194938+0000","last_peered":"2024-04-16T15:53:20.194938+0000","last_clean":"2024-04-16T15:53:20.194938+0000","last_became_active":"2024-04-16T15:53:19.218474+0000","last_became_peered":"2024-04-16T15:53:19.218474+0000","last_unstale":"2024-04-16T15:53:20.194938+0000","last_undegraded":"2024-04-16T15:53:20.194938+0000","last_fullsized":"2024-04-16T15:53:20.194938+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:47:53.262802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195914+0000","last_change":"2024-04-16T15:53:18.204483+0000","last_active":"2024-04-16T15:53:20.195914+0000","last_peered":"2024-04-16T15:53:20.195914+0000","last_clean":"2024-04-16T15:53:20.195914+0000","last_became_active":"2024-04-16T15:53:18.203790+0000","last_became_peered":"2024-04-16T15:53:18.203790+0000","last_unstale":"2024-04-16T15:53:20.195914+0000","last_undegraded":"2024-04-16T15:53:20.195914+0000","last_fullsized":"2024-04-16T15:53:20.195914+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:49:24.686045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197045+0000","last_change":"2024-04-16T15:53:19.218646+0000","last_active":"2024-04-16T15:53:20.197045+0000","last_peered":"2024-04-16T15:53:20.197045+0000","last_clean":"2024-04-16T15:53:20.197045+0000","last_became_active":"2024-04-16T15:53:19.218379+0000","last_became_peered":"2024-04-16T15:53:19.218379+0000","last_unstale":"2024-04-16T15:53:20.197045+0000","last_undegraded":"2024-04-16T15:53:20.197045+0000","last_fullsized":"2024-04-16T15:53:20.197045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:21:33.438988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.194988+0000","last_change":"2024-04-16T15:53:18.211846+0000","last_active":"2024-04-16T15:53:20.194988+0000","last_peered":"2024-04-16T15:53:20.194988+0000","last_clean":"2024-04-16T15:53:20.194988+0000","last_became_active":"2024-04-16T15:53:18.211604+0000","last_became_peered":"2024-04-16T15:53:18.211604+0000","last_unstale":"2024-04-16T15:53:20.194988+0000","last_undegraded":"2024-04-16T15:53:20.194988+0000","last_fullsized":"2024-04-16T15:53:20.194988+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:09:08.367141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196459+0000","last_change":"2024-04-16T15:53:19.213036+0000","last_active":"2024-04-16T15:53:20.196459+0000","last_peered":"2024-04-16T15:53:20.196459+0000","last_clean":"2024-04-16T15:53:20.196459+0000","last_became_active":"2024-04-16T15:53:19.212758+0000","last_became_peered":"2024-04-16T15:53:19.212758+0000","last_unstale":"2024-04-16T15:53:20.196459+0000","last_undegraded":"2024-04-16T15:53:20.196459+0000","last_fullsized":"2024-04-16T15:53:20.196459+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:32:14.472011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-16T15:53:18.218640+0000","last_change":"2024-04-16T15:53:18.213907+0000","last_active":"2024-04-16T15:53:18.218640+0000","last_peered":"2024-04-16T15:53:18.218640+0000","last_clean":"2024-04-16T15:53:18.218640+0000","last_became_active":"2024-04-16T15:53:18.213572+0000","last_became_peered":"2024-04-16T15:53:18.213572+0000","last_unstale":"2024-04-16T15:53:18.218640+0000","last_undegraded":"2024-04-16T15:53:18.218640+0000","last_fullsized":"2024-04-16T15:53:18.218640+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:26:09.897432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":196,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196856+0000","last_change":"2024-04-16T15:52:04.356095+0000","last_active":"2024-04-16T15:53:20.196856+0000","last_peered":"2024-04-16T15:53:20.196856+0000","last_clean":"2024-04-16T15:53:20.196856+0000","last_became_active":"2024-04-16T15:52:04.355126+0000","last_became_peered":"2024-04-16T15:52:04.355126+0000","last_unstale":"2024-04-16T15:53:20.196856+0000","last_undegraded":"2024-04-16T15:53:20.196856+0000","last_fullsized":"2024-04-16T15:53:20.196856+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:03.285037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:03.285037+0000","last_clean_scrub_stamp":"2024-04-16T15:52:03.285037+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:19.005024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1738,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":983040,"data_stored":742389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":348160,"data_stored":132589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":152035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":401408,"data_stored":153565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":401408,"data_stored":153565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":978944,"data_stored":742299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T15:53:27.139 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T15:53:27.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.258+0000 7f51bd3ba640 1 Processor -- start 2024-04-16T15:53:27.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.258+0000 7f51bd3ba640 1 -- start start 2024-04-16T15:53:27.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.259+0000 7f51bd3ba640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f51b80d5580 0x7f51b8169630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:27.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.259+0000 7f51bd3ba640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51b80d2ce0 con 0x7f51b815eb80 2024-04-16T15:53:27.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.259+0000 7f51bd3ba640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51b80d2fc0 con 0x7f51b80d21a0 2024-04-16T15:53:27.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.259+0000 7f51bd3ba640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f51b80cfea0 con 0x7f51b80d5580 2024-04-16T15:53:27.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.259+0000 7f51b77fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f51b80d5580 0x7f51b8169630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:27.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.259+0000 7f51b6ffd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f51b815eb80 0x7f51b80d1a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:41488/0 (socket says 172.21.15.132:41488) 2024-04-16T15:53:27.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.259+0000 7f51b77fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f51b80d5580 0x7f51b8169630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41888/0 (socket says 172.21.15.132:41888) 2024-04-16T15:53:27.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.259+0000 7f51b6ffd640 1 -- 172.21.15.132:0/895239276 learned_addr learned my addr 172.21.15.132:0/895239276 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:53:27.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.259+0000 7f51b77fe640 1 -- 172.21.15.132:0/895239276 >> v1:172.21.15.179:6789/0 conn(0x7f51b80d21a0 legacy=0x7f51b80d3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:27.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.259+0000 7f51b77fe640 1 -- 172.21.15.132:0/895239276 >> v1:172.21.15.132:6789/0 conn(0x7f51b815eb80 legacy=0x7f51b80d1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:27.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.259+0000 7f51b77fe640 1 -- 172.21.15.132:0/895239276 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51b80d32a0 con 0x7f51b80d5580 2024-04-16T15:53:27.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.259+0000 7f51b67fc640 1 -- 172.21.15.132:0/895239276 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2960741380 0 0) 0x7f51b80d2ce0 con 0x7f51b815eb80 2024-04-16T15:53:27.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.260+0000 7f51b77fe640 1 --2- 172.21.15.132:0/895239276 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51b80d5580 0x7f51b8169630 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f51b0009d90 tx=0x7f51b002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbd3f515e1b27bed server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:27.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.260+0000 7f51b67fc640 1 -- 172.21.15.132:0/895239276 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b0039070 con 0x7f51b80d5580 2024-04-16T15:53:27.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.260+0000 7f51b67fc640 1 -- 172.21.15.132:0/895239276 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51b002cc60 con 0x7f51b80d5580 2024-04-16T15:53:27.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.260+0000 7f51b67fc640 1 -- 172.21.15.132:0/895239276 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b0034660 con 0x7f51b80d5580 2024-04-16T15:53:27.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.261+0000 7f51bd3ba640 1 -- 172.21.15.132:0/895239276 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51b80d5580 msgr2=0x7f51b8169630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:27.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.261+0000 7f51bd3ba640 1 --2- 172.21.15.132:0/895239276 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51b80d5580 0x7f51b8169630 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f51b0009d90 tx=0x7f51b002beb0 comp rx=0 tx=0).stop 2024-04-16T15:53:27.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.261+0000 7f51bd3ba640 1 -- 172.21.15.132:0/895239276 shutdown_connections 2024-04-16T15:53:27.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.261+0000 7f51bd3ba640 1 --2- 172.21.15.132:0/895239276 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51b80d5580 0x7f51b8169630 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:27.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.261+0000 7f51bd3ba640 1 -- 172.21.15.132:0/895239276 >> 172.21.15.132:0/895239276 conn(0x7f51b8067b80 msgr2=0x7f51b8067f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:27.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.261+0000 7f51bd3ba640 1 -- 172.21.15.132:0/895239276 shutdown_connections 2024-04-16T15:53:27.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.261+0000 7f51bd3ba640 1 -- 172.21.15.132:0/895239276 wait complete. 2024-04-16T15:53:27.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.262+0000 7f51bd3ba640 1 Processor -- start 2024-04-16T15:53:27.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.262+0000 7f51bd3ba640 1 -- start start 2024-04-16T15:53:27.265 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.263+0000 7f51bd3ba640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51b80d21a0 0x7f51b80b2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:27.265 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.263+0000 7f51bd3ba640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51b80d5580 0x7f51b81612c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:27.265 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.263+0000 7f51bd3ba640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51b815eb80 0x7f51b8161800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:27.265 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.263+0000 7f51bd3ba640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f51b80b8b60 con 0x7f51b80d5580 2024-04-16T15:53:27.265 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.263+0000 7f51bd3ba640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f51b80b8ce0 con 0x7f51b80d21a0 2024-04-16T15:53:27.265 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.263+0000 7f51bd3ba640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f51b80b8e60 con 0x7f51b815eb80 2024-04-16T15:53:27.265 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.263+0000 7f51ae7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51b80d5580 0x7f51b81612c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:27.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.263+0000 7f51ae7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51b80d5580 0x7f51b81612c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41904/0 (socket says 172.21.15.132:41904) 2024-04-16T15:53:27.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.263+0000 7f51ae7fc640 1 -- 172.21.15.132:0/2254849988 learned_addr learned my addr 172.21.15.132:0/2254849988 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:27.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.263+0000 7f51b6ffd640 1 --2- 172.21.15.132:0/2254849988 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51b80d21a0 0x7f51b80b2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:27.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.263+0000 7f51b77fe640 1 --2- 172.21.15.132:0/2254849988 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51b815eb80 0x7f51b8161800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:27.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.263+0000 7f51ae7fc640 1 -- 172.21.15.132:0/2254849988 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51b815eb80 msgr2=0x7f51b8161800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:27.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.263+0000 7f51ae7fc640 1 --2- 172.21.15.132:0/2254849988 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51b815eb80 0x7f51b8161800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:27.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.263+0000 7f51ae7fc640 1 -- 172.21.15.132:0/2254849988 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51b80d21a0 msgr2=0x7f51b80b2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:27.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.263+0000 7f51ae7fc640 1 --2- 172.21.15.132:0/2254849988 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51b80d21a0 0x7f51b80b2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:27.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.263+0000 7f51ae7fc640 1 -- 172.21.15.132:0/2254849988 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51b814cb70 con 0x7f51b80d5580 2024-04-16T15:53:27.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.263+0000 7f51b77fe640 1 --2- 172.21.15.132:0/2254849988 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51b815eb80 0x7f51b8161800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:53:27.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.263+0000 7f51b6ffd640 1 --2- 172.21.15.132:0/2254849988 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51b80d21a0 0x7f51b80b2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:53:27.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.263+0000 7f51ae7fc640 1 --2- 172.21.15.132:0/2254849988 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51b80d5580 0x7f51b81612c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f51a000c450 tx=0x7f51a000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:27.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.263+0000 7f51affff640 1 -- 172.21.15.132:0/2254849988 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a00052d0 con 0x7f51b80d5580 2024-04-16T15:53:27.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.263+0000 7f51affff640 1 -- 172.21.15.132:0/2254849988 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51a0005470 con 0x7f51b80d5580 2024-04-16T15:53:27.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.263+0000 7f51bd3ba640 1 -- 172.21.15.132:0/2254849988 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51b814e5f0 con 0x7f51b80d5580 2024-04-16T15:53:27.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.263+0000 7f51affff640 1 -- 172.21.15.132:0/2254849988 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a0012870 con 0x7f51b80d5580 2024-04-16T15:53:27.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.264+0000 7f51bd3ba640 1 -- 172.21.15.132:0/2254849988 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51b814ebb0 con 0x7f51b80d5580 2024-04-16T15:53:27.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.264+0000 7f51bd3ba640 1 -- 172.21.15.132:0/2254849988 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51b8075510 con 0x7f51b80d5580 2024-04-16T15:53:27.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.265+0000 7f51affff640 1 -- 172.21.15.132:0/2254849988 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f51a0012a10 con 0x7f51b80d5580 2024-04-16T15:53:27.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.265+0000 7f51affff640 1 --2- 172.21.15.132:0/2254849988 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f519806c8f0 0x7f519806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:27.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.265+0000 7f51affff640 1 -- 172.21.15.132:0/2254849988 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f51a008b750 con 0x7f51b80d5580 2024-04-16T15:53:27.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.266+0000 7f51b6ffd640 1 --2- 172.21.15.132:0/2254849988 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f519806c8f0 0x7f519806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:27.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.266+0000 7f51b6ffd640 1 --2- 172.21.15.132:0/2254849988 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f519806c8f0 0x7f519806edb0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f51a8000f60 tx=0x7f51a8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:27.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.270+0000 7f51affff640 1 -- 172.21.15.132:0/2254849988 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f51a0059b80 con 0x7f51b80d5580 2024-04-16T15:53:27.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.444+0000 7f51bd3ba640 1 -- 172.21.15.132:0/2254849988 --> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f51b80b6e30 con 0x7f519806c8f0 2024-04-16T15:53:27.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.450+0000 7f51affff640 1 -- 172.21.15.132:0/2254849988 <== mgr.4101 v2:172.21.15.132:6832/3896387465 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251949 (secure 0 0 0) 0x7f51b80b6e30 con 0x7f519806c8f0 2024-04-16T15:53:27.451 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:53:27.453 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2024-04-16T15:53:27.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.453+0000 7f51bd3ba640 1 -- 172.21.15.132:0/2254849988 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f519806c8f0 msgr2=0x7f519806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:27.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.453+0000 7f51bd3ba640 1 --2- 172.21.15.132:0/2254849988 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f519806c8f0 0x7f519806edb0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f51a8000f60 tx=0x7f51a8009040 comp rx=0 tx=0).stop 2024-04-16T15:53:27.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.453+0000 7f51bd3ba640 1 -- 172.21.15.132:0/2254849988 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51b80d5580 msgr2=0x7f51b81612c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:27.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.453+0000 7f51bd3ba640 1 --2- 172.21.15.132:0/2254849988 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51b80d5580 0x7f51b81612c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f51a000c450 tx=0x7f51a000c910 comp rx=0 tx=0).stop 2024-04-16T15:53:27.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.453+0000 7f51bd3ba640 1 -- 172.21.15.132:0/2254849988 shutdown_connections 2024-04-16T15:53:27.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.453+0000 7f51bd3ba640 1 --2- 172.21.15.132:0/2254849988 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f519806c8f0 0x7f519806edb0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:27.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.453+0000 7f51bd3ba640 1 --2- 172.21.15.132:0/2254849988 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51b815eb80 0x7f51b8161800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:27.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.453+0000 7f51bd3ba640 1 --2- 172.21.15.132:0/2254849988 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51b80d5580 0x7f51b81612c0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:27.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.453+0000 7f51bd3ba640 1 --2- 172.21.15.132:0/2254849988 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51b80d21a0 0x7f51b80b2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:27.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.453+0000 7f51bd3ba640 1 -- 172.21.15.132:0/2254849988 >> 172.21.15.132:0/2254849988 conn(0x7f51b8067b80 msgr2=0x7f51b80b53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:27.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.453+0000 7f51bd3ba640 1 -- 172.21.15.132:0/2254849988 shutdown_connections 2024-04-16T15:53:27.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.453+0000 7f51bd3ba640 1 -- 172.21.15.132:0/2254849988 wait complete. 2024-04-16T15:53:27.463 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2024-04-16T15:53:27.283267+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":165,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224592,"kb_used_data":4232,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750128,"statfs":{"total":773094113280,"available":772864131072,"internally_reserved":0,"allocated":4333568,"data_stored":2401004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.089195"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464477+0000","last_change":"2024-04-16T15:53:19.219500+0000","last_active":"2024-04-16T15:53:20.464477+0000","last_peered":"2024-04-16T15:53:20.464477+0000","last_clean":"2024-04-16T15:53:20.464477+0000","last_became_active":"2024-04-16T15:53:19.219026+0000","last_became_peered":"2024-04-16T15:53:19.219026+0000","last_unstale":"2024-04-16T15:53:20.464477+0000","last_undegraded":"2024-04-16T15:53:20.464477+0000","last_fullsized":"2024-04-16T15:53:20.464477+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:14:20.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195457+0000","last_change":"2024-04-16T15:53:19.226148+0000","last_active":"2024-04-16T15:53:20.195457+0000","last_peered":"2024-04-16T15:53:20.195457+0000","last_clean":"2024-04-16T15:53:20.195457+0000","last_became_active":"2024-04-16T15:53:19.225869+0000","last_became_peered":"2024-04-16T15:53:19.225869+0000","last_unstale":"2024-04-16T15:53:20.195457+0000","last_undegraded":"2024-04-16T15:53:20.195457+0000","last_fullsized":"2024-04-16T15:53:20.195457+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:00:13.986513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464246+0000","last_change":"2024-04-16T15:53:19.209925+0000","last_active":"2024-04-16T15:53:20.464246+0000","last_peered":"2024-04-16T15:53:20.464246+0000","last_clean":"2024-04-16T15:53:20.464246+0000","last_became_active":"2024-04-16T15:53:19.209186+0000","last_became_peered":"2024-04-16T15:53:19.209186+0000","last_unstale":"2024-04-16T15:53:20.464246+0000","last_undegraded":"2024-04-16T15:53:20.464246+0000","last_fullsized":"2024-04-16T15:53:20.464246+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:12:25.656341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277237+0000","last_change":"2024-04-16T15:53:19.214711+0000","last_active":"2024-04-16T15:53:20.277237+0000","last_peered":"2024-04-16T15:53:20.277237+0000","last_clean":"2024-04-16T15:53:20.277237+0000","last_became_active":"2024-04-16T15:53:19.214414+0000","last_became_peered":"2024-04-16T15:53:19.214414+0000","last_unstale":"2024-04-16T15:53:20.277237+0000","last_undegraded":"2024-04-16T15:53:20.277237+0000","last_fullsized":"2024-04-16T15:53:20.277237+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:09:09.369395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463939+0000","last_change":"2024-04-16T15:53:19.218064+0000","last_active":"2024-04-16T15:53:20.463939+0000","last_peered":"2024-04-16T15:53:20.463939+0000","last_clean":"2024-04-16T15:53:20.463939+0000","last_became_active":"2024-04-16T15:53:19.217808+0000","last_became_peered":"2024-04-16T15:53:19.217808+0000","last_unstale":"2024-04-16T15:53:20.463939+0000","last_undegraded":"2024-04-16T15:53:20.463939+0000","last_fullsized":"2024-04-16T15:53:20.463939+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:27:14.925743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195195+0000","last_change":"2024-04-16T15:53:19.214250+0000","last_active":"2024-04-16T15:53:20.195195+0000","last_peered":"2024-04-16T15:53:20.195195+0000","last_clean":"2024-04-16T15:53:20.195195+0000","last_became_active":"2024-04-16T15:53:19.213980+0000","last_became_peered":"2024-04-16T15:53:19.213980+0000","last_unstale":"2024-04-16T15:53:20.195195+0000","last_undegraded":"2024-04-16T15:53:20.195195+0000","last_fullsized":"2024-04-16T15:53:20.195195+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:55:20.146233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197135+0000","last_change":"2024-04-16T15:53:19.221453+0000","last_active":"2024-04-16T15:53:20.197135+0000","last_peered":"2024-04-16T15:53:20.197135+0000","last_clean":"2024-04-16T15:53:20.197135+0000","last_became_active":"2024-04-16T15:53:19.221101+0000","last_became_peered":"2024-04-16T15:53:19.221101+0000","last_unstale":"2024-04-16T15:53:20.197135+0000","last_undegraded":"2024-04-16T15:53:20.197135+0000","last_fullsized":"2024-04-16T15:53:20.197135+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:47:53.262802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197388+0000","last_change":"2024-04-16T15:53:19.214371+0000","last_active":"2024-04-16T15:53:20.197388+0000","last_peered":"2024-04-16T15:53:20.197388+0000","last_clean":"2024-04-16T15:53:20.197388+0000","last_became_active":"2024-04-16T15:53:19.213544+0000","last_became_peered":"2024-04-16T15:53:19.213544+0000","last_unstale":"2024-04-16T15:53:20.197388+0000","last_undegraded":"2024-04-16T15:53:20.197388+0000","last_fullsized":"2024-04-16T15:53:20.197388+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:55:20.146233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197066+0000","last_change":"2024-04-16T15:53:19.207377+0000","last_active":"2024-04-16T15:53:20.197066+0000","last_peered":"2024-04-16T15:53:20.197066+0000","last_clean":"2024-04-16T15:53:20.197066+0000","last_became_active":"2024-04-16T15:53:19.206972+0000","last_became_peered":"2024-04-16T15:53:19.206972+0000","last_unstale":"2024-04-16T15:53:20.197066+0000","last_undegraded":"2024-04-16T15:53:20.197066+0000","last_fullsized":"2024-04-16T15:53:20.197066+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:41:40.266044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277465+0000","last_change":"2024-04-16T15:53:19.216192+0000","last_active":"2024-04-16T15:53:20.277465+0000","last_peered":"2024-04-16T15:53:20.277465+0000","last_clean":"2024-04-16T15:53:20.277465+0000","last_became_active":"2024-04-16T15:53:19.215441+0000","last_became_peered":"2024-04-16T15:53:19.215441+0000","last_unstale":"2024-04-16T15:53:20.277465+0000","last_undegraded":"2024-04-16T15:53:20.277465+0000","last_fullsized":"2024-04-16T15:53:20.277465+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:41:40.266044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196998+0000","last_change":"2024-04-16T15:53:19.219404+0000","last_active":"2024-04-16T15:53:20.196998+0000","last_peered":"2024-04-16T15:53:20.196998+0000","last_clean":"2024-04-16T15:53:20.196998+0000","last_became_active":"2024-04-16T15:53:19.219142+0000","last_became_peered":"2024-04-16T15:53:19.219142+0000","last_unstale":"2024-04-16T15:53:20.196998+0000","last_undegraded":"2024-04-16T15:53:20.196998+0000","last_fullsized":"2024-04-16T15:53:20.196998+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:40:00.074304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464668+0000","last_change":"2024-04-16T15:53:19.215861+0000","last_active":"2024-04-16T15:53:20.464668+0000","last_peered":"2024-04-16T15:53:20.464668+0000","last_clean":"2024-04-16T15:53:20.464668+0000","last_became_active":"2024-04-16T15:53:19.215574+0000","last_became_peered":"2024-04-16T15:53:19.215574+0000","last_unstale":"2024-04-16T15:53:20.464668+0000","last_undegraded":"2024-04-16T15:53:20.464668+0000","last_fullsized":"2024-04-16T15:53:20.464668+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:55:20.146233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463954+0000","last_change":"2024-04-16T15:53:19.219125+0000","last_active":"2024-04-16T15:53:20.463954+0000","last_peered":"2024-04-16T15:53:20.463954+0000","last_clean":"2024-04-16T15:53:20.463954+0000","last_became_active":"2024-04-16T15:53:19.218503+0000","last_became_peered":"2024-04-16T15:53:19.218503+0000","last_unstale":"2024-04-16T15:53:20.463954+0000","last_undegraded":"2024-04-16T15:53:20.463954+0000","last_fullsized":"2024-04-16T15:53:20.463954+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:49:25.688299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195100+0000","last_change":"2024-04-16T15:53:19.214790+0000","last_active":"2024-04-16T15:53:20.195100+0000","last_peered":"2024-04-16T15:53:20.195100+0000","last_clean":"2024-04-16T15:53:20.195100+0000","last_became_active":"2024-04-16T15:53:19.214539+0000","last_became_peered":"2024-04-16T15:53:19.214539+0000","last_unstale":"2024-04-16T15:53:20.195100+0000","last_undegraded":"2024-04-16T15:53:20.195100+0000","last_fullsized":"2024-04-16T15:53:20.195100+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:09:12.444137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464200+0000","last_change":"2024-04-16T15:53:19.215379+0000","last_active":"2024-04-16T15:53:20.464200+0000","last_peered":"2024-04-16T15:53:20.464200+0000","last_clean":"2024-04-16T15:53:20.464200+0000","last_became_active":"2024-04-16T15:53:19.215064+0000","last_became_peered":"2024-04-16T15:53:19.215064+0000","last_unstale":"2024-04-16T15:53:20.464200+0000","last_undegraded":"2024-04-16T15:53:20.464200+0000","last_fullsized":"2024-04-16T15:53:20.464200+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:32:14.472011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196790+0000","last_change":"2024-04-16T15:53:19.226607+0000","last_active":"2024-04-16T15:53:20.196790+0000","last_peered":"2024-04-16T15:53:20.196790+0000","last_clean":"2024-04-16T15:53:20.196790+0000","last_became_active":"2024-04-16T15:53:19.226349+0000","last_became_peered":"2024-04-16T15:53:19.226349+0000","last_unstale":"2024-04-16T15:53:20.196790+0000","last_undegraded":"2024-04-16T15:53:20.196790+0000","last_fullsized":"2024-04-16T15:53:20.196790+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:19.727876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197376+0000","last_change":"2024-04-16T15:53:19.222520+0000","last_active":"2024-04-16T15:53:20.197376+0000","last_peered":"2024-04-16T15:53:20.197376+0000","last_clean":"2024-04-16T15:53:20.197376+0000","last_became_active":"2024-04-16T15:53:19.222235+0000","last_became_peered":"2024-04-16T15:53:19.222235+0000","last_unstale":"2024-04-16T15:53:20.197376+0000","last_undegraded":"2024-04-16T15:53:20.197376+0000","last_fullsized":"2024-04-16T15:53:20.197376+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:26:17.244174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195538+0000","last_change":"2024-04-16T15:53:19.218035+0000","last_active":"2024-04-16T15:53:20.195538+0000","last_peered":"2024-04-16T15:53:20.195538+0000","last_clean":"2024-04-16T15:53:20.195538+0000","last_became_active":"2024-04-16T15:53:19.217745+0000","last_became_peered":"2024-04-16T15:53:19.217745+0000","last_unstale":"2024-04-16T15:53:20.195538+0000","last_undegraded":"2024-04-16T15:53:20.195538+0000","last_fullsized":"2024-04-16T15:53:20.195538+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:15:31.542491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195338+0000","last_change":"2024-04-16T15:53:19.217634+0000","last_active":"2024-04-16T15:53:20.195338+0000","last_peered":"2024-04-16T15:53:20.195338+0000","last_clean":"2024-04-16T15:53:20.195338+0000","last_became_active":"2024-04-16T15:53:19.217373+0000","last_became_peered":"2024-04-16T15:53:19.217373+0000","last_unstale":"2024-04-16T15:53:20.195338+0000","last_undegraded":"2024-04-16T15:53:20.195338+0000","last_fullsized":"2024-04-16T15:53:20.195338+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:48:31.729009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464109+0000","last_change":"2024-04-16T15:53:19.211323+0000","last_active":"2024-04-16T15:53:20.464109+0000","last_peered":"2024-04-16T15:53:20.464109+0000","last_clean":"2024-04-16T15:53:20.464109+0000","last_became_active":"2024-04-16T15:53:19.210812+0000","last_became_peered":"2024-04-16T15:53:19.210812+0000","last_unstale":"2024-04-16T15:53:20.464109+0000","last_undegraded":"2024-04-16T15:53:20.464109+0000","last_fullsized":"2024-04-16T15:53:20.464109+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:13:40.919473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196930+0000","last_change":"2024-04-16T15:53:19.199390+0000","last_active":"2024-04-16T15:53:20.196930+0000","last_peered":"2024-04-16T15:53:20.196930+0000","last_clean":"2024-04-16T15:53:20.196930+0000","last_became_active":"2024-04-16T15:53:19.199066+0000","last_became_peered":"2024-04-16T15:53:19.199066+0000","last_unstale":"2024-04-16T15:53:20.196930+0000","last_undegraded":"2024-04-16T15:53:20.196930+0000","last_fullsized":"2024-04-16T15:53:20.196930+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:01:01.640923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197022+0000","last_change":"2024-04-16T15:53:19.219587+0000","last_active":"2024-04-16T15:53:20.197022+0000","last_peered":"2024-04-16T15:53:20.197022+0000","last_clean":"2024-04-16T15:53:20.197022+0000","last_became_active":"2024-04-16T15:53:19.219150+0000","last_became_peered":"2024-04-16T15:53:19.219150+0000","last_unstale":"2024-04-16T15:53:20.197022+0000","last_undegraded":"2024-04-16T15:53:20.197022+0000","last_fullsized":"2024-04-16T15:53:20.197022+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:09:09.369395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463763+0000","last_change":"2024-04-16T15:53:19.211517+0000","last_active":"2024-04-16T15:53:20.463763+0000","last_peered":"2024-04-16T15:53:20.463763+0000","last_clean":"2024-04-16T15:53:20.463763+0000","last_became_active":"2024-04-16T15:53:19.211260+0000","last_became_peered":"2024-04-16T15:53:19.211260+0000","last_unstale":"2024-04-16T15:53:20.463763+0000","last_undegraded":"2024-04-16T15:53:20.463763+0000","last_fullsized":"2024-04-16T15:53:20.463763+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:54:25.966875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464423+0000","last_change":"2024-04-16T15:53:19.204402+0000","last_active":"2024-04-16T15:53:20.464423+0000","last_peered":"2024-04-16T15:53:20.464423+0000","last_clean":"2024-04-16T15:53:20.464423+0000","last_became_active":"2024-04-16T15:53:19.204086+0000","last_became_peered":"2024-04-16T15:53:19.204086+0000","last_unstale":"2024-04-16T15:53:20.464423+0000","last_undegraded":"2024-04-16T15:53:20.464423+0000","last_fullsized":"2024-04-16T15:53:20.464423+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:09:12.444137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277504+0000","last_change":"2024-04-16T15:53:19.214478+0000","last_active":"2024-04-16T15:53:20.277504+0000","last_peered":"2024-04-16T15:53:20.277504+0000","last_clean":"2024-04-16T15:53:20.277504+0000","last_became_active":"2024-04-16T15:53:19.214199+0000","last_became_peered":"2024-04-16T15:53:19.214199+0000","last_unstale":"2024-04-16T15:53:20.277504+0000","last_undegraded":"2024-04-16T15:53:20.277504+0000","last_fullsized":"2024-04-16T15:53:20.277504+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:38:12.802270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195587+0000","last_change":"2024-04-16T15:53:19.223834+0000","last_active":"2024-04-16T15:53:20.195587+0000","last_peered":"2024-04-16T15:53:20.195587+0000","last_clean":"2024-04-16T15:53:20.195587+0000","last_became_active":"2024-04-16T15:53:19.223467+0000","last_became_peered":"2024-04-16T15:53:19.223467+0000","last_unstale":"2024-04-16T15:53:20.195587+0000","last_undegraded":"2024-04-16T15:53:20.195587+0000","last_fullsized":"2024-04-16T15:53:20.195587+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:20:36.722580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277601+0000","last_change":"2024-04-16T15:53:19.215061+0000","last_active":"2024-04-16T15:53:20.277601+0000","last_peered":"2024-04-16T15:53:20.277601+0000","last_clean":"2024-04-16T15:53:20.277601+0000","last_became_active":"2024-04-16T15:53:19.214786+0000","last_became_peered":"2024-04-16T15:53:19.214786+0000","last_unstale":"2024-04-16T15:53:20.277601+0000","last_undegraded":"2024-04-16T15:53:20.277601+0000","last_fullsized":"2024-04-16T15:53:20.277601+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:24:52.885269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464800+0000","last_change":"2024-04-16T15:53:19.199651+0000","last_active":"2024-04-16T15:53:20.464800+0000","last_peered":"2024-04-16T15:53:20.464800+0000","last_clean":"2024-04-16T15:53:20.464800+0000","last_became_active":"2024-04-16T15:53:19.199270+0000","last_became_peered":"2024-04-16T15:53:19.199270+0000","last_unstale":"2024-04-16T15:53:20.464800+0000","last_undegraded":"2024-04-16T15:53:20.464800+0000","last_fullsized":"2024-04-16T15:53:20.464800+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:48:31.729009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197108+0000","last_change":"2024-04-16T15:53:19.218009+0000","last_active":"2024-04-16T15:53:20.197108+0000","last_peered":"2024-04-16T15:53:20.197108+0000","last_clean":"2024-04-16T15:53:20.197108+0000","last_became_active":"2024-04-16T15:53:19.217749+0000","last_became_peered":"2024-04-16T15:53:19.217749+0000","last_unstale":"2024-04-16T15:53:20.197108+0000","last_undegraded":"2024-04-16T15:53:20.197108+0000","last_fullsized":"2024-04-16T15:53:20.197108+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:38:12.802270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196284+0000","last_change":"2024-04-16T15:53:19.215554+0000","last_active":"2024-04-16T15:53:20.196284+0000","last_peered":"2024-04-16T15:53:20.196284+0000","last_clean":"2024-04-16T15:53:20.196284+0000","last_became_active":"2024-04-16T15:53:19.215243+0000","last_became_peered":"2024-04-16T15:53:19.215243+0000","last_unstale":"2024-04-16T15:53:20.196284+0000","last_undegraded":"2024-04-16T15:53:20.196284+0000","last_fullsized":"2024-04-16T15:53:20.196284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:24:52.885269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463993+0000","last_change":"2024-04-16T15:53:19.213628+0000","last_active":"2024-04-16T15:53:20.463993+0000","last_peered":"2024-04-16T15:53:20.463993+0000","last_clean":"2024-04-16T15:53:20.463993+0000","last_became_active":"2024-04-16T15:53:19.213345+0000","last_became_peered":"2024-04-16T15:53:19.213345+0000","last_unstale":"2024-04-16T15:53:20.463993+0000","last_undegraded":"2024-04-16T15:53:20.463993+0000","last_fullsized":"2024-04-16T15:53:20.463993+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:34:49.536139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196294+0000","last_change":"2024-04-16T15:53:19.212569+0000","last_active":"2024-04-16T15:53:20.196294+0000","last_peered":"2024-04-16T15:53:20.196294+0000","last_clean":"2024-04-16T15:53:20.196294+0000","last_became_active":"2024-04-16T15:53:19.212198+0000","last_became_peered":"2024-04-16T15:53:19.212198+0000","last_unstale":"2024-04-16T15:53:20.196294+0000","last_undegraded":"2024-04-16T15:53:20.196294+0000","last_fullsized":"2024-04-16T15:53:20.196294+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:27:57.263921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463687+0000","last_change":"2024-04-16T15:53:19.212160+0000","last_active":"2024-04-16T15:53:20.463687+0000","last_peered":"2024-04-16T15:53:20.463687+0000","last_clean":"2024-04-16T15:53:20.463687+0000","last_became_active":"2024-04-16T15:53:19.211902+0000","last_became_peered":"2024-04-16T15:53:19.211902+0000","last_unstale":"2024-04-16T15:53:20.463687+0000","last_undegraded":"2024-04-16T15:53:20.463687+0000","last_fullsized":"2024-04-16T15:53:20.463687+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:14:20.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464727+0000","last_change":"2024-04-16T15:53:18.210743+0000","last_active":"2024-04-16T15:53:20.464727+0000","last_peered":"2024-04-16T15:53:20.464727+0000","last_clean":"2024-04-16T15:53:20.464727+0000","last_became_active":"2024-04-16T15:53:18.210466+0000","last_became_peered":"2024-04-16T15:53:18.210466+0000","last_unstale":"2024-04-16T15:53:20.464727+0000","last_undegraded":"2024-04-16T15:53:20.464727+0000","last_fullsized":"2024-04-16T15:53:20.464727+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:03:51.897303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464638+0000","last_change":"2024-04-16T15:53:19.214490+0000","last_active":"2024-04-16T15:53:20.464638+0000","last_peered":"2024-04-16T15:53:20.464638+0000","last_clean":"2024-04-16T15:53:20.464638+0000","last_became_active":"2024-04-16T15:53:19.214206+0000","last_became_peered":"2024-04-16T15:53:19.214206+0000","last_unstale":"2024-04-16T15:53:20.464638+0000","last_undegraded":"2024-04-16T15:53:20.464638+0000","last_fullsized":"2024-04-16T15:53:20.464638+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:54:25.966875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463629+0000","last_change":"2024-04-16T15:53:18.213622+0000","last_active":"2024-04-16T15:53:20.463629+0000","last_peered":"2024-04-16T15:53:20.463629+0000","last_clean":"2024-04-16T15:53:20.463629+0000","last_became_active":"2024-04-16T15:53:18.213368+0000","last_became_peered":"2024-04-16T15:53:18.213368+0000","last_unstale":"2024-04-16T15:53:20.463629+0000","last_undegraded":"2024-04-16T15:53:20.463629+0000","last_fullsized":"2024-04-16T15:53:20.463629+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:31:41.162544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196775+0000","last_change":"2024-04-16T15:53:19.217908+0000","last_active":"2024-04-16T15:53:20.196775+0000","last_peered":"2024-04-16T15:53:20.196775+0000","last_clean":"2024-04-16T15:53:20.196775+0000","last_became_active":"2024-04-16T15:53:19.217659+0000","last_became_peered":"2024-04-16T15:53:19.217659+0000","last_unstale":"2024-04-16T15:53:20.196775+0000","last_undegraded":"2024-04-16T15:53:20.196775+0000","last_fullsized":"2024-04-16T15:53:20.196775+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:18:05.482765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195229+0000","last_change":"2024-04-16T15:53:18.206967+0000","last_active":"2024-04-16T15:53:20.195229+0000","last_peered":"2024-04-16T15:53:20.195229+0000","last_clean":"2024-04-16T15:53:20.195229+0000","last_became_active":"2024-04-16T15:53:18.206684+0000","last_became_peered":"2024-04-16T15:53:18.206684+0000","last_unstale":"2024-04-16T15:53:20.195229+0000","last_undegraded":"2024-04-16T15:53:20.195229+0000","last_fullsized":"2024-04-16T15:53:20.195229+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:14:19.341087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277619+0000","last_change":"2024-04-16T15:53:19.214612+0000","last_active":"2024-04-16T15:53:20.277619+0000","last_peered":"2024-04-16T15:53:20.277619+0000","last_clean":"2024-04-16T15:53:20.277619+0000","last_became_active":"2024-04-16T15:53:19.214331+0000","last_became_peered":"2024-04-16T15:53:19.214331+0000","last_unstale":"2024-04-16T15:53:20.277619+0000","last_undegraded":"2024-04-16T15:53:20.277619+0000","last_fullsized":"2024-04-16T15:53:20.277619+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:27:57.263921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464122+0000","last_change":"2024-04-16T15:53:18.210644+0000","last_active":"2024-04-16T15:53:20.464122+0000","last_peered":"2024-04-16T15:53:20.464122+0000","last_clean":"2024-04-16T15:53:20.464122+0000","last_became_active":"2024-04-16T15:53:18.210390+0000","last_became_peered":"2024-04-16T15:53:18.210390+0000","last_unstale":"2024-04-16T15:53:20.464122+0000","last_undegraded":"2024-04-16T15:53:20.464122+0000","last_fullsized":"2024-04-16T15:53:20.464122+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:00:38.767894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196471+0000","last_change":"2024-04-16T15:53:19.218628+0000","last_active":"2024-04-16T15:53:20.196471+0000","last_peered":"2024-04-16T15:53:20.196471+0000","last_clean":"2024-04-16T15:53:20.196471+0000","last_became_active":"2024-04-16T15:53:19.218185+0000","last_became_peered":"2024-04-16T15:53:19.218185+0000","last_unstale":"2024-04-16T15:53:20.196471+0000","last_undegraded":"2024-04-16T15:53:20.196471+0000","last_fullsized":"2024-04-16T15:53:20.196471+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:20:34.974674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197176+0000","last_change":"2024-04-16T15:53:18.210540+0000","last_active":"2024-04-16T15:53:20.197176+0000","last_peered":"2024-04-16T15:53:20.197176+0000","last_clean":"2024-04-16T15:53:20.197176+0000","last_became_active":"2024-04-16T15:53:18.210271+0000","last_became_peered":"2024-04-16T15:53:18.210271+0000","last_unstale":"2024-04-16T15:53:20.197176+0000","last_undegraded":"2024-04-16T15:53:20.197176+0000","last_fullsized":"2024-04-16T15:53:20.197176+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:08:37.253061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464363+0000","last_change":"2024-04-16T15:53:19.200361+0000","last_active":"2024-04-16T15:53:20.464363+0000","last_peered":"2024-04-16T15:53:20.464363+0000","last_clean":"2024-04-16T15:53:20.464363+0000","last_became_active":"2024-04-16T15:53:19.200086+0000","last_became_peered":"2024-04-16T15:53:19.200086+0000","last_unstale":"2024-04-16T15:53:20.464363+0000","last_undegraded":"2024-04-16T15:53:20.464363+0000","last_fullsized":"2024-04-16T15:53:20.464363+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:40:00.074304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196830+0000","last_change":"2024-04-16T15:53:18.210491+0000","last_active":"2024-04-16T15:53:20.196830+0000","last_peered":"2024-04-16T15:53:20.196830+0000","last_clean":"2024-04-16T15:53:20.196830+0000","last_became_active":"2024-04-16T15:53:18.210234+0000","last_became_peered":"2024-04-16T15:53:18.210234+0000","last_unstale":"2024-04-16T15:53:20.196830+0000","last_undegraded":"2024-04-16T15:53:20.196830+0000","last_fullsized":"2024-04-16T15:53:20.196830+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:28:44.787593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196717+0000","last_change":"2024-04-16T15:53:19.210713+0000","last_active":"2024-04-16T15:53:20.196717+0000","last_peered":"2024-04-16T15:53:20.196717+0000","last_clean":"2024-04-16T15:53:20.196717+0000","last_became_active":"2024-04-16T15:53:19.210425+0000","last_became_peered":"2024-04-16T15:53:19.210425+0000","last_unstale":"2024-04-16T15:53:20.196717+0000","last_undegraded":"2024-04-16T15:53:20.196717+0000","last_fullsized":"2024-04-16T15:53:20.196717+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:42:06.870549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.194850+0000","last_change":"2024-04-16T15:53:18.210535+0000","last_active":"2024-04-16T15:53:20.194850+0000","last_peered":"2024-04-16T15:53:20.194850+0000","last_clean":"2024-04-16T15:53:20.194850+0000","last_became_active":"2024-04-16T15:53:18.210282+0000","last_became_peered":"2024-04-16T15:53:18.210282+0000","last_unstale":"2024-04-16T15:53:20.194850+0000","last_undegraded":"2024-04-16T15:53:20.194850+0000","last_fullsized":"2024-04-16T15:53:20.194850+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:09:56.208391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277154+0000","last_change":"2024-04-16T15:53:19.212496+0000","last_active":"2024-04-16T15:53:20.277154+0000","last_peered":"2024-04-16T15:53:20.277154+0000","last_clean":"2024-04-16T15:53:20.277154+0000","last_became_active":"2024-04-16T15:53:19.212239+0000","last_became_peered":"2024-04-16T15:53:19.212239+0000","last_unstale":"2024-04-16T15:53:20.277154+0000","last_undegraded":"2024-04-16T15:53:20.277154+0000","last_fullsized":"2024-04-16T15:53:20.277154+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:18:05.482765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195756+0000","last_change":"2024-04-16T15:53:18.208530+0000","last_active":"2024-04-16T15:53:20.195756+0000","last_peered":"2024-04-16T15:53:20.195756+0000","last_clean":"2024-04-16T15:53:20.195756+0000","last_became_active":"2024-04-16T15:53:18.208225+0000","last_became_peered":"2024-04-16T15:53:18.208225+0000","last_unstale":"2024-04-16T15:53:20.195756+0000","last_undegraded":"2024-04-16T15:53:20.195756+0000","last_fullsized":"2024-04-16T15:53:20.195756+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:01:02.783464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464310+0000","last_change":"2024-04-16T15:53:19.215852+0000","last_active":"2024-04-16T15:53:20.464310+0000","last_peered":"2024-04-16T15:53:20.464310+0000","last_clean":"2024-04-16T15:53:20.464310+0000","last_became_active":"2024-04-16T15:53:19.215600+0000","last_became_peered":"2024-04-16T15:53:19.215600+0000","last_unstale":"2024-04-16T15:53:20.464310+0000","last_undegraded":"2024-04-16T15:53:20.464310+0000","last_fullsized":"2024-04-16T15:53:20.464310+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:19.727876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195485+0000","last_change":"2024-04-16T15:53:18.209410+0000","last_active":"2024-04-16T15:53:20.195485+0000","last_peered":"2024-04-16T15:53:20.195485+0000","last_clean":"2024-04-16T15:53:20.195485+0000","last_became_active":"2024-04-16T15:53:18.209128+0000","last_became_peered":"2024-04-16T15:53:18.209128+0000","last_unstale":"2024-04-16T15:53:20.195485+0000","last_undegraded":"2024-04-16T15:53:20.195485+0000","last_fullsized":"2024-04-16T15:53:20.195485+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:18:04.480511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195481+0000","last_change":"2024-04-16T15:53:19.218196+0000","last_active":"2024-04-16T15:53:20.195481+0000","last_peered":"2024-04-16T15:53:20.195481+0000","last_clean":"2024-04-16T15:53:20.195481+0000","last_became_active":"2024-04-16T15:53:19.217938+0000","last_became_peered":"2024-04-16T15:53:19.217938+0000","last_unstale":"2024-04-16T15:53:20.195481+0000","last_undegraded":"2024-04-16T15:53:20.195481+0000","last_fullsized":"2024-04-16T15:53:20.195481+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:15:54.665161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463743+0000","last_change":"2024-04-16T15:53:18.212761+0000","last_active":"2024-04-16T15:53:20.463743+0000","last_peered":"2024-04-16T15:53:20.463743+0000","last_clean":"2024-04-16T15:53:20.463743+0000","last_became_active":"2024-04-16T15:53:18.212427+0000","last_became_peered":"2024-04-16T15:53:18.212427+0000","last_unstale":"2024-04-16T15:53:20.463743+0000","last_undegraded":"2024-04-16T15:53:20.463743+0000","last_fullsized":"2024-04-16T15:53:20.463743+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:46:28.763927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195317+0000","last_change":"2024-04-16T15:53:19.223760+0000","last_active":"2024-04-16T15:53:20.195317+0000","last_peered":"2024-04-16T15:53:20.195317+0000","last_clean":"2024-04-16T15:53:20.195317+0000","last_became_active":"2024-04-16T15:53:19.223461+0000","last_became_peered":"2024-04-16T15:53:19.223461+0000","last_unstale":"2024-04-16T15:53:20.195317+0000","last_undegraded":"2024-04-16T15:53:20.195317+0000","last_fullsized":"2024-04-16T15:53:20.195317+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:19:47.160288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464486+0000","last_change":"2024-04-16T15:53:18.208880+0000","last_active":"2024-04-16T15:53:20.464486+0000","last_peered":"2024-04-16T15:53:20.464486+0000","last_clean":"2024-04-16T15:53:20.464486+0000","last_became_active":"2024-04-16T15:53:18.208317+0000","last_became_peered":"2024-04-16T15:53:18.208317+0000","last_unstale":"2024-04-16T15:53:20.464486+0000","last_undegraded":"2024-04-16T15:53:20.464486+0000","last_fullsized":"2024-04-16T15:53:20.464486+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:09:56.208391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464325+0000","last_change":"2024-04-16T15:53:19.218075+0000","last_active":"2024-04-16T15:53:20.464325+0000","last_peered":"2024-04-16T15:53:20.464325+0000","last_clean":"2024-04-16T15:53:20.464325+0000","last_became_active":"2024-04-16T15:53:19.217805+0000","last_became_peered":"2024-04-16T15:53:19.217805+0000","last_unstale":"2024-04-16T15:53:20.464325+0000","last_undegraded":"2024-04-16T15:53:20.464325+0000","last_fullsized":"2024-04-16T15:53:20.464325+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:47:53.262802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195193+0000","last_change":"2024-04-16T15:53:18.206853+0000","last_active":"2024-04-16T15:53:20.195193+0000","last_peered":"2024-04-16T15:53:20.195193+0000","last_clean":"2024-04-16T15:53:20.195193+0000","last_became_active":"2024-04-16T15:53:18.206613+0000","last_became_peered":"2024-04-16T15:53:18.206613+0000","last_unstale":"2024-04-16T15:53:20.195193+0000","last_undegraded":"2024-04-16T15:53:20.195193+0000","last_fullsized":"2024-04-16T15:53:20.195193+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:54:24.964622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277187+0000","last_change":"2024-04-16T15:53:19.222111+0000","last_active":"2024-04-16T15:53:20.277187+0000","last_peered":"2024-04-16T15:53:20.277187+0000","last_clean":"2024-04-16T15:53:20.277187+0000","last_became_active":"2024-04-16T15:53:19.221536+0000","last_became_peered":"2024-04-16T15:53:19.221536+0000","last_unstale":"2024-04-16T15:53:20.277187+0000","last_undegraded":"2024-04-16T15:53:20.277187+0000","last_fullsized":"2024-04-16T15:53:20.277187+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:01:01.640923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197189+0000","last_change":"2024-04-16T15:53:18.207932+0000","last_active":"2024-04-16T15:53:20.197189+0000","last_peered":"2024-04-16T15:53:20.197189+0000","last_clean":"2024-04-16T15:53:20.197189+0000","last_became_active":"2024-04-16T15:53:18.207445+0000","last_became_peered":"2024-04-16T15:53:18.207445+0000","last_unstale":"2024-04-16T15:53:20.197189+0000","last_undegraded":"2024-04-16T15:53:20.197189+0000","last_fullsized":"2024-04-16T15:53:20.197189+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:26:09.897432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195254+0000","last_change":"2024-04-16T15:53:19.215660+0000","last_active":"2024-04-16T15:53:20.195254+0000","last_peered":"2024-04-16T15:53:20.195254+0000","last_clean":"2024-04-16T15:53:20.195254+0000","last_became_active":"2024-04-16T15:53:19.215415+0000","last_became_peered":"2024-04-16T15:53:19.215415+0000","last_unstale":"2024-04-16T15:53:20.195254+0000","last_undegraded":"2024-04-16T15:53:20.195254+0000","last_fullsized":"2024-04-16T15:53:20.195254+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:26:17.244174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277262+0000","last_change":"2024-04-16T15:53:18.207023+0000","last_active":"2024-04-16T15:53:20.277262+0000","last_peered":"2024-04-16T15:53:20.277262+0000","last_clean":"2024-04-16T15:53:20.277262+0000","last_became_active":"2024-04-16T15:53:18.206764+0000","last_became_peered":"2024-04-16T15:53:18.206764+0000","last_unstale":"2024-04-16T15:53:20.277262+0000","last_undegraded":"2024-04-16T15:53:20.277262+0000","last_fullsized":"2024-04-16T15:53:20.277262+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:49:24.686045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196471+0000","last_change":"2024-04-16T15:53:19.218507+0000","last_active":"2024-04-16T15:53:20.196471+0000","last_peered":"2024-04-16T15:53:20.196471+0000","last_clean":"2024-04-16T15:53:20.196471+0000","last_became_active":"2024-04-16T15:53:19.218250+0000","last_became_peered":"2024-04-16T15:53:19.218250+0000","last_unstale":"2024-04-16T15:53:20.196471+0000","last_undegraded":"2024-04-16T15:53:20.196471+0000","last_fullsized":"2024-04-16T15:53:20.196471+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:12:25.656341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.194904+0000","last_change":"2024-04-16T15:53:18.207895+0000","last_active":"2024-04-16T15:53:20.194904+0000","last_peered":"2024-04-16T15:53:20.194904+0000","last_clean":"2024-04-16T15:53:20.194904+0000","last_became_active":"2024-04-16T15:53:18.207633+0000","last_became_peered":"2024-04-16T15:53:18.207633+0000","last_unstale":"2024-04-16T15:53:20.194904+0000","last_undegraded":"2024-04-16T15:53:20.194904+0000","last_fullsized":"2024-04-16T15:53:20.194904+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:42:05.868295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464143+0000","last_change":"2024-04-16T15:53:19.212616+0000","last_active":"2024-04-16T15:53:20.464143+0000","last_peered":"2024-04-16T15:53:20.464143+0000","last_clean":"2024-04-16T15:53:20.464143+0000","last_became_active":"2024-04-16T15:53:19.212171+0000","last_became_peered":"2024-04-16T15:53:19.212171+0000","last_unstale":"2024-04-16T15:53:20.464143+0000","last_undegraded":"2024-04-16T15:53:20.464143+0000","last_fullsized":"2024-04-16T15:53:20.464143+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:13:11.997144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.194904+0000","last_change":"2024-04-16T15:53:18.207615+0000","last_active":"2024-04-16T15:53:20.194904+0000","last_peered":"2024-04-16T15:53:20.194904+0000","last_clean":"2024-04-16T15:53:20.194904+0000","last_became_active":"2024-04-16T15:53:18.207332+0000","last_became_peered":"2024-04-16T15:53:18.207332+0000","last_unstale":"2024-04-16T15:53:20.194904+0000","last_undegraded":"2024-04-16T15:53:20.194904+0000","last_fullsized":"2024-04-16T15:53:20.194904+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:01:00.638669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196700+0000","last_change":"2024-04-16T15:53:19.202791+0000","last_active":"2024-04-16T15:53:20.196700+0000","last_peered":"2024-04-16T15:53:20.196700+0000","last_clean":"2024-04-16T15:53:20.196700+0000","last_became_active":"2024-04-16T15:53:19.202414+0000","last_became_peered":"2024-04-16T15:53:19.202414+0000","last_unstale":"2024-04-16T15:53:20.196700+0000","last_undegraded":"2024-04-16T15:53:20.196700+0000","last_fullsized":"2024-04-16T15:53:20.196700+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:09:57.210644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277536+0000","last_change":"2024-04-16T15:53:18.211975+0000","last_active":"2024-04-16T15:53:20.277536+0000","last_peered":"2024-04-16T15:53:20.277536+0000","last_clean":"2024-04-16T15:53:20.277536+0000","last_became_active":"2024-04-16T15:53:18.211709+0000","last_became_peered":"2024-04-16T15:53:18.211709+0000","last_unstale":"2024-04-16T15:53:20.277536+0000","last_undegraded":"2024-04-16T15:53:20.277536+0000","last_fullsized":"2024-04-16T15:53:20.277536+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:03:51.897303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464666+0000","last_change":"2024-04-16T15:53:19.202854+0000","last_active":"2024-04-16T15:53:20.464666+0000","last_peered":"2024-04-16T15:53:20.464666+0000","last_clean":"2024-04-16T15:53:20.464666+0000","last_became_active":"2024-04-16T15:53:19.202530+0000","last_became_peered":"2024-04-16T15:53:19.202530+0000","last_unstale":"2024-04-16T15:53:20.464666+0000","last_undegraded":"2024-04-16T15:53:20.464666+0000","last_fullsized":"2024-04-16T15:53:20.464666+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:26:17.244174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196884+0000","last_change":"2024-04-16T15:53:18.208018+0000","last_active":"2024-04-16T15:53:20.196884+0000","last_peered":"2024-04-16T15:53:20.196884+0000","last_clean":"2024-04-16T15:53:20.196884+0000","last_became_active":"2024-04-16T15:53:18.207596+0000","last_became_peered":"2024-04-16T15:53:18.207596+0000","last_unstale":"2024-04-16T15:53:20.196884+0000","last_undegraded":"2024-04-16T15:53:20.196884+0000","last_fullsized":"2024-04-16T15:53:20.196884+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:03:51.897303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277265+0000","last_change":"2024-04-16T15:53:19.215051+0000","last_active":"2024-04-16T15:53:20.277265+0000","last_peered":"2024-04-16T15:53:20.277265+0000","last_clean":"2024-04-16T15:53:20.277265+0000","last_became_active":"2024-04-16T15:53:19.214161+0000","last_became_peered":"2024-04-16T15:53:19.214161+0000","last_unstale":"2024-04-16T15:53:20.277265+0000","last_undegraded":"2024-04-16T15:53:20.277265+0000","last_fullsized":"2024-04-16T15:53:20.277265+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:21:33.438988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196677+0000","last_change":"2024-04-16T15:53:18.210890+0000","last_active":"2024-04-16T15:53:20.196677+0000","last_peered":"2024-04-16T15:53:20.196677+0000","last_clean":"2024-04-16T15:53:20.196677+0000","last_became_active":"2024-04-16T15:53:18.210498+0000","last_became_peered":"2024-04-16T15:53:18.210498+0000","last_unstale":"2024-04-16T15:53:20.196677+0000","last_undegraded":"2024-04-16T15:53:20.196677+0000","last_fullsized":"2024-04-16T15:53:20.196677+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:31:41.162544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463890+0000","last_change":"2024-04-16T15:53:19.212904+0000","last_active":"2024-04-16T15:53:20.463890+0000","last_peered":"2024-04-16T15:53:20.463890+0000","last_clean":"2024-04-16T15:53:20.463890+0000","last_became_active":"2024-04-16T15:53:19.212661+0000","last_became_peered":"2024-04-16T15:53:19.212661+0000","last_unstale":"2024-04-16T15:53:20.463890+0000","last_undegraded":"2024-04-16T15:53:20.463890+0000","last_fullsized":"2024-04-16T15:53:20.463890+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:46:29.766181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196432+0000","last_change":"2024-04-16T15:53:18.212722+0000","last_active":"2024-04-16T15:53:20.196432+0000","last_peered":"2024-04-16T15:53:20.196432+0000","last_clean":"2024-04-16T15:53:20.196432+0000","last_became_active":"2024-04-16T15:53:18.212434+0000","last_became_peered":"2024-04-16T15:53:18.212434+0000","last_unstale":"2024-04-16T15:53:20.196432+0000","last_undegraded":"2024-04-16T15:53:20.196432+0000","last_fullsized":"2024-04-16T15:53:20.196432+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:46:28.763927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463722+0000","last_change":"2024-04-16T15:53:19.212150+0000","last_active":"2024-04-16T15:53:20.463722+0000","last_peered":"2024-04-16T15:53:20.463722+0000","last_clean":"2024-04-16T15:53:20.463722+0000","last_became_active":"2024-04-16T15:53:19.211842+0000","last_became_peered":"2024-04-16T15:53:19.211842+0000","last_unstale":"2024-04-16T15:53:20.463722+0000","last_undegraded":"2024-04-16T15:53:20.463722+0000","last_fullsized":"2024-04-16T15:53:20.463722+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:03:52.899556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464047+0000","last_change":"2024-04-16T15:53:18.210794+0000","last_active":"2024-04-16T15:53:20.464047+0000","last_peered":"2024-04-16T15:53:20.464047+0000","last_clean":"2024-04-16T15:53:20.464047+0000","last_became_active":"2024-04-16T15:53:18.210087+0000","last_became_peered":"2024-04-16T15:53:18.210087+0000","last_unstale":"2024-04-16T15:53:20.464047+0000","last_undegraded":"2024-04-16T15:53:20.464047+0000","last_fullsized":"2024-04-16T15:53:20.464047+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:03:51.897303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464082+0000","last_change":"2024-04-16T15:53:19.206926+0000","last_active":"2024-04-16T15:53:20.464082+0000","last_peered":"2024-04-16T15:53:20.464082+0000","last_clean":"2024-04-16T15:53:20.464082+0000","last_became_active":"2024-04-16T15:53:19.206660+0000","last_became_peered":"2024-04-16T15:53:19.206660+0000","last_unstale":"2024-04-16T15:53:20.464082+0000","last_undegraded":"2024-04-16T15:53:20.464082+0000","last_fullsized":"2024-04-16T15:53:20.464082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:20:17.996907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464223+0000","last_change":"2024-04-16T15:53:18.210087+0000","last_active":"2024-04-16T15:53:20.464223+0000","last_peered":"2024-04-16T15:53:20.464223+0000","last_clean":"2024-04-16T15:53:20.464223+0000","last_became_active":"2024-04-16T15:53:18.209539+0000","last_became_peered":"2024-04-16T15:53:18.209539+0000","last_unstale":"2024-04-16T15:53:20.464223+0000","last_undegraded":"2024-04-16T15:53:20.464223+0000","last_fullsized":"2024-04-16T15:53:20.464223+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:31:41.162544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463515+0000","last_change":"2024-04-16T15:53:19.206275+0000","last_active":"2024-04-16T15:53:20.463515+0000","last_peered":"2024-04-16T15:53:20.463515+0000","last_clean":"2024-04-16T15:53:20.463515+0000","last_became_active":"2024-04-16T15:53:19.205995+0000","last_became_peered":"2024-04-16T15:53:19.205995+0000","last_unstale":"2024-04-16T15:53:20.463515+0000","last_undegraded":"2024-04-16T15:53:20.463515+0000","last_fullsized":"2024-04-16T15:53:20.463515+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:08:38.255314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195767+0000","last_change":"2024-04-16T15:53:18.204767+0000","last_active":"2024-04-16T15:53:20.195767+0000","last_peered":"2024-04-16T15:53:20.195767+0000","last_clean":"2024-04-16T15:53:20.195767+0000","last_became_active":"2024-04-16T15:53:18.204142+0000","last_became_peered":"2024-04-16T15:53:18.204142+0000","last_unstale":"2024-04-16T15:53:20.195767+0000","last_undegraded":"2024-04-16T15:53:20.195767+0000","last_fullsized":"2024-04-16T15:53:20.195767+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:27:13.923490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197141+0000","last_change":"2024-04-16T15:53:19.215530+0000","last_active":"2024-04-16T15:53:20.197141+0000","last_peered":"2024-04-16T15:53:20.197141+0000","last_clean":"2024-04-16T15:53:20.197141+0000","last_became_active":"2024-04-16T15:53:19.215227+0000","last_became_peered":"2024-04-16T15:53:19.215227+0000","last_unstale":"2024-04-16T15:53:20.197141+0000","last_undegraded":"2024-04-16T15:53:20.197141+0000","last_fullsized":"2024-04-16T15:53:20.197141+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:09:12.444137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464488+0000","last_change":"2024-04-16T15:53:18.209377+0000","last_active":"2024-04-16T15:53:20.464488+0000","last_peered":"2024-04-16T15:53:20.464488+0000","last_clean":"2024-04-16T15:53:20.464488+0000","last_became_active":"2024-04-16T15:53:18.209092+0000","last_became_peered":"2024-04-16T15:53:18.209092+0000","last_unstale":"2024-04-16T15:53:20.464488+0000","last_undegraded":"2024-04-16T15:53:20.464488+0000","last_fullsized":"2024-04-16T15:53:20.464488+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:54:24.964622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463717+0000","last_change":"2024-04-16T15:53:19.210213+0000","last_active":"2024-04-16T15:53:20.463717+0000","last_peered":"2024-04-16T15:53:20.463717+0000","last_clean":"2024-04-16T15:53:20.463717+0000","last_became_active":"2024-04-16T15:53:19.209941+0000","last_became_peered":"2024-04-16T15:53:19.209941+0000","last_unstale":"2024-04-16T15:53:20.463717+0000","last_undegraded":"2024-04-16T15:53:20.463717+0000","last_fullsized":"2024-04-16T15:53:20.463717+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:31:42.164797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277554+0000","last_change":"2024-04-16T15:53:18.204255+0000","last_active":"2024-04-16T15:53:20.277554+0000","last_peered":"2024-04-16T15:53:20.277554+0000","last_clean":"2024-04-16T15:53:20.277554+0000","last_became_active":"2024-04-16T15:53:18.203960+0000","last_became_peered":"2024-04-16T15:53:18.203960+0000","last_unstale":"2024-04-16T15:53:20.277554+0000","last_undegraded":"2024-04-16T15:53:20.277554+0000","last_fullsized":"2024-04-16T15:53:20.277554+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:46:28.763927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464698+0000","last_change":"2024-04-16T15:53:19.218513+0000","last_active":"2024-04-16T15:53:20.464698+0000","last_peered":"2024-04-16T15:53:20.464698+0000","last_clean":"2024-04-16T15:53:20.464698+0000","last_became_active":"2024-04-16T15:53:19.217646+0000","last_became_peered":"2024-04-16T15:53:19.217646+0000","last_unstale":"2024-04-16T15:53:20.464698+0000","last_undegraded":"2024-04-16T15:53:20.464698+0000","last_fullsized":"2024-04-16T15:53:20.464698+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:19:47.160288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463839+0000","last_change":"2024-04-16T15:53:18.208864+0000","last_active":"2024-04-16T15:53:20.463839+0000","last_peered":"2024-04-16T15:53:20.463839+0000","last_clean":"2024-04-16T15:53:20.463839+0000","last_became_active":"2024-04-16T15:53:18.208576+0000","last_became_peered":"2024-04-16T15:53:18.208576+0000","last_unstale":"2024-04-16T15:53:20.463839+0000","last_undegraded":"2024-04-16T15:53:20.463839+0000","last_fullsized":"2024-04-16T15:53:20.463839+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:49:24.686045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463570+0000","last_change":"2024-04-16T15:53:19.220923+0000","last_active":"2024-04-16T15:53:20.463570+0000","last_peered":"2024-04-16T15:53:20.463570+0000","last_clean":"2024-04-16T15:53:20.463570+0000","last_became_active":"2024-04-16T15:53:19.218050+0000","last_became_peered":"2024-04-16T15:53:19.218050+0000","last_unstale":"2024-04-16T15:53:20.463570+0000","last_undegraded":"2024-04-16T15:53:20.463570+0000","last_fullsized":"2024-04-16T15:53:20.463570+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:13:11.997144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277301+0000","last_change":"2024-04-16T15:53:18.211328+0000","last_active":"2024-04-16T15:53:20.277301+0000","last_peered":"2024-04-16T15:53:20.277301+0000","last_clean":"2024-04-16T15:53:20.277301+0000","last_became_active":"2024-04-16T15:53:18.211063+0000","last_became_peered":"2024-04-16T15:53:18.211063+0000","last_unstale":"2024-04-16T15:53:20.277301+0000","last_undegraded":"2024-04-16T15:53:20.277301+0000","last_fullsized":"2024-04-16T15:53:20.277301+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:27:13.923490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464047+0000","last_change":"2024-04-16T15:53:19.210169+0000","last_active":"2024-04-16T15:53:20.464047+0000","last_peered":"2024-04-16T15:53:20.464047+0000","last_clean":"2024-04-16T15:53:20.464047+0000","last_became_active":"2024-04-16T15:53:19.209882+0000","last_became_peered":"2024-04-16T15:53:19.209882+0000","last_unstale":"2024-04-16T15:53:20.464047+0000","last_undegraded":"2024-04-16T15:53:20.464047+0000","last_fullsized":"2024-04-16T15:53:20.464047+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:34:17.258739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464213+0000","last_change":"2024-04-16T15:53:18.204297+0000","last_active":"2024-04-16T15:53:20.464213+0000","last_peered":"2024-04-16T15:53:20.464213+0000","last_clean":"2024-04-16T15:53:20.464213+0000","last_became_active":"2024-04-16T15:53:18.204054+0000","last_became_peered":"2024-04-16T15:53:18.204054+0000","last_unstale":"2024-04-16T15:53:20.464213+0000","last_undegraded":"2024-04-16T15:53:20.464213+0000","last_fullsized":"2024-04-16T15:53:20.464213+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:27:13.923490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463987+0000","last_change":"2024-04-16T15:53:19.211221+0000","last_active":"2024-04-16T15:53:20.463987+0000","last_peered":"2024-04-16T15:53:20.463987+0000","last_clean":"2024-04-16T15:53:20.463987+0000","last_became_active":"2024-04-16T15:53:19.210969+0000","last_became_peered":"2024-04-16T15:53:19.210969+0000","last_unstale":"2024-04-16T15:53:20.463987+0000","last_undegraded":"2024-04-16T15:53:20.463987+0000","last_fullsized":"2024-04-16T15:53:20.463987+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:09:57.210644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277362+0000","last_change":"2024-04-16T15:53:18.204310+0000","last_active":"2024-04-16T15:53:20.277362+0000","last_peered":"2024-04-16T15:53:20.277362+0000","last_clean":"2024-04-16T15:53:20.277362+0000","last_became_active":"2024-04-16T15:53:18.204031+0000","last_became_peered":"2024-04-16T15:53:18.204031+0000","last_unstale":"2024-04-16T15:53:20.277362+0000","last_undegraded":"2024-04-16T15:53:20.277362+0000","last_fullsized":"2024-04-16T15:53:20.277362+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:20:16.994654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.194938+0000","last_change":"2024-04-16T15:53:19.218748+0000","last_active":"2024-04-16T15:53:20.194938+0000","last_peered":"2024-04-16T15:53:20.194938+0000","last_clean":"2024-04-16T15:53:20.194938+0000","last_became_active":"2024-04-16T15:53:19.218474+0000","last_became_peered":"2024-04-16T15:53:19.218474+0000","last_unstale":"2024-04-16T15:53:20.194938+0000","last_undegraded":"2024-04-16T15:53:20.194938+0000","last_fullsized":"2024-04-16T15:53:20.194938+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:47:53.262802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195914+0000","last_change":"2024-04-16T15:53:18.204483+0000","last_active":"2024-04-16T15:53:20.195914+0000","last_peered":"2024-04-16T15:53:20.195914+0000","last_clean":"2024-04-16T15:53:20.195914+0000","last_became_active":"2024-04-16T15:53:18.203790+0000","last_became_peered":"2024-04-16T15:53:18.203790+0000","last_unstale":"2024-04-16T15:53:20.195914+0000","last_undegraded":"2024-04-16T15:53:20.195914+0000","last_fullsized":"2024-04-16T15:53:20.195914+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:49:24.686045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197045+0000","last_change":"2024-04-16T15:53:19.218646+0000","last_active":"2024-04-16T15:53:20.197045+0000","last_peered":"2024-04-16T15:53:20.197045+0000","last_clean":"2024-04-16T15:53:20.197045+0000","last_became_active":"2024-04-16T15:53:19.218379+0000","last_became_peered":"2024-04-16T15:53:19.218379+0000","last_unstale":"2024-04-16T15:53:20.197045+0000","last_undegraded":"2024-04-16T15:53:20.197045+0000","last_fullsized":"2024-04-16T15:53:20.197045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:21:33.438988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.194988+0000","last_change":"2024-04-16T15:53:18.211846+0000","last_active":"2024-04-16T15:53:20.194988+0000","last_peered":"2024-04-16T15:53:20.194988+0000","last_clean":"2024-04-16T15:53:20.194988+0000","last_became_active":"2024-04-16T15:53:18.211604+0000","last_became_peered":"2024-04-16T15:53:18.211604+0000","last_unstale":"2024-04-16T15:53:20.194988+0000","last_undegraded":"2024-04-16T15:53:20.194988+0000","last_fullsized":"2024-04-16T15:53:20.194988+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:09:08.367141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196459+0000","last_change":"2024-04-16T15:53:19.213036+0000","last_active":"2024-04-16T15:53:20.196459+0000","last_peered":"2024-04-16T15:53:20.196459+0000","last_clean":"2024-04-16T15:53:20.196459+0000","last_became_active":"2024-04-16T15:53:19.212758+0000","last_became_peered":"2024-04-16T15:53:19.212758+0000","last_unstale":"2024-04-16T15:53:20.196459+0000","last_undegraded":"2024-04-16T15:53:20.196459+0000","last_fullsized":"2024-04-16T15:53:20.196459+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:32:14.472011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464513+0000","last_change":"2024-04-16T15:53:18.213907+0000","last_active":"2024-04-16T15:53:20.464513+0000","last_peered":"2024-04-16T15:53:20.464513+0000","last_clean":"2024-04-16T15:53:20.464513+0000","last_became_active":"2024-04-16T15:53:18.213572+0000","last_became_peered":"2024-04-16T15:53:18.213572+0000","last_unstale":"2024-04-16T15:53:20.464513+0000","last_undegraded":"2024-04-16T15:53:20.464513+0000","last_fullsized":"2024-04-16T15:53:20.464513+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:08:37.253061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":196,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196856+0000","last_change":"2024-04-16T15:52:04.356095+0000","last_active":"2024-04-16T15:53:20.196856+0000","last_peered":"2024-04-16T15:53:20.196856+0000","last_clean":"2024-04-16T15:53:20.196856+0000","last_became_active":"2024-04-16T15:52:04.355126+0000","last_became_peered":"2024-04-16T15:52:04.355126+0000","last_unstale":"2024-04-16T15:53:20.196856+0000","last_undegraded":"2024-04-16T15:53:20.196856+0000","last_fullsized":"2024-04-16T15:53:20.196856+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:03.285037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:03.285037+0000","last_clean_scrub_stamp":"2024-04-16T15:52:03.285037+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:19.005024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":983040,"data_stored":742389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":152547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31568,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":393216,"data_stored":152603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":152035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":401408,"data_stored":153565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":152001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":401408,"data_stored":153565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":978944,"data_stored":742299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T15:53:27.467 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-16T15:53:27.467 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-16T15:53:27.614 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.615+0000 7f3140088640 1 Processor -- start 2024-04-16T15:53:27.615 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.615+0000 7f3140088640 1 -- start start 2024-04-16T15:53:27.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.616+0000 7f3140088640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f313815b840 0x7f31380cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:27.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.616+0000 7f3140088640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f313806dfb0 con 0x7f31380b4e60 2024-04-16T15:53:27.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.616+0000 7f3140088640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f313806e290 con 0x7f31380cf470 2024-04-16T15:53:27.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.616+0000 7f3140088640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f313806e570 con 0x7f313815b840 2024-04-16T15:53:27.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.616+0000 7f313de24640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f313815b840 0x7f31380cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:27.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.616+0000 7f313e625640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f31380b4e60 0x7f313806f050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:41500/0 (socket says 172.21.15.132:41500) 2024-04-16T15:53:27.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.616+0000 7f313e625640 1 -- 172.21.15.132:0/1678581805 learned_addr learned my addr 172.21.15.132:0/1678581805 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:53:27.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.616+0000 7f313de24640 1 -- 172.21.15.132:0/1678581805 >> v1:172.21.15.179:6789/0 conn(0x7f31380cf470 legacy=0x7f31380b4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:27.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.616+0000 7f313de24640 1 -- 172.21.15.132:0/1678581805 >> v1:172.21.15.132:6789/0 conn(0x7f31380b4e60 legacy=0x7f313806f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:27.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.616+0000 7f313ce22640 1 -- 172.21.15.132:0/1678581805 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4066214918 0 0) 0x7f313806dfb0 con 0x7f31380b4e60 2024-04-16T15:53:27.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.617+0000 7f313de24640 1 -- 172.21.15.132:0/1678581805 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f313806e850 con 0x7f313815b840 2024-04-16T15:53:27.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.617+0000 7f313de24640 1 --2- 172.21.15.132:0/1678581805 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f313815b840 0x7f31380cef30 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3134009d90 tx=0x7f313402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14a25eb90d68634b server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:27.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.617+0000 7f313ce22640 1 -- 172.21.15.132:0/1678581805 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3134039070 con 0x7f313815b840 2024-04-16T15:53:27.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.617+0000 7f313ce22640 1 -- 172.21.15.132:0/1678581805 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f313402cc60 con 0x7f313815b840 2024-04-16T15:53:27.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.617+0000 7f313ce22640 1 -- 172.21.15.132:0/1678581805 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3134034660 con 0x7f313815b840 2024-04-16T15:53:27.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.618+0000 7f3140088640 1 -- 172.21.15.132:0/1678581805 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f313815b840 msgr2=0x7f31380cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:27.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.618+0000 7f3140088640 1 --2- 172.21.15.132:0/1678581805 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f313815b840 0x7f31380cef30 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3134009d90 tx=0x7f313402beb0 comp rx=0 tx=0).stop 2024-04-16T15:53:27.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.618+0000 7f3140088640 1 -- 172.21.15.132:0/1678581805 shutdown_connections 2024-04-16T15:53:27.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.618+0000 7f3140088640 1 --2- 172.21.15.132:0/1678581805 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f313815b840 0x7f31380cef30 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:27.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.618+0000 7f3140088640 1 -- 172.21.15.132:0/1678581805 >> 172.21.15.132:0/1678581805 conn(0x7f31380d0490 msgr2=0x7f31380d08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:27.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.618+0000 7f3140088640 1 -- 172.21.15.132:0/1678581805 shutdown_connections 2024-04-16T15:53:27.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.618+0000 7f3140088640 1 -- 172.21.15.132:0/1678581805 wait complete. 2024-04-16T15:53:27.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.619+0000 7f3140088640 1 Processor -- start 2024-04-16T15:53:27.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.619+0000 7f3140088640 1 -- start start 2024-04-16T15:53:27.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.620+0000 7f3140088640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31380b4e60 0x7f31381f01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:27.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.620+0000 7f3140088640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31380cf470 0x7f3138153c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:27.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.620+0000 7f3140088640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f313815b840 0x7f313815e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:27.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.620+0000 7f3140088640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f313815bc20 con 0x7f31380cf470 2024-04-16T15:53:27.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.620+0000 7f3140088640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f31380b5740 con 0x7f31380b4e60 2024-04-16T15:53:27.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.620+0000 7f3140088640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f31381551a0 con 0x7f313815b840 2024-04-16T15:53:27.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.620+0000 7f313d623640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31380cf470 0x7f3138153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:27.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.620+0000 7f313d623640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31380cf470 0x7f3138153c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41924/0 (socket says 172.21.15.132:41924) 2024-04-16T15:53:27.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.620+0000 7f313d623640 1 -- 172.21.15.132:0/2809999935 learned_addr learned my addr 172.21.15.132:0/2809999935 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:27.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.620+0000 7f313d623640 1 -- 172.21.15.132:0/2809999935 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f313815b840 msgr2=0x7f313815e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:27.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.620+0000 7f313d623640 1 --2- 172.21.15.132:0/2809999935 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f313815b840 0x7f313815e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:27.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.620+0000 7f313d623640 1 -- 172.21.15.132:0/2809999935 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31380b4e60 msgr2=0x7f31381f01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:27.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.620+0000 7f313d623640 1 --2- 172.21.15.132:0/2809999935 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31380b4e60 0x7f31381f01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:27.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.620+0000 7f313d623640 1 -- 172.21.15.132:0/2809999935 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3138154590 con 0x7f31380cf470 2024-04-16T15:53:27.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.621+0000 7f313d623640 1 --2- 172.21.15.132:0/2809999935 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31380cf470 0x7f3138153c90 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f312800c430 tx=0x7f312800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:27.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.621+0000 7f312e7fc640 1 -- 172.21.15.132:0/2809999935 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3128011790 con 0x7f31380cf470 2024-04-16T15:53:27.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.621+0000 7f312e7fc640 1 -- 172.21.15.132:0/2809999935 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3128017070 con 0x7f31380cf470 2024-04-16T15:53:27.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.621+0000 7f312e7fc640 1 -- 172.21.15.132:0/2809999935 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3128011b70 con 0x7f31380cf470 2024-04-16T15:53:27.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.621+0000 7f3140088640 1 -- 172.21.15.132:0/2809999935 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3138154870 con 0x7f31380cf470 2024-04-16T15:53:27.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.621+0000 7f3140088640 1 -- 172.21.15.132:0/2809999935 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3138154e30 con 0x7f31380cf470 2024-04-16T15:53:27.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.622+0000 7f3140088640 1 -- 172.21.15.132:0/2809999935 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3138075510 con 0x7f31380cf470 2024-04-16T15:53:27.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.622+0000 7f312e7fc640 1 -- 172.21.15.132:0/2809999935 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3128011d10 con 0x7f31380cf470 2024-04-16T15:53:27.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.623+0000 7f312e7fc640 1 --2- 172.21.15.132:0/2809999935 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f311c06c8f0 0x7f311c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:27.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.623+0000 7f313de24640 1 --2- 172.21.15.132:0/2809999935 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f311c06c8f0 0x7f311c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:27.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.623+0000 7f312e7fc640 1 -- 172.21.15.132:0/2809999935 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f312808ba20 con 0x7f31380cf470 2024-04-16T15:53:27.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.623+0000 7f313de24640 1 --2- 172.21.15.132:0/2809999935 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f311c06c8f0 0x7f311c06edb0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3134036000 tx=0x7f313402e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:27.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.627+0000 7f312e7fc640 1 -- 172.21.15.132:0/2809999935 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3128059e50 con 0x7f31380cf470 2024-04-16T15:53:27.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.873+0000 7f3140088640 1 -- 172.21.15.132:0/2809999935 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f31380af9b0 con 0x7f31380cf470 2024-04-16T15:53:27.877 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~7s 2024-04-16T15:53:27.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.875+0000 7f312e7fc640 1 -- 172.21.15.132:0/2809999935 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) ==== 190+0+147 (secure 0 0 0) 0x7f3128059750 con 0x7f31380cf470 2024-04-16T15:53:27.878 INFO:teuthology.orchestra.run.smithi132.stdout:[client.0] 2024-04-16T15:53:27.878 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQB1nh5msfL1JRAAxfWBGq3EmoGhFqhZir0xkg== 2024-04-16T15:53:27.879 INFO:teuthology.orchestra.run.smithi132.stdout: caps mds = "allow" 2024-04-16T15:53:27.879 INFO:teuthology.orchestra.run.smithi132.stdout: caps mon = "allow r" 2024-04-16T15:53:27.879 INFO:teuthology.orchestra.run.smithi132.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-16T15:53:27.880 INFO:teuthology.orchestra.run.smithi132.stderr:updated caps for client.0 2024-04-16T15:53:27.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.877+0000 7f3140088640 1 -- 172.21.15.132:0/2809999935 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f311c06c8f0 msgr2=0x7f311c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:27.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.877+0000 7f3140088640 1 --2- 172.21.15.132:0/2809999935 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f311c06c8f0 0x7f311c06edb0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3134036000 tx=0x7f313402e000 comp rx=0 tx=0).stop 2024-04-16T15:53:27.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.877+0000 7f3140088640 1 -- 172.21.15.132:0/2809999935 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31380cf470 msgr2=0x7f3138153c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:27.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.877+0000 7f3140088640 1 --2- 172.21.15.132:0/2809999935 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31380cf470 0x7f3138153c90 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f312800c430 tx=0x7f312800c8f0 comp rx=0 tx=0).stop 2024-04-16T15:53:27.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.877+0000 7f3140088640 1 -- 172.21.15.132:0/2809999935 shutdown_connections 2024-04-16T15:53:27.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.877+0000 7f3140088640 1 --2- 172.21.15.132:0/2809999935 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f311c06c8f0 0x7f311c06edb0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:27.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.877+0000 7f3140088640 1 --2- 172.21.15.132:0/2809999935 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f313815b840 0x7f313815e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:27.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.877+0000 7f3140088640 1 --2- 172.21.15.132:0/2809999935 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31380cf470 0x7f3138153c90 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:27.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.877+0000 7f3140088640 1 --2- 172.21.15.132:0/2809999935 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31380b4e60 0x7f31381f01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:27.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.877+0000 7f3140088640 1 -- 172.21.15.132:0/2809999935 >> 172.21.15.132:0/2809999935 conn(0x7f31380d0490 msgr2=0x7f313806f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:27.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.877+0000 7f3140088640 1 -- 172.21.15.132:0/2809999935 shutdown_connections 2024-04-16T15:53:27.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.877+0000 7f3140088640 1 -- 172.21.15.132:0/2809999935 wait complete. 2024-04-16T15:53:27.888 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T15:53:27.998 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.998+0000 7fe38604a640 1 Processor -- start 2024-04-16T15:53:27.998 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.998+0000 7fe38604a640 1 -- start start 2024-04-16T15:53:27.998 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.998+0000 7fe38604a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe3800b6b00 0x7fe380169b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:27.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.998+0000 7fe38604a640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe380162cc0 con 0x7fe38015eed0 2024-04-16T15:53:27.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.998+0000 7fe38604a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe380162fa0 con 0x7fe38015eaf0 2024-04-16T15:53:27.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.999+0000 7fe38604a640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fe3800d2af0 con 0x7fe3800b6b00 2024-04-16T15:53:27.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.999+0000 7fe37effd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fe38015eed0 0x7fe3800b63f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:41516/0 (socket says 172.21.15.132:41516) 2024-04-16T15:53:27.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.999+0000 7fe37effd640 1 -- 172.21.15.132:0/1029066563 learned_addr learned my addr 172.21.15.132:0/1029066563 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:53:27.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.999+0000 7fe37ffff640 1 --2- 172.21.15.132:0/1029066563 >> v2:172.21.15.179:3300/0 conn(0x7fe3800b6b00 0x7fe380169b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:27.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.999+0000 7fe37e7fc640 1 -- 172.21.15.132:0/1029066563 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 221841921 0 0) 0x7fe380162cc0 con 0x7fe38015eed0 2024-04-16T15:53:27.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.999+0000 7fe37e7fc640 1 -- 172.21.15.132:0/1029066563 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe36c003520 con 0x7fe38015eed0 2024-04-16T15:53:27.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.999+0000 7fe37ffff640 1 -- 172.21.15.132:0/1029066563 >> v1:172.21.15.179:6789/0 conn(0x7fe38015eaf0 legacy=0x7fe3800ba300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:27.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.999+0000 7fe37ffff640 1 -- 172.21.15.132:0/1029066563 >> v1:172.21.15.132:6789/0 conn(0x7fe38015eed0 legacy=0x7fe3800b63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:27.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.999+0000 7fe37e7fc640 1 -- 172.21.15.132:0/1029066563 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 846316418 0 0) 0x7fe36c003520 con 0x7fe38015eed0 2024-04-16T15:53:27.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:27.999+0000 7fe37ffff640 1 -- 172.21.15.132:0/1029066563 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe380163280 con 0x7fe3800b6b00 2024-04-16T15:53:28.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.000+0000 7fe37ffff640 1 --2- 172.21.15.132:0/1029066563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3800b6b00 0x7fe380169b10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe3800d2c70 tx=0x7fe37802be00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f11ba00b54e5ef47 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:28.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.000+0000 7fe37e7fc640 1 -- 172.21.15.132:0/1029066563 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe378039070 con 0x7fe3800b6b00 2024-04-16T15:53:28.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.000+0000 7fe37e7fc640 1 -- 172.21.15.132:0/1029066563 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe37802c930 con 0x7fe3800b6b00 2024-04-16T15:53:28.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.000+0000 7fe37e7fc640 1 -- 172.21.15.132:0/1029066563 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe368001670 con 0x7fe3800b6b00 2024-04-16T15:53:28.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.001+0000 7fe38604a640 1 -- 172.21.15.132:0/1029066563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3800b6b00 msgr2=0x7fe380169b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:28.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.001+0000 7fe38604a640 1 --2- 172.21.15.132:0/1029066563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3800b6b00 0x7fe380169b10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe3800d2c70 tx=0x7fe37802be00 comp rx=0 tx=0).stop 2024-04-16T15:53:28.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.001+0000 7fe38604a640 1 -- 172.21.15.132:0/1029066563 shutdown_connections 2024-04-16T15:53:28.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.001+0000 7fe38604a640 1 --2- 172.21.15.132:0/1029066563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3800b6b00 0x7fe380169b10 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:28.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.001+0000 7fe38604a640 1 -- 172.21.15.132:0/1029066563 >> 172.21.15.132:0/1029066563 conn(0x7fe3800d13f0 msgr2=0x7fe3800d1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:28.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.001+0000 7fe38604a640 1 -- 172.21.15.132:0/1029066563 shutdown_connections 2024-04-16T15:53:28.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.001+0000 7fe38604a640 1 -- 172.21.15.132:0/1029066563 wait complete. 2024-04-16T15:53:28.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.002+0000 7fe38604a640 1 Processor -- start 2024-04-16T15:53:28.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.002+0000 7fe38604a640 1 -- start start 2024-04-16T15:53:28.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.003+0000 7fe38604a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3800b6b00 0x7fe380155a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:28.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.003+0000 7fe38604a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe38015eaf0 0x7fe3800cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:28.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.003+0000 7fe38604a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe38015eed0 0x7fe380157e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:28.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.003+0000 7fe38604a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe380162960 con 0x7fe38015eaf0 2024-04-16T15:53:28.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.003+0000 7fe38604a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe3801627e0 con 0x7fe38015eed0 2024-04-16T15:53:28.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.003+0000 7fe38604a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe3800d3f90 con 0x7fe3800b6b00 2024-04-16T15:53:28.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.003+0000 7fe37effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe38015eaf0 0x7fe3800cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:28.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.003+0000 7fe37effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe38015eaf0 0x7fe3800cbc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41934/0 (socket says 172.21.15.132:41934) 2024-04-16T15:53:28.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.003+0000 7fe37effd640 1 -- 172.21.15.132:0/204660696 learned_addr learned my addr 172.21.15.132:0/204660696 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:28.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.003+0000 7fe37f7fe640 1 --2- 172.21.15.132:0/204660696 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3800b6b00 0x7fe380155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:28.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.003+0000 7fe37ffff640 1 --2- 172.21.15.132:0/204660696 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe38015eed0 0x7fe380157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:28.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.003+0000 7fe37effd640 1 -- 172.21.15.132:0/204660696 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3800b6b00 msgr2=0x7fe380155a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:28.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.003+0000 7fe37effd640 1 --2- 172.21.15.132:0/204660696 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3800b6b00 0x7fe380155a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:28.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.003+0000 7fe37effd640 1 -- 172.21.15.132:0/204660696 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe38015eed0 msgr2=0x7fe380157e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:28.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.003+0000 7fe37effd640 1 --2- 172.21.15.132:0/204660696 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe38015eed0 0x7fe380157e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:28.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.003+0000 7fe37effd640 1 -- 172.21.15.132:0/204660696 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3800cc180 con 0x7fe38015eaf0 2024-04-16T15:53:28.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.003+0000 7fe37ffff640 1 --2- 172.21.15.132:0/204660696 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe38015eed0 0x7fe380157e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:53:28.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.003+0000 7fe37effd640 1 --2- 172.21.15.132:0/204660696 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe38015eaf0 0x7fe3800cbc40 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fe36800c550 tx=0x7fe36800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:28.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.004+0000 7fe377fff640 1 -- 172.21.15.132:0/204660696 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe368017070 con 0x7fe38015eaf0 2024-04-16T15:53:28.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.004+0000 7fe377fff640 1 -- 172.21.15.132:0/204660696 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe368005ce0 con 0x7fe38015eaf0 2024-04-16T15:53:28.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.004+0000 7fe377fff640 1 -- 172.21.15.132:0/204660696 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3680072b0 con 0x7fe38015eaf0 2024-04-16T15:53:28.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.004+0000 7fe38604a640 1 -- 172.21.15.132:0/204660696 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe380158870 con 0x7fe38015eaf0 2024-04-16T15:53:28.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.004+0000 7fe38604a640 1 -- 172.21.15.132:0/204660696 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3800c8760 con 0x7fe38015eaf0 2024-04-16T15:53:28.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.005+0000 7fe38604a640 1 -- 172.21.15.132:0/204660696 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3800d2250 con 0x7fe38015eaf0 2024-04-16T15:53:28.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.005+0000 7fe377fff640 1 -- 172.21.15.132:0/204660696 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe36801a070 con 0x7fe38015eaf0 2024-04-16T15:53:28.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.005+0000 7fe377fff640 1 --2- 172.21.15.132:0/204660696 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fe36006c8f0 0x7fe36006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:28.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.006+0000 7fe37f7fe640 1 --2- 172.21.15.132:0/204660696 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fe36006c8f0 0x7fe36006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:28.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.006+0000 7fe377fff640 1 -- 172.21.15.132:0/204660696 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fe36808ae10 con 0x7fe38015eaf0 2024-04-16T15:53:28.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.006+0000 7fe37f7fe640 1 --2- 172.21.15.132:0/204660696 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fe36006c8f0 0x7fe36006edb0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe3800c82a0 tx=0x7fe370009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:28.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.010+0000 7fe377fff640 1 -- 172.21.15.132:0/204660696 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe3800d2250 con 0x7fe38015eaf0 2024-04-16T15:53:28.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.219+0000 7fe38604a640 1 -- 172.21.15.132:0/204660696 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe380075510 con 0x7fe38015eaf0 2024-04-16T15:53:28.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.220+0000 7fe377fff640 1 -- 172.21.15.132:0/204660696 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5192 (secure 0 0 0) 0x7fe368058bf0 con 0x7fe38015eaf0 2024-04-16T15:53:28.219 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:53:28.220 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/1515313270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1515313270},{"type":"v1","addr":"172.21.15.179:6833","nonce":1515313270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4790,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1873998575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1873998575},{"type":"v1","addr":"172.21.15.179:6835","nonce":1873998575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/1111207224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1111207224},{"type":"v1","addr":"172.21.15.132:6836","nonce":1111207224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T15:53:18.546482+0000","modified":"2024-04-16T15:53:20.571317+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5235":{"gid":5235,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":5,"addr":"172.21.15.132:6837/1743416273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":1743416273},{"type":"v1","addr":"172.21.15.132:6837","nonce":1743416273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5235,"qdb_cluster":[5235]},"id":2}]} 2024-04-16T15:53:28.220 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 14 2024-04-16T15:53:28.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.222+0000 7fe38604a640 1 -- 172.21.15.132:0/204660696 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fe36006c8f0 msgr2=0x7fe36006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:28.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.222+0000 7fe38604a640 1 --2- 172.21.15.132:0/204660696 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fe36006c8f0 0x7fe36006edb0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe3800c82a0 tx=0x7fe370009040 comp rx=0 tx=0).stop 2024-04-16T15:53:28.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.222+0000 7fe38604a640 1 -- 172.21.15.132:0/204660696 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe38015eaf0 msgr2=0x7fe3800cbc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:28.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.222+0000 7fe38604a640 1 --2- 172.21.15.132:0/204660696 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe38015eaf0 0x7fe3800cbc40 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fe36800c550 tx=0x7fe36800ca10 comp rx=0 tx=0).stop 2024-04-16T15:53:28.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.222+0000 7fe38604a640 1 -- 172.21.15.132:0/204660696 shutdown_connections 2024-04-16T15:53:28.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.222+0000 7fe38604a640 1 --2- 172.21.15.132:0/204660696 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fe36006c8f0 0x7fe36006edb0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:28.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.222+0000 7fe38604a640 1 --2- 172.21.15.132:0/204660696 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe38015eed0 0x7fe380157e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:28.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.222+0000 7fe38604a640 1 --2- 172.21.15.132:0/204660696 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe38015eaf0 0x7fe3800cbc40 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:28.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.222+0000 7fe38604a640 1 --2- 172.21.15.132:0/204660696 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3800b6b00 0x7fe380155a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:28.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.222+0000 7fe38604a640 1 -- 172.21.15.132:0/204660696 >> 172.21.15.132:0/204660696 conn(0x7fe3800d13f0 msgr2=0x7fe3800cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:28.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.222+0000 7fe38604a640 1 -- 172.21.15.132:0/204660696 shutdown_connections 2024-04-16T15:53:28.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:28.222+0000 7fe38604a640 1 -- 172.21.15.132:0/204660696 wait complete. 2024-04-16T15:53:28.235 INFO:tasks.cephfs_test_runner:test_extra_data_pool_rebuild_few_files (tasks.cephfs.test_data_scan.TestDataScan) ... ERROR 2024-04-16T15:53:28.236 INFO:tasks.cephfs_test_runner: 2024-04-16T15:53:28.236 INFO:tasks.cephfs_test_runner:====================================================================== 2024-04-16T15:53:28.236 INFO:tasks.cephfs_test_runner:ERROR: test_extra_data_pool_rebuild_few_files (tasks.cephfs.test_data_scan.TestDataScan) 2024-04-16T15:53:28.236 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-16T15:53:28.236 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-04-16T15:53:28.236 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks/cephfs/cephfs_test_case.py", line 180, in setUp 2024-04-16T15:53:28.236 INFO:tasks.cephfs_test_runner: self.fs.wait_for_daemons() 2024-04-16T15:53:28.236 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks/cephfs/filesystem.py", line 1270, in wait_for_daemons 2024-04-16T15:53:28.236 INFO:tasks.cephfs_test_runner: if self.are_daemons_healthy(status=status, skip_max_mds_check=skip_max_mds_check): 2024-04-16T15:53:28.236 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks/cephfs/filesystem.py", line 1075, in are_daemons_healthy 2024-04-16T15:53:28.236 INFO:tasks.cephfs_test_runner: mds.check_status() 2024-04-16T15:53:28.237 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/daemon/state.py", line 43, in check_status 2024-04-16T15:53:28.237 INFO:tasks.cephfs_test_runner: return self.proc.poll() 2024-04-16T15:53:28.237 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 211, in poll 2024-04-16T15:53:28.237 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-04-16T15:53:28.237 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-04-16T15:53:28.237 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-04-16T15:53:28.237 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi132 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a' 2024-04-16T15:53:28.237 INFO:tasks.cephfs_test_runner: 2024-04-16T15:53:28.237 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-16T15:53:28.237 INFO:tasks.cephfs_test_runner:Ran 1 test in 45.956s 2024-04-16T15:53:28.237 INFO:tasks.cephfs_test_runner: 2024-04-16T15:53:28.237 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-04-16T15:53:28.237 INFO:tasks.cephfs_test_runner: 2024-04-16T15:53:28.237 INFO:tasks.cephfs_test_runner:====================================================================== 2024-04-16T15:53:28.237 INFO:tasks.cephfs_test_runner:ERROR: test_extra_data_pool_rebuild_few_files (tasks.cephfs.test_data_scan.TestDataScan) 2024-04-16T15:53:28.238 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-16T15:53:28.238 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-04-16T15:53:28.238 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks/cephfs/cephfs_test_case.py", line 180, in setUp 2024-04-16T15:53:28.238 INFO:tasks.cephfs_test_runner: self.fs.wait_for_daemons() 2024-04-16T15:53:28.238 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks/cephfs/filesystem.py", line 1270, in wait_for_daemons 2024-04-16T15:53:28.238 INFO:tasks.cephfs_test_runner: if self.are_daemons_healthy(status=status, skip_max_mds_check=skip_max_mds_check): 2024-04-16T15:53:28.238 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks/cephfs/filesystem.py", line 1075, in are_daemons_healthy 2024-04-16T15:53:28.238 INFO:tasks.cephfs_test_runner: mds.check_status() 2024-04-16T15:53:28.238 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/daemon/state.py", line 43, in check_status 2024-04-16T15:53:28.238 INFO:tasks.cephfs_test_runner: return self.proc.poll() 2024-04-16T15:53:28.238 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 211, in poll 2024-04-16T15:53:28.238 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-04-16T15:53:28.238 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-04-16T15:53:28.238 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-04-16T15:53:28.238 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi132 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a' 2024-04-16T15:53:28.238 INFO:tasks.cephfs_test_runner: 2024-04-16T15:53:28.239 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_extra_data_pool_rebuild_few_files (tasks.cephfs.test_data_scan.TestDataScan) 2024-04-16T15:53:28.493 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=92dd9784ee38472bbeb3a710cd436c0d Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_extra_data_pool_rebuild_few_files (tasks.cephfs.test_data_scan.TestDataScan) 2024-04-16T15:53:28.494 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-04-16T15:53:28.523 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-16T15:53:28.532 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-16T15:53:28.533 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-16T15:53:28.533 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T15:53:28.552 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056375,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15784 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248848k,nr_inodes=812212,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-16T15:53:28.552 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-16T15:53:28.552 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T15:53:28.608 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056375,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15784 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248848k,nr_inodes=812212,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-16T15:53:28.608 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-16T15:53:28.608 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T15:53:28.628 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056360,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1352 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-16T15:53:28.628 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-16T15:53:28.628 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T15:53:28.687 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056360,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1352 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-16T15:53:28.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:53:28.688 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list 2024-04-16T15:53:28.704 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-16T15:53:28.704 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-16T15:53:28.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:53:28.704 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-16T15:53:28.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:53:28.773 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-16T15:53:28.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:53:28.843 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link delete ceph-brx 2024-04-16T15:53:28.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:53:28.942 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2024-04-16T15:53:28.961 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-16T15:53:28.962 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-16T15:53:28.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:53:28.962 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-16T15:53:29.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:53:29.037 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-16T15:53:29.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:53:29.109 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link delete ceph-brx 2024-04-16T15:53:29.204 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-16T15:53:29.213 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-16T15:53:29.213 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T15:53:29.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.320+0000 7f24b02c8640 1 Processor -- start 2024-04-16T15:53:29.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.320+0000 7f24b02c8640 1 -- start start 2024-04-16T15:53:29.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.321+0000 7f24b02c8640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f24a8144f50 0x7f24a80b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:29.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.321+0000 7f24b02c8640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f24a80cd2a0 0x7f24a80cd730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:29.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.321+0000 7f24b02c8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24a806eda0 0x7f24a806f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:29.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.321+0000 7f24b02c8640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f24a80ce040 con 0x7f24a80cd2a0 2024-04-16T15:53:29.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.321+0000 7f24b02c8640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f24a806f6f0 con 0x7f24a8144f50 2024-04-16T15:53:29.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.321+0000 7f24b02c8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f24a80cdd60 con 0x7f24a806eda0 2024-04-16T15:53:29.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.321+0000 7f24ad863640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f24a80cd2a0 0x7f24a80cd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:29.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.321+0000 7f24ad863640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f24a80cd2a0 0x7f24a80cd730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41946/0 (socket says 172.21.15.132:41946) 2024-04-16T15:53:29.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.321+0000 7f24ad863640 1 -- 172.21.15.132:0/3612986266 learned_addr learned my addr 172.21.15.132:0/3612986266 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:29.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.321+0000 7f24ae064640 1 --2- 172.21.15.132:0/3612986266 >> v2:172.21.15.179:3300/0 conn(0x7f24a8144f50 0x7f24a80b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:29.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.321+0000 7f24ae865640 1 --2- 172.21.15.132:0/3612986266 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24a806eda0 0x7f24a806f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:29.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.321+0000 7f24ad863640 1 -- 172.21.15.132:0/3612986266 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24a806eda0 msgr2=0x7f24a806f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:29.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.321+0000 7f24ad863640 1 --2- 172.21.15.132:0/3612986266 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24a806eda0 0x7f24a806f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:29.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.321+0000 7f24ad863640 1 -- 172.21.15.132:0/3612986266 >> v2:172.21.15.179:3300/0 conn(0x7f24a8144f50 msgr2=0x7f24a80b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:29.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.321+0000 7f24ad863640 1 --2- 172.21.15.132:0/3612986266 >> v2:172.21.15.179:3300/0 conn(0x7f24a8144f50 0x7f24a80b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:29.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.321+0000 7f24ad863640 1 -- 172.21.15.132:0/3612986266 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24a80b3770 con 0x7f24a80cd2a0 2024-04-16T15:53:29.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.321+0000 7f24ae064640 1 --2- 172.21.15.132:0/3612986266 >> v2:172.21.15.179:3300/0 conn(0x7f24a8144f50 0x7f24a80b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:53:29.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.321+0000 7f24ae865640 1 --2- 172.21.15.132:0/3612986266 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24a806eda0 0x7f24a806f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:53:29.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.322+0000 7f24ad863640 1 --2- 172.21.15.132:0/3612986266 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24a80cd2a0 0x7f24a80cd730 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f24a80702f0 tx=0x7f249c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f37ce2d54a309e1c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:29.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.322+0000 7f24ad062640 1 -- 172.21.15.132:0/3612986266 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249c02e070 con 0x7f24a80cd2a0 2024-04-16T15:53:29.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.322+0000 7f24ad062640 1 -- 172.21.15.132:0/3612986266 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f249c037070 con 0x7f24a80cd2a0 2024-04-16T15:53:29.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.322+0000 7f24ad062640 1 -- 172.21.15.132:0/3612986266 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249c031a00 con 0x7f24a80cd2a0 2024-04-16T15:53:29.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.322+0000 7f24b02c8640 1 -- 172.21.15.132:0/3612986266 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24a80cd2a0 msgr2=0x7f24a80cd730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:29.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.322+0000 7f24b02c8640 1 --2- 172.21.15.132:0/3612986266 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24a80cd2a0 0x7f24a80cd730 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f24a80702f0 tx=0x7f249c02b880 comp rx=0 tx=0).stop 2024-04-16T15:53:29.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.323+0000 7f24b02c8640 1 -- 172.21.15.132:0/3612986266 shutdown_connections 2024-04-16T15:53:29.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.323+0000 7f24b02c8640 1 --2- 172.21.15.132:0/3612986266 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24a806eda0 0x7f24a806f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:29.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.323+0000 7f24b02c8640 1 --2- 172.21.15.132:0/3612986266 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24a80cd2a0 0x7f24a80cd730 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:29.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.323+0000 7f24b02c8640 1 --2- 172.21.15.132:0/3612986266 >> v2:172.21.15.179:3300/0 conn(0x7f24a8144f50 0x7f24a80b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:29.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.323+0000 7f24b02c8640 1 -- 172.21.15.132:0/3612986266 >> 172.21.15.132:0/3612986266 conn(0x7f24a80b2d50 msgr2=0x7f24a806ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:29.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.323+0000 7f24b02c8640 1 -- 172.21.15.132:0/3612986266 shutdown_connections 2024-04-16T15:53:29.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.323+0000 7f24b02c8640 1 -- 172.21.15.132:0/3612986266 wait complete. 2024-04-16T15:53:29.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.324+0000 7f24b02c8640 1 Processor -- start 2024-04-16T15:53:29.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.324+0000 7f24b02c8640 1 -- start start 2024-04-16T15:53:29.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.325+0000 7f24b02c8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24a806eda0 0x7f24a815afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:29.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.325+0000 7f24b02c8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24a80cd2a0 0x7f24a813df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:29.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.325+0000 7f24b02c8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24a8144f50 0x7f24a81e5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:29.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.325+0000 7f24b02c8640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f24a80afda0 con 0x7f24a806eda0 2024-04-16T15:53:29.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.325+0000 7f24b02c8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f24a80b3d30 con 0x7f24a8144f50 2024-04-16T15:53:29.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.325+0000 7f24b02c8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f24a8145330 con 0x7f24a80cd2a0 2024-04-16T15:53:29.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.325+0000 7f24ae064640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24a806eda0 0x7f24a815afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:29.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.325+0000 7f24ae064640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24a806eda0 0x7f24a815afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41950/0 (socket says 172.21.15.132:41950) 2024-04-16T15:53:29.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.325+0000 7f24ae064640 1 -- 172.21.15.132:0/4046909666 learned_addr learned my addr 172.21.15.132:0/4046909666 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:29.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.325+0000 7f24ae064640 1 -- 172.21.15.132:0/4046909666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24a80cd2a0 msgr2=0x7f24a813df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:29.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.325+0000 7f24ae064640 1 --2- 172.21.15.132:0/4046909666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24a80cd2a0 0x7f24a813df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:29.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.325+0000 7f24ae064640 1 -- 172.21.15.132:0/4046909666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24a8144f50 msgr2=0x7f24a81e5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:29.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.325+0000 7f24ae064640 1 --2- 172.21.15.132:0/4046909666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24a8144f50 0x7f24a81e5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:29.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.325+0000 7f24ae064640 1 -- 172.21.15.132:0/4046909666 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24a81e6470 con 0x7f24a806eda0 2024-04-16T15:53:29.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.325+0000 7f24ae064640 1 --2- 172.21.15.132:0/4046909666 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24a806eda0 0x7f24a815afa0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f24a0007ec0 tx=0x7f24a000dba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:29.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.325+0000 7f24a6ffd640 1 -- 172.21.15.132:0/4046909666 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a0004230 con 0x7f24a806eda0 2024-04-16T15:53:29.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.325+0000 7f24a6ffd640 1 -- 172.21.15.132:0/4046909666 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24a00043d0 con 0x7f24a806eda0 2024-04-16T15:53:29.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.325+0000 7f24b02c8640 1 -- 172.21.15.132:0/4046909666 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24a81e6750 con 0x7f24a806eda0 2024-04-16T15:53:29.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.325+0000 7f24a6ffd640 1 -- 172.21.15.132:0/4046909666 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a000b8e0 con 0x7f24a806eda0 2024-04-16T15:53:29.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.325+0000 7f24b02c8640 1 -- 172.21.15.132:0/4046909666 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24a813ea80 con 0x7f24a806eda0 2024-04-16T15:53:29.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.326+0000 7f24b02c8640 1 -- 172.21.15.132:0/4046909666 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24a8075510 con 0x7f24a806eda0 2024-04-16T15:53:29.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.327+0000 7f24a6ffd640 1 -- 172.21.15.132:0/4046909666 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f24a000ba80 con 0x7f24a806eda0 2024-04-16T15:53:29.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.327+0000 7f24a6ffd640 1 --2- 172.21.15.132:0/4046909666 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f249406c8f0 0x7f249406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:29.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.327+0000 7f24ad863640 1 --2- 172.21.15.132:0/4046909666 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f249406c8f0 0x7f249406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:29.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.327+0000 7f24a6ffd640 1 -- 172.21.15.132:0/4046909666 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f24a008d9b0 con 0x7f24a806eda0 2024-04-16T15:53:29.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.328+0000 7f24ad863640 1 --2- 172.21.15.132:0/4046909666 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f249406c8f0 0x7f249406edb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f249c036000 tx=0x7f249c030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:29.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.332+0000 7f24a6ffd640 1 -- 172.21.15.132:0/4046909666 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f24a005b790 con 0x7f24a806eda0 2024-04-16T15:53:29.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.503+0000 7f24b02c8640 1 -- 172.21.15.132:0/4046909666 --> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f24a8068de0 con 0x7f249406c8f0 2024-04-16T15:53:29.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.509+0000 7f24a6ffd640 1 -- 172.21.15.132:0/4046909666 <== mgr.4101 v2:172.21.15.132:6832/3896387465 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251839 (secure 0 0 0) 0x7f24a8068de0 con 0x7f249406c8f0 2024-04-16T15:53:29.511 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:53:29.513 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2024-04-16T15:53:29.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.512+0000 7f24b02c8640 1 -- 172.21.15.132:0/4046909666 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f249406c8f0 msgr2=0x7f249406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:29.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.512+0000 7f24b02c8640 1 --2- 172.21.15.132:0/4046909666 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f249406c8f0 0x7f249406edb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f249c036000 tx=0x7f249c030000 comp rx=0 tx=0).stop 2024-04-16T15:53:29.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.512+0000 7f24b02c8640 1 -- 172.21.15.132:0/4046909666 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24a806eda0 msgr2=0x7f24a815afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:29.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.512+0000 7f24b02c8640 1 --2- 172.21.15.132:0/4046909666 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24a806eda0 0x7f24a815afa0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f24a0007ec0 tx=0x7f24a000dba0 comp rx=0 tx=0).stop 2024-04-16T15:53:29.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.512+0000 7f24b02c8640 1 -- 172.21.15.132:0/4046909666 shutdown_connections 2024-04-16T15:53:29.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.512+0000 7f24b02c8640 1 --2- 172.21.15.132:0/4046909666 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f249406c8f0 0x7f249406edb0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:29.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.512+0000 7f24b02c8640 1 --2- 172.21.15.132:0/4046909666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24a8144f50 0x7f24a81e5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:29.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.512+0000 7f24b02c8640 1 --2- 172.21.15.132:0/4046909666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24a80cd2a0 0x7f24a813df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:29.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.512+0000 7f24b02c8640 1 --2- 172.21.15.132:0/4046909666 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24a806eda0 0x7f24a815afa0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:29.516 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.512+0000 7f24b02c8640 1 -- 172.21.15.132:0/4046909666 >> 172.21.15.132:0/4046909666 conn(0x7f24a80b2d50 msgr2=0x7f24a80b4bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:29.516 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.512+0000 7f24b02c8640 1 -- 172.21.15.132:0/4046909666 shutdown_connections 2024-04-16T15:53:29.516 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.512+0000 7f24b02c8640 1 -- 172.21.15.132:0/4046909666 wait complete. 2024-04-16T15:53:29.522 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2024-04-16T15:53:29.283581+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224592,"kb_used_data":4232,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750128,"statfs":{"total":773094113280,"available":772864131072,"internally_reserved":0,"allocated":4333568,"data_stored":2401004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001965"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464477+0000","last_change":"2024-04-16T15:53:19.219500+0000","last_active":"2024-04-16T15:53:20.464477+0000","last_peered":"2024-04-16T15:53:20.464477+0000","last_clean":"2024-04-16T15:53:20.464477+0000","last_became_active":"2024-04-16T15:53:19.219026+0000","last_became_peered":"2024-04-16T15:53:19.219026+0000","last_unstale":"2024-04-16T15:53:20.464477+0000","last_undegraded":"2024-04-16T15:53:20.464477+0000","last_fullsized":"2024-04-16T15:53:20.464477+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:14:20.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195457+0000","last_change":"2024-04-16T15:53:19.226148+0000","last_active":"2024-04-16T15:53:20.195457+0000","last_peered":"2024-04-16T15:53:20.195457+0000","last_clean":"2024-04-16T15:53:20.195457+0000","last_became_active":"2024-04-16T15:53:19.225869+0000","last_became_peered":"2024-04-16T15:53:19.225869+0000","last_unstale":"2024-04-16T15:53:20.195457+0000","last_undegraded":"2024-04-16T15:53:20.195457+0000","last_fullsized":"2024-04-16T15:53:20.195457+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:00:13.986513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464246+0000","last_change":"2024-04-16T15:53:19.209925+0000","last_active":"2024-04-16T15:53:20.464246+0000","last_peered":"2024-04-16T15:53:20.464246+0000","last_clean":"2024-04-16T15:53:20.464246+0000","last_became_active":"2024-04-16T15:53:19.209186+0000","last_became_peered":"2024-04-16T15:53:19.209186+0000","last_unstale":"2024-04-16T15:53:20.464246+0000","last_undegraded":"2024-04-16T15:53:20.464246+0000","last_fullsized":"2024-04-16T15:53:20.464246+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:12:25.656341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277237+0000","last_change":"2024-04-16T15:53:19.214711+0000","last_active":"2024-04-16T15:53:20.277237+0000","last_peered":"2024-04-16T15:53:20.277237+0000","last_clean":"2024-04-16T15:53:20.277237+0000","last_became_active":"2024-04-16T15:53:19.214414+0000","last_became_peered":"2024-04-16T15:53:19.214414+0000","last_unstale":"2024-04-16T15:53:20.277237+0000","last_undegraded":"2024-04-16T15:53:20.277237+0000","last_fullsized":"2024-04-16T15:53:20.277237+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:09:09.369395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463939+0000","last_change":"2024-04-16T15:53:19.218064+0000","last_active":"2024-04-16T15:53:20.463939+0000","last_peered":"2024-04-16T15:53:20.463939+0000","last_clean":"2024-04-16T15:53:20.463939+0000","last_became_active":"2024-04-16T15:53:19.217808+0000","last_became_peered":"2024-04-16T15:53:19.217808+0000","last_unstale":"2024-04-16T15:53:20.463939+0000","last_undegraded":"2024-04-16T15:53:20.463939+0000","last_fullsized":"2024-04-16T15:53:20.463939+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:27:14.925743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195195+0000","last_change":"2024-04-16T15:53:19.214250+0000","last_active":"2024-04-16T15:53:20.195195+0000","last_peered":"2024-04-16T15:53:20.195195+0000","last_clean":"2024-04-16T15:53:20.195195+0000","last_became_active":"2024-04-16T15:53:19.213980+0000","last_became_peered":"2024-04-16T15:53:19.213980+0000","last_unstale":"2024-04-16T15:53:20.195195+0000","last_undegraded":"2024-04-16T15:53:20.195195+0000","last_fullsized":"2024-04-16T15:53:20.195195+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:55:20.146233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197135+0000","last_change":"2024-04-16T15:53:19.221453+0000","last_active":"2024-04-16T15:53:20.197135+0000","last_peered":"2024-04-16T15:53:20.197135+0000","last_clean":"2024-04-16T15:53:20.197135+0000","last_became_active":"2024-04-16T15:53:19.221101+0000","last_became_peered":"2024-04-16T15:53:19.221101+0000","last_unstale":"2024-04-16T15:53:20.197135+0000","last_undegraded":"2024-04-16T15:53:20.197135+0000","last_fullsized":"2024-04-16T15:53:20.197135+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:47:53.262802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197388+0000","last_change":"2024-04-16T15:53:19.214371+0000","last_active":"2024-04-16T15:53:20.197388+0000","last_peered":"2024-04-16T15:53:20.197388+0000","last_clean":"2024-04-16T15:53:20.197388+0000","last_became_active":"2024-04-16T15:53:19.213544+0000","last_became_peered":"2024-04-16T15:53:19.213544+0000","last_unstale":"2024-04-16T15:53:20.197388+0000","last_undegraded":"2024-04-16T15:53:20.197388+0000","last_fullsized":"2024-04-16T15:53:20.197388+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:55:20.146233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197066+0000","last_change":"2024-04-16T15:53:19.207377+0000","last_active":"2024-04-16T15:53:20.197066+0000","last_peered":"2024-04-16T15:53:20.197066+0000","last_clean":"2024-04-16T15:53:20.197066+0000","last_became_active":"2024-04-16T15:53:19.206972+0000","last_became_peered":"2024-04-16T15:53:19.206972+0000","last_unstale":"2024-04-16T15:53:20.197066+0000","last_undegraded":"2024-04-16T15:53:20.197066+0000","last_fullsized":"2024-04-16T15:53:20.197066+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:41:40.266044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277465+0000","last_change":"2024-04-16T15:53:19.216192+0000","last_active":"2024-04-16T15:53:20.277465+0000","last_peered":"2024-04-16T15:53:20.277465+0000","last_clean":"2024-04-16T15:53:20.277465+0000","last_became_active":"2024-04-16T15:53:19.215441+0000","last_became_peered":"2024-04-16T15:53:19.215441+0000","last_unstale":"2024-04-16T15:53:20.277465+0000","last_undegraded":"2024-04-16T15:53:20.277465+0000","last_fullsized":"2024-04-16T15:53:20.277465+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:41:40.266044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196998+0000","last_change":"2024-04-16T15:53:19.219404+0000","last_active":"2024-04-16T15:53:20.196998+0000","last_peered":"2024-04-16T15:53:20.196998+0000","last_clean":"2024-04-16T15:53:20.196998+0000","last_became_active":"2024-04-16T15:53:19.219142+0000","last_became_peered":"2024-04-16T15:53:19.219142+0000","last_unstale":"2024-04-16T15:53:20.196998+0000","last_undegraded":"2024-04-16T15:53:20.196998+0000","last_fullsized":"2024-04-16T15:53:20.196998+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:40:00.074304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464668+0000","last_change":"2024-04-16T15:53:19.215861+0000","last_active":"2024-04-16T15:53:20.464668+0000","last_peered":"2024-04-16T15:53:20.464668+0000","last_clean":"2024-04-16T15:53:20.464668+0000","last_became_active":"2024-04-16T15:53:19.215574+0000","last_became_peered":"2024-04-16T15:53:19.215574+0000","last_unstale":"2024-04-16T15:53:20.464668+0000","last_undegraded":"2024-04-16T15:53:20.464668+0000","last_fullsized":"2024-04-16T15:53:20.464668+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:55:20.146233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463954+0000","last_change":"2024-04-16T15:53:19.219125+0000","last_active":"2024-04-16T15:53:20.463954+0000","last_peered":"2024-04-16T15:53:20.463954+0000","last_clean":"2024-04-16T15:53:20.463954+0000","last_became_active":"2024-04-16T15:53:19.218503+0000","last_became_peered":"2024-04-16T15:53:19.218503+0000","last_unstale":"2024-04-16T15:53:20.463954+0000","last_undegraded":"2024-04-16T15:53:20.463954+0000","last_fullsized":"2024-04-16T15:53:20.463954+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:49:25.688299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195100+0000","last_change":"2024-04-16T15:53:19.214790+0000","last_active":"2024-04-16T15:53:20.195100+0000","last_peered":"2024-04-16T15:53:20.195100+0000","last_clean":"2024-04-16T15:53:20.195100+0000","last_became_active":"2024-04-16T15:53:19.214539+0000","last_became_peered":"2024-04-16T15:53:19.214539+0000","last_unstale":"2024-04-16T15:53:20.195100+0000","last_undegraded":"2024-04-16T15:53:20.195100+0000","last_fullsized":"2024-04-16T15:53:20.195100+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:09:12.444137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464200+0000","last_change":"2024-04-16T15:53:19.215379+0000","last_active":"2024-04-16T15:53:20.464200+0000","last_peered":"2024-04-16T15:53:20.464200+0000","last_clean":"2024-04-16T15:53:20.464200+0000","last_became_active":"2024-04-16T15:53:19.215064+0000","last_became_peered":"2024-04-16T15:53:19.215064+0000","last_unstale":"2024-04-16T15:53:20.464200+0000","last_undegraded":"2024-04-16T15:53:20.464200+0000","last_fullsized":"2024-04-16T15:53:20.464200+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:32:14.472011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196790+0000","last_change":"2024-04-16T15:53:19.226607+0000","last_active":"2024-04-16T15:53:20.196790+0000","last_peered":"2024-04-16T15:53:20.196790+0000","last_clean":"2024-04-16T15:53:20.196790+0000","last_became_active":"2024-04-16T15:53:19.226349+0000","last_became_peered":"2024-04-16T15:53:19.226349+0000","last_unstale":"2024-04-16T15:53:20.196790+0000","last_undegraded":"2024-04-16T15:53:20.196790+0000","last_fullsized":"2024-04-16T15:53:20.196790+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:19.727876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197376+0000","last_change":"2024-04-16T15:53:19.222520+0000","last_active":"2024-04-16T15:53:20.197376+0000","last_peered":"2024-04-16T15:53:20.197376+0000","last_clean":"2024-04-16T15:53:20.197376+0000","last_became_active":"2024-04-16T15:53:19.222235+0000","last_became_peered":"2024-04-16T15:53:19.222235+0000","last_unstale":"2024-04-16T15:53:20.197376+0000","last_undegraded":"2024-04-16T15:53:20.197376+0000","last_fullsized":"2024-04-16T15:53:20.197376+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:26:17.244174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195538+0000","last_change":"2024-04-16T15:53:19.218035+0000","last_active":"2024-04-16T15:53:20.195538+0000","last_peered":"2024-04-16T15:53:20.195538+0000","last_clean":"2024-04-16T15:53:20.195538+0000","last_became_active":"2024-04-16T15:53:19.217745+0000","last_became_peered":"2024-04-16T15:53:19.217745+0000","last_unstale":"2024-04-16T15:53:20.195538+0000","last_undegraded":"2024-04-16T15:53:20.195538+0000","last_fullsized":"2024-04-16T15:53:20.195538+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:15:31.542491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195338+0000","last_change":"2024-04-16T15:53:19.217634+0000","last_active":"2024-04-16T15:53:20.195338+0000","last_peered":"2024-04-16T15:53:20.195338+0000","last_clean":"2024-04-16T15:53:20.195338+0000","last_became_active":"2024-04-16T15:53:19.217373+0000","last_became_peered":"2024-04-16T15:53:19.217373+0000","last_unstale":"2024-04-16T15:53:20.195338+0000","last_undegraded":"2024-04-16T15:53:20.195338+0000","last_fullsized":"2024-04-16T15:53:20.195338+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:48:31.729009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464109+0000","last_change":"2024-04-16T15:53:19.211323+0000","last_active":"2024-04-16T15:53:20.464109+0000","last_peered":"2024-04-16T15:53:20.464109+0000","last_clean":"2024-04-16T15:53:20.464109+0000","last_became_active":"2024-04-16T15:53:19.210812+0000","last_became_peered":"2024-04-16T15:53:19.210812+0000","last_unstale":"2024-04-16T15:53:20.464109+0000","last_undegraded":"2024-04-16T15:53:20.464109+0000","last_fullsized":"2024-04-16T15:53:20.464109+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:13:40.919473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196930+0000","last_change":"2024-04-16T15:53:19.199390+0000","last_active":"2024-04-16T15:53:20.196930+0000","last_peered":"2024-04-16T15:53:20.196930+0000","last_clean":"2024-04-16T15:53:20.196930+0000","last_became_active":"2024-04-16T15:53:19.199066+0000","last_became_peered":"2024-04-16T15:53:19.199066+0000","last_unstale":"2024-04-16T15:53:20.196930+0000","last_undegraded":"2024-04-16T15:53:20.196930+0000","last_fullsized":"2024-04-16T15:53:20.196930+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:01:01.640923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197022+0000","last_change":"2024-04-16T15:53:19.219587+0000","last_active":"2024-04-16T15:53:20.197022+0000","last_peered":"2024-04-16T15:53:20.197022+0000","last_clean":"2024-04-16T15:53:20.197022+0000","last_became_active":"2024-04-16T15:53:19.219150+0000","last_became_peered":"2024-04-16T15:53:19.219150+0000","last_unstale":"2024-04-16T15:53:20.197022+0000","last_undegraded":"2024-04-16T15:53:20.197022+0000","last_fullsized":"2024-04-16T15:53:20.197022+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:09:09.369395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463763+0000","last_change":"2024-04-16T15:53:19.211517+0000","last_active":"2024-04-16T15:53:20.463763+0000","last_peered":"2024-04-16T15:53:20.463763+0000","last_clean":"2024-04-16T15:53:20.463763+0000","last_became_active":"2024-04-16T15:53:19.211260+0000","last_became_peered":"2024-04-16T15:53:19.211260+0000","last_unstale":"2024-04-16T15:53:20.463763+0000","last_undegraded":"2024-04-16T15:53:20.463763+0000","last_fullsized":"2024-04-16T15:53:20.463763+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:54:25.966875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464423+0000","last_change":"2024-04-16T15:53:19.204402+0000","last_active":"2024-04-16T15:53:20.464423+0000","last_peered":"2024-04-16T15:53:20.464423+0000","last_clean":"2024-04-16T15:53:20.464423+0000","last_became_active":"2024-04-16T15:53:19.204086+0000","last_became_peered":"2024-04-16T15:53:19.204086+0000","last_unstale":"2024-04-16T15:53:20.464423+0000","last_undegraded":"2024-04-16T15:53:20.464423+0000","last_fullsized":"2024-04-16T15:53:20.464423+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:09:12.444137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277504+0000","last_change":"2024-04-16T15:53:19.214478+0000","last_active":"2024-04-16T15:53:20.277504+0000","last_peered":"2024-04-16T15:53:20.277504+0000","last_clean":"2024-04-16T15:53:20.277504+0000","last_became_active":"2024-04-16T15:53:19.214199+0000","last_became_peered":"2024-04-16T15:53:19.214199+0000","last_unstale":"2024-04-16T15:53:20.277504+0000","last_undegraded":"2024-04-16T15:53:20.277504+0000","last_fullsized":"2024-04-16T15:53:20.277504+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:38:12.802270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195587+0000","last_change":"2024-04-16T15:53:19.223834+0000","last_active":"2024-04-16T15:53:20.195587+0000","last_peered":"2024-04-16T15:53:20.195587+0000","last_clean":"2024-04-16T15:53:20.195587+0000","last_became_active":"2024-04-16T15:53:19.223467+0000","last_became_peered":"2024-04-16T15:53:19.223467+0000","last_unstale":"2024-04-16T15:53:20.195587+0000","last_undegraded":"2024-04-16T15:53:20.195587+0000","last_fullsized":"2024-04-16T15:53:20.195587+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:20:36.722580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277601+0000","last_change":"2024-04-16T15:53:19.215061+0000","last_active":"2024-04-16T15:53:20.277601+0000","last_peered":"2024-04-16T15:53:20.277601+0000","last_clean":"2024-04-16T15:53:20.277601+0000","last_became_active":"2024-04-16T15:53:19.214786+0000","last_became_peered":"2024-04-16T15:53:19.214786+0000","last_unstale":"2024-04-16T15:53:20.277601+0000","last_undegraded":"2024-04-16T15:53:20.277601+0000","last_fullsized":"2024-04-16T15:53:20.277601+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:24:52.885269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464800+0000","last_change":"2024-04-16T15:53:19.199651+0000","last_active":"2024-04-16T15:53:20.464800+0000","last_peered":"2024-04-16T15:53:20.464800+0000","last_clean":"2024-04-16T15:53:20.464800+0000","last_became_active":"2024-04-16T15:53:19.199270+0000","last_became_peered":"2024-04-16T15:53:19.199270+0000","last_unstale":"2024-04-16T15:53:20.464800+0000","last_undegraded":"2024-04-16T15:53:20.464800+0000","last_fullsized":"2024-04-16T15:53:20.464800+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:48:31.729009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197108+0000","last_change":"2024-04-16T15:53:19.218009+0000","last_active":"2024-04-16T15:53:20.197108+0000","last_peered":"2024-04-16T15:53:20.197108+0000","last_clean":"2024-04-16T15:53:20.197108+0000","last_became_active":"2024-04-16T15:53:19.217749+0000","last_became_peered":"2024-04-16T15:53:19.217749+0000","last_unstale":"2024-04-16T15:53:20.197108+0000","last_undegraded":"2024-04-16T15:53:20.197108+0000","last_fullsized":"2024-04-16T15:53:20.197108+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:38:12.802270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196284+0000","last_change":"2024-04-16T15:53:19.215554+0000","last_active":"2024-04-16T15:53:20.196284+0000","last_peered":"2024-04-16T15:53:20.196284+0000","last_clean":"2024-04-16T15:53:20.196284+0000","last_became_active":"2024-04-16T15:53:19.215243+0000","last_became_peered":"2024-04-16T15:53:19.215243+0000","last_unstale":"2024-04-16T15:53:20.196284+0000","last_undegraded":"2024-04-16T15:53:20.196284+0000","last_fullsized":"2024-04-16T15:53:20.196284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:24:52.885269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463993+0000","last_change":"2024-04-16T15:53:19.213628+0000","last_active":"2024-04-16T15:53:20.463993+0000","last_peered":"2024-04-16T15:53:20.463993+0000","last_clean":"2024-04-16T15:53:20.463993+0000","last_became_active":"2024-04-16T15:53:19.213345+0000","last_became_peered":"2024-04-16T15:53:19.213345+0000","last_unstale":"2024-04-16T15:53:20.463993+0000","last_undegraded":"2024-04-16T15:53:20.463993+0000","last_fullsized":"2024-04-16T15:53:20.463993+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:34:49.536139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196294+0000","last_change":"2024-04-16T15:53:19.212569+0000","last_active":"2024-04-16T15:53:20.196294+0000","last_peered":"2024-04-16T15:53:20.196294+0000","last_clean":"2024-04-16T15:53:20.196294+0000","last_became_active":"2024-04-16T15:53:19.212198+0000","last_became_peered":"2024-04-16T15:53:19.212198+0000","last_unstale":"2024-04-16T15:53:20.196294+0000","last_undegraded":"2024-04-16T15:53:20.196294+0000","last_fullsized":"2024-04-16T15:53:20.196294+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:27:57.263921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463687+0000","last_change":"2024-04-16T15:53:19.212160+0000","last_active":"2024-04-16T15:53:20.463687+0000","last_peered":"2024-04-16T15:53:20.463687+0000","last_clean":"2024-04-16T15:53:20.463687+0000","last_became_active":"2024-04-16T15:53:19.211902+0000","last_became_peered":"2024-04-16T15:53:19.211902+0000","last_unstale":"2024-04-16T15:53:20.463687+0000","last_undegraded":"2024-04-16T15:53:20.463687+0000","last_fullsized":"2024-04-16T15:53:20.463687+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:14:20.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464727+0000","last_change":"2024-04-16T15:53:18.210743+0000","last_active":"2024-04-16T15:53:20.464727+0000","last_peered":"2024-04-16T15:53:20.464727+0000","last_clean":"2024-04-16T15:53:20.464727+0000","last_became_active":"2024-04-16T15:53:18.210466+0000","last_became_peered":"2024-04-16T15:53:18.210466+0000","last_unstale":"2024-04-16T15:53:20.464727+0000","last_undegraded":"2024-04-16T15:53:20.464727+0000","last_fullsized":"2024-04-16T15:53:20.464727+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:03:51.897303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464638+0000","last_change":"2024-04-16T15:53:19.214490+0000","last_active":"2024-04-16T15:53:20.464638+0000","last_peered":"2024-04-16T15:53:20.464638+0000","last_clean":"2024-04-16T15:53:20.464638+0000","last_became_active":"2024-04-16T15:53:19.214206+0000","last_became_peered":"2024-04-16T15:53:19.214206+0000","last_unstale":"2024-04-16T15:53:20.464638+0000","last_undegraded":"2024-04-16T15:53:20.464638+0000","last_fullsized":"2024-04-16T15:53:20.464638+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:54:25.966875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463629+0000","last_change":"2024-04-16T15:53:18.213622+0000","last_active":"2024-04-16T15:53:20.463629+0000","last_peered":"2024-04-16T15:53:20.463629+0000","last_clean":"2024-04-16T15:53:20.463629+0000","last_became_active":"2024-04-16T15:53:18.213368+0000","last_became_peered":"2024-04-16T15:53:18.213368+0000","last_unstale":"2024-04-16T15:53:20.463629+0000","last_undegraded":"2024-04-16T15:53:20.463629+0000","last_fullsized":"2024-04-16T15:53:20.463629+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:31:41.162544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196775+0000","last_change":"2024-04-16T15:53:19.217908+0000","last_active":"2024-04-16T15:53:20.196775+0000","last_peered":"2024-04-16T15:53:20.196775+0000","last_clean":"2024-04-16T15:53:20.196775+0000","last_became_active":"2024-04-16T15:53:19.217659+0000","last_became_peered":"2024-04-16T15:53:19.217659+0000","last_unstale":"2024-04-16T15:53:20.196775+0000","last_undegraded":"2024-04-16T15:53:20.196775+0000","last_fullsized":"2024-04-16T15:53:20.196775+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:18:05.482765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195229+0000","last_change":"2024-04-16T15:53:18.206967+0000","last_active":"2024-04-16T15:53:20.195229+0000","last_peered":"2024-04-16T15:53:20.195229+0000","last_clean":"2024-04-16T15:53:20.195229+0000","last_became_active":"2024-04-16T15:53:18.206684+0000","last_became_peered":"2024-04-16T15:53:18.206684+0000","last_unstale":"2024-04-16T15:53:20.195229+0000","last_undegraded":"2024-04-16T15:53:20.195229+0000","last_fullsized":"2024-04-16T15:53:20.195229+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:14:19.341087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277619+0000","last_change":"2024-04-16T15:53:19.214612+0000","last_active":"2024-04-16T15:53:20.277619+0000","last_peered":"2024-04-16T15:53:20.277619+0000","last_clean":"2024-04-16T15:53:20.277619+0000","last_became_active":"2024-04-16T15:53:19.214331+0000","last_became_peered":"2024-04-16T15:53:19.214331+0000","last_unstale":"2024-04-16T15:53:20.277619+0000","last_undegraded":"2024-04-16T15:53:20.277619+0000","last_fullsized":"2024-04-16T15:53:20.277619+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:27:57.263921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464122+0000","last_change":"2024-04-16T15:53:18.210644+0000","last_active":"2024-04-16T15:53:20.464122+0000","last_peered":"2024-04-16T15:53:20.464122+0000","last_clean":"2024-04-16T15:53:20.464122+0000","last_became_active":"2024-04-16T15:53:18.210390+0000","last_became_peered":"2024-04-16T15:53:18.210390+0000","last_unstale":"2024-04-16T15:53:20.464122+0000","last_undegraded":"2024-04-16T15:53:20.464122+0000","last_fullsized":"2024-04-16T15:53:20.464122+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:00:38.767894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196471+0000","last_change":"2024-04-16T15:53:19.218628+0000","last_active":"2024-04-16T15:53:20.196471+0000","last_peered":"2024-04-16T15:53:20.196471+0000","last_clean":"2024-04-16T15:53:20.196471+0000","last_became_active":"2024-04-16T15:53:19.218185+0000","last_became_peered":"2024-04-16T15:53:19.218185+0000","last_unstale":"2024-04-16T15:53:20.196471+0000","last_undegraded":"2024-04-16T15:53:20.196471+0000","last_fullsized":"2024-04-16T15:53:20.196471+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:20:34.974674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197176+0000","last_change":"2024-04-16T15:53:18.210540+0000","last_active":"2024-04-16T15:53:20.197176+0000","last_peered":"2024-04-16T15:53:20.197176+0000","last_clean":"2024-04-16T15:53:20.197176+0000","last_became_active":"2024-04-16T15:53:18.210271+0000","last_became_peered":"2024-04-16T15:53:18.210271+0000","last_unstale":"2024-04-16T15:53:20.197176+0000","last_undegraded":"2024-04-16T15:53:20.197176+0000","last_fullsized":"2024-04-16T15:53:20.197176+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:08:37.253061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464363+0000","last_change":"2024-04-16T15:53:19.200361+0000","last_active":"2024-04-16T15:53:20.464363+0000","last_peered":"2024-04-16T15:53:20.464363+0000","last_clean":"2024-04-16T15:53:20.464363+0000","last_became_active":"2024-04-16T15:53:19.200086+0000","last_became_peered":"2024-04-16T15:53:19.200086+0000","last_unstale":"2024-04-16T15:53:20.464363+0000","last_undegraded":"2024-04-16T15:53:20.464363+0000","last_fullsized":"2024-04-16T15:53:20.464363+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:40:00.074304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196830+0000","last_change":"2024-04-16T15:53:18.210491+0000","last_active":"2024-04-16T15:53:20.196830+0000","last_peered":"2024-04-16T15:53:20.196830+0000","last_clean":"2024-04-16T15:53:20.196830+0000","last_became_active":"2024-04-16T15:53:18.210234+0000","last_became_peered":"2024-04-16T15:53:18.210234+0000","last_unstale":"2024-04-16T15:53:20.196830+0000","last_undegraded":"2024-04-16T15:53:20.196830+0000","last_fullsized":"2024-04-16T15:53:20.196830+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:28:44.787593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196717+0000","last_change":"2024-04-16T15:53:19.210713+0000","last_active":"2024-04-16T15:53:20.196717+0000","last_peered":"2024-04-16T15:53:20.196717+0000","last_clean":"2024-04-16T15:53:20.196717+0000","last_became_active":"2024-04-16T15:53:19.210425+0000","last_became_peered":"2024-04-16T15:53:19.210425+0000","last_unstale":"2024-04-16T15:53:20.196717+0000","last_undegraded":"2024-04-16T15:53:20.196717+0000","last_fullsized":"2024-04-16T15:53:20.196717+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:42:06.870549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.194850+0000","last_change":"2024-04-16T15:53:18.210535+0000","last_active":"2024-04-16T15:53:20.194850+0000","last_peered":"2024-04-16T15:53:20.194850+0000","last_clean":"2024-04-16T15:53:20.194850+0000","last_became_active":"2024-04-16T15:53:18.210282+0000","last_became_peered":"2024-04-16T15:53:18.210282+0000","last_unstale":"2024-04-16T15:53:20.194850+0000","last_undegraded":"2024-04-16T15:53:20.194850+0000","last_fullsized":"2024-04-16T15:53:20.194850+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:09:56.208391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277154+0000","last_change":"2024-04-16T15:53:19.212496+0000","last_active":"2024-04-16T15:53:20.277154+0000","last_peered":"2024-04-16T15:53:20.277154+0000","last_clean":"2024-04-16T15:53:20.277154+0000","last_became_active":"2024-04-16T15:53:19.212239+0000","last_became_peered":"2024-04-16T15:53:19.212239+0000","last_unstale":"2024-04-16T15:53:20.277154+0000","last_undegraded":"2024-04-16T15:53:20.277154+0000","last_fullsized":"2024-04-16T15:53:20.277154+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:18:05.482765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195756+0000","last_change":"2024-04-16T15:53:18.208530+0000","last_active":"2024-04-16T15:53:20.195756+0000","last_peered":"2024-04-16T15:53:20.195756+0000","last_clean":"2024-04-16T15:53:20.195756+0000","last_became_active":"2024-04-16T15:53:18.208225+0000","last_became_peered":"2024-04-16T15:53:18.208225+0000","last_unstale":"2024-04-16T15:53:20.195756+0000","last_undegraded":"2024-04-16T15:53:20.195756+0000","last_fullsized":"2024-04-16T15:53:20.195756+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:01:02.783464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464310+0000","last_change":"2024-04-16T15:53:19.215852+0000","last_active":"2024-04-16T15:53:20.464310+0000","last_peered":"2024-04-16T15:53:20.464310+0000","last_clean":"2024-04-16T15:53:20.464310+0000","last_became_active":"2024-04-16T15:53:19.215600+0000","last_became_peered":"2024-04-16T15:53:19.215600+0000","last_unstale":"2024-04-16T15:53:20.464310+0000","last_undegraded":"2024-04-16T15:53:20.464310+0000","last_fullsized":"2024-04-16T15:53:20.464310+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:19.727876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195485+0000","last_change":"2024-04-16T15:53:18.209410+0000","last_active":"2024-04-16T15:53:20.195485+0000","last_peered":"2024-04-16T15:53:20.195485+0000","last_clean":"2024-04-16T15:53:20.195485+0000","last_became_active":"2024-04-16T15:53:18.209128+0000","last_became_peered":"2024-04-16T15:53:18.209128+0000","last_unstale":"2024-04-16T15:53:20.195485+0000","last_undegraded":"2024-04-16T15:53:20.195485+0000","last_fullsized":"2024-04-16T15:53:20.195485+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:18:04.480511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195481+0000","last_change":"2024-04-16T15:53:19.218196+0000","last_active":"2024-04-16T15:53:20.195481+0000","last_peered":"2024-04-16T15:53:20.195481+0000","last_clean":"2024-04-16T15:53:20.195481+0000","last_became_active":"2024-04-16T15:53:19.217938+0000","last_became_peered":"2024-04-16T15:53:19.217938+0000","last_unstale":"2024-04-16T15:53:20.195481+0000","last_undegraded":"2024-04-16T15:53:20.195481+0000","last_fullsized":"2024-04-16T15:53:20.195481+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:15:54.665161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463743+0000","last_change":"2024-04-16T15:53:18.212761+0000","last_active":"2024-04-16T15:53:20.463743+0000","last_peered":"2024-04-16T15:53:20.463743+0000","last_clean":"2024-04-16T15:53:20.463743+0000","last_became_active":"2024-04-16T15:53:18.212427+0000","last_became_peered":"2024-04-16T15:53:18.212427+0000","last_unstale":"2024-04-16T15:53:20.463743+0000","last_undegraded":"2024-04-16T15:53:20.463743+0000","last_fullsized":"2024-04-16T15:53:20.463743+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:46:28.763927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195317+0000","last_change":"2024-04-16T15:53:19.223760+0000","last_active":"2024-04-16T15:53:20.195317+0000","last_peered":"2024-04-16T15:53:20.195317+0000","last_clean":"2024-04-16T15:53:20.195317+0000","last_became_active":"2024-04-16T15:53:19.223461+0000","last_became_peered":"2024-04-16T15:53:19.223461+0000","last_unstale":"2024-04-16T15:53:20.195317+0000","last_undegraded":"2024-04-16T15:53:20.195317+0000","last_fullsized":"2024-04-16T15:53:20.195317+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:19:47.160288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464486+0000","last_change":"2024-04-16T15:53:18.208880+0000","last_active":"2024-04-16T15:53:20.464486+0000","last_peered":"2024-04-16T15:53:20.464486+0000","last_clean":"2024-04-16T15:53:20.464486+0000","last_became_active":"2024-04-16T15:53:18.208317+0000","last_became_peered":"2024-04-16T15:53:18.208317+0000","last_unstale":"2024-04-16T15:53:20.464486+0000","last_undegraded":"2024-04-16T15:53:20.464486+0000","last_fullsized":"2024-04-16T15:53:20.464486+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:09:56.208391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464325+0000","last_change":"2024-04-16T15:53:19.218075+0000","last_active":"2024-04-16T15:53:20.464325+0000","last_peered":"2024-04-16T15:53:20.464325+0000","last_clean":"2024-04-16T15:53:20.464325+0000","last_became_active":"2024-04-16T15:53:19.217805+0000","last_became_peered":"2024-04-16T15:53:19.217805+0000","last_unstale":"2024-04-16T15:53:20.464325+0000","last_undegraded":"2024-04-16T15:53:20.464325+0000","last_fullsized":"2024-04-16T15:53:20.464325+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:47:53.262802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195193+0000","last_change":"2024-04-16T15:53:18.206853+0000","last_active":"2024-04-16T15:53:20.195193+0000","last_peered":"2024-04-16T15:53:20.195193+0000","last_clean":"2024-04-16T15:53:20.195193+0000","last_became_active":"2024-04-16T15:53:18.206613+0000","last_became_peered":"2024-04-16T15:53:18.206613+0000","last_unstale":"2024-04-16T15:53:20.195193+0000","last_undegraded":"2024-04-16T15:53:20.195193+0000","last_fullsized":"2024-04-16T15:53:20.195193+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:54:24.964622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277187+0000","last_change":"2024-04-16T15:53:19.222111+0000","last_active":"2024-04-16T15:53:20.277187+0000","last_peered":"2024-04-16T15:53:20.277187+0000","last_clean":"2024-04-16T15:53:20.277187+0000","last_became_active":"2024-04-16T15:53:19.221536+0000","last_became_peered":"2024-04-16T15:53:19.221536+0000","last_unstale":"2024-04-16T15:53:20.277187+0000","last_undegraded":"2024-04-16T15:53:20.277187+0000","last_fullsized":"2024-04-16T15:53:20.277187+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:01:01.640923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197189+0000","last_change":"2024-04-16T15:53:18.207932+0000","last_active":"2024-04-16T15:53:20.197189+0000","last_peered":"2024-04-16T15:53:20.197189+0000","last_clean":"2024-04-16T15:53:20.197189+0000","last_became_active":"2024-04-16T15:53:18.207445+0000","last_became_peered":"2024-04-16T15:53:18.207445+0000","last_unstale":"2024-04-16T15:53:20.197189+0000","last_undegraded":"2024-04-16T15:53:20.197189+0000","last_fullsized":"2024-04-16T15:53:20.197189+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:26:09.897432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195254+0000","last_change":"2024-04-16T15:53:19.215660+0000","last_active":"2024-04-16T15:53:20.195254+0000","last_peered":"2024-04-16T15:53:20.195254+0000","last_clean":"2024-04-16T15:53:20.195254+0000","last_became_active":"2024-04-16T15:53:19.215415+0000","last_became_peered":"2024-04-16T15:53:19.215415+0000","last_unstale":"2024-04-16T15:53:20.195254+0000","last_undegraded":"2024-04-16T15:53:20.195254+0000","last_fullsized":"2024-04-16T15:53:20.195254+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:26:17.244174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277262+0000","last_change":"2024-04-16T15:53:18.207023+0000","last_active":"2024-04-16T15:53:20.277262+0000","last_peered":"2024-04-16T15:53:20.277262+0000","last_clean":"2024-04-16T15:53:20.277262+0000","last_became_active":"2024-04-16T15:53:18.206764+0000","last_became_peered":"2024-04-16T15:53:18.206764+0000","last_unstale":"2024-04-16T15:53:20.277262+0000","last_undegraded":"2024-04-16T15:53:20.277262+0000","last_fullsized":"2024-04-16T15:53:20.277262+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:49:24.686045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196471+0000","last_change":"2024-04-16T15:53:19.218507+0000","last_active":"2024-04-16T15:53:20.196471+0000","last_peered":"2024-04-16T15:53:20.196471+0000","last_clean":"2024-04-16T15:53:20.196471+0000","last_became_active":"2024-04-16T15:53:19.218250+0000","last_became_peered":"2024-04-16T15:53:19.218250+0000","last_unstale":"2024-04-16T15:53:20.196471+0000","last_undegraded":"2024-04-16T15:53:20.196471+0000","last_fullsized":"2024-04-16T15:53:20.196471+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:12:25.656341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.194904+0000","last_change":"2024-04-16T15:53:18.207895+0000","last_active":"2024-04-16T15:53:20.194904+0000","last_peered":"2024-04-16T15:53:20.194904+0000","last_clean":"2024-04-16T15:53:20.194904+0000","last_became_active":"2024-04-16T15:53:18.207633+0000","last_became_peered":"2024-04-16T15:53:18.207633+0000","last_unstale":"2024-04-16T15:53:20.194904+0000","last_undegraded":"2024-04-16T15:53:20.194904+0000","last_fullsized":"2024-04-16T15:53:20.194904+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:42:05.868295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464143+0000","last_change":"2024-04-16T15:53:19.212616+0000","last_active":"2024-04-16T15:53:20.464143+0000","last_peered":"2024-04-16T15:53:20.464143+0000","last_clean":"2024-04-16T15:53:20.464143+0000","last_became_active":"2024-04-16T15:53:19.212171+0000","last_became_peered":"2024-04-16T15:53:19.212171+0000","last_unstale":"2024-04-16T15:53:20.464143+0000","last_undegraded":"2024-04-16T15:53:20.464143+0000","last_fullsized":"2024-04-16T15:53:20.464143+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:13:11.997144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.194904+0000","last_change":"2024-04-16T15:53:18.207615+0000","last_active":"2024-04-16T15:53:20.194904+0000","last_peered":"2024-04-16T15:53:20.194904+0000","last_clean":"2024-04-16T15:53:20.194904+0000","last_became_active":"2024-04-16T15:53:18.207332+0000","last_became_peered":"2024-04-16T15:53:18.207332+0000","last_unstale":"2024-04-16T15:53:20.194904+0000","last_undegraded":"2024-04-16T15:53:20.194904+0000","last_fullsized":"2024-04-16T15:53:20.194904+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:01:00.638669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196700+0000","last_change":"2024-04-16T15:53:19.202791+0000","last_active":"2024-04-16T15:53:20.196700+0000","last_peered":"2024-04-16T15:53:20.196700+0000","last_clean":"2024-04-16T15:53:20.196700+0000","last_became_active":"2024-04-16T15:53:19.202414+0000","last_became_peered":"2024-04-16T15:53:19.202414+0000","last_unstale":"2024-04-16T15:53:20.196700+0000","last_undegraded":"2024-04-16T15:53:20.196700+0000","last_fullsized":"2024-04-16T15:53:20.196700+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:09:57.210644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277536+0000","last_change":"2024-04-16T15:53:18.211975+0000","last_active":"2024-04-16T15:53:20.277536+0000","last_peered":"2024-04-16T15:53:20.277536+0000","last_clean":"2024-04-16T15:53:20.277536+0000","last_became_active":"2024-04-16T15:53:18.211709+0000","last_became_peered":"2024-04-16T15:53:18.211709+0000","last_unstale":"2024-04-16T15:53:20.277536+0000","last_undegraded":"2024-04-16T15:53:20.277536+0000","last_fullsized":"2024-04-16T15:53:20.277536+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:03:51.897303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464666+0000","last_change":"2024-04-16T15:53:19.202854+0000","last_active":"2024-04-16T15:53:20.464666+0000","last_peered":"2024-04-16T15:53:20.464666+0000","last_clean":"2024-04-16T15:53:20.464666+0000","last_became_active":"2024-04-16T15:53:19.202530+0000","last_became_peered":"2024-04-16T15:53:19.202530+0000","last_unstale":"2024-04-16T15:53:20.464666+0000","last_undegraded":"2024-04-16T15:53:20.464666+0000","last_fullsized":"2024-04-16T15:53:20.464666+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:26:17.244174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196884+0000","last_change":"2024-04-16T15:53:18.208018+0000","last_active":"2024-04-16T15:53:20.196884+0000","last_peered":"2024-04-16T15:53:20.196884+0000","last_clean":"2024-04-16T15:53:20.196884+0000","last_became_active":"2024-04-16T15:53:18.207596+0000","last_became_peered":"2024-04-16T15:53:18.207596+0000","last_unstale":"2024-04-16T15:53:20.196884+0000","last_undegraded":"2024-04-16T15:53:20.196884+0000","last_fullsized":"2024-04-16T15:53:20.196884+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:03:51.897303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277265+0000","last_change":"2024-04-16T15:53:19.215051+0000","last_active":"2024-04-16T15:53:20.277265+0000","last_peered":"2024-04-16T15:53:20.277265+0000","last_clean":"2024-04-16T15:53:20.277265+0000","last_became_active":"2024-04-16T15:53:19.214161+0000","last_became_peered":"2024-04-16T15:53:19.214161+0000","last_unstale":"2024-04-16T15:53:20.277265+0000","last_undegraded":"2024-04-16T15:53:20.277265+0000","last_fullsized":"2024-04-16T15:53:20.277265+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:21:33.438988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196677+0000","last_change":"2024-04-16T15:53:18.210890+0000","last_active":"2024-04-16T15:53:20.196677+0000","last_peered":"2024-04-16T15:53:20.196677+0000","last_clean":"2024-04-16T15:53:20.196677+0000","last_became_active":"2024-04-16T15:53:18.210498+0000","last_became_peered":"2024-04-16T15:53:18.210498+0000","last_unstale":"2024-04-16T15:53:20.196677+0000","last_undegraded":"2024-04-16T15:53:20.196677+0000","last_fullsized":"2024-04-16T15:53:20.196677+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:31:41.162544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463890+0000","last_change":"2024-04-16T15:53:19.212904+0000","last_active":"2024-04-16T15:53:20.463890+0000","last_peered":"2024-04-16T15:53:20.463890+0000","last_clean":"2024-04-16T15:53:20.463890+0000","last_became_active":"2024-04-16T15:53:19.212661+0000","last_became_peered":"2024-04-16T15:53:19.212661+0000","last_unstale":"2024-04-16T15:53:20.463890+0000","last_undegraded":"2024-04-16T15:53:20.463890+0000","last_fullsized":"2024-04-16T15:53:20.463890+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:46:29.766181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196432+0000","last_change":"2024-04-16T15:53:18.212722+0000","last_active":"2024-04-16T15:53:20.196432+0000","last_peered":"2024-04-16T15:53:20.196432+0000","last_clean":"2024-04-16T15:53:20.196432+0000","last_became_active":"2024-04-16T15:53:18.212434+0000","last_became_peered":"2024-04-16T15:53:18.212434+0000","last_unstale":"2024-04-16T15:53:20.196432+0000","last_undegraded":"2024-04-16T15:53:20.196432+0000","last_fullsized":"2024-04-16T15:53:20.196432+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:46:28.763927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463722+0000","last_change":"2024-04-16T15:53:19.212150+0000","last_active":"2024-04-16T15:53:20.463722+0000","last_peered":"2024-04-16T15:53:20.463722+0000","last_clean":"2024-04-16T15:53:20.463722+0000","last_became_active":"2024-04-16T15:53:19.211842+0000","last_became_peered":"2024-04-16T15:53:19.211842+0000","last_unstale":"2024-04-16T15:53:20.463722+0000","last_undegraded":"2024-04-16T15:53:20.463722+0000","last_fullsized":"2024-04-16T15:53:20.463722+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:03:52.899556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464047+0000","last_change":"2024-04-16T15:53:18.210794+0000","last_active":"2024-04-16T15:53:20.464047+0000","last_peered":"2024-04-16T15:53:20.464047+0000","last_clean":"2024-04-16T15:53:20.464047+0000","last_became_active":"2024-04-16T15:53:18.210087+0000","last_became_peered":"2024-04-16T15:53:18.210087+0000","last_unstale":"2024-04-16T15:53:20.464047+0000","last_undegraded":"2024-04-16T15:53:20.464047+0000","last_fullsized":"2024-04-16T15:53:20.464047+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:03:51.897303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464082+0000","last_change":"2024-04-16T15:53:19.206926+0000","last_active":"2024-04-16T15:53:20.464082+0000","last_peered":"2024-04-16T15:53:20.464082+0000","last_clean":"2024-04-16T15:53:20.464082+0000","last_became_active":"2024-04-16T15:53:19.206660+0000","last_became_peered":"2024-04-16T15:53:19.206660+0000","last_unstale":"2024-04-16T15:53:20.464082+0000","last_undegraded":"2024-04-16T15:53:20.464082+0000","last_fullsized":"2024-04-16T15:53:20.464082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:20:17.996907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464223+0000","last_change":"2024-04-16T15:53:18.210087+0000","last_active":"2024-04-16T15:53:20.464223+0000","last_peered":"2024-04-16T15:53:20.464223+0000","last_clean":"2024-04-16T15:53:20.464223+0000","last_became_active":"2024-04-16T15:53:18.209539+0000","last_became_peered":"2024-04-16T15:53:18.209539+0000","last_unstale":"2024-04-16T15:53:20.464223+0000","last_undegraded":"2024-04-16T15:53:20.464223+0000","last_fullsized":"2024-04-16T15:53:20.464223+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:31:41.162544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463515+0000","last_change":"2024-04-16T15:53:19.206275+0000","last_active":"2024-04-16T15:53:20.463515+0000","last_peered":"2024-04-16T15:53:20.463515+0000","last_clean":"2024-04-16T15:53:20.463515+0000","last_became_active":"2024-04-16T15:53:19.205995+0000","last_became_peered":"2024-04-16T15:53:19.205995+0000","last_unstale":"2024-04-16T15:53:20.463515+0000","last_undegraded":"2024-04-16T15:53:20.463515+0000","last_fullsized":"2024-04-16T15:53:20.463515+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:08:38.255314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195767+0000","last_change":"2024-04-16T15:53:18.204767+0000","last_active":"2024-04-16T15:53:20.195767+0000","last_peered":"2024-04-16T15:53:20.195767+0000","last_clean":"2024-04-16T15:53:20.195767+0000","last_became_active":"2024-04-16T15:53:18.204142+0000","last_became_peered":"2024-04-16T15:53:18.204142+0000","last_unstale":"2024-04-16T15:53:20.195767+0000","last_undegraded":"2024-04-16T15:53:20.195767+0000","last_fullsized":"2024-04-16T15:53:20.195767+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:27:13.923490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197141+0000","last_change":"2024-04-16T15:53:19.215530+0000","last_active":"2024-04-16T15:53:20.197141+0000","last_peered":"2024-04-16T15:53:20.197141+0000","last_clean":"2024-04-16T15:53:20.197141+0000","last_became_active":"2024-04-16T15:53:19.215227+0000","last_became_peered":"2024-04-16T15:53:19.215227+0000","last_unstale":"2024-04-16T15:53:20.197141+0000","last_undegraded":"2024-04-16T15:53:20.197141+0000","last_fullsized":"2024-04-16T15:53:20.197141+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:09:12.444137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464488+0000","last_change":"2024-04-16T15:53:18.209377+0000","last_active":"2024-04-16T15:53:20.464488+0000","last_peered":"2024-04-16T15:53:20.464488+0000","last_clean":"2024-04-16T15:53:20.464488+0000","last_became_active":"2024-04-16T15:53:18.209092+0000","last_became_peered":"2024-04-16T15:53:18.209092+0000","last_unstale":"2024-04-16T15:53:20.464488+0000","last_undegraded":"2024-04-16T15:53:20.464488+0000","last_fullsized":"2024-04-16T15:53:20.464488+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:54:24.964622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463717+0000","last_change":"2024-04-16T15:53:19.210213+0000","last_active":"2024-04-16T15:53:20.463717+0000","last_peered":"2024-04-16T15:53:20.463717+0000","last_clean":"2024-04-16T15:53:20.463717+0000","last_became_active":"2024-04-16T15:53:19.209941+0000","last_became_peered":"2024-04-16T15:53:19.209941+0000","last_unstale":"2024-04-16T15:53:20.463717+0000","last_undegraded":"2024-04-16T15:53:20.463717+0000","last_fullsized":"2024-04-16T15:53:20.463717+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:31:42.164797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277554+0000","last_change":"2024-04-16T15:53:18.204255+0000","last_active":"2024-04-16T15:53:20.277554+0000","last_peered":"2024-04-16T15:53:20.277554+0000","last_clean":"2024-04-16T15:53:20.277554+0000","last_became_active":"2024-04-16T15:53:18.203960+0000","last_became_peered":"2024-04-16T15:53:18.203960+0000","last_unstale":"2024-04-16T15:53:20.277554+0000","last_undegraded":"2024-04-16T15:53:20.277554+0000","last_fullsized":"2024-04-16T15:53:20.277554+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:46:28.763927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464698+0000","last_change":"2024-04-16T15:53:19.218513+0000","last_active":"2024-04-16T15:53:20.464698+0000","last_peered":"2024-04-16T15:53:20.464698+0000","last_clean":"2024-04-16T15:53:20.464698+0000","last_became_active":"2024-04-16T15:53:19.217646+0000","last_became_peered":"2024-04-16T15:53:19.217646+0000","last_unstale":"2024-04-16T15:53:20.464698+0000","last_undegraded":"2024-04-16T15:53:20.464698+0000","last_fullsized":"2024-04-16T15:53:20.464698+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:19:47.160288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463839+0000","last_change":"2024-04-16T15:53:18.208864+0000","last_active":"2024-04-16T15:53:20.463839+0000","last_peered":"2024-04-16T15:53:20.463839+0000","last_clean":"2024-04-16T15:53:20.463839+0000","last_became_active":"2024-04-16T15:53:18.208576+0000","last_became_peered":"2024-04-16T15:53:18.208576+0000","last_unstale":"2024-04-16T15:53:20.463839+0000","last_undegraded":"2024-04-16T15:53:20.463839+0000","last_fullsized":"2024-04-16T15:53:20.463839+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:49:24.686045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463570+0000","last_change":"2024-04-16T15:53:19.220923+0000","last_active":"2024-04-16T15:53:20.463570+0000","last_peered":"2024-04-16T15:53:20.463570+0000","last_clean":"2024-04-16T15:53:20.463570+0000","last_became_active":"2024-04-16T15:53:19.218050+0000","last_became_peered":"2024-04-16T15:53:19.218050+0000","last_unstale":"2024-04-16T15:53:20.463570+0000","last_undegraded":"2024-04-16T15:53:20.463570+0000","last_fullsized":"2024-04-16T15:53:20.463570+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:13:11.997144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277301+0000","last_change":"2024-04-16T15:53:18.211328+0000","last_active":"2024-04-16T15:53:20.277301+0000","last_peered":"2024-04-16T15:53:20.277301+0000","last_clean":"2024-04-16T15:53:20.277301+0000","last_became_active":"2024-04-16T15:53:18.211063+0000","last_became_peered":"2024-04-16T15:53:18.211063+0000","last_unstale":"2024-04-16T15:53:20.277301+0000","last_undegraded":"2024-04-16T15:53:20.277301+0000","last_fullsized":"2024-04-16T15:53:20.277301+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:27:13.923490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464047+0000","last_change":"2024-04-16T15:53:19.210169+0000","last_active":"2024-04-16T15:53:20.464047+0000","last_peered":"2024-04-16T15:53:20.464047+0000","last_clean":"2024-04-16T15:53:20.464047+0000","last_became_active":"2024-04-16T15:53:19.209882+0000","last_became_peered":"2024-04-16T15:53:19.209882+0000","last_unstale":"2024-04-16T15:53:20.464047+0000","last_undegraded":"2024-04-16T15:53:20.464047+0000","last_fullsized":"2024-04-16T15:53:20.464047+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:34:17.258739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464213+0000","last_change":"2024-04-16T15:53:18.204297+0000","last_active":"2024-04-16T15:53:20.464213+0000","last_peered":"2024-04-16T15:53:20.464213+0000","last_clean":"2024-04-16T15:53:20.464213+0000","last_became_active":"2024-04-16T15:53:18.204054+0000","last_became_peered":"2024-04-16T15:53:18.204054+0000","last_unstale":"2024-04-16T15:53:20.464213+0000","last_undegraded":"2024-04-16T15:53:20.464213+0000","last_fullsized":"2024-04-16T15:53:20.464213+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:27:13.923490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463987+0000","last_change":"2024-04-16T15:53:19.211221+0000","last_active":"2024-04-16T15:53:20.463987+0000","last_peered":"2024-04-16T15:53:20.463987+0000","last_clean":"2024-04-16T15:53:20.463987+0000","last_became_active":"2024-04-16T15:53:19.210969+0000","last_became_peered":"2024-04-16T15:53:19.210969+0000","last_unstale":"2024-04-16T15:53:20.463987+0000","last_undegraded":"2024-04-16T15:53:20.463987+0000","last_fullsized":"2024-04-16T15:53:20.463987+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:09:57.210644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277362+0000","last_change":"2024-04-16T15:53:18.204310+0000","last_active":"2024-04-16T15:53:20.277362+0000","last_peered":"2024-04-16T15:53:20.277362+0000","last_clean":"2024-04-16T15:53:20.277362+0000","last_became_active":"2024-04-16T15:53:18.204031+0000","last_became_peered":"2024-04-16T15:53:18.204031+0000","last_unstale":"2024-04-16T15:53:20.277362+0000","last_undegraded":"2024-04-16T15:53:20.277362+0000","last_fullsized":"2024-04-16T15:53:20.277362+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:20:16.994654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.194938+0000","last_change":"2024-04-16T15:53:19.218748+0000","last_active":"2024-04-16T15:53:20.194938+0000","last_peered":"2024-04-16T15:53:20.194938+0000","last_clean":"2024-04-16T15:53:20.194938+0000","last_became_active":"2024-04-16T15:53:19.218474+0000","last_became_peered":"2024-04-16T15:53:19.218474+0000","last_unstale":"2024-04-16T15:53:20.194938+0000","last_undegraded":"2024-04-16T15:53:20.194938+0000","last_fullsized":"2024-04-16T15:53:20.194938+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:47:53.262802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195914+0000","last_change":"2024-04-16T15:53:18.204483+0000","last_active":"2024-04-16T15:53:20.195914+0000","last_peered":"2024-04-16T15:53:20.195914+0000","last_clean":"2024-04-16T15:53:20.195914+0000","last_became_active":"2024-04-16T15:53:18.203790+0000","last_became_peered":"2024-04-16T15:53:18.203790+0000","last_unstale":"2024-04-16T15:53:20.195914+0000","last_undegraded":"2024-04-16T15:53:20.195914+0000","last_fullsized":"2024-04-16T15:53:20.195914+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:49:24.686045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197045+0000","last_change":"2024-04-16T15:53:19.218646+0000","last_active":"2024-04-16T15:53:20.197045+0000","last_peered":"2024-04-16T15:53:20.197045+0000","last_clean":"2024-04-16T15:53:20.197045+0000","last_became_active":"2024-04-16T15:53:19.218379+0000","last_became_peered":"2024-04-16T15:53:19.218379+0000","last_unstale":"2024-04-16T15:53:20.197045+0000","last_undegraded":"2024-04-16T15:53:20.197045+0000","last_fullsized":"2024-04-16T15:53:20.197045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:21:33.438988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.194988+0000","last_change":"2024-04-16T15:53:18.211846+0000","last_active":"2024-04-16T15:53:20.194988+0000","last_peered":"2024-04-16T15:53:20.194988+0000","last_clean":"2024-04-16T15:53:20.194988+0000","last_became_active":"2024-04-16T15:53:18.211604+0000","last_became_peered":"2024-04-16T15:53:18.211604+0000","last_unstale":"2024-04-16T15:53:20.194988+0000","last_undegraded":"2024-04-16T15:53:20.194988+0000","last_fullsized":"2024-04-16T15:53:20.194988+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:09:08.367141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196459+0000","last_change":"2024-04-16T15:53:19.213036+0000","last_active":"2024-04-16T15:53:20.196459+0000","last_peered":"2024-04-16T15:53:20.196459+0000","last_clean":"2024-04-16T15:53:20.196459+0000","last_became_active":"2024-04-16T15:53:19.212758+0000","last_became_peered":"2024-04-16T15:53:19.212758+0000","last_unstale":"2024-04-16T15:53:20.196459+0000","last_undegraded":"2024-04-16T15:53:20.196459+0000","last_fullsized":"2024-04-16T15:53:20.196459+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:32:14.472011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464513+0000","last_change":"2024-04-16T15:53:18.213907+0000","last_active":"2024-04-16T15:53:20.464513+0000","last_peered":"2024-04-16T15:53:20.464513+0000","last_clean":"2024-04-16T15:53:20.464513+0000","last_became_active":"2024-04-16T15:53:18.213572+0000","last_became_peered":"2024-04-16T15:53:18.213572+0000","last_unstale":"2024-04-16T15:53:20.464513+0000","last_undegraded":"2024-04-16T15:53:20.464513+0000","last_fullsized":"2024-04-16T15:53:20.464513+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:08:37.253061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":196,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196856+0000","last_change":"2024-04-16T15:52:04.356095+0000","last_active":"2024-04-16T15:53:20.196856+0000","last_peered":"2024-04-16T15:53:20.196856+0000","last_clean":"2024-04-16T15:53:20.196856+0000","last_became_active":"2024-04-16T15:52:04.355126+0000","last_became_peered":"2024-04-16T15:52:04.355126+0000","last_unstale":"2024-04-16T15:53:20.196856+0000","last_undegraded":"2024-04-16T15:53:20.196856+0000","last_fullsized":"2024-04-16T15:53:20.196856+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:03.285037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:03.285037+0000","last_clean_scrub_stamp":"2024-04-16T15:52:03.285037+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:19.005024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":983040,"data_stored":742389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":152547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31568,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":393216,"data_stored":152603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":152035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":401408,"data_stored":153565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":152001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":401408,"data_stored":153565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":978944,"data_stored":742299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T15:53:29.527 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T15:53:29.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.666+0000 7f92bcd90640 1 Processor -- start 2024-04-16T15:53:29.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.666+0000 7f92bcd90640 1 -- start start 2024-04-16T15:53:29.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.667+0000 7f92bcd90640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f92b809aa30 0x7f92b806cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:29.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.667+0000 7f92bcd90640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92b80d1fe0 con 0x7f92b806df50 2024-04-16T15:53:29.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.667+0000 7f92bcd90640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92b80ccee0 con 0x7f92b815ede0 2024-04-16T15:53:29.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.667+0000 7f92bcd90640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f92b80b1c00 con 0x7f92b809aa30 2024-04-16T15:53:29.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.667+0000 7f92b659c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f92b809aa30 0x7f92b806cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:29.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.667+0000 7f92b6d9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f92b806df50 0x7f92b80d0af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:41532/0 (socket says 172.21.15.132:41532) 2024-04-16T15:53:29.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.667+0000 7f92b6d9d640 1 -- 172.21.15.132:0/1232701838 learned_addr learned my addr 172.21.15.132:0/1232701838 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:53:29.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.667+0000 7f92b659c640 1 -- 172.21.15.132:0/1232701838 >> v1:172.21.15.179:6789/0 conn(0x7f92b815ede0 legacy=0x7f92b809ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:29.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.667+0000 7f92b659c640 1 -- 172.21.15.132:0/1232701838 >> v1:172.21.15.132:6789/0 conn(0x7f92b806df50 legacy=0x7f92b80d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:29.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.667+0000 7f92b659c640 1 -- 172.21.15.132:0/1232701838 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92b80cd1c0 con 0x7f92b809aa30 2024-04-16T15:53:29.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.667+0000 7f92b5d9b640 1 -- 172.21.15.132:0/1232701838 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2479826531 0 0) 0x7f92b80d1fe0 con 0x7f92b806df50 2024-04-16T15:53:29.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.668+0000 7f92b659c640 1 --2- 172.21.15.132:0/1232701838 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f92b809aa30 0x7f92b806cd40 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f92a80097a0 tx=0x7f92a802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f40e98be84656f0b server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:29.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.668+0000 7f92b5d9b640 1 -- 172.21.15.132:0/1232701838 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a8035020 con 0x7f92b809aa30 2024-04-16T15:53:29.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.668+0000 7f92b5d9b640 1 -- 172.21.15.132:0/1232701838 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92a8031830 con 0x7f92b809aa30 2024-04-16T15:53:29.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.668+0000 7f92b5d9b640 1 -- 172.21.15.132:0/1232701838 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a8031c00 con 0x7f92b809aa30 2024-04-16T15:53:29.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.669+0000 7f92bcd90640 1 -- 172.21.15.132:0/1232701838 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f92b809aa30 msgr2=0x7f92b806cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:29.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.669+0000 7f92bcd90640 1 --2- 172.21.15.132:0/1232701838 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f92b809aa30 0x7f92b806cd40 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f92a80097a0 tx=0x7f92a802b8d0 comp rx=0 tx=0).stop 2024-04-16T15:53:29.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.669+0000 7f92bcd90640 1 -- 172.21.15.132:0/1232701838 shutdown_connections 2024-04-16T15:53:29.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.669+0000 7f92bcd90640 1 --2- 172.21.15.132:0/1232701838 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f92b809aa30 0x7f92b806cd40 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:29.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.669+0000 7f92bcd90640 1 -- 172.21.15.132:0/1232701838 >> 172.21.15.132:0/1232701838 conn(0x7f92b80b41e0 msgr2=0x7f92b80b45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:29.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.669+0000 7f92bcd90640 1 -- 172.21.15.132:0/1232701838 shutdown_connections 2024-04-16T15:53:29.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.669+0000 7f92bcd90640 1 -- 172.21.15.132:0/1232701838 wait complete. 2024-04-16T15:53:29.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.670+0000 7f92bcd90640 1 Processor -- start 2024-04-16T15:53:29.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.670+0000 7f92bcd90640 1 -- start start 2024-04-16T15:53:29.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.671+0000 7f92bcd90640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f92b806df50 0x7f92b80b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:29.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.671+0000 7f92bcd90640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92b809aa30 0x7f92b80b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:29.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.671+0000 7f92bcd90640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92b815d760 0x7f92b80cf140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:29.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.671+0000 7f92bcd90640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f92b80d1200 con 0x7f92b806df50 2024-04-16T15:53:29.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.671+0000 7f92bcd90640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f92b80cd530 con 0x7f92b809aa30 2024-04-16T15:53:29.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.671+0000 7f92bcd90640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f92b80d1380 con 0x7f92b815d760 2024-04-16T15:53:29.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.671+0000 7f92b659c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f92b806df50 0x7f92b80b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:29.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.671+0000 7f92b659c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f92b806df50 0x7f92b80b5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41956/0 (socket says 172.21.15.132:41956) 2024-04-16T15:53:29.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.671+0000 7f92b659c640 1 -- 172.21.15.132:0/2444523215 learned_addr learned my addr 172.21.15.132:0/2444523215 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:29.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.671+0000 7f92b6d9d640 1 --2- 172.21.15.132:0/2444523215 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92b815d760 0x7f92b80cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:29.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.671+0000 7f92b659c640 1 -- 172.21.15.132:0/2444523215 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92b815d760 msgr2=0x7f92b80cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:29.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.671+0000 7f92b659c640 1 --2- 172.21.15.132:0/2444523215 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92b815d760 0x7f92b80cf140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:29.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.671+0000 7f92b659c640 1 -- 172.21.15.132:0/2444523215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92b809aa30 msgr2=0x7f92b80b54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:29.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.671+0000 7f92affff640 1 --2- 172.21.15.132:0/2444523215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92b809aa30 0x7f92b80b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:29.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.671+0000 7f92b659c640 1 --2- 172.21.15.132:0/2444523215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92b809aa30 0x7f92b80b54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:29.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.671+0000 7f92b659c640 1 -- 172.21.15.132:0/2444523215 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92b80b6380 con 0x7f92b806df50 2024-04-16T15:53:29.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.671+0000 7f92b6d9d640 1 --2- 172.21.15.132:0/2444523215 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92b815d760 0x7f92b80cf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:53:29.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.671+0000 7f92affff640 1 --2- 172.21.15.132:0/2444523215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92b809aa30 0x7f92b80b54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:53:29.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.671+0000 7f92b659c640 1 --2- 172.21.15.132:0/2444523215 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f92b806df50 0x7f92b80b5cf0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f92a80098c0 tx=0x7f92a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:29.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.671+0000 7f92aeffd640 1 -- 172.21.15.132:0/2444523215 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a8004230 con 0x7f92b806df50 2024-04-16T15:53:29.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.671+0000 7f92aeffd640 1 -- 172.21.15.132:0/2444523215 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92a80043d0 con 0x7f92b806df50 2024-04-16T15:53:29.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.671+0000 7f92bcd90640 1 -- 172.21.15.132:0/2444523215 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92b8160740 con 0x7f92b806df50 2024-04-16T15:53:29.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.671+0000 7f92aeffd640 1 -- 172.21.15.132:0/2444523215 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a803cad0 con 0x7f92b806df50 2024-04-16T15:53:29.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.671+0000 7f92bcd90640 1 -- 172.21.15.132:0/2444523215 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92b8160d00 con 0x7f92b806df50 2024-04-16T15:53:29.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.672+0000 7f92bcd90640 1 -- 172.21.15.132:0/2444523215 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92b8075510 con 0x7f92b806df50 2024-04-16T15:53:29.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.673+0000 7f92aeffd640 1 -- 172.21.15.132:0/2444523215 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f92a8038020 con 0x7f92b806df50 2024-04-16T15:53:29.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.673+0000 7f92aeffd640 1 --2- 172.21.15.132:0/2444523215 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f929806c8f0 0x7f929806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:29.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.673+0000 7f92aeffd640 1 -- 172.21.15.132:0/2444523215 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f92a80addf0 con 0x7f92b806df50 2024-04-16T15:53:29.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.673+0000 7f92affff640 1 --2- 172.21.15.132:0/2444523215 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f929806c8f0 0x7f929806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:29.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.674+0000 7f92affff640 1 --2- 172.21.15.132:0/2444523215 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f929806c8f0 0x7f929806edb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f92b80b87a0 tx=0x7f92a0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:29.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.678+0000 7f92aeffd640 1 -- 172.21.15.132:0/2444523215 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f92a8041070 con 0x7f92b806df50 2024-04-16T15:53:29.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.849+0000 7f92bcd90640 1 -- 172.21.15.132:0/2444523215 --> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f92b80b5a30 con 0x7f929806c8f0 2024-04-16T15:53:29.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.855+0000 7f92aeffd640 1 -- 172.21.15.132:0/2444523215 <== mgr.4101 v2:172.21.15.132:6832/3896387465 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251839 (secure 0 0 0) 0x7f92a000ad80 con 0x7f929806c8f0 2024-04-16T15:53:29.856 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:53:29.858 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2024-04-16T15:53:29.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.857+0000 7f92bcd90640 1 -- 172.21.15.132:0/2444523215 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f929806c8f0 msgr2=0x7f929806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:29.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.857+0000 7f92bcd90640 1 --2- 172.21.15.132:0/2444523215 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f929806c8f0 0x7f929806edb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f92b80b87a0 tx=0x7f92a0008040 comp rx=0 tx=0).stop 2024-04-16T15:53:29.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.857+0000 7f92bcd90640 1 -- 172.21.15.132:0/2444523215 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f92b806df50 msgr2=0x7f92b80b5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:29.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.857+0000 7f92bcd90640 1 --2- 172.21.15.132:0/2444523215 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f92b806df50 0x7f92b80b5cf0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f92a80098c0 tx=0x7f92a80046c0 comp rx=0 tx=0).stop 2024-04-16T15:53:29.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.858+0000 7f92bcd90640 1 -- 172.21.15.132:0/2444523215 shutdown_connections 2024-04-16T15:53:29.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.858+0000 7f92bcd90640 1 --2- 172.21.15.132:0/2444523215 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f929806c8f0 0x7f929806edb0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:29.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.858+0000 7f92bcd90640 1 --2- 172.21.15.132:0/2444523215 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92b815d760 0x7f92b80cf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:29.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.858+0000 7f92bcd90640 1 --2- 172.21.15.132:0/2444523215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92b809aa30 0x7f92b80b54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:29.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.858+0000 7f92bcd90640 1 --2- 172.21.15.132:0/2444523215 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f92b806df50 0x7f92b80b5cf0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:29.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.858+0000 7f92bcd90640 1 -- 172.21.15.132:0/2444523215 >> 172.21.15.132:0/2444523215 conn(0x7f92b80b41e0 msgr2=0x7f92b806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:29.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.858+0000 7f92bcd90640 1 -- 172.21.15.132:0/2444523215 shutdown_connections 2024-04-16T15:53:29.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:29.858+0000 7f92bcd90640 1 -- 172.21.15.132:0/2444523215 wait complete. 2024-04-16T15:53:29.868 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2024-04-16T15:53:29.283581+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224592,"kb_used_data":4232,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750128,"statfs":{"total":773094113280,"available":772864131072,"internally_reserved":0,"allocated":4333568,"data_stored":2401004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001965"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464477+0000","last_change":"2024-04-16T15:53:19.219500+0000","last_active":"2024-04-16T15:53:20.464477+0000","last_peered":"2024-04-16T15:53:20.464477+0000","last_clean":"2024-04-16T15:53:20.464477+0000","last_became_active":"2024-04-16T15:53:19.219026+0000","last_became_peered":"2024-04-16T15:53:19.219026+0000","last_unstale":"2024-04-16T15:53:20.464477+0000","last_undegraded":"2024-04-16T15:53:20.464477+0000","last_fullsized":"2024-04-16T15:53:20.464477+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:14:20.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195457+0000","last_change":"2024-04-16T15:53:19.226148+0000","last_active":"2024-04-16T15:53:20.195457+0000","last_peered":"2024-04-16T15:53:20.195457+0000","last_clean":"2024-04-16T15:53:20.195457+0000","last_became_active":"2024-04-16T15:53:19.225869+0000","last_became_peered":"2024-04-16T15:53:19.225869+0000","last_unstale":"2024-04-16T15:53:20.195457+0000","last_undegraded":"2024-04-16T15:53:20.195457+0000","last_fullsized":"2024-04-16T15:53:20.195457+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:00:13.986513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464246+0000","last_change":"2024-04-16T15:53:19.209925+0000","last_active":"2024-04-16T15:53:20.464246+0000","last_peered":"2024-04-16T15:53:20.464246+0000","last_clean":"2024-04-16T15:53:20.464246+0000","last_became_active":"2024-04-16T15:53:19.209186+0000","last_became_peered":"2024-04-16T15:53:19.209186+0000","last_unstale":"2024-04-16T15:53:20.464246+0000","last_undegraded":"2024-04-16T15:53:20.464246+0000","last_fullsized":"2024-04-16T15:53:20.464246+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:12:25.656341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277237+0000","last_change":"2024-04-16T15:53:19.214711+0000","last_active":"2024-04-16T15:53:20.277237+0000","last_peered":"2024-04-16T15:53:20.277237+0000","last_clean":"2024-04-16T15:53:20.277237+0000","last_became_active":"2024-04-16T15:53:19.214414+0000","last_became_peered":"2024-04-16T15:53:19.214414+0000","last_unstale":"2024-04-16T15:53:20.277237+0000","last_undegraded":"2024-04-16T15:53:20.277237+0000","last_fullsized":"2024-04-16T15:53:20.277237+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:09:09.369395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463939+0000","last_change":"2024-04-16T15:53:19.218064+0000","last_active":"2024-04-16T15:53:20.463939+0000","last_peered":"2024-04-16T15:53:20.463939+0000","last_clean":"2024-04-16T15:53:20.463939+0000","last_became_active":"2024-04-16T15:53:19.217808+0000","last_became_peered":"2024-04-16T15:53:19.217808+0000","last_unstale":"2024-04-16T15:53:20.463939+0000","last_undegraded":"2024-04-16T15:53:20.463939+0000","last_fullsized":"2024-04-16T15:53:20.463939+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:27:14.925743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195195+0000","last_change":"2024-04-16T15:53:19.214250+0000","last_active":"2024-04-16T15:53:20.195195+0000","last_peered":"2024-04-16T15:53:20.195195+0000","last_clean":"2024-04-16T15:53:20.195195+0000","last_became_active":"2024-04-16T15:53:19.213980+0000","last_became_peered":"2024-04-16T15:53:19.213980+0000","last_unstale":"2024-04-16T15:53:20.195195+0000","last_undegraded":"2024-04-16T15:53:20.195195+0000","last_fullsized":"2024-04-16T15:53:20.195195+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:55:20.146233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197135+0000","last_change":"2024-04-16T15:53:19.221453+0000","last_active":"2024-04-16T15:53:20.197135+0000","last_peered":"2024-04-16T15:53:20.197135+0000","last_clean":"2024-04-16T15:53:20.197135+0000","last_became_active":"2024-04-16T15:53:19.221101+0000","last_became_peered":"2024-04-16T15:53:19.221101+0000","last_unstale":"2024-04-16T15:53:20.197135+0000","last_undegraded":"2024-04-16T15:53:20.197135+0000","last_fullsized":"2024-04-16T15:53:20.197135+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:47:53.262802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197388+0000","last_change":"2024-04-16T15:53:19.214371+0000","last_active":"2024-04-16T15:53:20.197388+0000","last_peered":"2024-04-16T15:53:20.197388+0000","last_clean":"2024-04-16T15:53:20.197388+0000","last_became_active":"2024-04-16T15:53:19.213544+0000","last_became_peered":"2024-04-16T15:53:19.213544+0000","last_unstale":"2024-04-16T15:53:20.197388+0000","last_undegraded":"2024-04-16T15:53:20.197388+0000","last_fullsized":"2024-04-16T15:53:20.197388+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:55:20.146233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197066+0000","last_change":"2024-04-16T15:53:19.207377+0000","last_active":"2024-04-16T15:53:20.197066+0000","last_peered":"2024-04-16T15:53:20.197066+0000","last_clean":"2024-04-16T15:53:20.197066+0000","last_became_active":"2024-04-16T15:53:19.206972+0000","last_became_peered":"2024-04-16T15:53:19.206972+0000","last_unstale":"2024-04-16T15:53:20.197066+0000","last_undegraded":"2024-04-16T15:53:20.197066+0000","last_fullsized":"2024-04-16T15:53:20.197066+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:41:40.266044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277465+0000","last_change":"2024-04-16T15:53:19.216192+0000","last_active":"2024-04-16T15:53:20.277465+0000","last_peered":"2024-04-16T15:53:20.277465+0000","last_clean":"2024-04-16T15:53:20.277465+0000","last_became_active":"2024-04-16T15:53:19.215441+0000","last_became_peered":"2024-04-16T15:53:19.215441+0000","last_unstale":"2024-04-16T15:53:20.277465+0000","last_undegraded":"2024-04-16T15:53:20.277465+0000","last_fullsized":"2024-04-16T15:53:20.277465+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:41:40.266044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196998+0000","last_change":"2024-04-16T15:53:19.219404+0000","last_active":"2024-04-16T15:53:20.196998+0000","last_peered":"2024-04-16T15:53:20.196998+0000","last_clean":"2024-04-16T15:53:20.196998+0000","last_became_active":"2024-04-16T15:53:19.219142+0000","last_became_peered":"2024-04-16T15:53:19.219142+0000","last_unstale":"2024-04-16T15:53:20.196998+0000","last_undegraded":"2024-04-16T15:53:20.196998+0000","last_fullsized":"2024-04-16T15:53:20.196998+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:40:00.074304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464668+0000","last_change":"2024-04-16T15:53:19.215861+0000","last_active":"2024-04-16T15:53:20.464668+0000","last_peered":"2024-04-16T15:53:20.464668+0000","last_clean":"2024-04-16T15:53:20.464668+0000","last_became_active":"2024-04-16T15:53:19.215574+0000","last_became_peered":"2024-04-16T15:53:19.215574+0000","last_unstale":"2024-04-16T15:53:20.464668+0000","last_undegraded":"2024-04-16T15:53:20.464668+0000","last_fullsized":"2024-04-16T15:53:20.464668+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:55:20.146233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463954+0000","last_change":"2024-04-16T15:53:19.219125+0000","last_active":"2024-04-16T15:53:20.463954+0000","last_peered":"2024-04-16T15:53:20.463954+0000","last_clean":"2024-04-16T15:53:20.463954+0000","last_became_active":"2024-04-16T15:53:19.218503+0000","last_became_peered":"2024-04-16T15:53:19.218503+0000","last_unstale":"2024-04-16T15:53:20.463954+0000","last_undegraded":"2024-04-16T15:53:20.463954+0000","last_fullsized":"2024-04-16T15:53:20.463954+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:49:25.688299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195100+0000","last_change":"2024-04-16T15:53:19.214790+0000","last_active":"2024-04-16T15:53:20.195100+0000","last_peered":"2024-04-16T15:53:20.195100+0000","last_clean":"2024-04-16T15:53:20.195100+0000","last_became_active":"2024-04-16T15:53:19.214539+0000","last_became_peered":"2024-04-16T15:53:19.214539+0000","last_unstale":"2024-04-16T15:53:20.195100+0000","last_undegraded":"2024-04-16T15:53:20.195100+0000","last_fullsized":"2024-04-16T15:53:20.195100+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:09:12.444137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464200+0000","last_change":"2024-04-16T15:53:19.215379+0000","last_active":"2024-04-16T15:53:20.464200+0000","last_peered":"2024-04-16T15:53:20.464200+0000","last_clean":"2024-04-16T15:53:20.464200+0000","last_became_active":"2024-04-16T15:53:19.215064+0000","last_became_peered":"2024-04-16T15:53:19.215064+0000","last_unstale":"2024-04-16T15:53:20.464200+0000","last_undegraded":"2024-04-16T15:53:20.464200+0000","last_fullsized":"2024-04-16T15:53:20.464200+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:32:14.472011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196790+0000","last_change":"2024-04-16T15:53:19.226607+0000","last_active":"2024-04-16T15:53:20.196790+0000","last_peered":"2024-04-16T15:53:20.196790+0000","last_clean":"2024-04-16T15:53:20.196790+0000","last_became_active":"2024-04-16T15:53:19.226349+0000","last_became_peered":"2024-04-16T15:53:19.226349+0000","last_unstale":"2024-04-16T15:53:20.196790+0000","last_undegraded":"2024-04-16T15:53:20.196790+0000","last_fullsized":"2024-04-16T15:53:20.196790+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:19.727876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197376+0000","last_change":"2024-04-16T15:53:19.222520+0000","last_active":"2024-04-16T15:53:20.197376+0000","last_peered":"2024-04-16T15:53:20.197376+0000","last_clean":"2024-04-16T15:53:20.197376+0000","last_became_active":"2024-04-16T15:53:19.222235+0000","last_became_peered":"2024-04-16T15:53:19.222235+0000","last_unstale":"2024-04-16T15:53:20.197376+0000","last_undegraded":"2024-04-16T15:53:20.197376+0000","last_fullsized":"2024-04-16T15:53:20.197376+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:26:17.244174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195538+0000","last_change":"2024-04-16T15:53:19.218035+0000","last_active":"2024-04-16T15:53:20.195538+0000","last_peered":"2024-04-16T15:53:20.195538+0000","last_clean":"2024-04-16T15:53:20.195538+0000","last_became_active":"2024-04-16T15:53:19.217745+0000","last_became_peered":"2024-04-16T15:53:19.217745+0000","last_unstale":"2024-04-16T15:53:20.195538+0000","last_undegraded":"2024-04-16T15:53:20.195538+0000","last_fullsized":"2024-04-16T15:53:20.195538+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:15:31.542491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195338+0000","last_change":"2024-04-16T15:53:19.217634+0000","last_active":"2024-04-16T15:53:20.195338+0000","last_peered":"2024-04-16T15:53:20.195338+0000","last_clean":"2024-04-16T15:53:20.195338+0000","last_became_active":"2024-04-16T15:53:19.217373+0000","last_became_peered":"2024-04-16T15:53:19.217373+0000","last_unstale":"2024-04-16T15:53:20.195338+0000","last_undegraded":"2024-04-16T15:53:20.195338+0000","last_fullsized":"2024-04-16T15:53:20.195338+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:48:31.729009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464109+0000","last_change":"2024-04-16T15:53:19.211323+0000","last_active":"2024-04-16T15:53:20.464109+0000","last_peered":"2024-04-16T15:53:20.464109+0000","last_clean":"2024-04-16T15:53:20.464109+0000","last_became_active":"2024-04-16T15:53:19.210812+0000","last_became_peered":"2024-04-16T15:53:19.210812+0000","last_unstale":"2024-04-16T15:53:20.464109+0000","last_undegraded":"2024-04-16T15:53:20.464109+0000","last_fullsized":"2024-04-16T15:53:20.464109+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:13:40.919473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196930+0000","last_change":"2024-04-16T15:53:19.199390+0000","last_active":"2024-04-16T15:53:20.196930+0000","last_peered":"2024-04-16T15:53:20.196930+0000","last_clean":"2024-04-16T15:53:20.196930+0000","last_became_active":"2024-04-16T15:53:19.199066+0000","last_became_peered":"2024-04-16T15:53:19.199066+0000","last_unstale":"2024-04-16T15:53:20.196930+0000","last_undegraded":"2024-04-16T15:53:20.196930+0000","last_fullsized":"2024-04-16T15:53:20.196930+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:01:01.640923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197022+0000","last_change":"2024-04-16T15:53:19.219587+0000","last_active":"2024-04-16T15:53:20.197022+0000","last_peered":"2024-04-16T15:53:20.197022+0000","last_clean":"2024-04-16T15:53:20.197022+0000","last_became_active":"2024-04-16T15:53:19.219150+0000","last_became_peered":"2024-04-16T15:53:19.219150+0000","last_unstale":"2024-04-16T15:53:20.197022+0000","last_undegraded":"2024-04-16T15:53:20.197022+0000","last_fullsized":"2024-04-16T15:53:20.197022+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:09:09.369395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463763+0000","last_change":"2024-04-16T15:53:19.211517+0000","last_active":"2024-04-16T15:53:20.463763+0000","last_peered":"2024-04-16T15:53:20.463763+0000","last_clean":"2024-04-16T15:53:20.463763+0000","last_became_active":"2024-04-16T15:53:19.211260+0000","last_became_peered":"2024-04-16T15:53:19.211260+0000","last_unstale":"2024-04-16T15:53:20.463763+0000","last_undegraded":"2024-04-16T15:53:20.463763+0000","last_fullsized":"2024-04-16T15:53:20.463763+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:54:25.966875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464423+0000","last_change":"2024-04-16T15:53:19.204402+0000","last_active":"2024-04-16T15:53:20.464423+0000","last_peered":"2024-04-16T15:53:20.464423+0000","last_clean":"2024-04-16T15:53:20.464423+0000","last_became_active":"2024-04-16T15:53:19.204086+0000","last_became_peered":"2024-04-16T15:53:19.204086+0000","last_unstale":"2024-04-16T15:53:20.464423+0000","last_undegraded":"2024-04-16T15:53:20.464423+0000","last_fullsized":"2024-04-16T15:53:20.464423+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:09:12.444137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277504+0000","last_change":"2024-04-16T15:53:19.214478+0000","last_active":"2024-04-16T15:53:20.277504+0000","last_peered":"2024-04-16T15:53:20.277504+0000","last_clean":"2024-04-16T15:53:20.277504+0000","last_became_active":"2024-04-16T15:53:19.214199+0000","last_became_peered":"2024-04-16T15:53:19.214199+0000","last_unstale":"2024-04-16T15:53:20.277504+0000","last_undegraded":"2024-04-16T15:53:20.277504+0000","last_fullsized":"2024-04-16T15:53:20.277504+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:38:12.802270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195587+0000","last_change":"2024-04-16T15:53:19.223834+0000","last_active":"2024-04-16T15:53:20.195587+0000","last_peered":"2024-04-16T15:53:20.195587+0000","last_clean":"2024-04-16T15:53:20.195587+0000","last_became_active":"2024-04-16T15:53:19.223467+0000","last_became_peered":"2024-04-16T15:53:19.223467+0000","last_unstale":"2024-04-16T15:53:20.195587+0000","last_undegraded":"2024-04-16T15:53:20.195587+0000","last_fullsized":"2024-04-16T15:53:20.195587+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:20:36.722580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277601+0000","last_change":"2024-04-16T15:53:19.215061+0000","last_active":"2024-04-16T15:53:20.277601+0000","last_peered":"2024-04-16T15:53:20.277601+0000","last_clean":"2024-04-16T15:53:20.277601+0000","last_became_active":"2024-04-16T15:53:19.214786+0000","last_became_peered":"2024-04-16T15:53:19.214786+0000","last_unstale":"2024-04-16T15:53:20.277601+0000","last_undegraded":"2024-04-16T15:53:20.277601+0000","last_fullsized":"2024-04-16T15:53:20.277601+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:24:52.885269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464800+0000","last_change":"2024-04-16T15:53:19.199651+0000","last_active":"2024-04-16T15:53:20.464800+0000","last_peered":"2024-04-16T15:53:20.464800+0000","last_clean":"2024-04-16T15:53:20.464800+0000","last_became_active":"2024-04-16T15:53:19.199270+0000","last_became_peered":"2024-04-16T15:53:19.199270+0000","last_unstale":"2024-04-16T15:53:20.464800+0000","last_undegraded":"2024-04-16T15:53:20.464800+0000","last_fullsized":"2024-04-16T15:53:20.464800+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:48:31.729009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197108+0000","last_change":"2024-04-16T15:53:19.218009+0000","last_active":"2024-04-16T15:53:20.197108+0000","last_peered":"2024-04-16T15:53:20.197108+0000","last_clean":"2024-04-16T15:53:20.197108+0000","last_became_active":"2024-04-16T15:53:19.217749+0000","last_became_peered":"2024-04-16T15:53:19.217749+0000","last_unstale":"2024-04-16T15:53:20.197108+0000","last_undegraded":"2024-04-16T15:53:20.197108+0000","last_fullsized":"2024-04-16T15:53:20.197108+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:38:12.802270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196284+0000","last_change":"2024-04-16T15:53:19.215554+0000","last_active":"2024-04-16T15:53:20.196284+0000","last_peered":"2024-04-16T15:53:20.196284+0000","last_clean":"2024-04-16T15:53:20.196284+0000","last_became_active":"2024-04-16T15:53:19.215243+0000","last_became_peered":"2024-04-16T15:53:19.215243+0000","last_unstale":"2024-04-16T15:53:20.196284+0000","last_undegraded":"2024-04-16T15:53:20.196284+0000","last_fullsized":"2024-04-16T15:53:20.196284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:24:52.885269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463993+0000","last_change":"2024-04-16T15:53:19.213628+0000","last_active":"2024-04-16T15:53:20.463993+0000","last_peered":"2024-04-16T15:53:20.463993+0000","last_clean":"2024-04-16T15:53:20.463993+0000","last_became_active":"2024-04-16T15:53:19.213345+0000","last_became_peered":"2024-04-16T15:53:19.213345+0000","last_unstale":"2024-04-16T15:53:20.463993+0000","last_undegraded":"2024-04-16T15:53:20.463993+0000","last_fullsized":"2024-04-16T15:53:20.463993+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:34:49.536139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196294+0000","last_change":"2024-04-16T15:53:19.212569+0000","last_active":"2024-04-16T15:53:20.196294+0000","last_peered":"2024-04-16T15:53:20.196294+0000","last_clean":"2024-04-16T15:53:20.196294+0000","last_became_active":"2024-04-16T15:53:19.212198+0000","last_became_peered":"2024-04-16T15:53:19.212198+0000","last_unstale":"2024-04-16T15:53:20.196294+0000","last_undegraded":"2024-04-16T15:53:20.196294+0000","last_fullsized":"2024-04-16T15:53:20.196294+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:27:57.263921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463687+0000","last_change":"2024-04-16T15:53:19.212160+0000","last_active":"2024-04-16T15:53:20.463687+0000","last_peered":"2024-04-16T15:53:20.463687+0000","last_clean":"2024-04-16T15:53:20.463687+0000","last_became_active":"2024-04-16T15:53:19.211902+0000","last_became_peered":"2024-04-16T15:53:19.211902+0000","last_unstale":"2024-04-16T15:53:20.463687+0000","last_undegraded":"2024-04-16T15:53:20.463687+0000","last_fullsized":"2024-04-16T15:53:20.463687+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:14:20.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464727+0000","last_change":"2024-04-16T15:53:18.210743+0000","last_active":"2024-04-16T15:53:20.464727+0000","last_peered":"2024-04-16T15:53:20.464727+0000","last_clean":"2024-04-16T15:53:20.464727+0000","last_became_active":"2024-04-16T15:53:18.210466+0000","last_became_peered":"2024-04-16T15:53:18.210466+0000","last_unstale":"2024-04-16T15:53:20.464727+0000","last_undegraded":"2024-04-16T15:53:20.464727+0000","last_fullsized":"2024-04-16T15:53:20.464727+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:03:51.897303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464638+0000","last_change":"2024-04-16T15:53:19.214490+0000","last_active":"2024-04-16T15:53:20.464638+0000","last_peered":"2024-04-16T15:53:20.464638+0000","last_clean":"2024-04-16T15:53:20.464638+0000","last_became_active":"2024-04-16T15:53:19.214206+0000","last_became_peered":"2024-04-16T15:53:19.214206+0000","last_unstale":"2024-04-16T15:53:20.464638+0000","last_undegraded":"2024-04-16T15:53:20.464638+0000","last_fullsized":"2024-04-16T15:53:20.464638+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:54:25.966875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463629+0000","last_change":"2024-04-16T15:53:18.213622+0000","last_active":"2024-04-16T15:53:20.463629+0000","last_peered":"2024-04-16T15:53:20.463629+0000","last_clean":"2024-04-16T15:53:20.463629+0000","last_became_active":"2024-04-16T15:53:18.213368+0000","last_became_peered":"2024-04-16T15:53:18.213368+0000","last_unstale":"2024-04-16T15:53:20.463629+0000","last_undegraded":"2024-04-16T15:53:20.463629+0000","last_fullsized":"2024-04-16T15:53:20.463629+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:31:41.162544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196775+0000","last_change":"2024-04-16T15:53:19.217908+0000","last_active":"2024-04-16T15:53:20.196775+0000","last_peered":"2024-04-16T15:53:20.196775+0000","last_clean":"2024-04-16T15:53:20.196775+0000","last_became_active":"2024-04-16T15:53:19.217659+0000","last_became_peered":"2024-04-16T15:53:19.217659+0000","last_unstale":"2024-04-16T15:53:20.196775+0000","last_undegraded":"2024-04-16T15:53:20.196775+0000","last_fullsized":"2024-04-16T15:53:20.196775+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:18:05.482765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195229+0000","last_change":"2024-04-16T15:53:18.206967+0000","last_active":"2024-04-16T15:53:20.195229+0000","last_peered":"2024-04-16T15:53:20.195229+0000","last_clean":"2024-04-16T15:53:20.195229+0000","last_became_active":"2024-04-16T15:53:18.206684+0000","last_became_peered":"2024-04-16T15:53:18.206684+0000","last_unstale":"2024-04-16T15:53:20.195229+0000","last_undegraded":"2024-04-16T15:53:20.195229+0000","last_fullsized":"2024-04-16T15:53:20.195229+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:14:19.341087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277619+0000","last_change":"2024-04-16T15:53:19.214612+0000","last_active":"2024-04-16T15:53:20.277619+0000","last_peered":"2024-04-16T15:53:20.277619+0000","last_clean":"2024-04-16T15:53:20.277619+0000","last_became_active":"2024-04-16T15:53:19.214331+0000","last_became_peered":"2024-04-16T15:53:19.214331+0000","last_unstale":"2024-04-16T15:53:20.277619+0000","last_undegraded":"2024-04-16T15:53:20.277619+0000","last_fullsized":"2024-04-16T15:53:20.277619+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:27:57.263921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464122+0000","last_change":"2024-04-16T15:53:18.210644+0000","last_active":"2024-04-16T15:53:20.464122+0000","last_peered":"2024-04-16T15:53:20.464122+0000","last_clean":"2024-04-16T15:53:20.464122+0000","last_became_active":"2024-04-16T15:53:18.210390+0000","last_became_peered":"2024-04-16T15:53:18.210390+0000","last_unstale":"2024-04-16T15:53:20.464122+0000","last_undegraded":"2024-04-16T15:53:20.464122+0000","last_fullsized":"2024-04-16T15:53:20.464122+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:00:38.767894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196471+0000","last_change":"2024-04-16T15:53:19.218628+0000","last_active":"2024-04-16T15:53:20.196471+0000","last_peered":"2024-04-16T15:53:20.196471+0000","last_clean":"2024-04-16T15:53:20.196471+0000","last_became_active":"2024-04-16T15:53:19.218185+0000","last_became_peered":"2024-04-16T15:53:19.218185+0000","last_unstale":"2024-04-16T15:53:20.196471+0000","last_undegraded":"2024-04-16T15:53:20.196471+0000","last_fullsized":"2024-04-16T15:53:20.196471+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:20:34.974674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197176+0000","last_change":"2024-04-16T15:53:18.210540+0000","last_active":"2024-04-16T15:53:20.197176+0000","last_peered":"2024-04-16T15:53:20.197176+0000","last_clean":"2024-04-16T15:53:20.197176+0000","last_became_active":"2024-04-16T15:53:18.210271+0000","last_became_peered":"2024-04-16T15:53:18.210271+0000","last_unstale":"2024-04-16T15:53:20.197176+0000","last_undegraded":"2024-04-16T15:53:20.197176+0000","last_fullsized":"2024-04-16T15:53:20.197176+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:08:37.253061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464363+0000","last_change":"2024-04-16T15:53:19.200361+0000","last_active":"2024-04-16T15:53:20.464363+0000","last_peered":"2024-04-16T15:53:20.464363+0000","last_clean":"2024-04-16T15:53:20.464363+0000","last_became_active":"2024-04-16T15:53:19.200086+0000","last_became_peered":"2024-04-16T15:53:19.200086+0000","last_unstale":"2024-04-16T15:53:20.464363+0000","last_undegraded":"2024-04-16T15:53:20.464363+0000","last_fullsized":"2024-04-16T15:53:20.464363+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:40:00.074304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196830+0000","last_change":"2024-04-16T15:53:18.210491+0000","last_active":"2024-04-16T15:53:20.196830+0000","last_peered":"2024-04-16T15:53:20.196830+0000","last_clean":"2024-04-16T15:53:20.196830+0000","last_became_active":"2024-04-16T15:53:18.210234+0000","last_became_peered":"2024-04-16T15:53:18.210234+0000","last_unstale":"2024-04-16T15:53:20.196830+0000","last_undegraded":"2024-04-16T15:53:20.196830+0000","last_fullsized":"2024-04-16T15:53:20.196830+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:28:44.787593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196717+0000","last_change":"2024-04-16T15:53:19.210713+0000","last_active":"2024-04-16T15:53:20.196717+0000","last_peered":"2024-04-16T15:53:20.196717+0000","last_clean":"2024-04-16T15:53:20.196717+0000","last_became_active":"2024-04-16T15:53:19.210425+0000","last_became_peered":"2024-04-16T15:53:19.210425+0000","last_unstale":"2024-04-16T15:53:20.196717+0000","last_undegraded":"2024-04-16T15:53:20.196717+0000","last_fullsized":"2024-04-16T15:53:20.196717+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:42:06.870549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.194850+0000","last_change":"2024-04-16T15:53:18.210535+0000","last_active":"2024-04-16T15:53:20.194850+0000","last_peered":"2024-04-16T15:53:20.194850+0000","last_clean":"2024-04-16T15:53:20.194850+0000","last_became_active":"2024-04-16T15:53:18.210282+0000","last_became_peered":"2024-04-16T15:53:18.210282+0000","last_unstale":"2024-04-16T15:53:20.194850+0000","last_undegraded":"2024-04-16T15:53:20.194850+0000","last_fullsized":"2024-04-16T15:53:20.194850+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:09:56.208391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277154+0000","last_change":"2024-04-16T15:53:19.212496+0000","last_active":"2024-04-16T15:53:20.277154+0000","last_peered":"2024-04-16T15:53:20.277154+0000","last_clean":"2024-04-16T15:53:20.277154+0000","last_became_active":"2024-04-16T15:53:19.212239+0000","last_became_peered":"2024-04-16T15:53:19.212239+0000","last_unstale":"2024-04-16T15:53:20.277154+0000","last_undegraded":"2024-04-16T15:53:20.277154+0000","last_fullsized":"2024-04-16T15:53:20.277154+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:18:05.482765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195756+0000","last_change":"2024-04-16T15:53:18.208530+0000","last_active":"2024-04-16T15:53:20.195756+0000","last_peered":"2024-04-16T15:53:20.195756+0000","last_clean":"2024-04-16T15:53:20.195756+0000","last_became_active":"2024-04-16T15:53:18.208225+0000","last_became_peered":"2024-04-16T15:53:18.208225+0000","last_unstale":"2024-04-16T15:53:20.195756+0000","last_undegraded":"2024-04-16T15:53:20.195756+0000","last_fullsized":"2024-04-16T15:53:20.195756+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:01:02.783464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464310+0000","last_change":"2024-04-16T15:53:19.215852+0000","last_active":"2024-04-16T15:53:20.464310+0000","last_peered":"2024-04-16T15:53:20.464310+0000","last_clean":"2024-04-16T15:53:20.464310+0000","last_became_active":"2024-04-16T15:53:19.215600+0000","last_became_peered":"2024-04-16T15:53:19.215600+0000","last_unstale":"2024-04-16T15:53:20.464310+0000","last_undegraded":"2024-04-16T15:53:20.464310+0000","last_fullsized":"2024-04-16T15:53:20.464310+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:19.727876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195485+0000","last_change":"2024-04-16T15:53:18.209410+0000","last_active":"2024-04-16T15:53:20.195485+0000","last_peered":"2024-04-16T15:53:20.195485+0000","last_clean":"2024-04-16T15:53:20.195485+0000","last_became_active":"2024-04-16T15:53:18.209128+0000","last_became_peered":"2024-04-16T15:53:18.209128+0000","last_unstale":"2024-04-16T15:53:20.195485+0000","last_undegraded":"2024-04-16T15:53:20.195485+0000","last_fullsized":"2024-04-16T15:53:20.195485+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:18:04.480511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195481+0000","last_change":"2024-04-16T15:53:19.218196+0000","last_active":"2024-04-16T15:53:20.195481+0000","last_peered":"2024-04-16T15:53:20.195481+0000","last_clean":"2024-04-16T15:53:20.195481+0000","last_became_active":"2024-04-16T15:53:19.217938+0000","last_became_peered":"2024-04-16T15:53:19.217938+0000","last_unstale":"2024-04-16T15:53:20.195481+0000","last_undegraded":"2024-04-16T15:53:20.195481+0000","last_fullsized":"2024-04-16T15:53:20.195481+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:15:54.665161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463743+0000","last_change":"2024-04-16T15:53:18.212761+0000","last_active":"2024-04-16T15:53:20.463743+0000","last_peered":"2024-04-16T15:53:20.463743+0000","last_clean":"2024-04-16T15:53:20.463743+0000","last_became_active":"2024-04-16T15:53:18.212427+0000","last_became_peered":"2024-04-16T15:53:18.212427+0000","last_unstale":"2024-04-16T15:53:20.463743+0000","last_undegraded":"2024-04-16T15:53:20.463743+0000","last_fullsized":"2024-04-16T15:53:20.463743+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:46:28.763927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195317+0000","last_change":"2024-04-16T15:53:19.223760+0000","last_active":"2024-04-16T15:53:20.195317+0000","last_peered":"2024-04-16T15:53:20.195317+0000","last_clean":"2024-04-16T15:53:20.195317+0000","last_became_active":"2024-04-16T15:53:19.223461+0000","last_became_peered":"2024-04-16T15:53:19.223461+0000","last_unstale":"2024-04-16T15:53:20.195317+0000","last_undegraded":"2024-04-16T15:53:20.195317+0000","last_fullsized":"2024-04-16T15:53:20.195317+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:19:47.160288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464486+0000","last_change":"2024-04-16T15:53:18.208880+0000","last_active":"2024-04-16T15:53:20.464486+0000","last_peered":"2024-04-16T15:53:20.464486+0000","last_clean":"2024-04-16T15:53:20.464486+0000","last_became_active":"2024-04-16T15:53:18.208317+0000","last_became_peered":"2024-04-16T15:53:18.208317+0000","last_unstale":"2024-04-16T15:53:20.464486+0000","last_undegraded":"2024-04-16T15:53:20.464486+0000","last_fullsized":"2024-04-16T15:53:20.464486+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:09:56.208391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464325+0000","last_change":"2024-04-16T15:53:19.218075+0000","last_active":"2024-04-16T15:53:20.464325+0000","last_peered":"2024-04-16T15:53:20.464325+0000","last_clean":"2024-04-16T15:53:20.464325+0000","last_became_active":"2024-04-16T15:53:19.217805+0000","last_became_peered":"2024-04-16T15:53:19.217805+0000","last_unstale":"2024-04-16T15:53:20.464325+0000","last_undegraded":"2024-04-16T15:53:20.464325+0000","last_fullsized":"2024-04-16T15:53:20.464325+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:47:53.262802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195193+0000","last_change":"2024-04-16T15:53:18.206853+0000","last_active":"2024-04-16T15:53:20.195193+0000","last_peered":"2024-04-16T15:53:20.195193+0000","last_clean":"2024-04-16T15:53:20.195193+0000","last_became_active":"2024-04-16T15:53:18.206613+0000","last_became_peered":"2024-04-16T15:53:18.206613+0000","last_unstale":"2024-04-16T15:53:20.195193+0000","last_undegraded":"2024-04-16T15:53:20.195193+0000","last_fullsized":"2024-04-16T15:53:20.195193+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:54:24.964622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277187+0000","last_change":"2024-04-16T15:53:19.222111+0000","last_active":"2024-04-16T15:53:20.277187+0000","last_peered":"2024-04-16T15:53:20.277187+0000","last_clean":"2024-04-16T15:53:20.277187+0000","last_became_active":"2024-04-16T15:53:19.221536+0000","last_became_peered":"2024-04-16T15:53:19.221536+0000","last_unstale":"2024-04-16T15:53:20.277187+0000","last_undegraded":"2024-04-16T15:53:20.277187+0000","last_fullsized":"2024-04-16T15:53:20.277187+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:01:01.640923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197189+0000","last_change":"2024-04-16T15:53:18.207932+0000","last_active":"2024-04-16T15:53:20.197189+0000","last_peered":"2024-04-16T15:53:20.197189+0000","last_clean":"2024-04-16T15:53:20.197189+0000","last_became_active":"2024-04-16T15:53:18.207445+0000","last_became_peered":"2024-04-16T15:53:18.207445+0000","last_unstale":"2024-04-16T15:53:20.197189+0000","last_undegraded":"2024-04-16T15:53:20.197189+0000","last_fullsized":"2024-04-16T15:53:20.197189+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:26:09.897432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195254+0000","last_change":"2024-04-16T15:53:19.215660+0000","last_active":"2024-04-16T15:53:20.195254+0000","last_peered":"2024-04-16T15:53:20.195254+0000","last_clean":"2024-04-16T15:53:20.195254+0000","last_became_active":"2024-04-16T15:53:19.215415+0000","last_became_peered":"2024-04-16T15:53:19.215415+0000","last_unstale":"2024-04-16T15:53:20.195254+0000","last_undegraded":"2024-04-16T15:53:20.195254+0000","last_fullsized":"2024-04-16T15:53:20.195254+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:26:17.244174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277262+0000","last_change":"2024-04-16T15:53:18.207023+0000","last_active":"2024-04-16T15:53:20.277262+0000","last_peered":"2024-04-16T15:53:20.277262+0000","last_clean":"2024-04-16T15:53:20.277262+0000","last_became_active":"2024-04-16T15:53:18.206764+0000","last_became_peered":"2024-04-16T15:53:18.206764+0000","last_unstale":"2024-04-16T15:53:20.277262+0000","last_undegraded":"2024-04-16T15:53:20.277262+0000","last_fullsized":"2024-04-16T15:53:20.277262+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:49:24.686045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196471+0000","last_change":"2024-04-16T15:53:19.218507+0000","last_active":"2024-04-16T15:53:20.196471+0000","last_peered":"2024-04-16T15:53:20.196471+0000","last_clean":"2024-04-16T15:53:20.196471+0000","last_became_active":"2024-04-16T15:53:19.218250+0000","last_became_peered":"2024-04-16T15:53:19.218250+0000","last_unstale":"2024-04-16T15:53:20.196471+0000","last_undegraded":"2024-04-16T15:53:20.196471+0000","last_fullsized":"2024-04-16T15:53:20.196471+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:12:25.656341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.194904+0000","last_change":"2024-04-16T15:53:18.207895+0000","last_active":"2024-04-16T15:53:20.194904+0000","last_peered":"2024-04-16T15:53:20.194904+0000","last_clean":"2024-04-16T15:53:20.194904+0000","last_became_active":"2024-04-16T15:53:18.207633+0000","last_became_peered":"2024-04-16T15:53:18.207633+0000","last_unstale":"2024-04-16T15:53:20.194904+0000","last_undegraded":"2024-04-16T15:53:20.194904+0000","last_fullsized":"2024-04-16T15:53:20.194904+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:42:05.868295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464143+0000","last_change":"2024-04-16T15:53:19.212616+0000","last_active":"2024-04-16T15:53:20.464143+0000","last_peered":"2024-04-16T15:53:20.464143+0000","last_clean":"2024-04-16T15:53:20.464143+0000","last_became_active":"2024-04-16T15:53:19.212171+0000","last_became_peered":"2024-04-16T15:53:19.212171+0000","last_unstale":"2024-04-16T15:53:20.464143+0000","last_undegraded":"2024-04-16T15:53:20.464143+0000","last_fullsized":"2024-04-16T15:53:20.464143+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:13:11.997144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.194904+0000","last_change":"2024-04-16T15:53:18.207615+0000","last_active":"2024-04-16T15:53:20.194904+0000","last_peered":"2024-04-16T15:53:20.194904+0000","last_clean":"2024-04-16T15:53:20.194904+0000","last_became_active":"2024-04-16T15:53:18.207332+0000","last_became_peered":"2024-04-16T15:53:18.207332+0000","last_unstale":"2024-04-16T15:53:20.194904+0000","last_undegraded":"2024-04-16T15:53:20.194904+0000","last_fullsized":"2024-04-16T15:53:20.194904+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:01:00.638669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196700+0000","last_change":"2024-04-16T15:53:19.202791+0000","last_active":"2024-04-16T15:53:20.196700+0000","last_peered":"2024-04-16T15:53:20.196700+0000","last_clean":"2024-04-16T15:53:20.196700+0000","last_became_active":"2024-04-16T15:53:19.202414+0000","last_became_peered":"2024-04-16T15:53:19.202414+0000","last_unstale":"2024-04-16T15:53:20.196700+0000","last_undegraded":"2024-04-16T15:53:20.196700+0000","last_fullsized":"2024-04-16T15:53:20.196700+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:09:57.210644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277536+0000","last_change":"2024-04-16T15:53:18.211975+0000","last_active":"2024-04-16T15:53:20.277536+0000","last_peered":"2024-04-16T15:53:20.277536+0000","last_clean":"2024-04-16T15:53:20.277536+0000","last_became_active":"2024-04-16T15:53:18.211709+0000","last_became_peered":"2024-04-16T15:53:18.211709+0000","last_unstale":"2024-04-16T15:53:20.277536+0000","last_undegraded":"2024-04-16T15:53:20.277536+0000","last_fullsized":"2024-04-16T15:53:20.277536+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:03:51.897303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464666+0000","last_change":"2024-04-16T15:53:19.202854+0000","last_active":"2024-04-16T15:53:20.464666+0000","last_peered":"2024-04-16T15:53:20.464666+0000","last_clean":"2024-04-16T15:53:20.464666+0000","last_became_active":"2024-04-16T15:53:19.202530+0000","last_became_peered":"2024-04-16T15:53:19.202530+0000","last_unstale":"2024-04-16T15:53:20.464666+0000","last_undegraded":"2024-04-16T15:53:20.464666+0000","last_fullsized":"2024-04-16T15:53:20.464666+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:26:17.244174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196884+0000","last_change":"2024-04-16T15:53:18.208018+0000","last_active":"2024-04-16T15:53:20.196884+0000","last_peered":"2024-04-16T15:53:20.196884+0000","last_clean":"2024-04-16T15:53:20.196884+0000","last_became_active":"2024-04-16T15:53:18.207596+0000","last_became_peered":"2024-04-16T15:53:18.207596+0000","last_unstale":"2024-04-16T15:53:20.196884+0000","last_undegraded":"2024-04-16T15:53:20.196884+0000","last_fullsized":"2024-04-16T15:53:20.196884+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:03:51.897303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277265+0000","last_change":"2024-04-16T15:53:19.215051+0000","last_active":"2024-04-16T15:53:20.277265+0000","last_peered":"2024-04-16T15:53:20.277265+0000","last_clean":"2024-04-16T15:53:20.277265+0000","last_became_active":"2024-04-16T15:53:19.214161+0000","last_became_peered":"2024-04-16T15:53:19.214161+0000","last_unstale":"2024-04-16T15:53:20.277265+0000","last_undegraded":"2024-04-16T15:53:20.277265+0000","last_fullsized":"2024-04-16T15:53:20.277265+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:21:33.438988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196677+0000","last_change":"2024-04-16T15:53:18.210890+0000","last_active":"2024-04-16T15:53:20.196677+0000","last_peered":"2024-04-16T15:53:20.196677+0000","last_clean":"2024-04-16T15:53:20.196677+0000","last_became_active":"2024-04-16T15:53:18.210498+0000","last_became_peered":"2024-04-16T15:53:18.210498+0000","last_unstale":"2024-04-16T15:53:20.196677+0000","last_undegraded":"2024-04-16T15:53:20.196677+0000","last_fullsized":"2024-04-16T15:53:20.196677+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:31:41.162544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463890+0000","last_change":"2024-04-16T15:53:19.212904+0000","last_active":"2024-04-16T15:53:20.463890+0000","last_peered":"2024-04-16T15:53:20.463890+0000","last_clean":"2024-04-16T15:53:20.463890+0000","last_became_active":"2024-04-16T15:53:19.212661+0000","last_became_peered":"2024-04-16T15:53:19.212661+0000","last_unstale":"2024-04-16T15:53:20.463890+0000","last_undegraded":"2024-04-16T15:53:20.463890+0000","last_fullsized":"2024-04-16T15:53:20.463890+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:46:29.766181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196432+0000","last_change":"2024-04-16T15:53:18.212722+0000","last_active":"2024-04-16T15:53:20.196432+0000","last_peered":"2024-04-16T15:53:20.196432+0000","last_clean":"2024-04-16T15:53:20.196432+0000","last_became_active":"2024-04-16T15:53:18.212434+0000","last_became_peered":"2024-04-16T15:53:18.212434+0000","last_unstale":"2024-04-16T15:53:20.196432+0000","last_undegraded":"2024-04-16T15:53:20.196432+0000","last_fullsized":"2024-04-16T15:53:20.196432+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:46:28.763927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463722+0000","last_change":"2024-04-16T15:53:19.212150+0000","last_active":"2024-04-16T15:53:20.463722+0000","last_peered":"2024-04-16T15:53:20.463722+0000","last_clean":"2024-04-16T15:53:20.463722+0000","last_became_active":"2024-04-16T15:53:19.211842+0000","last_became_peered":"2024-04-16T15:53:19.211842+0000","last_unstale":"2024-04-16T15:53:20.463722+0000","last_undegraded":"2024-04-16T15:53:20.463722+0000","last_fullsized":"2024-04-16T15:53:20.463722+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:03:52.899556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464047+0000","last_change":"2024-04-16T15:53:18.210794+0000","last_active":"2024-04-16T15:53:20.464047+0000","last_peered":"2024-04-16T15:53:20.464047+0000","last_clean":"2024-04-16T15:53:20.464047+0000","last_became_active":"2024-04-16T15:53:18.210087+0000","last_became_peered":"2024-04-16T15:53:18.210087+0000","last_unstale":"2024-04-16T15:53:20.464047+0000","last_undegraded":"2024-04-16T15:53:20.464047+0000","last_fullsized":"2024-04-16T15:53:20.464047+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:03:51.897303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464082+0000","last_change":"2024-04-16T15:53:19.206926+0000","last_active":"2024-04-16T15:53:20.464082+0000","last_peered":"2024-04-16T15:53:20.464082+0000","last_clean":"2024-04-16T15:53:20.464082+0000","last_became_active":"2024-04-16T15:53:19.206660+0000","last_became_peered":"2024-04-16T15:53:19.206660+0000","last_unstale":"2024-04-16T15:53:20.464082+0000","last_undegraded":"2024-04-16T15:53:20.464082+0000","last_fullsized":"2024-04-16T15:53:20.464082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:20:17.996907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464223+0000","last_change":"2024-04-16T15:53:18.210087+0000","last_active":"2024-04-16T15:53:20.464223+0000","last_peered":"2024-04-16T15:53:20.464223+0000","last_clean":"2024-04-16T15:53:20.464223+0000","last_became_active":"2024-04-16T15:53:18.209539+0000","last_became_peered":"2024-04-16T15:53:18.209539+0000","last_unstale":"2024-04-16T15:53:20.464223+0000","last_undegraded":"2024-04-16T15:53:20.464223+0000","last_fullsized":"2024-04-16T15:53:20.464223+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:31:41.162544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463515+0000","last_change":"2024-04-16T15:53:19.206275+0000","last_active":"2024-04-16T15:53:20.463515+0000","last_peered":"2024-04-16T15:53:20.463515+0000","last_clean":"2024-04-16T15:53:20.463515+0000","last_became_active":"2024-04-16T15:53:19.205995+0000","last_became_peered":"2024-04-16T15:53:19.205995+0000","last_unstale":"2024-04-16T15:53:20.463515+0000","last_undegraded":"2024-04-16T15:53:20.463515+0000","last_fullsized":"2024-04-16T15:53:20.463515+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:08:38.255314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195767+0000","last_change":"2024-04-16T15:53:18.204767+0000","last_active":"2024-04-16T15:53:20.195767+0000","last_peered":"2024-04-16T15:53:20.195767+0000","last_clean":"2024-04-16T15:53:20.195767+0000","last_became_active":"2024-04-16T15:53:18.204142+0000","last_became_peered":"2024-04-16T15:53:18.204142+0000","last_unstale":"2024-04-16T15:53:20.195767+0000","last_undegraded":"2024-04-16T15:53:20.195767+0000","last_fullsized":"2024-04-16T15:53:20.195767+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:27:13.923490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197141+0000","last_change":"2024-04-16T15:53:19.215530+0000","last_active":"2024-04-16T15:53:20.197141+0000","last_peered":"2024-04-16T15:53:20.197141+0000","last_clean":"2024-04-16T15:53:20.197141+0000","last_became_active":"2024-04-16T15:53:19.215227+0000","last_became_peered":"2024-04-16T15:53:19.215227+0000","last_unstale":"2024-04-16T15:53:20.197141+0000","last_undegraded":"2024-04-16T15:53:20.197141+0000","last_fullsized":"2024-04-16T15:53:20.197141+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:09:12.444137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464488+0000","last_change":"2024-04-16T15:53:18.209377+0000","last_active":"2024-04-16T15:53:20.464488+0000","last_peered":"2024-04-16T15:53:20.464488+0000","last_clean":"2024-04-16T15:53:20.464488+0000","last_became_active":"2024-04-16T15:53:18.209092+0000","last_became_peered":"2024-04-16T15:53:18.209092+0000","last_unstale":"2024-04-16T15:53:20.464488+0000","last_undegraded":"2024-04-16T15:53:20.464488+0000","last_fullsized":"2024-04-16T15:53:20.464488+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:54:24.964622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463717+0000","last_change":"2024-04-16T15:53:19.210213+0000","last_active":"2024-04-16T15:53:20.463717+0000","last_peered":"2024-04-16T15:53:20.463717+0000","last_clean":"2024-04-16T15:53:20.463717+0000","last_became_active":"2024-04-16T15:53:19.209941+0000","last_became_peered":"2024-04-16T15:53:19.209941+0000","last_unstale":"2024-04-16T15:53:20.463717+0000","last_undegraded":"2024-04-16T15:53:20.463717+0000","last_fullsized":"2024-04-16T15:53:20.463717+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:31:42.164797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277554+0000","last_change":"2024-04-16T15:53:18.204255+0000","last_active":"2024-04-16T15:53:20.277554+0000","last_peered":"2024-04-16T15:53:20.277554+0000","last_clean":"2024-04-16T15:53:20.277554+0000","last_became_active":"2024-04-16T15:53:18.203960+0000","last_became_peered":"2024-04-16T15:53:18.203960+0000","last_unstale":"2024-04-16T15:53:20.277554+0000","last_undegraded":"2024-04-16T15:53:20.277554+0000","last_fullsized":"2024-04-16T15:53:20.277554+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:46:28.763927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464698+0000","last_change":"2024-04-16T15:53:19.218513+0000","last_active":"2024-04-16T15:53:20.464698+0000","last_peered":"2024-04-16T15:53:20.464698+0000","last_clean":"2024-04-16T15:53:20.464698+0000","last_became_active":"2024-04-16T15:53:19.217646+0000","last_became_peered":"2024-04-16T15:53:19.217646+0000","last_unstale":"2024-04-16T15:53:20.464698+0000","last_undegraded":"2024-04-16T15:53:20.464698+0000","last_fullsized":"2024-04-16T15:53:20.464698+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:19:47.160288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463839+0000","last_change":"2024-04-16T15:53:18.208864+0000","last_active":"2024-04-16T15:53:20.463839+0000","last_peered":"2024-04-16T15:53:20.463839+0000","last_clean":"2024-04-16T15:53:20.463839+0000","last_became_active":"2024-04-16T15:53:18.208576+0000","last_became_peered":"2024-04-16T15:53:18.208576+0000","last_unstale":"2024-04-16T15:53:20.463839+0000","last_undegraded":"2024-04-16T15:53:20.463839+0000","last_fullsized":"2024-04-16T15:53:20.463839+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:49:24.686045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463570+0000","last_change":"2024-04-16T15:53:19.220923+0000","last_active":"2024-04-16T15:53:20.463570+0000","last_peered":"2024-04-16T15:53:20.463570+0000","last_clean":"2024-04-16T15:53:20.463570+0000","last_became_active":"2024-04-16T15:53:19.218050+0000","last_became_peered":"2024-04-16T15:53:19.218050+0000","last_unstale":"2024-04-16T15:53:20.463570+0000","last_undegraded":"2024-04-16T15:53:20.463570+0000","last_fullsized":"2024-04-16T15:53:20.463570+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:13:11.997144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277301+0000","last_change":"2024-04-16T15:53:18.211328+0000","last_active":"2024-04-16T15:53:20.277301+0000","last_peered":"2024-04-16T15:53:20.277301+0000","last_clean":"2024-04-16T15:53:20.277301+0000","last_became_active":"2024-04-16T15:53:18.211063+0000","last_became_peered":"2024-04-16T15:53:18.211063+0000","last_unstale":"2024-04-16T15:53:20.277301+0000","last_undegraded":"2024-04-16T15:53:20.277301+0000","last_fullsized":"2024-04-16T15:53:20.277301+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:27:13.923490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464047+0000","last_change":"2024-04-16T15:53:19.210169+0000","last_active":"2024-04-16T15:53:20.464047+0000","last_peered":"2024-04-16T15:53:20.464047+0000","last_clean":"2024-04-16T15:53:20.464047+0000","last_became_active":"2024-04-16T15:53:19.209882+0000","last_became_peered":"2024-04-16T15:53:19.209882+0000","last_unstale":"2024-04-16T15:53:20.464047+0000","last_undegraded":"2024-04-16T15:53:20.464047+0000","last_fullsized":"2024-04-16T15:53:20.464047+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:34:17.258739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464213+0000","last_change":"2024-04-16T15:53:18.204297+0000","last_active":"2024-04-16T15:53:20.464213+0000","last_peered":"2024-04-16T15:53:20.464213+0000","last_clean":"2024-04-16T15:53:20.464213+0000","last_became_active":"2024-04-16T15:53:18.204054+0000","last_became_peered":"2024-04-16T15:53:18.204054+0000","last_unstale":"2024-04-16T15:53:20.464213+0000","last_undegraded":"2024-04-16T15:53:20.464213+0000","last_fullsized":"2024-04-16T15:53:20.464213+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:27:13.923490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463987+0000","last_change":"2024-04-16T15:53:19.211221+0000","last_active":"2024-04-16T15:53:20.463987+0000","last_peered":"2024-04-16T15:53:20.463987+0000","last_clean":"2024-04-16T15:53:20.463987+0000","last_became_active":"2024-04-16T15:53:19.210969+0000","last_became_peered":"2024-04-16T15:53:19.210969+0000","last_unstale":"2024-04-16T15:53:20.463987+0000","last_undegraded":"2024-04-16T15:53:20.463987+0000","last_fullsized":"2024-04-16T15:53:20.463987+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:09:57.210644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277362+0000","last_change":"2024-04-16T15:53:18.204310+0000","last_active":"2024-04-16T15:53:20.277362+0000","last_peered":"2024-04-16T15:53:20.277362+0000","last_clean":"2024-04-16T15:53:20.277362+0000","last_became_active":"2024-04-16T15:53:18.204031+0000","last_became_peered":"2024-04-16T15:53:18.204031+0000","last_unstale":"2024-04-16T15:53:20.277362+0000","last_undegraded":"2024-04-16T15:53:20.277362+0000","last_fullsized":"2024-04-16T15:53:20.277362+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:20:16.994654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.194938+0000","last_change":"2024-04-16T15:53:19.218748+0000","last_active":"2024-04-16T15:53:20.194938+0000","last_peered":"2024-04-16T15:53:20.194938+0000","last_clean":"2024-04-16T15:53:20.194938+0000","last_became_active":"2024-04-16T15:53:19.218474+0000","last_became_peered":"2024-04-16T15:53:19.218474+0000","last_unstale":"2024-04-16T15:53:20.194938+0000","last_undegraded":"2024-04-16T15:53:20.194938+0000","last_fullsized":"2024-04-16T15:53:20.194938+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:47:53.262802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195914+0000","last_change":"2024-04-16T15:53:18.204483+0000","last_active":"2024-04-16T15:53:20.195914+0000","last_peered":"2024-04-16T15:53:20.195914+0000","last_clean":"2024-04-16T15:53:20.195914+0000","last_became_active":"2024-04-16T15:53:18.203790+0000","last_became_peered":"2024-04-16T15:53:18.203790+0000","last_unstale":"2024-04-16T15:53:20.195914+0000","last_undegraded":"2024-04-16T15:53:20.195914+0000","last_fullsized":"2024-04-16T15:53:20.195914+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:49:24.686045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197045+0000","last_change":"2024-04-16T15:53:19.218646+0000","last_active":"2024-04-16T15:53:20.197045+0000","last_peered":"2024-04-16T15:53:20.197045+0000","last_clean":"2024-04-16T15:53:20.197045+0000","last_became_active":"2024-04-16T15:53:19.218379+0000","last_became_peered":"2024-04-16T15:53:19.218379+0000","last_unstale":"2024-04-16T15:53:20.197045+0000","last_undegraded":"2024-04-16T15:53:20.197045+0000","last_fullsized":"2024-04-16T15:53:20.197045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:21:33.438988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.194988+0000","last_change":"2024-04-16T15:53:18.211846+0000","last_active":"2024-04-16T15:53:20.194988+0000","last_peered":"2024-04-16T15:53:20.194988+0000","last_clean":"2024-04-16T15:53:20.194988+0000","last_became_active":"2024-04-16T15:53:18.211604+0000","last_became_peered":"2024-04-16T15:53:18.211604+0000","last_unstale":"2024-04-16T15:53:20.194988+0000","last_undegraded":"2024-04-16T15:53:20.194988+0000","last_fullsized":"2024-04-16T15:53:20.194988+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:09:08.367141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196459+0000","last_change":"2024-04-16T15:53:19.213036+0000","last_active":"2024-04-16T15:53:20.196459+0000","last_peered":"2024-04-16T15:53:20.196459+0000","last_clean":"2024-04-16T15:53:20.196459+0000","last_became_active":"2024-04-16T15:53:19.212758+0000","last_became_peered":"2024-04-16T15:53:19.212758+0000","last_unstale":"2024-04-16T15:53:20.196459+0000","last_undegraded":"2024-04-16T15:53:20.196459+0000","last_fullsized":"2024-04-16T15:53:20.196459+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:32:14.472011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464513+0000","last_change":"2024-04-16T15:53:18.213907+0000","last_active":"2024-04-16T15:53:20.464513+0000","last_peered":"2024-04-16T15:53:20.464513+0000","last_clean":"2024-04-16T15:53:20.464513+0000","last_became_active":"2024-04-16T15:53:18.213572+0000","last_became_peered":"2024-04-16T15:53:18.213572+0000","last_unstale":"2024-04-16T15:53:20.464513+0000","last_undegraded":"2024-04-16T15:53:20.464513+0000","last_fullsized":"2024-04-16T15:53:20.464513+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:08:37.253061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":196,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196856+0000","last_change":"2024-04-16T15:52:04.356095+0000","last_active":"2024-04-16T15:53:20.196856+0000","last_peered":"2024-04-16T15:53:20.196856+0000","last_clean":"2024-04-16T15:53:20.196856+0000","last_became_active":"2024-04-16T15:52:04.355126+0000","last_became_peered":"2024-04-16T15:52:04.355126+0000","last_unstale":"2024-04-16T15:53:20.196856+0000","last_undegraded":"2024-04-16T15:53:20.196856+0000","last_fullsized":"2024-04-16T15:53:20.196856+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:03.285037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:03.285037+0000","last_clean_scrub_stamp":"2024-04-16T15:52:03.285037+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:19.005024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":983040,"data_stored":742389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":152547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31568,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":393216,"data_stored":152603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":152035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":401408,"data_stored":153565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":152001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":401408,"data_stored":153565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":978944,"data_stored":742299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T15:53:29.871 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-16T15:53:29.871 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T15:53:30.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.014+0000 7fcf46c60640 1 Processor -- start 2024-04-16T15:53:30.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.014+0000 7fcf46c60640 1 -- start start 2024-04-16T15:53:30.014 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.014+0000 7fcf46c60640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcf4015eaf0 0x7fcf400ba300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:30.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.014+0000 7fcf46c60640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcf4015eed0 0x7fcf400b63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:30.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.014+0000 7fcf46c60640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf40162cc0 con 0x7fcf401627e0 2024-04-16T15:53:30.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.014+0000 7fcf46c60640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fcf400d2af0 con 0x7fcf4015eaf0 2024-04-16T15:53:30.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.014+0000 7fcf46c60640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fcf40162fa0 con 0x7fcf4015eed0 2024-04-16T15:53:30.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.015+0000 7fcf449fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcf4015eaf0 0x7fcf400ba300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:30.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.015+0000 7fcf451fd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fcf401627e0 0x7fcf40067760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:41542/0 (socket says 172.21.15.132:41542) 2024-04-16T15:53:30.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.015+0000 7fcf451fd640 1 -- 172.21.15.132:0/3946824225 learned_addr learned my addr 172.21.15.132:0/3946824225 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:53:30.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.015+0000 7fcf449fc640 1 -- 172.21.15.132:0/3946824225 >> v2:172.21.15.179:3300/0 conn(0x7fcf4015eed0 msgr2=0x7fcf400b63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:30.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.015+0000 7fcf3ffff640 1 --2- 172.21.15.132:0/3946824225 >> v2:172.21.15.179:3300/0 conn(0x7fcf4015eed0 0x7fcf400b63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:30.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.015+0000 7fcf3f7fe640 1 -- 172.21.15.132:0/3946824225 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 822019360 0 0) 0x7fcf40162cc0 con 0x7fcf401627e0 2024-04-16T15:53:30.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.015+0000 7fcf449fc640 1 --2- 172.21.15.132:0/3946824225 >> v2:172.21.15.179:3300/0 conn(0x7fcf4015eed0 0x7fcf400b63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:30.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.015+0000 7fcf449fc640 1 -- 172.21.15.132:0/3946824225 >> v1:172.21.15.132:6789/0 conn(0x7fcf401627e0 legacy=0x7fcf40067760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:30.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.015+0000 7fcf449fc640 1 -- 172.21.15.132:0/3946824225 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf40163280 con 0x7fcf4015eaf0 2024-04-16T15:53:30.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.015+0000 7fcf3ffff640 1 --2- 172.21.15.132:0/3946824225 >> v2:172.21.15.179:3300/0 conn(0x7fcf4015eed0 0x7fcf400b63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:53:30.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.016+0000 7fcf449fc640 1 --2- 172.21.15.132:0/3946824225 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf4015eaf0 0x7fcf400ba300 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fcf4008cdf0 tx=0x7fcf3002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdcf0ed05271c9a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:30.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.016+0000 7fcf3f7fe640 1 -- 172.21.15.132:0/3946824225 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf30035020 con 0x7fcf4015eaf0 2024-04-16T15:53:30.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.016+0000 7fcf3f7fe640 1 -- 172.21.15.132:0/3946824225 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf30031830 con 0x7fcf4015eaf0 2024-04-16T15:53:30.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.016+0000 7fcf3f7fe640 1 -- 172.21.15.132:0/3946824225 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf30031c00 con 0x7fcf4015eaf0 2024-04-16T15:53:30.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.016+0000 7fcf46c60640 1 -- 172.21.15.132:0/3946824225 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf4015eaf0 msgr2=0x7fcf400ba300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:30.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.016+0000 7fcf46c60640 1 --2- 172.21.15.132:0/3946824225 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf4015eaf0 0x7fcf400ba300 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fcf4008cdf0 tx=0x7fcf3002b8d0 comp rx=0 tx=0).stop 2024-04-16T15:53:30.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.016+0000 7fcf46c60640 1 -- 172.21.15.132:0/3946824225 shutdown_connections 2024-04-16T15:53:30.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.016+0000 7fcf46c60640 1 --2- 172.21.15.132:0/3946824225 >> v2:172.21.15.179:3300/0 conn(0x7fcf4015eed0 0x7fcf400b63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:30.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.016+0000 7fcf46c60640 1 --2- 172.21.15.132:0/3946824225 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf4015eaf0 0x7fcf400ba300 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:30.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.016+0000 7fcf46c60640 1 -- 172.21.15.132:0/3946824225 >> 172.21.15.132:0/3946824225 conn(0x7fcf400d13f0 msgr2=0x7fcf400d1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:30.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.017+0000 7fcf46c60640 1 -- 172.21.15.132:0/3946824225 shutdown_connections 2024-04-16T15:53:30.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.017+0000 7fcf46c60640 1 -- 172.21.15.132:0/3946824225 wait complete. 2024-04-16T15:53:30.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.018+0000 7fcf46c60640 1 Processor -- start 2024-04-16T15:53:30.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.018+0000 7fcf46c60640 1 -- start start 2024-04-16T15:53:30.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.018+0000 7fcf46c60640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf4015eaf0 0x7fcf401f7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:30.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.018+0000 7fcf46c60640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf4015eed0 0x7fcf400cbf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:30.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.018+0000 7fcf46c60640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf401627e0 0x7fcf400c99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:30.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.018+0000 7fcf46c60640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fcf400d3f90 con 0x7fcf401627e0 2024-04-16T15:53:30.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.018+0000 7fcf46c60640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fcf400ba840 con 0x7fcf4015eed0 2024-04-16T15:53:30.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.018+0000 7fcf46c60640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fcf400d4110 con 0x7fcf4015eaf0 2024-04-16T15:53:30.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.019+0000 7fcf451fd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf401627e0 0x7fcf400c99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:30.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.019+0000 7fcf451fd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf401627e0 0x7fcf400c99f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41962/0 (socket says 172.21.15.132:41962) 2024-04-16T15:53:30.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.019+0000 7fcf451fd640 1 -- 172.21.15.132:0/190271701 learned_addr learned my addr 172.21.15.132:0/190271701 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:30.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.019+0000 7fcf3ffff640 1 --2- 172.21.15.132:0/190271701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf4015eed0 0x7fcf400cbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:30.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.019+0000 7fcf449fc640 1 --2- 172.21.15.132:0/190271701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf4015eaf0 0x7fcf401f7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:30.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.019+0000 7fcf451fd640 1 -- 172.21.15.132:0/190271701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf4015eaf0 msgr2=0x7fcf401f7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:30.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.019+0000 7fcf451fd640 1 --2- 172.21.15.132:0/190271701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf4015eaf0 0x7fcf401f7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:30.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.019+0000 7fcf451fd640 1 -- 172.21.15.132:0/190271701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf4015eed0 msgr2=0x7fcf400cbf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:30.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.019+0000 7fcf451fd640 1 --2- 172.21.15.132:0/190271701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf4015eed0 0x7fcf400cbf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:30.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.019+0000 7fcf451fd640 1 -- 172.21.15.132:0/190271701 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf401f81e0 con 0x7fcf401627e0 2024-04-16T15:53:30.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.019+0000 7fcf3ffff640 1 --2- 172.21.15.132:0/190271701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf4015eed0 0x7fcf400cbf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:53:30.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.019+0000 7fcf451fd640 1 --2- 172.21.15.132:0/190271701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf401627e0 0x7fcf400c99f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fcf3800c780 tx=0x7fcf3800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:30.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.019+0000 7fcf3d7fa640 1 -- 172.21.15.132:0/190271701 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf38018070 con 0x7fcf401627e0 2024-04-16T15:53:30.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.019+0000 7fcf3d7fa640 1 -- 172.21.15.132:0/190271701 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf3800ce30 con 0x7fcf401627e0 2024-04-16T15:53:30.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.019+0000 7fcf46c60640 1 -- 172.21.15.132:0/190271701 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf401f84c0 con 0x7fcf401627e0 2024-04-16T15:53:30.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.019+0000 7fcf3d7fa640 1 -- 172.21.15.132:0/190271701 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf3800a840 con 0x7fcf401627e0 2024-04-16T15:53:30.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.019+0000 7fcf46c60640 1 -- 172.21.15.132:0/190271701 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf400c8540 con 0x7fcf401627e0 2024-04-16T15:53:30.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.020+0000 7fcf46c60640 1 -- 172.21.15.132:0/190271701 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf401f8690 con 0x7fcf401627e0 2024-04-16T15:53:30.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.021+0000 7fcf3d7fa640 1 -- 172.21.15.132:0/190271701 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcf3801b070 con 0x7fcf401627e0 2024-04-16T15:53:30.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.021+0000 7fcf3d7fa640 1 --2- 172.21.15.132:0/190271701 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fcf2c06c8f0 0x7fcf2c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:30.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.021+0000 7fcf3d7fa640 1 -- 172.21.15.132:0/190271701 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fcf3808b070 con 0x7fcf401627e0 2024-04-16T15:53:30.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.021+0000 7fcf449fc640 1 --2- 172.21.15.132:0/190271701 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fcf2c06c8f0 0x7fcf2c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:30.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.021+0000 7fcf449fc640 1 --2- 172.21.15.132:0/190271701 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fcf2c06c8f0 0x7fcf2c06edb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fcf30036000 tx=0x7fcf3003c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:30.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.025+0000 7fcf3d7fa640 1 -- 172.21.15.132:0/190271701 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcf380594a0 con 0x7fcf401627e0 2024-04-16T15:53:30.197 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.198+0000 7fcf46c60640 1 -- 172.21.15.132:0/190271701 --> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcf40075510 con 0x7fcf2c06c8f0 2024-04-16T15:53:30.203 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.204+0000 7fcf3d7fa640 1 -- 172.21.15.132:0/190271701 <== mgr.4101 v2:172.21.15.132:6832/3896387465 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251839 (secure 0 0 0) 0x7fcf300867d0 con 0x7fcf2c06c8f0 2024-04-16T15:53:30.207 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:53:30.209 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2024-04-16T15:53:30.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.207+0000 7fcf46c60640 1 -- 172.21.15.132:0/190271701 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fcf2c06c8f0 msgr2=0x7fcf2c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:30.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.207+0000 7fcf46c60640 1 --2- 172.21.15.132:0/190271701 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fcf2c06c8f0 0x7fcf2c06edb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fcf30036000 tx=0x7fcf3003c040 comp rx=0 tx=0).stop 2024-04-16T15:53:30.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.207+0000 7fcf46c60640 1 -- 172.21.15.132:0/190271701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf401627e0 msgr2=0x7fcf400c99f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:30.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.207+0000 7fcf46c60640 1 --2- 172.21.15.132:0/190271701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf401627e0 0x7fcf400c99f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fcf3800c780 tx=0x7fcf3800cc40 comp rx=0 tx=0).stop 2024-04-16T15:53:30.213 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.207+0000 7fcf46c60640 1 -- 172.21.15.132:0/190271701 shutdown_connections 2024-04-16T15:53:30.213 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.207+0000 7fcf46c60640 1 --2- 172.21.15.132:0/190271701 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fcf2c06c8f0 0x7fcf2c06edb0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:30.213 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.207+0000 7fcf46c60640 1 --2- 172.21.15.132:0/190271701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf401627e0 0x7fcf400c99f0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:30.213 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.207+0000 7fcf46c60640 1 --2- 172.21.15.132:0/190271701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf4015eed0 0x7fcf400cbf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:30.213 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.207+0000 7fcf46c60640 1 --2- 172.21.15.132:0/190271701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf4015eaf0 0x7fcf401f7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:30.213 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.207+0000 7fcf46c60640 1 -- 172.21.15.132:0/190271701 >> 172.21.15.132:0/190271701 conn(0x7fcf400d13f0 msgr2=0x7fcf400b8a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:30.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.207+0000 7fcf46c60640 1 -- 172.21.15.132:0/190271701 shutdown_connections 2024-04-16T15:53:30.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.208+0000 7fcf46c60640 1 -- 172.21.15.132:0/190271701 wait complete. 2024-04-16T15:53:30.217 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2024-04-16T15:53:29.283581+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224592,"kb_used_data":4232,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750128,"statfs":{"total":773094113280,"available":772864131072,"internally_reserved":0,"allocated":4333568,"data_stored":2401004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001965"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464477+0000","last_change":"2024-04-16T15:53:19.219500+0000","last_active":"2024-04-16T15:53:20.464477+0000","last_peered":"2024-04-16T15:53:20.464477+0000","last_clean":"2024-04-16T15:53:20.464477+0000","last_became_active":"2024-04-16T15:53:19.219026+0000","last_became_peered":"2024-04-16T15:53:19.219026+0000","last_unstale":"2024-04-16T15:53:20.464477+0000","last_undegraded":"2024-04-16T15:53:20.464477+0000","last_fullsized":"2024-04-16T15:53:20.464477+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:14:20.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195457+0000","last_change":"2024-04-16T15:53:19.226148+0000","last_active":"2024-04-16T15:53:20.195457+0000","last_peered":"2024-04-16T15:53:20.195457+0000","last_clean":"2024-04-16T15:53:20.195457+0000","last_became_active":"2024-04-16T15:53:19.225869+0000","last_became_peered":"2024-04-16T15:53:19.225869+0000","last_unstale":"2024-04-16T15:53:20.195457+0000","last_undegraded":"2024-04-16T15:53:20.195457+0000","last_fullsized":"2024-04-16T15:53:20.195457+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:00:13.986513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464246+0000","last_change":"2024-04-16T15:53:19.209925+0000","last_active":"2024-04-16T15:53:20.464246+0000","last_peered":"2024-04-16T15:53:20.464246+0000","last_clean":"2024-04-16T15:53:20.464246+0000","last_became_active":"2024-04-16T15:53:19.209186+0000","last_became_peered":"2024-04-16T15:53:19.209186+0000","last_unstale":"2024-04-16T15:53:20.464246+0000","last_undegraded":"2024-04-16T15:53:20.464246+0000","last_fullsized":"2024-04-16T15:53:20.464246+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:12:25.656341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277237+0000","last_change":"2024-04-16T15:53:19.214711+0000","last_active":"2024-04-16T15:53:20.277237+0000","last_peered":"2024-04-16T15:53:20.277237+0000","last_clean":"2024-04-16T15:53:20.277237+0000","last_became_active":"2024-04-16T15:53:19.214414+0000","last_became_peered":"2024-04-16T15:53:19.214414+0000","last_unstale":"2024-04-16T15:53:20.277237+0000","last_undegraded":"2024-04-16T15:53:20.277237+0000","last_fullsized":"2024-04-16T15:53:20.277237+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:09:09.369395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463939+0000","last_change":"2024-04-16T15:53:19.218064+0000","last_active":"2024-04-16T15:53:20.463939+0000","last_peered":"2024-04-16T15:53:20.463939+0000","last_clean":"2024-04-16T15:53:20.463939+0000","last_became_active":"2024-04-16T15:53:19.217808+0000","last_became_peered":"2024-04-16T15:53:19.217808+0000","last_unstale":"2024-04-16T15:53:20.463939+0000","last_undegraded":"2024-04-16T15:53:20.463939+0000","last_fullsized":"2024-04-16T15:53:20.463939+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:27:14.925743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195195+0000","last_change":"2024-04-16T15:53:19.214250+0000","last_active":"2024-04-16T15:53:20.195195+0000","last_peered":"2024-04-16T15:53:20.195195+0000","last_clean":"2024-04-16T15:53:20.195195+0000","last_became_active":"2024-04-16T15:53:19.213980+0000","last_became_peered":"2024-04-16T15:53:19.213980+0000","last_unstale":"2024-04-16T15:53:20.195195+0000","last_undegraded":"2024-04-16T15:53:20.195195+0000","last_fullsized":"2024-04-16T15:53:20.195195+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:55:20.146233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197135+0000","last_change":"2024-04-16T15:53:19.221453+0000","last_active":"2024-04-16T15:53:20.197135+0000","last_peered":"2024-04-16T15:53:20.197135+0000","last_clean":"2024-04-16T15:53:20.197135+0000","last_became_active":"2024-04-16T15:53:19.221101+0000","last_became_peered":"2024-04-16T15:53:19.221101+0000","last_unstale":"2024-04-16T15:53:20.197135+0000","last_undegraded":"2024-04-16T15:53:20.197135+0000","last_fullsized":"2024-04-16T15:53:20.197135+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:47:53.262802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197388+0000","last_change":"2024-04-16T15:53:19.214371+0000","last_active":"2024-04-16T15:53:20.197388+0000","last_peered":"2024-04-16T15:53:20.197388+0000","last_clean":"2024-04-16T15:53:20.197388+0000","last_became_active":"2024-04-16T15:53:19.213544+0000","last_became_peered":"2024-04-16T15:53:19.213544+0000","last_unstale":"2024-04-16T15:53:20.197388+0000","last_undegraded":"2024-04-16T15:53:20.197388+0000","last_fullsized":"2024-04-16T15:53:20.197388+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:55:20.146233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197066+0000","last_change":"2024-04-16T15:53:19.207377+0000","last_active":"2024-04-16T15:53:20.197066+0000","last_peered":"2024-04-16T15:53:20.197066+0000","last_clean":"2024-04-16T15:53:20.197066+0000","last_became_active":"2024-04-16T15:53:19.206972+0000","last_became_peered":"2024-04-16T15:53:19.206972+0000","last_unstale":"2024-04-16T15:53:20.197066+0000","last_undegraded":"2024-04-16T15:53:20.197066+0000","last_fullsized":"2024-04-16T15:53:20.197066+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:41:40.266044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277465+0000","last_change":"2024-04-16T15:53:19.216192+0000","last_active":"2024-04-16T15:53:20.277465+0000","last_peered":"2024-04-16T15:53:20.277465+0000","last_clean":"2024-04-16T15:53:20.277465+0000","last_became_active":"2024-04-16T15:53:19.215441+0000","last_became_peered":"2024-04-16T15:53:19.215441+0000","last_unstale":"2024-04-16T15:53:20.277465+0000","last_undegraded":"2024-04-16T15:53:20.277465+0000","last_fullsized":"2024-04-16T15:53:20.277465+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:41:40.266044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196998+0000","last_change":"2024-04-16T15:53:19.219404+0000","last_active":"2024-04-16T15:53:20.196998+0000","last_peered":"2024-04-16T15:53:20.196998+0000","last_clean":"2024-04-16T15:53:20.196998+0000","last_became_active":"2024-04-16T15:53:19.219142+0000","last_became_peered":"2024-04-16T15:53:19.219142+0000","last_unstale":"2024-04-16T15:53:20.196998+0000","last_undegraded":"2024-04-16T15:53:20.196998+0000","last_fullsized":"2024-04-16T15:53:20.196998+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:40:00.074304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464668+0000","last_change":"2024-04-16T15:53:19.215861+0000","last_active":"2024-04-16T15:53:20.464668+0000","last_peered":"2024-04-16T15:53:20.464668+0000","last_clean":"2024-04-16T15:53:20.464668+0000","last_became_active":"2024-04-16T15:53:19.215574+0000","last_became_peered":"2024-04-16T15:53:19.215574+0000","last_unstale":"2024-04-16T15:53:20.464668+0000","last_undegraded":"2024-04-16T15:53:20.464668+0000","last_fullsized":"2024-04-16T15:53:20.464668+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:55:20.146233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463954+0000","last_change":"2024-04-16T15:53:19.219125+0000","last_active":"2024-04-16T15:53:20.463954+0000","last_peered":"2024-04-16T15:53:20.463954+0000","last_clean":"2024-04-16T15:53:20.463954+0000","last_became_active":"2024-04-16T15:53:19.218503+0000","last_became_peered":"2024-04-16T15:53:19.218503+0000","last_unstale":"2024-04-16T15:53:20.463954+0000","last_undegraded":"2024-04-16T15:53:20.463954+0000","last_fullsized":"2024-04-16T15:53:20.463954+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:49:25.688299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195100+0000","last_change":"2024-04-16T15:53:19.214790+0000","last_active":"2024-04-16T15:53:20.195100+0000","last_peered":"2024-04-16T15:53:20.195100+0000","last_clean":"2024-04-16T15:53:20.195100+0000","last_became_active":"2024-04-16T15:53:19.214539+0000","last_became_peered":"2024-04-16T15:53:19.214539+0000","last_unstale":"2024-04-16T15:53:20.195100+0000","last_undegraded":"2024-04-16T15:53:20.195100+0000","last_fullsized":"2024-04-16T15:53:20.195100+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:09:12.444137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464200+0000","last_change":"2024-04-16T15:53:19.215379+0000","last_active":"2024-04-16T15:53:20.464200+0000","last_peered":"2024-04-16T15:53:20.464200+0000","last_clean":"2024-04-16T15:53:20.464200+0000","last_became_active":"2024-04-16T15:53:19.215064+0000","last_became_peered":"2024-04-16T15:53:19.215064+0000","last_unstale":"2024-04-16T15:53:20.464200+0000","last_undegraded":"2024-04-16T15:53:20.464200+0000","last_fullsized":"2024-04-16T15:53:20.464200+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:32:14.472011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196790+0000","last_change":"2024-04-16T15:53:19.226607+0000","last_active":"2024-04-16T15:53:20.196790+0000","last_peered":"2024-04-16T15:53:20.196790+0000","last_clean":"2024-04-16T15:53:20.196790+0000","last_became_active":"2024-04-16T15:53:19.226349+0000","last_became_peered":"2024-04-16T15:53:19.226349+0000","last_unstale":"2024-04-16T15:53:20.196790+0000","last_undegraded":"2024-04-16T15:53:20.196790+0000","last_fullsized":"2024-04-16T15:53:20.196790+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:19.727876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197376+0000","last_change":"2024-04-16T15:53:19.222520+0000","last_active":"2024-04-16T15:53:20.197376+0000","last_peered":"2024-04-16T15:53:20.197376+0000","last_clean":"2024-04-16T15:53:20.197376+0000","last_became_active":"2024-04-16T15:53:19.222235+0000","last_became_peered":"2024-04-16T15:53:19.222235+0000","last_unstale":"2024-04-16T15:53:20.197376+0000","last_undegraded":"2024-04-16T15:53:20.197376+0000","last_fullsized":"2024-04-16T15:53:20.197376+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:26:17.244174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195538+0000","last_change":"2024-04-16T15:53:19.218035+0000","last_active":"2024-04-16T15:53:20.195538+0000","last_peered":"2024-04-16T15:53:20.195538+0000","last_clean":"2024-04-16T15:53:20.195538+0000","last_became_active":"2024-04-16T15:53:19.217745+0000","last_became_peered":"2024-04-16T15:53:19.217745+0000","last_unstale":"2024-04-16T15:53:20.195538+0000","last_undegraded":"2024-04-16T15:53:20.195538+0000","last_fullsized":"2024-04-16T15:53:20.195538+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:15:31.542491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195338+0000","last_change":"2024-04-16T15:53:19.217634+0000","last_active":"2024-04-16T15:53:20.195338+0000","last_peered":"2024-04-16T15:53:20.195338+0000","last_clean":"2024-04-16T15:53:20.195338+0000","last_became_active":"2024-04-16T15:53:19.217373+0000","last_became_peered":"2024-04-16T15:53:19.217373+0000","last_unstale":"2024-04-16T15:53:20.195338+0000","last_undegraded":"2024-04-16T15:53:20.195338+0000","last_fullsized":"2024-04-16T15:53:20.195338+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:48:31.729009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464109+0000","last_change":"2024-04-16T15:53:19.211323+0000","last_active":"2024-04-16T15:53:20.464109+0000","last_peered":"2024-04-16T15:53:20.464109+0000","last_clean":"2024-04-16T15:53:20.464109+0000","last_became_active":"2024-04-16T15:53:19.210812+0000","last_became_peered":"2024-04-16T15:53:19.210812+0000","last_unstale":"2024-04-16T15:53:20.464109+0000","last_undegraded":"2024-04-16T15:53:20.464109+0000","last_fullsized":"2024-04-16T15:53:20.464109+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:13:40.919473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196930+0000","last_change":"2024-04-16T15:53:19.199390+0000","last_active":"2024-04-16T15:53:20.196930+0000","last_peered":"2024-04-16T15:53:20.196930+0000","last_clean":"2024-04-16T15:53:20.196930+0000","last_became_active":"2024-04-16T15:53:19.199066+0000","last_became_peered":"2024-04-16T15:53:19.199066+0000","last_unstale":"2024-04-16T15:53:20.196930+0000","last_undegraded":"2024-04-16T15:53:20.196930+0000","last_fullsized":"2024-04-16T15:53:20.196930+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:01:01.640923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197022+0000","last_change":"2024-04-16T15:53:19.219587+0000","last_active":"2024-04-16T15:53:20.197022+0000","last_peered":"2024-04-16T15:53:20.197022+0000","last_clean":"2024-04-16T15:53:20.197022+0000","last_became_active":"2024-04-16T15:53:19.219150+0000","last_became_peered":"2024-04-16T15:53:19.219150+0000","last_unstale":"2024-04-16T15:53:20.197022+0000","last_undegraded":"2024-04-16T15:53:20.197022+0000","last_fullsized":"2024-04-16T15:53:20.197022+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:09:09.369395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463763+0000","last_change":"2024-04-16T15:53:19.211517+0000","last_active":"2024-04-16T15:53:20.463763+0000","last_peered":"2024-04-16T15:53:20.463763+0000","last_clean":"2024-04-16T15:53:20.463763+0000","last_became_active":"2024-04-16T15:53:19.211260+0000","last_became_peered":"2024-04-16T15:53:19.211260+0000","last_unstale":"2024-04-16T15:53:20.463763+0000","last_undegraded":"2024-04-16T15:53:20.463763+0000","last_fullsized":"2024-04-16T15:53:20.463763+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:54:25.966875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464423+0000","last_change":"2024-04-16T15:53:19.204402+0000","last_active":"2024-04-16T15:53:20.464423+0000","last_peered":"2024-04-16T15:53:20.464423+0000","last_clean":"2024-04-16T15:53:20.464423+0000","last_became_active":"2024-04-16T15:53:19.204086+0000","last_became_peered":"2024-04-16T15:53:19.204086+0000","last_unstale":"2024-04-16T15:53:20.464423+0000","last_undegraded":"2024-04-16T15:53:20.464423+0000","last_fullsized":"2024-04-16T15:53:20.464423+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:09:12.444137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277504+0000","last_change":"2024-04-16T15:53:19.214478+0000","last_active":"2024-04-16T15:53:20.277504+0000","last_peered":"2024-04-16T15:53:20.277504+0000","last_clean":"2024-04-16T15:53:20.277504+0000","last_became_active":"2024-04-16T15:53:19.214199+0000","last_became_peered":"2024-04-16T15:53:19.214199+0000","last_unstale":"2024-04-16T15:53:20.277504+0000","last_undegraded":"2024-04-16T15:53:20.277504+0000","last_fullsized":"2024-04-16T15:53:20.277504+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:38:12.802270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195587+0000","last_change":"2024-04-16T15:53:19.223834+0000","last_active":"2024-04-16T15:53:20.195587+0000","last_peered":"2024-04-16T15:53:20.195587+0000","last_clean":"2024-04-16T15:53:20.195587+0000","last_became_active":"2024-04-16T15:53:19.223467+0000","last_became_peered":"2024-04-16T15:53:19.223467+0000","last_unstale":"2024-04-16T15:53:20.195587+0000","last_undegraded":"2024-04-16T15:53:20.195587+0000","last_fullsized":"2024-04-16T15:53:20.195587+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:20:36.722580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277601+0000","last_change":"2024-04-16T15:53:19.215061+0000","last_active":"2024-04-16T15:53:20.277601+0000","last_peered":"2024-04-16T15:53:20.277601+0000","last_clean":"2024-04-16T15:53:20.277601+0000","last_became_active":"2024-04-16T15:53:19.214786+0000","last_became_peered":"2024-04-16T15:53:19.214786+0000","last_unstale":"2024-04-16T15:53:20.277601+0000","last_undegraded":"2024-04-16T15:53:20.277601+0000","last_fullsized":"2024-04-16T15:53:20.277601+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:24:52.885269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464800+0000","last_change":"2024-04-16T15:53:19.199651+0000","last_active":"2024-04-16T15:53:20.464800+0000","last_peered":"2024-04-16T15:53:20.464800+0000","last_clean":"2024-04-16T15:53:20.464800+0000","last_became_active":"2024-04-16T15:53:19.199270+0000","last_became_peered":"2024-04-16T15:53:19.199270+0000","last_unstale":"2024-04-16T15:53:20.464800+0000","last_undegraded":"2024-04-16T15:53:20.464800+0000","last_fullsized":"2024-04-16T15:53:20.464800+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:48:31.729009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197108+0000","last_change":"2024-04-16T15:53:19.218009+0000","last_active":"2024-04-16T15:53:20.197108+0000","last_peered":"2024-04-16T15:53:20.197108+0000","last_clean":"2024-04-16T15:53:20.197108+0000","last_became_active":"2024-04-16T15:53:19.217749+0000","last_became_peered":"2024-04-16T15:53:19.217749+0000","last_unstale":"2024-04-16T15:53:20.197108+0000","last_undegraded":"2024-04-16T15:53:20.197108+0000","last_fullsized":"2024-04-16T15:53:20.197108+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:38:12.802270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196284+0000","last_change":"2024-04-16T15:53:19.215554+0000","last_active":"2024-04-16T15:53:20.196284+0000","last_peered":"2024-04-16T15:53:20.196284+0000","last_clean":"2024-04-16T15:53:20.196284+0000","last_became_active":"2024-04-16T15:53:19.215243+0000","last_became_peered":"2024-04-16T15:53:19.215243+0000","last_unstale":"2024-04-16T15:53:20.196284+0000","last_undegraded":"2024-04-16T15:53:20.196284+0000","last_fullsized":"2024-04-16T15:53:20.196284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:24:52.885269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463993+0000","last_change":"2024-04-16T15:53:19.213628+0000","last_active":"2024-04-16T15:53:20.463993+0000","last_peered":"2024-04-16T15:53:20.463993+0000","last_clean":"2024-04-16T15:53:20.463993+0000","last_became_active":"2024-04-16T15:53:19.213345+0000","last_became_peered":"2024-04-16T15:53:19.213345+0000","last_unstale":"2024-04-16T15:53:20.463993+0000","last_undegraded":"2024-04-16T15:53:20.463993+0000","last_fullsized":"2024-04-16T15:53:20.463993+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:34:49.536139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196294+0000","last_change":"2024-04-16T15:53:19.212569+0000","last_active":"2024-04-16T15:53:20.196294+0000","last_peered":"2024-04-16T15:53:20.196294+0000","last_clean":"2024-04-16T15:53:20.196294+0000","last_became_active":"2024-04-16T15:53:19.212198+0000","last_became_peered":"2024-04-16T15:53:19.212198+0000","last_unstale":"2024-04-16T15:53:20.196294+0000","last_undegraded":"2024-04-16T15:53:20.196294+0000","last_fullsized":"2024-04-16T15:53:20.196294+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:27:57.263921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463687+0000","last_change":"2024-04-16T15:53:19.212160+0000","last_active":"2024-04-16T15:53:20.463687+0000","last_peered":"2024-04-16T15:53:20.463687+0000","last_clean":"2024-04-16T15:53:20.463687+0000","last_became_active":"2024-04-16T15:53:19.211902+0000","last_became_peered":"2024-04-16T15:53:19.211902+0000","last_unstale":"2024-04-16T15:53:20.463687+0000","last_undegraded":"2024-04-16T15:53:20.463687+0000","last_fullsized":"2024-04-16T15:53:20.463687+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:14:20.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464727+0000","last_change":"2024-04-16T15:53:18.210743+0000","last_active":"2024-04-16T15:53:20.464727+0000","last_peered":"2024-04-16T15:53:20.464727+0000","last_clean":"2024-04-16T15:53:20.464727+0000","last_became_active":"2024-04-16T15:53:18.210466+0000","last_became_peered":"2024-04-16T15:53:18.210466+0000","last_unstale":"2024-04-16T15:53:20.464727+0000","last_undegraded":"2024-04-16T15:53:20.464727+0000","last_fullsized":"2024-04-16T15:53:20.464727+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:03:51.897303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464638+0000","last_change":"2024-04-16T15:53:19.214490+0000","last_active":"2024-04-16T15:53:20.464638+0000","last_peered":"2024-04-16T15:53:20.464638+0000","last_clean":"2024-04-16T15:53:20.464638+0000","last_became_active":"2024-04-16T15:53:19.214206+0000","last_became_peered":"2024-04-16T15:53:19.214206+0000","last_unstale":"2024-04-16T15:53:20.464638+0000","last_undegraded":"2024-04-16T15:53:20.464638+0000","last_fullsized":"2024-04-16T15:53:20.464638+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:54:25.966875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463629+0000","last_change":"2024-04-16T15:53:18.213622+0000","last_active":"2024-04-16T15:53:20.463629+0000","last_peered":"2024-04-16T15:53:20.463629+0000","last_clean":"2024-04-16T15:53:20.463629+0000","last_became_active":"2024-04-16T15:53:18.213368+0000","last_became_peered":"2024-04-16T15:53:18.213368+0000","last_unstale":"2024-04-16T15:53:20.463629+0000","last_undegraded":"2024-04-16T15:53:20.463629+0000","last_fullsized":"2024-04-16T15:53:20.463629+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:31:41.162544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196775+0000","last_change":"2024-04-16T15:53:19.217908+0000","last_active":"2024-04-16T15:53:20.196775+0000","last_peered":"2024-04-16T15:53:20.196775+0000","last_clean":"2024-04-16T15:53:20.196775+0000","last_became_active":"2024-04-16T15:53:19.217659+0000","last_became_peered":"2024-04-16T15:53:19.217659+0000","last_unstale":"2024-04-16T15:53:20.196775+0000","last_undegraded":"2024-04-16T15:53:20.196775+0000","last_fullsized":"2024-04-16T15:53:20.196775+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:18:05.482765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195229+0000","last_change":"2024-04-16T15:53:18.206967+0000","last_active":"2024-04-16T15:53:20.195229+0000","last_peered":"2024-04-16T15:53:20.195229+0000","last_clean":"2024-04-16T15:53:20.195229+0000","last_became_active":"2024-04-16T15:53:18.206684+0000","last_became_peered":"2024-04-16T15:53:18.206684+0000","last_unstale":"2024-04-16T15:53:20.195229+0000","last_undegraded":"2024-04-16T15:53:20.195229+0000","last_fullsized":"2024-04-16T15:53:20.195229+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:14:19.341087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277619+0000","last_change":"2024-04-16T15:53:19.214612+0000","last_active":"2024-04-16T15:53:20.277619+0000","last_peered":"2024-04-16T15:53:20.277619+0000","last_clean":"2024-04-16T15:53:20.277619+0000","last_became_active":"2024-04-16T15:53:19.214331+0000","last_became_peered":"2024-04-16T15:53:19.214331+0000","last_unstale":"2024-04-16T15:53:20.277619+0000","last_undegraded":"2024-04-16T15:53:20.277619+0000","last_fullsized":"2024-04-16T15:53:20.277619+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:27:57.263921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464122+0000","last_change":"2024-04-16T15:53:18.210644+0000","last_active":"2024-04-16T15:53:20.464122+0000","last_peered":"2024-04-16T15:53:20.464122+0000","last_clean":"2024-04-16T15:53:20.464122+0000","last_became_active":"2024-04-16T15:53:18.210390+0000","last_became_peered":"2024-04-16T15:53:18.210390+0000","last_unstale":"2024-04-16T15:53:20.464122+0000","last_undegraded":"2024-04-16T15:53:20.464122+0000","last_fullsized":"2024-04-16T15:53:20.464122+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:00:38.767894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196471+0000","last_change":"2024-04-16T15:53:19.218628+0000","last_active":"2024-04-16T15:53:20.196471+0000","last_peered":"2024-04-16T15:53:20.196471+0000","last_clean":"2024-04-16T15:53:20.196471+0000","last_became_active":"2024-04-16T15:53:19.218185+0000","last_became_peered":"2024-04-16T15:53:19.218185+0000","last_unstale":"2024-04-16T15:53:20.196471+0000","last_undegraded":"2024-04-16T15:53:20.196471+0000","last_fullsized":"2024-04-16T15:53:20.196471+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:20:34.974674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197176+0000","last_change":"2024-04-16T15:53:18.210540+0000","last_active":"2024-04-16T15:53:20.197176+0000","last_peered":"2024-04-16T15:53:20.197176+0000","last_clean":"2024-04-16T15:53:20.197176+0000","last_became_active":"2024-04-16T15:53:18.210271+0000","last_became_peered":"2024-04-16T15:53:18.210271+0000","last_unstale":"2024-04-16T15:53:20.197176+0000","last_undegraded":"2024-04-16T15:53:20.197176+0000","last_fullsized":"2024-04-16T15:53:20.197176+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:08:37.253061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464363+0000","last_change":"2024-04-16T15:53:19.200361+0000","last_active":"2024-04-16T15:53:20.464363+0000","last_peered":"2024-04-16T15:53:20.464363+0000","last_clean":"2024-04-16T15:53:20.464363+0000","last_became_active":"2024-04-16T15:53:19.200086+0000","last_became_peered":"2024-04-16T15:53:19.200086+0000","last_unstale":"2024-04-16T15:53:20.464363+0000","last_undegraded":"2024-04-16T15:53:20.464363+0000","last_fullsized":"2024-04-16T15:53:20.464363+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:40:00.074304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196830+0000","last_change":"2024-04-16T15:53:18.210491+0000","last_active":"2024-04-16T15:53:20.196830+0000","last_peered":"2024-04-16T15:53:20.196830+0000","last_clean":"2024-04-16T15:53:20.196830+0000","last_became_active":"2024-04-16T15:53:18.210234+0000","last_became_peered":"2024-04-16T15:53:18.210234+0000","last_unstale":"2024-04-16T15:53:20.196830+0000","last_undegraded":"2024-04-16T15:53:20.196830+0000","last_fullsized":"2024-04-16T15:53:20.196830+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:28:44.787593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196717+0000","last_change":"2024-04-16T15:53:19.210713+0000","last_active":"2024-04-16T15:53:20.196717+0000","last_peered":"2024-04-16T15:53:20.196717+0000","last_clean":"2024-04-16T15:53:20.196717+0000","last_became_active":"2024-04-16T15:53:19.210425+0000","last_became_peered":"2024-04-16T15:53:19.210425+0000","last_unstale":"2024-04-16T15:53:20.196717+0000","last_undegraded":"2024-04-16T15:53:20.196717+0000","last_fullsized":"2024-04-16T15:53:20.196717+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:42:06.870549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.194850+0000","last_change":"2024-04-16T15:53:18.210535+0000","last_active":"2024-04-16T15:53:20.194850+0000","last_peered":"2024-04-16T15:53:20.194850+0000","last_clean":"2024-04-16T15:53:20.194850+0000","last_became_active":"2024-04-16T15:53:18.210282+0000","last_became_peered":"2024-04-16T15:53:18.210282+0000","last_unstale":"2024-04-16T15:53:20.194850+0000","last_undegraded":"2024-04-16T15:53:20.194850+0000","last_fullsized":"2024-04-16T15:53:20.194850+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:09:56.208391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277154+0000","last_change":"2024-04-16T15:53:19.212496+0000","last_active":"2024-04-16T15:53:20.277154+0000","last_peered":"2024-04-16T15:53:20.277154+0000","last_clean":"2024-04-16T15:53:20.277154+0000","last_became_active":"2024-04-16T15:53:19.212239+0000","last_became_peered":"2024-04-16T15:53:19.212239+0000","last_unstale":"2024-04-16T15:53:20.277154+0000","last_undegraded":"2024-04-16T15:53:20.277154+0000","last_fullsized":"2024-04-16T15:53:20.277154+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:18:05.482765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195756+0000","last_change":"2024-04-16T15:53:18.208530+0000","last_active":"2024-04-16T15:53:20.195756+0000","last_peered":"2024-04-16T15:53:20.195756+0000","last_clean":"2024-04-16T15:53:20.195756+0000","last_became_active":"2024-04-16T15:53:18.208225+0000","last_became_peered":"2024-04-16T15:53:18.208225+0000","last_unstale":"2024-04-16T15:53:20.195756+0000","last_undegraded":"2024-04-16T15:53:20.195756+0000","last_fullsized":"2024-04-16T15:53:20.195756+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:01:02.783464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464310+0000","last_change":"2024-04-16T15:53:19.215852+0000","last_active":"2024-04-16T15:53:20.464310+0000","last_peered":"2024-04-16T15:53:20.464310+0000","last_clean":"2024-04-16T15:53:20.464310+0000","last_became_active":"2024-04-16T15:53:19.215600+0000","last_became_peered":"2024-04-16T15:53:19.215600+0000","last_unstale":"2024-04-16T15:53:20.464310+0000","last_undegraded":"2024-04-16T15:53:20.464310+0000","last_fullsized":"2024-04-16T15:53:20.464310+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:19.727876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195485+0000","last_change":"2024-04-16T15:53:18.209410+0000","last_active":"2024-04-16T15:53:20.195485+0000","last_peered":"2024-04-16T15:53:20.195485+0000","last_clean":"2024-04-16T15:53:20.195485+0000","last_became_active":"2024-04-16T15:53:18.209128+0000","last_became_peered":"2024-04-16T15:53:18.209128+0000","last_unstale":"2024-04-16T15:53:20.195485+0000","last_undegraded":"2024-04-16T15:53:20.195485+0000","last_fullsized":"2024-04-16T15:53:20.195485+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:18:04.480511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195481+0000","last_change":"2024-04-16T15:53:19.218196+0000","last_active":"2024-04-16T15:53:20.195481+0000","last_peered":"2024-04-16T15:53:20.195481+0000","last_clean":"2024-04-16T15:53:20.195481+0000","last_became_active":"2024-04-16T15:53:19.217938+0000","last_became_peered":"2024-04-16T15:53:19.217938+0000","last_unstale":"2024-04-16T15:53:20.195481+0000","last_undegraded":"2024-04-16T15:53:20.195481+0000","last_fullsized":"2024-04-16T15:53:20.195481+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:15:54.665161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463743+0000","last_change":"2024-04-16T15:53:18.212761+0000","last_active":"2024-04-16T15:53:20.463743+0000","last_peered":"2024-04-16T15:53:20.463743+0000","last_clean":"2024-04-16T15:53:20.463743+0000","last_became_active":"2024-04-16T15:53:18.212427+0000","last_became_peered":"2024-04-16T15:53:18.212427+0000","last_unstale":"2024-04-16T15:53:20.463743+0000","last_undegraded":"2024-04-16T15:53:20.463743+0000","last_fullsized":"2024-04-16T15:53:20.463743+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:46:28.763927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195317+0000","last_change":"2024-04-16T15:53:19.223760+0000","last_active":"2024-04-16T15:53:20.195317+0000","last_peered":"2024-04-16T15:53:20.195317+0000","last_clean":"2024-04-16T15:53:20.195317+0000","last_became_active":"2024-04-16T15:53:19.223461+0000","last_became_peered":"2024-04-16T15:53:19.223461+0000","last_unstale":"2024-04-16T15:53:20.195317+0000","last_undegraded":"2024-04-16T15:53:20.195317+0000","last_fullsized":"2024-04-16T15:53:20.195317+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:19:47.160288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464486+0000","last_change":"2024-04-16T15:53:18.208880+0000","last_active":"2024-04-16T15:53:20.464486+0000","last_peered":"2024-04-16T15:53:20.464486+0000","last_clean":"2024-04-16T15:53:20.464486+0000","last_became_active":"2024-04-16T15:53:18.208317+0000","last_became_peered":"2024-04-16T15:53:18.208317+0000","last_unstale":"2024-04-16T15:53:20.464486+0000","last_undegraded":"2024-04-16T15:53:20.464486+0000","last_fullsized":"2024-04-16T15:53:20.464486+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:09:56.208391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464325+0000","last_change":"2024-04-16T15:53:19.218075+0000","last_active":"2024-04-16T15:53:20.464325+0000","last_peered":"2024-04-16T15:53:20.464325+0000","last_clean":"2024-04-16T15:53:20.464325+0000","last_became_active":"2024-04-16T15:53:19.217805+0000","last_became_peered":"2024-04-16T15:53:19.217805+0000","last_unstale":"2024-04-16T15:53:20.464325+0000","last_undegraded":"2024-04-16T15:53:20.464325+0000","last_fullsized":"2024-04-16T15:53:20.464325+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:47:53.262802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195193+0000","last_change":"2024-04-16T15:53:18.206853+0000","last_active":"2024-04-16T15:53:20.195193+0000","last_peered":"2024-04-16T15:53:20.195193+0000","last_clean":"2024-04-16T15:53:20.195193+0000","last_became_active":"2024-04-16T15:53:18.206613+0000","last_became_peered":"2024-04-16T15:53:18.206613+0000","last_unstale":"2024-04-16T15:53:20.195193+0000","last_undegraded":"2024-04-16T15:53:20.195193+0000","last_fullsized":"2024-04-16T15:53:20.195193+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:54:24.964622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277187+0000","last_change":"2024-04-16T15:53:19.222111+0000","last_active":"2024-04-16T15:53:20.277187+0000","last_peered":"2024-04-16T15:53:20.277187+0000","last_clean":"2024-04-16T15:53:20.277187+0000","last_became_active":"2024-04-16T15:53:19.221536+0000","last_became_peered":"2024-04-16T15:53:19.221536+0000","last_unstale":"2024-04-16T15:53:20.277187+0000","last_undegraded":"2024-04-16T15:53:20.277187+0000","last_fullsized":"2024-04-16T15:53:20.277187+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:01:01.640923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197189+0000","last_change":"2024-04-16T15:53:18.207932+0000","last_active":"2024-04-16T15:53:20.197189+0000","last_peered":"2024-04-16T15:53:20.197189+0000","last_clean":"2024-04-16T15:53:20.197189+0000","last_became_active":"2024-04-16T15:53:18.207445+0000","last_became_peered":"2024-04-16T15:53:18.207445+0000","last_unstale":"2024-04-16T15:53:20.197189+0000","last_undegraded":"2024-04-16T15:53:20.197189+0000","last_fullsized":"2024-04-16T15:53:20.197189+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:26:09.897432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195254+0000","last_change":"2024-04-16T15:53:19.215660+0000","last_active":"2024-04-16T15:53:20.195254+0000","last_peered":"2024-04-16T15:53:20.195254+0000","last_clean":"2024-04-16T15:53:20.195254+0000","last_became_active":"2024-04-16T15:53:19.215415+0000","last_became_peered":"2024-04-16T15:53:19.215415+0000","last_unstale":"2024-04-16T15:53:20.195254+0000","last_undegraded":"2024-04-16T15:53:20.195254+0000","last_fullsized":"2024-04-16T15:53:20.195254+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:26:17.244174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277262+0000","last_change":"2024-04-16T15:53:18.207023+0000","last_active":"2024-04-16T15:53:20.277262+0000","last_peered":"2024-04-16T15:53:20.277262+0000","last_clean":"2024-04-16T15:53:20.277262+0000","last_became_active":"2024-04-16T15:53:18.206764+0000","last_became_peered":"2024-04-16T15:53:18.206764+0000","last_unstale":"2024-04-16T15:53:20.277262+0000","last_undegraded":"2024-04-16T15:53:20.277262+0000","last_fullsized":"2024-04-16T15:53:20.277262+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:49:24.686045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196471+0000","last_change":"2024-04-16T15:53:19.218507+0000","last_active":"2024-04-16T15:53:20.196471+0000","last_peered":"2024-04-16T15:53:20.196471+0000","last_clean":"2024-04-16T15:53:20.196471+0000","last_became_active":"2024-04-16T15:53:19.218250+0000","last_became_peered":"2024-04-16T15:53:19.218250+0000","last_unstale":"2024-04-16T15:53:20.196471+0000","last_undegraded":"2024-04-16T15:53:20.196471+0000","last_fullsized":"2024-04-16T15:53:20.196471+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:12:25.656341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.194904+0000","last_change":"2024-04-16T15:53:18.207895+0000","last_active":"2024-04-16T15:53:20.194904+0000","last_peered":"2024-04-16T15:53:20.194904+0000","last_clean":"2024-04-16T15:53:20.194904+0000","last_became_active":"2024-04-16T15:53:18.207633+0000","last_became_peered":"2024-04-16T15:53:18.207633+0000","last_unstale":"2024-04-16T15:53:20.194904+0000","last_undegraded":"2024-04-16T15:53:20.194904+0000","last_fullsized":"2024-04-16T15:53:20.194904+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:42:05.868295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464143+0000","last_change":"2024-04-16T15:53:19.212616+0000","last_active":"2024-04-16T15:53:20.464143+0000","last_peered":"2024-04-16T15:53:20.464143+0000","last_clean":"2024-04-16T15:53:20.464143+0000","last_became_active":"2024-04-16T15:53:19.212171+0000","last_became_peered":"2024-04-16T15:53:19.212171+0000","last_unstale":"2024-04-16T15:53:20.464143+0000","last_undegraded":"2024-04-16T15:53:20.464143+0000","last_fullsized":"2024-04-16T15:53:20.464143+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:13:11.997144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.194904+0000","last_change":"2024-04-16T15:53:18.207615+0000","last_active":"2024-04-16T15:53:20.194904+0000","last_peered":"2024-04-16T15:53:20.194904+0000","last_clean":"2024-04-16T15:53:20.194904+0000","last_became_active":"2024-04-16T15:53:18.207332+0000","last_became_peered":"2024-04-16T15:53:18.207332+0000","last_unstale":"2024-04-16T15:53:20.194904+0000","last_undegraded":"2024-04-16T15:53:20.194904+0000","last_fullsized":"2024-04-16T15:53:20.194904+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:01:00.638669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196700+0000","last_change":"2024-04-16T15:53:19.202791+0000","last_active":"2024-04-16T15:53:20.196700+0000","last_peered":"2024-04-16T15:53:20.196700+0000","last_clean":"2024-04-16T15:53:20.196700+0000","last_became_active":"2024-04-16T15:53:19.202414+0000","last_became_peered":"2024-04-16T15:53:19.202414+0000","last_unstale":"2024-04-16T15:53:20.196700+0000","last_undegraded":"2024-04-16T15:53:20.196700+0000","last_fullsized":"2024-04-16T15:53:20.196700+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:09:57.210644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277536+0000","last_change":"2024-04-16T15:53:18.211975+0000","last_active":"2024-04-16T15:53:20.277536+0000","last_peered":"2024-04-16T15:53:20.277536+0000","last_clean":"2024-04-16T15:53:20.277536+0000","last_became_active":"2024-04-16T15:53:18.211709+0000","last_became_peered":"2024-04-16T15:53:18.211709+0000","last_unstale":"2024-04-16T15:53:20.277536+0000","last_undegraded":"2024-04-16T15:53:20.277536+0000","last_fullsized":"2024-04-16T15:53:20.277536+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:03:51.897303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464666+0000","last_change":"2024-04-16T15:53:19.202854+0000","last_active":"2024-04-16T15:53:20.464666+0000","last_peered":"2024-04-16T15:53:20.464666+0000","last_clean":"2024-04-16T15:53:20.464666+0000","last_became_active":"2024-04-16T15:53:19.202530+0000","last_became_peered":"2024-04-16T15:53:19.202530+0000","last_unstale":"2024-04-16T15:53:20.464666+0000","last_undegraded":"2024-04-16T15:53:20.464666+0000","last_fullsized":"2024-04-16T15:53:20.464666+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:26:17.244174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196884+0000","last_change":"2024-04-16T15:53:18.208018+0000","last_active":"2024-04-16T15:53:20.196884+0000","last_peered":"2024-04-16T15:53:20.196884+0000","last_clean":"2024-04-16T15:53:20.196884+0000","last_became_active":"2024-04-16T15:53:18.207596+0000","last_became_peered":"2024-04-16T15:53:18.207596+0000","last_unstale":"2024-04-16T15:53:20.196884+0000","last_undegraded":"2024-04-16T15:53:20.196884+0000","last_fullsized":"2024-04-16T15:53:20.196884+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:03:51.897303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277265+0000","last_change":"2024-04-16T15:53:19.215051+0000","last_active":"2024-04-16T15:53:20.277265+0000","last_peered":"2024-04-16T15:53:20.277265+0000","last_clean":"2024-04-16T15:53:20.277265+0000","last_became_active":"2024-04-16T15:53:19.214161+0000","last_became_peered":"2024-04-16T15:53:19.214161+0000","last_unstale":"2024-04-16T15:53:20.277265+0000","last_undegraded":"2024-04-16T15:53:20.277265+0000","last_fullsized":"2024-04-16T15:53:20.277265+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:21:33.438988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196677+0000","last_change":"2024-04-16T15:53:18.210890+0000","last_active":"2024-04-16T15:53:20.196677+0000","last_peered":"2024-04-16T15:53:20.196677+0000","last_clean":"2024-04-16T15:53:20.196677+0000","last_became_active":"2024-04-16T15:53:18.210498+0000","last_became_peered":"2024-04-16T15:53:18.210498+0000","last_unstale":"2024-04-16T15:53:20.196677+0000","last_undegraded":"2024-04-16T15:53:20.196677+0000","last_fullsized":"2024-04-16T15:53:20.196677+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:31:41.162544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463890+0000","last_change":"2024-04-16T15:53:19.212904+0000","last_active":"2024-04-16T15:53:20.463890+0000","last_peered":"2024-04-16T15:53:20.463890+0000","last_clean":"2024-04-16T15:53:20.463890+0000","last_became_active":"2024-04-16T15:53:19.212661+0000","last_became_peered":"2024-04-16T15:53:19.212661+0000","last_unstale":"2024-04-16T15:53:20.463890+0000","last_undegraded":"2024-04-16T15:53:20.463890+0000","last_fullsized":"2024-04-16T15:53:20.463890+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:46:29.766181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196432+0000","last_change":"2024-04-16T15:53:18.212722+0000","last_active":"2024-04-16T15:53:20.196432+0000","last_peered":"2024-04-16T15:53:20.196432+0000","last_clean":"2024-04-16T15:53:20.196432+0000","last_became_active":"2024-04-16T15:53:18.212434+0000","last_became_peered":"2024-04-16T15:53:18.212434+0000","last_unstale":"2024-04-16T15:53:20.196432+0000","last_undegraded":"2024-04-16T15:53:20.196432+0000","last_fullsized":"2024-04-16T15:53:20.196432+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:46:28.763927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463722+0000","last_change":"2024-04-16T15:53:19.212150+0000","last_active":"2024-04-16T15:53:20.463722+0000","last_peered":"2024-04-16T15:53:20.463722+0000","last_clean":"2024-04-16T15:53:20.463722+0000","last_became_active":"2024-04-16T15:53:19.211842+0000","last_became_peered":"2024-04-16T15:53:19.211842+0000","last_unstale":"2024-04-16T15:53:20.463722+0000","last_undegraded":"2024-04-16T15:53:20.463722+0000","last_fullsized":"2024-04-16T15:53:20.463722+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:03:52.899556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464047+0000","last_change":"2024-04-16T15:53:18.210794+0000","last_active":"2024-04-16T15:53:20.464047+0000","last_peered":"2024-04-16T15:53:20.464047+0000","last_clean":"2024-04-16T15:53:20.464047+0000","last_became_active":"2024-04-16T15:53:18.210087+0000","last_became_peered":"2024-04-16T15:53:18.210087+0000","last_unstale":"2024-04-16T15:53:20.464047+0000","last_undegraded":"2024-04-16T15:53:20.464047+0000","last_fullsized":"2024-04-16T15:53:20.464047+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:03:51.897303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464082+0000","last_change":"2024-04-16T15:53:19.206926+0000","last_active":"2024-04-16T15:53:20.464082+0000","last_peered":"2024-04-16T15:53:20.464082+0000","last_clean":"2024-04-16T15:53:20.464082+0000","last_became_active":"2024-04-16T15:53:19.206660+0000","last_became_peered":"2024-04-16T15:53:19.206660+0000","last_unstale":"2024-04-16T15:53:20.464082+0000","last_undegraded":"2024-04-16T15:53:20.464082+0000","last_fullsized":"2024-04-16T15:53:20.464082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:20:17.996907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464223+0000","last_change":"2024-04-16T15:53:18.210087+0000","last_active":"2024-04-16T15:53:20.464223+0000","last_peered":"2024-04-16T15:53:20.464223+0000","last_clean":"2024-04-16T15:53:20.464223+0000","last_became_active":"2024-04-16T15:53:18.209539+0000","last_became_peered":"2024-04-16T15:53:18.209539+0000","last_unstale":"2024-04-16T15:53:20.464223+0000","last_undegraded":"2024-04-16T15:53:20.464223+0000","last_fullsized":"2024-04-16T15:53:20.464223+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:31:41.162544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463515+0000","last_change":"2024-04-16T15:53:19.206275+0000","last_active":"2024-04-16T15:53:20.463515+0000","last_peered":"2024-04-16T15:53:20.463515+0000","last_clean":"2024-04-16T15:53:20.463515+0000","last_became_active":"2024-04-16T15:53:19.205995+0000","last_became_peered":"2024-04-16T15:53:19.205995+0000","last_unstale":"2024-04-16T15:53:20.463515+0000","last_undegraded":"2024-04-16T15:53:20.463515+0000","last_fullsized":"2024-04-16T15:53:20.463515+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:08:38.255314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195767+0000","last_change":"2024-04-16T15:53:18.204767+0000","last_active":"2024-04-16T15:53:20.195767+0000","last_peered":"2024-04-16T15:53:20.195767+0000","last_clean":"2024-04-16T15:53:20.195767+0000","last_became_active":"2024-04-16T15:53:18.204142+0000","last_became_peered":"2024-04-16T15:53:18.204142+0000","last_unstale":"2024-04-16T15:53:20.195767+0000","last_undegraded":"2024-04-16T15:53:20.195767+0000","last_fullsized":"2024-04-16T15:53:20.195767+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:27:13.923490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197141+0000","last_change":"2024-04-16T15:53:19.215530+0000","last_active":"2024-04-16T15:53:20.197141+0000","last_peered":"2024-04-16T15:53:20.197141+0000","last_clean":"2024-04-16T15:53:20.197141+0000","last_became_active":"2024-04-16T15:53:19.215227+0000","last_became_peered":"2024-04-16T15:53:19.215227+0000","last_unstale":"2024-04-16T15:53:20.197141+0000","last_undegraded":"2024-04-16T15:53:20.197141+0000","last_fullsized":"2024-04-16T15:53:20.197141+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:09:12.444137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464488+0000","last_change":"2024-04-16T15:53:18.209377+0000","last_active":"2024-04-16T15:53:20.464488+0000","last_peered":"2024-04-16T15:53:20.464488+0000","last_clean":"2024-04-16T15:53:20.464488+0000","last_became_active":"2024-04-16T15:53:18.209092+0000","last_became_peered":"2024-04-16T15:53:18.209092+0000","last_unstale":"2024-04-16T15:53:20.464488+0000","last_undegraded":"2024-04-16T15:53:20.464488+0000","last_fullsized":"2024-04-16T15:53:20.464488+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:54:24.964622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463717+0000","last_change":"2024-04-16T15:53:19.210213+0000","last_active":"2024-04-16T15:53:20.463717+0000","last_peered":"2024-04-16T15:53:20.463717+0000","last_clean":"2024-04-16T15:53:20.463717+0000","last_became_active":"2024-04-16T15:53:19.209941+0000","last_became_peered":"2024-04-16T15:53:19.209941+0000","last_unstale":"2024-04-16T15:53:20.463717+0000","last_undegraded":"2024-04-16T15:53:20.463717+0000","last_fullsized":"2024-04-16T15:53:20.463717+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:31:42.164797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277554+0000","last_change":"2024-04-16T15:53:18.204255+0000","last_active":"2024-04-16T15:53:20.277554+0000","last_peered":"2024-04-16T15:53:20.277554+0000","last_clean":"2024-04-16T15:53:20.277554+0000","last_became_active":"2024-04-16T15:53:18.203960+0000","last_became_peered":"2024-04-16T15:53:18.203960+0000","last_unstale":"2024-04-16T15:53:20.277554+0000","last_undegraded":"2024-04-16T15:53:20.277554+0000","last_fullsized":"2024-04-16T15:53:20.277554+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:46:28.763927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464698+0000","last_change":"2024-04-16T15:53:19.218513+0000","last_active":"2024-04-16T15:53:20.464698+0000","last_peered":"2024-04-16T15:53:20.464698+0000","last_clean":"2024-04-16T15:53:20.464698+0000","last_became_active":"2024-04-16T15:53:19.217646+0000","last_became_peered":"2024-04-16T15:53:19.217646+0000","last_unstale":"2024-04-16T15:53:20.464698+0000","last_undegraded":"2024-04-16T15:53:20.464698+0000","last_fullsized":"2024-04-16T15:53:20.464698+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:19:47.160288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463839+0000","last_change":"2024-04-16T15:53:18.208864+0000","last_active":"2024-04-16T15:53:20.463839+0000","last_peered":"2024-04-16T15:53:20.463839+0000","last_clean":"2024-04-16T15:53:20.463839+0000","last_became_active":"2024-04-16T15:53:18.208576+0000","last_became_peered":"2024-04-16T15:53:18.208576+0000","last_unstale":"2024-04-16T15:53:20.463839+0000","last_undegraded":"2024-04-16T15:53:20.463839+0000","last_fullsized":"2024-04-16T15:53:20.463839+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:49:24.686045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463570+0000","last_change":"2024-04-16T15:53:19.220923+0000","last_active":"2024-04-16T15:53:20.463570+0000","last_peered":"2024-04-16T15:53:20.463570+0000","last_clean":"2024-04-16T15:53:20.463570+0000","last_became_active":"2024-04-16T15:53:19.218050+0000","last_became_peered":"2024-04-16T15:53:19.218050+0000","last_unstale":"2024-04-16T15:53:20.463570+0000","last_undegraded":"2024-04-16T15:53:20.463570+0000","last_fullsized":"2024-04-16T15:53:20.463570+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:13:11.997144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277301+0000","last_change":"2024-04-16T15:53:18.211328+0000","last_active":"2024-04-16T15:53:20.277301+0000","last_peered":"2024-04-16T15:53:20.277301+0000","last_clean":"2024-04-16T15:53:20.277301+0000","last_became_active":"2024-04-16T15:53:18.211063+0000","last_became_peered":"2024-04-16T15:53:18.211063+0000","last_unstale":"2024-04-16T15:53:20.277301+0000","last_undegraded":"2024-04-16T15:53:20.277301+0000","last_fullsized":"2024-04-16T15:53:20.277301+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:27:13.923490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464047+0000","last_change":"2024-04-16T15:53:19.210169+0000","last_active":"2024-04-16T15:53:20.464047+0000","last_peered":"2024-04-16T15:53:20.464047+0000","last_clean":"2024-04-16T15:53:20.464047+0000","last_became_active":"2024-04-16T15:53:19.209882+0000","last_became_peered":"2024-04-16T15:53:19.209882+0000","last_unstale":"2024-04-16T15:53:20.464047+0000","last_undegraded":"2024-04-16T15:53:20.464047+0000","last_fullsized":"2024-04-16T15:53:20.464047+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:34:17.258739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464213+0000","last_change":"2024-04-16T15:53:18.204297+0000","last_active":"2024-04-16T15:53:20.464213+0000","last_peered":"2024-04-16T15:53:20.464213+0000","last_clean":"2024-04-16T15:53:20.464213+0000","last_became_active":"2024-04-16T15:53:18.204054+0000","last_became_peered":"2024-04-16T15:53:18.204054+0000","last_unstale":"2024-04-16T15:53:20.464213+0000","last_undegraded":"2024-04-16T15:53:20.464213+0000","last_fullsized":"2024-04-16T15:53:20.464213+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:27:13.923490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463987+0000","last_change":"2024-04-16T15:53:19.211221+0000","last_active":"2024-04-16T15:53:20.463987+0000","last_peered":"2024-04-16T15:53:20.463987+0000","last_clean":"2024-04-16T15:53:20.463987+0000","last_became_active":"2024-04-16T15:53:19.210969+0000","last_became_peered":"2024-04-16T15:53:19.210969+0000","last_unstale":"2024-04-16T15:53:20.463987+0000","last_undegraded":"2024-04-16T15:53:20.463987+0000","last_fullsized":"2024-04-16T15:53:20.463987+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:09:57.210644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277362+0000","last_change":"2024-04-16T15:53:18.204310+0000","last_active":"2024-04-16T15:53:20.277362+0000","last_peered":"2024-04-16T15:53:20.277362+0000","last_clean":"2024-04-16T15:53:20.277362+0000","last_became_active":"2024-04-16T15:53:18.204031+0000","last_became_peered":"2024-04-16T15:53:18.204031+0000","last_unstale":"2024-04-16T15:53:20.277362+0000","last_undegraded":"2024-04-16T15:53:20.277362+0000","last_fullsized":"2024-04-16T15:53:20.277362+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:20:16.994654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.194938+0000","last_change":"2024-04-16T15:53:19.218748+0000","last_active":"2024-04-16T15:53:20.194938+0000","last_peered":"2024-04-16T15:53:20.194938+0000","last_clean":"2024-04-16T15:53:20.194938+0000","last_became_active":"2024-04-16T15:53:19.218474+0000","last_became_peered":"2024-04-16T15:53:19.218474+0000","last_unstale":"2024-04-16T15:53:20.194938+0000","last_undegraded":"2024-04-16T15:53:20.194938+0000","last_fullsized":"2024-04-16T15:53:20.194938+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:47:53.262802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195914+0000","last_change":"2024-04-16T15:53:18.204483+0000","last_active":"2024-04-16T15:53:20.195914+0000","last_peered":"2024-04-16T15:53:20.195914+0000","last_clean":"2024-04-16T15:53:20.195914+0000","last_became_active":"2024-04-16T15:53:18.203790+0000","last_became_peered":"2024-04-16T15:53:18.203790+0000","last_unstale":"2024-04-16T15:53:20.195914+0000","last_undegraded":"2024-04-16T15:53:20.195914+0000","last_fullsized":"2024-04-16T15:53:20.195914+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:49:24.686045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197045+0000","last_change":"2024-04-16T15:53:19.218646+0000","last_active":"2024-04-16T15:53:20.197045+0000","last_peered":"2024-04-16T15:53:20.197045+0000","last_clean":"2024-04-16T15:53:20.197045+0000","last_became_active":"2024-04-16T15:53:19.218379+0000","last_became_peered":"2024-04-16T15:53:19.218379+0000","last_unstale":"2024-04-16T15:53:20.197045+0000","last_undegraded":"2024-04-16T15:53:20.197045+0000","last_fullsized":"2024-04-16T15:53:20.197045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:21:33.438988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.194988+0000","last_change":"2024-04-16T15:53:18.211846+0000","last_active":"2024-04-16T15:53:20.194988+0000","last_peered":"2024-04-16T15:53:20.194988+0000","last_clean":"2024-04-16T15:53:20.194988+0000","last_became_active":"2024-04-16T15:53:18.211604+0000","last_became_peered":"2024-04-16T15:53:18.211604+0000","last_unstale":"2024-04-16T15:53:20.194988+0000","last_undegraded":"2024-04-16T15:53:20.194988+0000","last_fullsized":"2024-04-16T15:53:20.194988+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:09:08.367141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196459+0000","last_change":"2024-04-16T15:53:19.213036+0000","last_active":"2024-04-16T15:53:20.196459+0000","last_peered":"2024-04-16T15:53:20.196459+0000","last_clean":"2024-04-16T15:53:20.196459+0000","last_became_active":"2024-04-16T15:53:19.212758+0000","last_became_peered":"2024-04-16T15:53:19.212758+0000","last_unstale":"2024-04-16T15:53:20.196459+0000","last_undegraded":"2024-04-16T15:53:20.196459+0000","last_fullsized":"2024-04-16T15:53:20.196459+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:32:14.472011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464513+0000","last_change":"2024-04-16T15:53:18.213907+0000","last_active":"2024-04-16T15:53:20.464513+0000","last_peered":"2024-04-16T15:53:20.464513+0000","last_clean":"2024-04-16T15:53:20.464513+0000","last_became_active":"2024-04-16T15:53:18.213572+0000","last_became_peered":"2024-04-16T15:53:18.213572+0000","last_unstale":"2024-04-16T15:53:20.464513+0000","last_undegraded":"2024-04-16T15:53:20.464513+0000","last_fullsized":"2024-04-16T15:53:20.464513+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:08:37.253061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":196,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196856+0000","last_change":"2024-04-16T15:52:04.356095+0000","last_active":"2024-04-16T15:53:20.196856+0000","last_peered":"2024-04-16T15:53:20.196856+0000","last_clean":"2024-04-16T15:53:20.196856+0000","last_became_active":"2024-04-16T15:52:04.355126+0000","last_became_peered":"2024-04-16T15:52:04.355126+0000","last_unstale":"2024-04-16T15:53:20.196856+0000","last_undegraded":"2024-04-16T15:53:20.196856+0000","last_fullsized":"2024-04-16T15:53:20.196856+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:03.285037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:03.285037+0000","last_clean_scrub_stamp":"2024-04-16T15:52:03.285037+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:19.005024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":983040,"data_stored":742389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":152547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31568,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":393216,"data_stored":152603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":152035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":401408,"data_stored":153565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":152001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":401408,"data_stored":153565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":978944,"data_stored":742299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T15:53:30.221 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:53:30.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.363+0000 7f9039274640 1 Processor -- start 2024-04-16T15:53:30.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.363+0000 7f9039274640 1 -- start start 2024-04-16T15:53:30.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.364+0000 7f9039274640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f903415ed40 0x7f90340d00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:30.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.364+0000 7f9039274640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90340b85e0 con 0x7f903406cf50 2024-04-16T15:53:30.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.364+0000 7f9039274640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90340d2750 con 0x7f90340c7ed0 2024-04-16T15:53:30.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.364+0000 7f9039274640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f90340d2500 con 0x7f903415ed40 2024-04-16T15:53:30.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.364+0000 7f90337fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f903406cf50 0x7f90340d37f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:41558/0 (socket says 172.21.15.132:41558) 2024-04-16T15:53:30.367 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.364+0000 7f90337fe640 1 -- 172.21.15.132:0/477366662 learned_addr learned my addr 172.21.15.132:0/477366662 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:53:30.367 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.364+0000 7f9032ffd640 1 --2- 172.21.15.132:0/477366662 >> v2:172.21.15.179:3300/0 conn(0x7f903415ed40 0x7f90340d00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:30.367 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.364+0000 7f90327fc640 1 -- 172.21.15.132:0/477366662 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1445946478 0 0) 0x7f902c001490 con 0x7f903406cf50 2024-04-16T15:53:30.367 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.364+0000 7f90327fc640 1 -- 172.21.15.132:0/477366662 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9020003520 con 0x7f903406cf50 2024-04-16T15:53:30.367 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.364+0000 7f90327fc640 1 -- 172.21.15.132:0/477366662 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1957852711 0 0) 0x7f9020003520 con 0x7f903406cf50 2024-04-16T15:53:30.367 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.364+0000 7f90327fc640 1 -- 172.21.15.132:0/477366662 >> v2:172.21.15.179:3300/0 conn(0x7f903415ed40 msgr2=0x7f90340d00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:30.367 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.364+0000 7f90327fc640 1 --2- 172.21.15.132:0/477366662 >> v2:172.21.15.179:3300/0 conn(0x7f903415ed40 0x7f90340d00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:30.367 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.364+0000 7f90327fc640 1 -- 172.21.15.132:0/477366662 >> v1:172.21.15.179:6789/0 conn(0x7f90340c7ed0 legacy=0x7f90340b7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:30.367 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.364+0000 7f90327fc640 1 -- 172.21.15.132:0/477366662 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90340d2a30 con 0x7f903406cf50 2024-04-16T15:53:30.368 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.364+0000 7f90327fc640 1 -- 172.21.15.132:0/477366662 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2803668828 0 0) 0x7f902c001bc0 con 0x7f903406cf50 2024-04-16T15:53:30.368 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.364+0000 7f90327fc640 1 -- 172.21.15.132:0/477366662 >> v1:172.21.15.132:6789/0 conn(0x7f903406cf50 legacy=0x7f90340d37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:30.368 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.364+0000 7f90327fc640 1 --2- 172.21.15.132:0/477366662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90200039b0 0x7f9020003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:30.368 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.364+0000 7f90327fc640 1 --2- 172.21.15.132:0/477366662 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9020004800 0x7f9020004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:30.368 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.364+0000 7f90327fc640 1 --2- 172.21.15.132:0/477366662 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90200051c0 0x7f902000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:30.368 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.364+0000 7f90327fc640 1 -- 172.21.15.132:0/477366662 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f90340d2500 con 0x7f90200051c0 2024-04-16T15:53:30.368 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.364+0000 7f90327fc640 1 -- 172.21.15.132:0/477366662 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f902000c060 con 0x7f90200039b0 2024-04-16T15:53:30.368 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.364+0000 7f90327fc640 1 -- 172.21.15.132:0/477366662 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f902000c260 con 0x7f9020004800 2024-04-16T15:53:30.368 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.365+0000 7f90337fe640 1 --2- 172.21.15.132:0/477366662 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90200051c0 0x7f902000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:30.369 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.365+0000 7f9032ffd640 1 --2- 172.21.15.132:0/477366662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90200039b0 0x7f9020003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:30.369 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.365+0000 7f902a7fc640 1 --2- 172.21.15.132:0/477366662 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9020004800 0x7f9020004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:30.369 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.365+0000 7f90337fe640 1 -- 172.21.15.132:0/477366662 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9020004800 msgr2=0x7f9020004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:30.369 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.365+0000 7f90337fe640 1 --2- 172.21.15.132:0/477366662 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9020004800 0x7f9020004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:30.369 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.365+0000 7f90337fe640 1 -- 172.21.15.132:0/477366662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90200039b0 msgr2=0x7f9020003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:30.369 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.365+0000 7f90337fe640 1 --2- 172.21.15.132:0/477366662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90200039b0 0x7f9020003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:30.369 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.365+0000 7f90337fe640 1 -- 172.21.15.132:0/477366662 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9020003520 con 0x7f90200051c0 2024-04-16T15:53:30.369 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.365+0000 7f9032ffd640 1 --2- 172.21.15.132:0/477366662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90200039b0 0x7f9020003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:53:30.369 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.365+0000 7f90337fe640 1 -- 172.21.15.132:0/477366662 reap_dead start 2024-04-16T15:53:30.370 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.366+0000 7f90337fe640 1 --2- 172.21.15.132:0/477366662 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90200051c0 0x7f902000b9c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f902c00aa20 tx=0x7f9020005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74721b080cd57a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:30.370 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.366+0000 7f90327fc640 1 -- 172.21.15.132:0/477366662 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f902c038070 con 0x7f90200051c0 2024-04-16T15:53:30.370 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.366+0000 7f90327fc640 1 -- 172.21.15.132:0/477366662 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f902c033640 con 0x7f90200051c0 2024-04-16T15:53:30.370 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.366+0000 7f90327fc640 1 -- 172.21.15.132:0/477366662 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f902c00a640 con 0x7f90200051c0 2024-04-16T15:53:30.370 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.366+0000 7f9039274640 1 -- 172.21.15.132:0/477366662 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90200051c0 msgr2=0x7f902000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:30.370 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.366+0000 7f9039274640 1 --2- 172.21.15.132:0/477366662 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90200051c0 0x7f902000b9c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f902c00aa20 tx=0x7f9020005830 comp rx=0 tx=0).stop 2024-04-16T15:53:30.370 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.366+0000 7f9039274640 1 -- 172.21.15.132:0/477366662 shutdown_connections 2024-04-16T15:53:30.370 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.366+0000 7f9039274640 1 --2- 172.21.15.132:0/477366662 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90200051c0 0x7f902000b9c0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:30.371 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.366+0000 7f9039274640 1 -- 172.21.15.132:0/477366662 >> 172.21.15.132:0/477366662 conn(0x7f90340d1440 msgr2=0x7f90340d1850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:30.371 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.366+0000 7f9039274640 1 -- 172.21.15.132:0/477366662 shutdown_connections 2024-04-16T15:53:30.371 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.366+0000 7f9039274640 1 -- 172.21.15.132:0/477366662 wait complete. 2024-04-16T15:53:30.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.367+0000 7f9039274640 1 Processor -- start 2024-04-16T15:53:30.374 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.368+0000 7f9039274640 1 -- start start 2024-04-16T15:53:30.374 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.368+0000 7f9039274640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90200051c0 0x7f9034150c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:30.374 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.368+0000 7f9039274640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f903415afc0 0x7f9034161b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:30.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.368+0000 7f9039274640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9034162060 0x7f90340c9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:30.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.368+0000 7f9039274640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f90340d32d0 con 0x7f90200051c0 2024-04-16T15:53:30.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.368+0000 7f9039274640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f90340d2ff0 con 0x7f903415afc0 2024-04-16T15:53:30.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.368+0000 7f9039274640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f903415f120 con 0x7f9034162060 2024-04-16T15:53:30.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.368+0000 7f9032ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90200051c0 0x7f9034150c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:30.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.368+0000 7f9032ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90200051c0 0x7f9034150c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41980/0 (socket says 172.21.15.132:41980) 2024-04-16T15:53:30.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.368+0000 7f9032ffd640 1 -- 172.21.15.132:0/4154236002 learned_addr learned my addr 172.21.15.132:0/4154236002 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:30.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.369+0000 7f902a7fc640 1 --2- 172.21.15.132:0/4154236002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f903415afc0 0x7f9034161b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:30.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.369+0000 7f90337fe640 1 --2- 172.21.15.132:0/4154236002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9034162060 0x7f90340c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:30.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.369+0000 7f9032ffd640 1 -- 172.21.15.132:0/4154236002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9034162060 msgr2=0x7f90340c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:30.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.369+0000 7f9032ffd640 1 --2- 172.21.15.132:0/4154236002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9034162060 0x7f90340c9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:30.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.369+0000 7f9032ffd640 1 -- 172.21.15.132:0/4154236002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f903415afc0 msgr2=0x7f9034161b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:30.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.369+0000 7f9032ffd640 1 --2- 172.21.15.132:0/4154236002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f903415afc0 0x7f9034161b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:30.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.369+0000 7f9032ffd640 1 -- 172.21.15.132:0/4154236002 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90340c8860 con 0x7f90200051c0 2024-04-16T15:53:30.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.369+0000 7f90337fe640 1 --2- 172.21.15.132:0/4154236002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9034162060 0x7f90340c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:53:30.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.369+0000 7f9032ffd640 1 --2- 172.21.15.132:0/4154236002 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90200051c0 0x7f9034150c80 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f9024011540 tx=0x7f9024011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:30.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.369+0000 7f902bfff640 1 -- 172.21.15.132:0/4154236002 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9024015870 con 0x7f90200051c0 2024-04-16T15:53:30.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.369+0000 7f902bfff640 1 -- 172.21.15.132:0/4154236002 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9024015a10 con 0x7f90200051c0 2024-04-16T15:53:30.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.369+0000 7f9039274640 1 -- 172.21.15.132:0/4154236002 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90340c8b40 con 0x7f90200051c0 2024-04-16T15:53:30.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.369+0000 7f902bfff640 1 -- 172.21.15.132:0/4154236002 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9024015dc0 con 0x7f90200051c0 2024-04-16T15:53:30.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.369+0000 7f9039274640 1 -- 172.21.15.132:0/4154236002 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90340c9100 con 0x7f90200051c0 2024-04-16T15:53:30.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.370+0000 7f9039274640 1 -- 172.21.15.132:0/4154236002 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9034075510 con 0x7f90200051c0 2024-04-16T15:53:30.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.370+0000 7f902bfff640 1 -- 172.21.15.132:0/4154236002 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f902400f460 con 0x7f90200051c0 2024-04-16T15:53:30.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.371+0000 7f902bfff640 1 --2- 172.21.15.132:0/4154236002 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f901406c8f0 0x7f901406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:30.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.371+0000 7f902a7fc640 1 --2- 172.21.15.132:0/4154236002 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f901406c8f0 0x7f901406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:30.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.371+0000 7f902bfff640 1 -- 172.21.15.132:0/4154236002 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f902408c4a0 con 0x7f90200051c0 2024-04-16T15:53:30.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.371+0000 7f902a7fc640 1 --2- 172.21.15.132:0/4154236002 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f901406c8f0 0x7f901406edb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f901c007fd0 tx=0x7f901c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:30.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.375+0000 7f902bfff640 1 -- 172.21.15.132:0/4154236002 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9024019030 con 0x7f90200051c0 2024-04-16T15:53:30.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.554+0000 7f9039274640 1 -- 172.21.15.132:0/4154236002 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f90340cf2b0 con 0x7f90200051c0 2024-04-16T15:53:30.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.555+0000 7f902bfff640 1 -- 172.21.15.132:0/4154236002 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16669 (secure 0 0 0) 0x7f902405a280 con 0x7f90200051c0 2024-04-16T15:53:30.554 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:53:30.554 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":34,"fsid":"6bdec5d9-f406-43ad-8584-0503b32f6f0d","created":"2024-04-16T15:51:51.073040+0000","modified":"2024-04-16T15:53:20.191244+0000","last_up_change":"2024-04-16T15:52:02.280496+0000","last_in_change":"2024-04-16T15:51:53.376468+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:52:03.284927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:53:16.451607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-16T15:53:17.510579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d45908b-6e22-4619-b190-897af594b712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6801","nonce":1170594668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6803","nonce":1170594668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6807","nonce":1170594668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1170594668},{"type":"v1","addr":"172.21.15.132:6805","nonce":1170594668}]},"public_addr":"172.21.15.132:6801/1170594668","cluster_addr":"172.21.15.132:6803/1170594668","heartbeat_back_addr":"172.21.15.132:6807/1170594668","heartbeat_front_addr":"172.21.15.132:6805/1170594668","state":["exists","up"]},{"osd":1,"uuid":"c88bf082-e51f-4ee6-815a-025f6ce0d67b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6809","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6811","nonce":2494780358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6815","nonce":2494780358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6823","nonce":2494780358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":2494780358},{"type":"v1","addr":"172.21.15.132:6819","nonce":2494780358}]},"public_addr":"172.21.15.132:6811/2494780358","cluster_addr":"172.21.15.132:6815/2494780358","heartbeat_back_addr":"172.21.15.132:6823/2494780358","heartbeat_front_addr":"172.21.15.132:6819/2494780358","state":["exists","up"]},{"osd":2,"uuid":"e5dbd6b4-4e7b-47e4-ad4e-35b4b81696c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6825","nonce":27655483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6827","nonce":27655483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6831","nonce":27655483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":27655483},{"type":"v1","addr":"172.21.15.132:6829","nonce":27655483}]},"public_addr":"172.21.15.132:6825/27655483","cluster_addr":"172.21.15.132:6827/27655483","heartbeat_back_addr":"172.21.15.132:6831/27655483","heartbeat_front_addr":"172.21.15.132:6829/27655483","state":["exists","up"]},{"osd":3,"uuid":"9d75cd67-3b8a-4424-8884-5f3660e1f5f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6810","nonce":3100919191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6814","nonce":3100919191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6821","nonce":3100919191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":3100919191},{"type":"v1","addr":"172.21.15.132:6818","nonce":3100919191}]},"public_addr":"172.21.15.132:6810/3100919191","cluster_addr":"172.21.15.132:6814/3100919191","heartbeat_back_addr":"172.21.15.132:6821/3100919191","heartbeat_front_addr":"172.21.15.132:6818/3100919191","state":["exists","up"]},{"osd":4,"uuid":"83aea46a-8642-4777-912b-c130e5890da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6825","nonce":123637799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6827","nonce":123637799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6831","nonce":123637799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":123637799},{"type":"v1","addr":"172.21.15.179:6829","nonce":123637799}]},"public_addr":"172.21.15.179:6825/123637799","cluster_addr":"172.21.15.179:6827/123637799","heartbeat_back_addr":"172.21.15.179:6831/123637799","heartbeat_front_addr":"172.21.15.179:6829/123637799","state":["exists","up"]},{"osd":5,"uuid":"534117c8-3317-48d6-b436-afd5709f71e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6801","nonce":2224750370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6803","nonce":2224750370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6807","nonce":2224750370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2224750370},{"type":"v1","addr":"172.21.15.179:6805","nonce":2224750370}]},"public_addr":"172.21.15.179:6801/2224750370","cluster_addr":"172.21.15.179:6803/2224750370","heartbeat_back_addr":"172.21.15.179:6807/2224750370","heartbeat_front_addr":"172.21.15.179:6805/2224750370","state":["exists","up"]},{"osd":6,"uuid":"0ba363e7-fa9d-42b1-ae09-a6a0f57d41f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6809","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6811","nonce":101498164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6813","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6815","nonce":101498164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6823","nonce":101498164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":101498164},{"type":"v1","addr":"172.21.15.179:6819","nonce":101498164}]},"public_addr":"172.21.15.179:6811/101498164","cluster_addr":"172.21.15.179:6815/101498164","heartbeat_back_addr":"172.21.15.179:6823/101498164","heartbeat_front_addr":"172.21.15.179:6819/101498164","state":["exists","up"]},{"osd":7,"uuid":"e6830c77-2f2d-4067-9866-ee7625afc1a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6810","nonce":872148365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6814","nonce":872148365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6822","nonce":872148365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":872148365},{"type":"v1","addr":"172.21.15.179:6818","nonce":872148365}]},"public_addr":"172.21.15.179:6810/872148365","cluster_addr":"172.21.15.179:6814/872148365","heartbeat_back_addr":"172.21.15.179:6822/872148365","heartbeat_front_addr":"172.21.15.179:6818/872148365","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.535221+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.563769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.520765+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.526264+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.517058+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.500842+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.534332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:51:58.512486+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:53:30.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.557+0000 7f9039274640 1 -- 172.21.15.132:0/4154236002 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f901406c8f0 msgr2=0x7f901406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:30.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.557+0000 7f9039274640 1 --2- 172.21.15.132:0/4154236002 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f901406c8f0 0x7f901406edb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f901c007fd0 tx=0x7f901c009040 comp rx=0 tx=0).stop 2024-04-16T15:53:30.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.557+0000 7f9039274640 1 -- 172.21.15.132:0/4154236002 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90200051c0 msgr2=0x7f9034150c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:30.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.557+0000 7f9039274640 1 --2- 172.21.15.132:0/4154236002 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90200051c0 0x7f9034150c80 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f9024011540 tx=0x7f9024011a00 comp rx=0 tx=0).stop 2024-04-16T15:53:30.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.557+0000 7f9039274640 1 -- 172.21.15.132:0/4154236002 shutdown_connections 2024-04-16T15:53:30.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.557+0000 7f9039274640 1 --2- 172.21.15.132:0/4154236002 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f901406c8f0 0x7f901406edb0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:30.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.557+0000 7f9039274640 1 --2- 172.21.15.132:0/4154236002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9034162060 0x7f90340c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:30.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.557+0000 7f9039274640 1 --2- 172.21.15.132:0/4154236002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f903415afc0 0x7f9034161b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:30.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.557+0000 7f9039274640 1 --2- 172.21.15.132:0/4154236002 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90200051c0 0x7f9034150c80 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:30.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.557+0000 7f9039274640 1 -- 172.21.15.132:0/4154236002 >> 172.21.15.132:0/4154236002 conn(0x7f90340d1440 msgr2=0x7f90340b63e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:30.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.557+0000 7f9039274640 1 -- 172.21.15.132:0/4154236002 shutdown_connections 2024-04-16T15:53:30.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:30.557+0000 7f9039274640 1 -- 172.21.15.132:0/4154236002 wait complete. 2024-04-16T15:53:31.568 INFO:tasks.ceph:Scrubbing osd.0 2024-04-16T15:53:31.569 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-16T15:53:31.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.688+0000 7f69229bd640 1 Processor -- start 2024-04-16T15:53:31.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.688+0000 7f69229bd640 1 -- start start 2024-04-16T15:53:31.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.689+0000 7f69229bd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f691c0b2e30 0x7f691c15ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:31.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.689+0000 7f69229bd640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f691c15d7c0 con 0x7f691c15d350 2024-04-16T15:53:31.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.689+0000 7f69229bd640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f691c06f4f0 con 0x7f691c1460a0 2024-04-16T15:53:31.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.689+0000 7f69229bd640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f691c146480 con 0x7f691c0b2e30 2024-04-16T15:53:31.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.689+0000 7f691b7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f691c0b2e30 0x7f691c15ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:31.690 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.689+0000 7f6920f5a640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f691c15d350 0x7f691c15eae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:52962/0 (socket says 172.21.15.132:52962) 2024-04-16T15:53:31.690 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.689+0000 7f6920f5a640 1 -- 172.21.15.132:0/3265378055 learned_addr learned my addr 172.21.15.132:0/3265378055 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:53:31.690 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.689+0000 7f691b7fe640 1 -- 172.21.15.132:0/3265378055 >> v1:172.21.15.179:6789/0 conn(0x7f691c1460a0 legacy=0x7f691c0b2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:31.690 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.689+0000 7f691b7fe640 1 -- 172.21.15.132:0/3265378055 >> v1:172.21.15.132:6789/0 conn(0x7f691c15d350 legacy=0x7f691c15eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:31.690 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.689+0000 7f691b7fe640 1 -- 172.21.15.132:0/3265378055 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f691c15da40 con 0x7f691c0b2e30 2024-04-16T15:53:31.690 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.689+0000 7f691affd640 1 -- 172.21.15.132:0/3265378055 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 335686500 0 0) 0x7f6914001490 con 0x7f691c15d350 2024-04-16T15:53:31.690 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.690+0000 7f691b7fe640 1 --2- 172.21.15.132:0/3265378055 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f691c0b2e30 0x7f691c15ce10 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f69100097a0 tx=0x7f691002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb02931800072daa server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:31.690 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.690+0000 7f691affd640 1 -- 172.21.15.132:0/3265378055 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69100315a0 con 0x7f691c0b2e30 2024-04-16T15:53:31.691 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.690+0000 7f691affd640 1 -- 172.21.15.132:0/3265378055 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6910037070 con 0x7f691c0b2e30 2024-04-16T15:53:31.691 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.690+0000 7f691affd640 1 -- 172.21.15.132:0/3265378055 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6910031960 con 0x7f691c0b2e30 2024-04-16T15:53:31.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.691+0000 7f69229bd640 1 -- 172.21.15.132:0/3265378055 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f691c0b2e30 msgr2=0x7f691c15ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:31.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.691+0000 7f69229bd640 1 --2- 172.21.15.132:0/3265378055 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f691c0b2e30 0x7f691c15ce10 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f69100097a0 tx=0x7f691002b840 comp rx=0 tx=0).stop 2024-04-16T15:53:31.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.691+0000 7f69229bd640 1 -- 172.21.15.132:0/3265378055 shutdown_connections 2024-04-16T15:53:31.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.691+0000 7f69229bd640 1 --2- 172.21.15.132:0/3265378055 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f691c0b2e30 0x7f691c15ce10 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:31.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.691+0000 7f69229bd640 1 -- 172.21.15.132:0/3265378055 >> 172.21.15.132:0/3265378055 conn(0x7f691c067d90 msgr2=0x7f691c06ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:31.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.691+0000 7f69229bd640 1 -- 172.21.15.132:0/3265378055 shutdown_connections 2024-04-16T15:53:31.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.691+0000 7f69229bd640 1 -- 172.21.15.132:0/3265378055 wait complete. 2024-04-16T15:53:31.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.692+0000 7f69229bd640 1 Processor -- start 2024-04-16T15:53:31.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.692+0000 7f69229bd640 1 -- start start 2024-04-16T15:53:31.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.693+0000 7f69229bd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f691c0b2e30 0x7f691c0aa2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:31.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.693+0000 7f69229bd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f691c1460a0 0x7f691c15acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:31.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.693+0000 7f69229bd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f691c15d350 0x7f691c15b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:31.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.693+0000 7f69229bd640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f691c15e2e0 con 0x7f691c15d350 2024-04-16T15:53:31.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.693+0000 7f69229bd640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f691c15e000 con 0x7f691c1460a0 2024-04-16T15:53:31.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.693+0000 7f69229bd640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f691c15e5c0 con 0x7f691c0b2e30 2024-04-16T15:53:31.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.693+0000 7f6920f5a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f691c15d350 0x7f691c15b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:31.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.693+0000 7f6920f5a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f691c15d350 0x7f691c15b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34582/0 (socket says 172.21.15.132:34582) 2024-04-16T15:53:31.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.693+0000 7f6920f5a640 1 -- 172.21.15.132:0/3735121964 learned_addr learned my addr 172.21.15.132:0/3735121964 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:31.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.693+0000 7f691b7fe640 1 --2- 172.21.15.132:0/3735121964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f691c1460a0 0x7f691c15acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:31.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.693+0000 7f691bfff640 1 --2- 172.21.15.132:0/3735121964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f691c0b2e30 0x7f691c0aa2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:31.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.693+0000 7f6920f5a640 1 -- 172.21.15.132:0/3735121964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f691c0b2e30 msgr2=0x7f691c0aa2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:31.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.693+0000 7f6920f5a640 1 --2- 172.21.15.132:0/3735121964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f691c0b2e30 0x7f691c0aa2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:31.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.693+0000 7f6920f5a640 1 -- 172.21.15.132:0/3735121964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f691c1460a0 msgr2=0x7f691c15acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:31.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.693+0000 7f6920f5a640 1 --2- 172.21.15.132:0/3735121964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f691c1460a0 0x7f691c15acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:31.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.693+0000 7f6920f5a640 1 -- 172.21.15.132:0/3735121964 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f691c12d6e0 con 0x7f691c15d350 2024-04-16T15:53:31.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.693+0000 7f6920f5a640 1 --2- 172.21.15.132:0/3735121964 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f691c15d350 0x7f691c15b200 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f691400c700 tx=0x7f691400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:31.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.694+0000 7f6918ff9640 1 -- 172.21.15.132:0/3735121964 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6914018070 con 0x7f691c15d350 2024-04-16T15:53:31.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.694+0000 7f6918ff9640 1 -- 172.21.15.132:0/3735121964 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f691400ce10 con 0x7f691c15d350 2024-04-16T15:53:31.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.694+0000 7f6918ff9640 1 -- 172.21.15.132:0/3735121964 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f691400a880 con 0x7f691c15d350 2024-04-16T15:53:31.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.694+0000 7f69229bd640 1 -- 172.21.15.132:0/3735121964 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f691c1f3500 con 0x7f691c15d350 2024-04-16T15:53:31.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.694+0000 7f69229bd640 1 -- 172.21.15.132:0/3735121964 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f691c12dc80 con 0x7f691c15d350 2024-04-16T15:53:31.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.695+0000 7f69229bd640 1 -- 172.21.15.132:0/3735121964 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f691c068b80 con 0x7f691c15d350 2024-04-16T15:53:31.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.695+0000 7f6918ff9640 1 -- 172.21.15.132:0/3735121964 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f691401b070 con 0x7f691c15d350 2024-04-16T15:53:31.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.695+0000 7f6918ff9640 1 --2- 172.21.15.132:0/3735121964 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f690806c8f0 0x7f690806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:31.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.696+0000 7f6918ff9640 1 -- 172.21.15.132:0/3735121964 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f691408afd0 con 0x7f691c15d350 2024-04-16T15:53:31.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.696+0000 7f691bfff640 1 --2- 172.21.15.132:0/3735121964 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f690806c8f0 0x7f690806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:31.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.696+0000 7f6918ff9640 1 --2- 172.21.15.132:0/3735121964 >> [v2:172.21.15.132:6800/1170594668,v1:172.21.15.132:6801/1170594668] conn(0x7f6908074a90 0x7f6908076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:31.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.696+0000 7f6918ff9640 1 -- 172.21.15.132:0/3735121964 --> [v2:172.21.15.132:6800/1170594668,v1:172.21.15.132:6801/1170594668] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6908077560 con 0x7f6908074a90 2024-04-16T15:53:31.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.696+0000 7f6918ff9640 1 -- 172.21.15.132:0/3735121964 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f6914092050 con 0x7f691c15d350 2024-04-16T15:53:31.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.696+0000 7f691b7fe640 1 --2- 172.21.15.132:0/3735121964 >> [v2:172.21.15.132:6800/1170594668,v1:172.21.15.132:6801/1170594668] conn(0x7f6908074a90 0x7f6908076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:31.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.696+0000 7f691bfff640 1 --2- 172.21.15.132:0/3735121964 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f690806c8f0 0x7f690806edb0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f690c004f60 tx=0x7f690c007e30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:31.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.696+0000 7f691b7fe640 1 --2- 172.21.15.132:0/3735121964 >> [v2:172.21.15.132:6800/1170594668,v1:172.21.15.132:6801/1170594668] conn(0x7f6908074a90 0x7f6908076eb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:31.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.697+0000 7f6918ff9640 1 -- 172.21.15.132:0/3735121964 <== osd.0 v2:172.21.15.132:6800/1170594668 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6908077560 con 0x7f6908074a90 2024-04-16T15:53:31.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.710+0000 7f69229bd640 1 -- 172.21.15.132:0/3735121964 --> [v2:172.21.15.132:6800/1170594668,v1:172.21.15.132:6801/1170594668] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f691c0afa20 con 0x7f6908074a90 2024-04-16T15:53:31.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.710+0000 7f6918ff9640 1 -- 172.21.15.132:0/3735121964 <== osd.0 v2:172.21.15.132:6800/1170594668 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f691c0afa20 con 0x7f6908074a90 2024-04-16T15:53:31.710 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-16T15:53:31.711 INFO:teuthology.orchestra.run.smithi132.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-16T15:53:31.711 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-16T15:53:31.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.710+0000 7f69229bd640 1 -- 172.21.15.132:0/3735121964 >> [v2:172.21.15.132:6800/1170594668,v1:172.21.15.132:6801/1170594668] conn(0x7f6908074a90 msgr2=0x7f6908076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:31.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.711+0000 7f69229bd640 1 --2- 172.21.15.132:0/3735121964 >> [v2:172.21.15.132:6800/1170594668,v1:172.21.15.132:6801/1170594668] conn(0x7f6908074a90 0x7f6908076eb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:31.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.711+0000 7f69229bd640 1 -- 172.21.15.132:0/3735121964 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f690806c8f0 msgr2=0x7f690806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:31.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.711+0000 7f69229bd640 1 --2- 172.21.15.132:0/3735121964 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f690806c8f0 0x7f690806edb0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f690c004f60 tx=0x7f690c007e30 comp rx=0 tx=0).stop 2024-04-16T15:53:31.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.711+0000 7f69229bd640 1 -- 172.21.15.132:0/3735121964 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f691c15d350 msgr2=0x7f691c15b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:31.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.711+0000 7f69229bd640 1 --2- 172.21.15.132:0/3735121964 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f691c15d350 0x7f691c15b200 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f691400c700 tx=0x7f691400cbc0 comp rx=0 tx=0).stop 2024-04-16T15:53:31.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.711+0000 7f6920f5a640 1 -- 172.21.15.132:0/3735121964 reap_dead start 2024-04-16T15:53:31.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.711+0000 7f69229bd640 1 -- 172.21.15.132:0/3735121964 shutdown_connections 2024-04-16T15:53:31.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.711+0000 7f69229bd640 1 -- 172.21.15.132:0/3735121964 >> 172.21.15.132:0/3735121964 conn(0x7f691c067d90 msgr2=0x7f691c06eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:31.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.711+0000 7f69229bd640 1 -- 172.21.15.132:0/3735121964 shutdown_connections 2024-04-16T15:53:31.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.711+0000 7f69229bd640 1 -- 172.21.15.132:0/3735121964 wait complete. 2024-04-16T15:53:31.721 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-16T15:53:31.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.826+0000 7f18cedaa640 1 Processor -- start 2024-04-16T15:53:31.826 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.826+0000 7f18cedaa640 1 -- start start 2024-04-16T15:53:31.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.827+0000 7f18cedaa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18c815b730 0x7f18c80b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:31.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.827+0000 7f18cedaa640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f18c806e930 0x7f18c806ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:31.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.827+0000 7f18cedaa640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f18c806bf60 0x7f18c80ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:31.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.827+0000 7f18cedaa640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f18c815bb10 con 0x7f18c806e930 2024-04-16T15:53:31.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.827+0000 7f18cedaa640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f18c80b3a10 con 0x7f18c806bf60 2024-04-16T15:53:31.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.827+0000 7f18cedaa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f18c80ce320 con 0x7f18c815b730 2024-04-16T15:53:31.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.827+0000 7f18c7fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f18c806e930 0x7f18c806ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:31.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.827+0000 7f18c7fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f18c806e930 0x7f18c806ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34586/0 (socket says 172.21.15.132:34586) 2024-04-16T15:53:31.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.827+0000 7f18c7fff640 1 -- 172.21.15.132:0/2589749607 learned_addr learned my addr 172.21.15.132:0/2589749607 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:31.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.827+0000 7f18cd347640 1 --2- 172.21.15.132:0/2589749607 >> v2:172.21.15.179:3300/0 conn(0x7f18c806bf60 0x7f18c80ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:31.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.827+0000 7f18ccb46640 1 --2- 172.21.15.132:0/2589749607 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18c815b730 0x7f18c80b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:31.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.827+0000 7f18c7fff640 1 -- 172.21.15.132:0/2589749607 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18c815b730 msgr2=0x7f18c80b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:31.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.827+0000 7f18c7fff640 1 --2- 172.21.15.132:0/2589749607 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18c815b730 0x7f18c80b34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:31.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.827+0000 7f18c7fff640 1 -- 172.21.15.132:0/2589749607 >> v2:172.21.15.179:3300/0 conn(0x7f18c806bf60 msgr2=0x7f18c80ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:31.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.827+0000 7f18c7fff640 1 --2- 172.21.15.132:0/2589749607 >> v2:172.21.15.179:3300/0 conn(0x7f18c806bf60 0x7f18c80ceae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:31.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.827+0000 7f18c7fff640 1 -- 172.21.15.132:0/2589749607 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c80b4ef0 con 0x7f18c806e930 2024-04-16T15:53:31.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.828+0000 7f18c7fff640 1 --2- 172.21.15.132:0/2589749607 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f18c806e930 0x7f18c806ba20 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f18c80cd000 tx=0x7f18bc02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cd106516aa83954 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:31.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.828+0000 7f18c77fe640 1 -- 172.21.15.132:0/2589749607 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18bc0317c0 con 0x7f18c806e930 2024-04-16T15:53:31.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.828+0000 7f18c77fe640 1 -- 172.21.15.132:0/2589749607 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18bc037070 con 0x7f18c806e930 2024-04-16T15:53:31.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.828+0000 7f18c77fe640 1 -- 172.21.15.132:0/2589749607 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18bc031b80 con 0x7f18c806e930 2024-04-16T15:53:31.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.829+0000 7f18cedaa640 1 -- 172.21.15.132:0/2589749607 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f18c806e930 msgr2=0x7f18c806ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:31.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.829+0000 7f18cedaa640 1 --2- 172.21.15.132:0/2589749607 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f18c806e930 0x7f18c806ba20 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f18c80cd000 tx=0x7f18bc02b860 comp rx=0 tx=0).stop 2024-04-16T15:53:31.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.829+0000 7f18cedaa640 1 -- 172.21.15.132:0/2589749607 shutdown_connections 2024-04-16T15:53:31.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.829+0000 7f18cedaa640 1 --2- 172.21.15.132:0/2589749607 >> v2:172.21.15.179:3300/0 conn(0x7f18c806bf60 0x7f18c80ceae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:31.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.829+0000 7f18cedaa640 1 --2- 172.21.15.132:0/2589749607 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f18c806e930 0x7f18c806ba20 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:31.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.829+0000 7f18cedaa640 1 --2- 172.21.15.132:0/2589749607 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18c815b730 0x7f18c80b34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:31.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.829+0000 7f18cedaa640 1 -- 172.21.15.132:0/2589749607 >> 172.21.15.132:0/2589749607 conn(0x7f18c8067ff0 msgr2=0x7f18c80b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:31.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.829+0000 7f18cedaa640 1 -- 172.21.15.132:0/2589749607 shutdown_connections 2024-04-16T15:53:31.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.829+0000 7f18cedaa640 1 -- 172.21.15.132:0/2589749607 wait complete. 2024-04-16T15:53:31.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.830+0000 7f18cedaa640 1 Processor -- start 2024-04-16T15:53:31.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.830+0000 7f18cedaa640 1 -- start start 2024-04-16T15:53:31.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.831+0000 7f18cedaa640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f18c806bf60 0x7f18c81540b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:31.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.831+0000 7f18cedaa640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18c806e930 0x7f18c8071ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:31.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.831+0000 7f18cedaa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18c815b730 0x7f18c8072430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:31.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.831+0000 7f18cedaa640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f18c80b5790 con 0x7f18c806bf60 2024-04-16T15:53:31.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.831+0000 7f18cedaa640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f18c80b54b0 con 0x7f18c806e930 2024-04-16T15:53:31.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.831+0000 7f18cedaa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f18c80ce5c0 con 0x7f18c815b730 2024-04-16T15:53:31.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.831+0000 7f18ccb46640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f18c806bf60 0x7f18c81540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:31.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.831+0000 7f18ccb46640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f18c806bf60 0x7f18c81540b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34602/0 (socket says 172.21.15.132:34602) 2024-04-16T15:53:31.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.831+0000 7f18ccb46640 1 -- 172.21.15.132:0/3582139616 learned_addr learned my addr 172.21.15.132:0/3582139616 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:31.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.831+0000 7f18c7fff640 1 --2- 172.21.15.132:0/3582139616 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18c806e930 0x7f18c8071ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:31.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.831+0000 7f18cd347640 1 --2- 172.21.15.132:0/3582139616 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18c815b730 0x7f18c8072430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:31.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.831+0000 7f18ccb46640 1 -- 172.21.15.132:0/3582139616 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18c815b730 msgr2=0x7f18c8072430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:31.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.831+0000 7f18ccb46640 1 --2- 172.21.15.132:0/3582139616 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18c815b730 0x7f18c8072430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:31.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.831+0000 7f18ccb46640 1 -- 172.21.15.132:0/3582139616 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18c806e930 msgr2=0x7f18c8071ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:31.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.831+0000 7f18ccb46640 1 --2- 172.21.15.132:0/3582139616 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18c806e930 0x7f18c8071ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:31.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.831+0000 7f18ccb46640 1 -- 172.21.15.132:0/3582139616 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c8158e50 con 0x7f18c806bf60 2024-04-16T15:53:31.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.831+0000 7f18c7fff640 1 --2- 172.21.15.132:0/3582139616 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18c806e930 0x7f18c8071ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:53:31.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.831+0000 7f18cd347640 1 --2- 172.21.15.132:0/3582139616 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18c815b730 0x7f18c8072430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:53:31.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.832+0000 7f18ccb46640 1 --2- 172.21.15.132:0/3582139616 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f18c806bf60 0x7f18c81540b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f18b800e870 tx=0x7f18b800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:31.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.832+0000 7f18c57fa640 1 -- 172.21.15.132:0/3582139616 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b8017070 con 0x7f18c806bf60 2024-04-16T15:53:31.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.832+0000 7f18c57fa640 1 -- 172.21.15.132:0/3582139616 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18b800c940 con 0x7f18c806bf60 2024-04-16T15:53:31.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.832+0000 7f18cedaa640 1 -- 172.21.15.132:0/3582139616 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18c8159130 con 0x7f18c806bf60 2024-04-16T15:53:31.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.832+0000 7f18c57fa640 1 -- 172.21.15.132:0/3582139616 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b800cd30 con 0x7f18c806bf60 2024-04-16T15:53:31.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.832+0000 7f18cedaa640 1 -- 172.21.15.132:0/3582139616 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18c81596f0 con 0x7f18c806bf60 2024-04-16T15:53:31.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.833+0000 7f18cedaa640 1 -- 172.21.15.132:0/3582139616 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18c8075510 con 0x7f18c806bf60 2024-04-16T15:53:31.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.833+0000 7f18c57fa640 1 -- 172.21.15.132:0/3582139616 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f18b801a070 con 0x7f18c806bf60 2024-04-16T15:53:31.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.834+0000 7f18c57fa640 1 --2- 172.21.15.132:0/3582139616 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f18b406c920 0x7f18b406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:31.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.834+0000 7f18c57fa640 1 -- 172.21.15.132:0/3582139616 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f18b808b940 con 0x7f18c806bf60 2024-04-16T15:53:31.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.834+0000 7f18c7fff640 1 --2- 172.21.15.132:0/3582139616 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f18b406c920 0x7f18b406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:31.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.834+0000 7f18c7fff640 1 --2- 172.21.15.132:0/3582139616 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f18b406c920 0x7f18b406ede0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f18bc036000 tx=0x7f18bc03d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:31.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:31.838+0000 7f18c57fa640 1 -- 172.21.15.132:0/3582139616 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f18b8059e00 con 0x7f18c806bf60 2024-04-16T15:53:32.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.016+0000 7f18cedaa640 1 -- 172.21.15.132:0/3582139616 --> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f18c806f580 con 0x7f18b406c920 2024-04-16T15:53:32.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.016+0000 7f18c57fa640 1 -- 172.21.15.132:0/3582139616 <== mgr.4101 v2:172.21.15.132:6832/3896387465 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f18c806f580 con 0x7f18b406c920 2024-04-16T15:53:32.016 INFO:teuthology.orchestra.run.smithi132.stderr:instructed osd(s) 0 to deep-scrub 2024-04-16T15:53:32.018 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.018+0000 7f18cedaa640 1 -- 172.21.15.132:0/3582139616 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f18b406c920 msgr2=0x7f18b406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:32.018 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.019+0000 7f18cedaa640 1 --2- 172.21.15.132:0/3582139616 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f18b406c920 0x7f18b406ede0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f18bc036000 tx=0x7f18bc03d040 comp rx=0 tx=0).stop 2024-04-16T15:53:32.018 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.019+0000 7f18cedaa640 1 -- 172.21.15.132:0/3582139616 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f18c806bf60 msgr2=0x7f18c81540b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:32.018 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.019+0000 7f18cedaa640 1 --2- 172.21.15.132:0/3582139616 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f18c806bf60 0x7f18c81540b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f18b800e870 tx=0x7f18b800ed30 comp rx=0 tx=0).stop 2024-04-16T15:53:32.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.019+0000 7f18cedaa640 1 -- 172.21.15.132:0/3582139616 shutdown_connections 2024-04-16T15:53:32.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.019+0000 7f18cedaa640 1 --2- 172.21.15.132:0/3582139616 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f18b406c920 0x7f18b406ede0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:32.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.019+0000 7f18cedaa640 1 --2- 172.21.15.132:0/3582139616 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18c815b730 0x7f18c8072430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:32.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.019+0000 7f18cedaa640 1 --2- 172.21.15.132:0/3582139616 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18c806e930 0x7f18c8071ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:32.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.019+0000 7f18cedaa640 1 --2- 172.21.15.132:0/3582139616 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f18c806bf60 0x7f18c81540b0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:32.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.019+0000 7f18cedaa640 1 -- 172.21.15.132:0/3582139616 >> 172.21.15.132:0/3582139616 conn(0x7f18c8067ff0 msgr2=0x7f18c80cebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:32.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.019+0000 7f18cedaa640 1 -- 172.21.15.132:0/3582139616 shutdown_connections 2024-04-16T15:53:32.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.019+0000 7f18cedaa640 1 -- 172.21.15.132:0/3582139616 wait complete. 2024-04-16T15:53:32.029 INFO:tasks.ceph:Scrubbing osd.1 2024-04-16T15:53:32.029 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-16T15:53:32.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.137+0000 7f4cba5db640 1 Processor -- start 2024-04-16T15:53:32.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.137+0000 7f4cba5db640 1 -- start start 2024-04-16T15:53:32.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.138+0000 7f4cba5db640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cb41460a0 0x7f4cb40b2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:32.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.138+0000 7f4cba5db640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4cb40b2c60 0x7f4cb415ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:32.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.138+0000 7f4cba5db640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cb406f4f0 con 0x7f4cb415d350 2024-04-16T15:53:32.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.138+0000 7f4cba5db640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f4cb415d7a0 con 0x7f4cb40b2c60 2024-04-16T15:53:32.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.138+0000 7f4cba5db640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f4cb4146480 con 0x7f4cb41460a0 2024-04-16T15:53:32.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.138+0000 7f4cabfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4cb40b2c60 0x7f4cb415ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:32.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.138+0000 7f4cb8b78640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f4cb415d350 0x7f4cb406dff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:52974/0 (socket says 172.21.15.132:52974) 2024-04-16T15:53:32.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.138+0000 7f4cb8b78640 1 -- 172.21.15.132:0/3903711625 learned_addr learned my addr 172.21.15.132:0/3903711625 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:53:32.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.138+0000 7f4cb3fff640 1 --2- 172.21.15.132:0/3903711625 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cb41460a0 0x7f4cb40b2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:32.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.138+0000 7f4cabfff640 1 -- 172.21.15.132:0/3903711625 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cb41460a0 msgr2=0x7f4cb40b2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:32.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.138+0000 7f4cabfff640 1 --2- 172.21.15.132:0/3903711625 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cb41460a0 0x7f4cb40b2720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:32.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.138+0000 7f4cabfff640 1 -- 172.21.15.132:0/3903711625 >> v1:172.21.15.132:6789/0 conn(0x7f4cb415d350 legacy=0x7f4cb406dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:32.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.138+0000 7f4cb37fe640 1 -- 172.21.15.132:0/3903711625 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2357580885 0 0) 0x7f4cb406f4f0 con 0x7f4cb415d350 2024-04-16T15:53:32.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.138+0000 7f4cabfff640 1 -- 172.21.15.132:0/3903711625 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cb415da40 con 0x7f4cb40b2c60 2024-04-16T15:53:32.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.139+0000 7f4cabfff640 1 --2- 172.21.15.132:0/3903711625 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4cb40b2c60 0x7f4cb415ce10 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c0097a0 tx=0x7f4c9c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=311539268c61ee46 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:32.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.139+0000 7f4cb37fe640 1 -- 172.21.15.132:0/3903711625 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c035020 con 0x7f4cb40b2c60 2024-04-16T15:53:32.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.139+0000 7f4cb37fe640 1 -- 172.21.15.132:0/3903711625 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c9c031830 con 0x7f4cb40b2c60 2024-04-16T15:53:32.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.139+0000 7f4cb37fe640 1 -- 172.21.15.132:0/3903711625 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c031c00 con 0x7f4cb40b2c60 2024-04-16T15:53:32.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.140+0000 7f4cba5db640 1 -- 172.21.15.132:0/3903711625 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4cb40b2c60 msgr2=0x7f4cb415ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:32.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.140+0000 7f4cba5db640 1 --2- 172.21.15.132:0/3903711625 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4cb40b2c60 0x7f4cb415ce10 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c0097a0 tx=0x7f4c9c02b8d0 comp rx=0 tx=0).stop 2024-04-16T15:53:32.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.140+0000 7f4cba5db640 1 -- 172.21.15.132:0/3903711625 shutdown_connections 2024-04-16T15:53:32.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.140+0000 7f4cba5db640 1 --2- 172.21.15.132:0/3903711625 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4cb40b2c60 0x7f4cb415ce10 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:32.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.140+0000 7f4cba5db640 1 --2- 172.21.15.132:0/3903711625 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cb41460a0 0x7f4cb40b2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:32.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.140+0000 7f4cba5db640 1 -- 172.21.15.132:0/3903711625 >> 172.21.15.132:0/3903711625 conn(0x7f4cb4067d90 msgr2=0x7f4cb406ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:32.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.140+0000 7f4cba5db640 1 -- 172.21.15.132:0/3903711625 shutdown_connections 2024-04-16T15:53:32.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.140+0000 7f4cba5db640 1 -- 172.21.15.132:0/3903711625 wait complete. 2024-04-16T15:53:32.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.141+0000 7f4cba5db640 1 Processor -- start 2024-04-16T15:53:32.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.141+0000 7f4cba5db640 1 -- start start 2024-04-16T15:53:32.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.142+0000 7f4cba5db640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4cb40b2c60 0x7f4cb4155fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:32.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.142+0000 7f4cba5db640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4cb41460a0 0x7f4cb4142170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:32.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.142+0000 7f4cba5db640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cb415d350 0x7f4cb413cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:32.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.142+0000 7f4cba5db640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb415e2e0 con 0x7f4cb40b2c60 2024-04-16T15:53:32.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.142+0000 7f4cba5db640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb415e000 con 0x7f4cb41460a0 2024-04-16T15:53:32.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.142+0000 7f4cba5db640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f4cb415e5c0 con 0x7f4cb415d350 2024-04-16T15:53:32.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.142+0000 7f4cb3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4cb40b2c60 0x7f4cb4155fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:32.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.142+0000 7f4cb3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4cb40b2c60 0x7f4cb4155fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34624/0 (socket says 172.21.15.132:34624) 2024-04-16T15:53:32.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.142+0000 7f4cb3fff640 1 -- 172.21.15.132:0/1879873842 learned_addr learned my addr 172.21.15.132:0/1879873842 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:32.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.142+0000 7f4cb3fff640 1 -- 172.21.15.132:0/1879873842 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cb415d350 msgr2=0x7f4cb413cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:32.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.142+0000 7f4cb3fff640 1 --2- 172.21.15.132:0/1879873842 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cb415d350 0x7f4cb413cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:32.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.142+0000 7f4cb3fff640 1 -- 172.21.15.132:0/1879873842 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4cb41460a0 msgr2=0x7f4cb4142170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:32.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.142+0000 7f4cabfff640 1 --2- 172.21.15.132:0/1879873842 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4cb41460a0 0x7f4cb4142170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:32.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.142+0000 7f4cb3fff640 1 --2- 172.21.15.132:0/1879873842 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4cb41460a0 0x7f4cb4142170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:32.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.142+0000 7f4cb3fff640 1 -- 172.21.15.132:0/1879873842 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cb41428e0 con 0x7f4cb40b2c60 2024-04-16T15:53:32.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.142+0000 7f4cb3fff640 1 --2- 172.21.15.132:0/1879873842 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4cb40b2c60 0x7f4cb4155fb0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f4ca400c820 tx=0x7f4ca400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:32.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.143+0000 7f4cb17fa640 1 -- 172.21.15.132:0/1879873842 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca4015070 con 0x7f4cb40b2c60 2024-04-16T15:53:32.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.143+0000 7f4cb17fa640 1 -- 172.21.15.132:0/1879873842 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ca4004240 con 0x7f4cb40b2c60 2024-04-16T15:53:32.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.143+0000 7f4cba5db640 1 -- 172.21.15.132:0/1879873842 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cb4142bc0 con 0x7f4cb40b2c60 2024-04-16T15:53:32.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.143+0000 7f4cb17fa640 1 -- 172.21.15.132:0/1879873842 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca400ce10 con 0x7f4cb40b2c60 2024-04-16T15:53:32.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.143+0000 7f4cba5db640 1 -- 172.21.15.132:0/1879873842 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cb4143180 con 0x7f4cb40b2c60 2024-04-16T15:53:32.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.143+0000 7f4cba5db640 1 -- 172.21.15.132:0/1879873842 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4cb4068b80 con 0x7f4cb40b2c60 2024-04-16T15:53:32.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.144+0000 7f4cb17fa640 1 -- 172.21.15.132:0/1879873842 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4ca4007830 con 0x7f4cb40b2c60 2024-04-16T15:53:32.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.144+0000 7f4cb17fa640 1 --2- 172.21.15.132:0/1879873842 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f4c9406c8f0 0x7f4c9406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:32.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.145+0000 7f4cabfff640 1 --2- 172.21.15.132:0/1879873842 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f4c9406c8f0 0x7f4c9406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:32.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.145+0000 7f4cb17fa640 1 -- 172.21.15.132:0/1879873842 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f4ca408ba70 con 0x7f4cb40b2c60 2024-04-16T15:53:32.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.145+0000 7f4cb17fa640 1 --2- 172.21.15.132:0/1879873842 >> [v2:172.21.15.132:6809/2494780358,v1:172.21.15.132:6811/2494780358] conn(0x7f4c94074a90 0x7f4c94076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:32.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.145+0000 7f4cb17fa640 1 -- 172.21.15.132:0/1879873842 --> [v2:172.21.15.132:6809/2494780358,v1:172.21.15.132:6811/2494780358] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4c94077560 con 0x7f4c94074a90 2024-04-16T15:53:32.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.145+0000 7f4cb17fa640 1 -- 172.21.15.132:0/1879873842 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f4ca40902c0 con 0x7f4cb40b2c60 2024-04-16T15:53:32.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.145+0000 7f4cb8b78640 1 --2- 172.21.15.132:0/1879873842 >> [v2:172.21.15.132:6809/2494780358,v1:172.21.15.132:6811/2494780358] conn(0x7f4c94074a90 0x7f4c94076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:32.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.145+0000 7f4cabfff640 1 --2- 172.21.15.132:0/1879873842 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f4c9406c8f0 0x7f4c9406edb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c036000 tx=0x7f4c9c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:32.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.145+0000 7f4cb8b78640 1 --2- 172.21.15.132:0/1879873842 >> [v2:172.21.15.132:6809/2494780358,v1:172.21.15.132:6811/2494780358] conn(0x7f4c94074a90 0x7f4c94076eb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:32.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.146+0000 7f4cb17fa640 1 -- 172.21.15.132:0/1879873842 <== osd.1 v2:172.21.15.132:6809/2494780358 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4c94077560 con 0x7f4c94074a90 2024-04-16T15:53:32.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.159+0000 7f4cba5db640 1 -- 172.21.15.132:0/1879873842 --> [v2:172.21.15.132:6809/2494780358,v1:172.21.15.132:6811/2494780358] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f4cb415fa30 con 0x7f4c94074a90 2024-04-16T15:53:32.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.159+0000 7f4cb17fa640 1 -- 172.21.15.132:0/1879873842 <== osd.1 v2:172.21.15.132:6809/2494780358 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f4cb415fa30 con 0x7f4c94074a90 2024-04-16T15:53:32.158 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-16T15:53:32.159 INFO:teuthology.orchestra.run.smithi132.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-16T15:53:32.159 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-16T15:53:32.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.159+0000 7f4cba5db640 1 -- 172.21.15.132:0/1879873842 >> [v2:172.21.15.132:6809/2494780358,v1:172.21.15.132:6811/2494780358] conn(0x7f4c94074a90 msgr2=0x7f4c94076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:32.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.159+0000 7f4cba5db640 1 --2- 172.21.15.132:0/1879873842 >> [v2:172.21.15.132:6809/2494780358,v1:172.21.15.132:6811/2494780358] conn(0x7f4c94074a90 0x7f4c94076eb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:32.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.159+0000 7f4cba5db640 1 -- 172.21.15.132:0/1879873842 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f4c9406c8f0 msgr2=0x7f4c9406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:32.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.159+0000 7f4cba5db640 1 --2- 172.21.15.132:0/1879873842 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f4c9406c8f0 0x7f4c9406edb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c036000 tx=0x7f4c9c008030 comp rx=0 tx=0).stop 2024-04-16T15:53:32.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.159+0000 7f4cba5db640 1 -- 172.21.15.132:0/1879873842 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4cb40b2c60 msgr2=0x7f4cb4155fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:32.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.159+0000 7f4cba5db640 1 --2- 172.21.15.132:0/1879873842 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4cb40b2c60 0x7f4cb4155fb0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f4ca400c820 tx=0x7f4ca400cce0 comp rx=0 tx=0).stop 2024-04-16T15:53:32.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.159+0000 7f4cb8b78640 1 -- 172.21.15.132:0/1879873842 reap_dead start 2024-04-16T15:53:32.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.159+0000 7f4cba5db640 1 -- 172.21.15.132:0/1879873842 shutdown_connections 2024-04-16T15:53:32.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.159+0000 7f4cba5db640 1 -- 172.21.15.132:0/1879873842 >> 172.21.15.132:0/1879873842 conn(0x7f4cb4067d90 msgr2=0x7f4cb415c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:32.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.159+0000 7f4cba5db640 1 -- 172.21.15.132:0/1879873842 shutdown_connections 2024-04-16T15:53:32.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.159+0000 7f4cba5db640 1 -- 172.21.15.132:0/1879873842 wait complete. 2024-04-16T15:53:32.169 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-16T15:53:32.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.273+0000 7fef2b51b640 1 Processor -- start 2024-04-16T15:53:32.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.274+0000 7fef2b51b640 1 -- start start 2024-04-16T15:53:32.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.274+0000 7fef2b51b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fef2406ba20 0x7fef240b2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:32.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.274+0000 7fef2b51b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef2415f940 0x7fef240b0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:32.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.274+0000 7fef2b51b640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef240b6390 con 0x7fef2406be00 2024-04-16T15:53:32.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.274+0000 7fef2b51b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fef2415f140 con 0x7fef2406ba20 2024-04-16T15:53:32.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.274+0000 7fef2b51b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fef2415f420 con 0x7fef2415f940 2024-04-16T15:53:32.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.275+0000 7fef292b7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fef2406ba20 0x7fef240b2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:32.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.275+0000 7fef292b7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fef2406ba20 0x7fef240b2bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34640/0 (socket says 172.21.15.132:34640) 2024-04-16T15:53:32.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.275+0000 7fef292b7640 1 -- 172.21.15.132:0/3871699293 learned_addr learned my addr 172.21.15.132:0/3871699293 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:32.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.275+0000 7fef29ab8640 1 --2- 172.21.15.132:0/3871699293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef2415f940 0x7fef240b0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:32.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.275+0000 7fef292b7640 1 -- 172.21.15.132:0/3871699293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef2415f940 msgr2=0x7fef240b0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:32.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.275+0000 7fef292b7640 1 --2- 172.21.15.132:0/3871699293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef2415f940 0x7fef240b0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:32.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.275+0000 7fef292b7640 1 -- 172.21.15.132:0/3871699293 >> v1:172.21.15.179:6789/0 conn(0x7fef2406be00 legacy=0x7fef240b4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:32.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.275+0000 7fef292b7640 1 -- 172.21.15.132:0/3871699293 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef2406c2b0 con 0x7fef2406ba20 2024-04-16T15:53:32.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.276+0000 7fef292b7640 1 --2- 172.21.15.132:0/3871699293 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fef2406ba20 0x7fef240b2bf0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fef1c009870 tx=0x7fef1c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=584c94b9b63f8cf0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:32.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.276+0000 7fef1bfff640 1 -- 172.21.15.132:0/3871699293 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef1c034070 con 0x7fef2406ba20 2024-04-16T15:53:32.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.276+0000 7fef1bfff640 1 -- 172.21.15.132:0/3871699293 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef1c030840 con 0x7fef2406ba20 2024-04-16T15:53:32.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.276+0000 7fef1bfff640 1 -- 172.21.15.132:0/3871699293 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef1c030c10 con 0x7fef2406ba20 2024-04-16T15:53:32.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.276+0000 7fef2b51b640 1 -- 172.21.15.132:0/3871699293 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fef2406ba20 msgr2=0x7fef240b2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:32.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.276+0000 7fef2b51b640 1 --2- 172.21.15.132:0/3871699293 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fef2406ba20 0x7fef240b2bf0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fef1c009870 tx=0x7fef1c02b980 comp rx=0 tx=0).stop 2024-04-16T15:53:32.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.276+0000 7fef2b51b640 1 -- 172.21.15.132:0/3871699293 shutdown_connections 2024-04-16T15:53:32.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.276+0000 7fef2b51b640 1 --2- 172.21.15.132:0/3871699293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef2415f940 0x7fef240b0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:32.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.276+0000 7fef2b51b640 1 --2- 172.21.15.132:0/3871699293 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fef2406ba20 0x7fef240b2bf0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:32.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.276+0000 7fef2b51b640 1 -- 172.21.15.132:0/3871699293 >> 172.21.15.132:0/3871699293 conn(0x7fef2409aa30 msgr2=0x7fef240b6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:32.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.276+0000 7fef2b51b640 1 -- 172.21.15.132:0/3871699293 shutdown_connections 2024-04-16T15:53:32.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.276+0000 7fef2b51b640 1 -- 172.21.15.132:0/3871699293 wait complete. 2024-04-16T15:53:32.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.278+0000 7fef2b51b640 1 Processor -- start 2024-04-16T15:53:32.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.278+0000 7fef2b51b640 1 -- start start 2024-04-16T15:53:32.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.278+0000 7fef2b51b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fef2406ba20 0x7fef241e93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:32.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.278+0000 7fef2b51b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef2406be00 0x7fef241588f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:32.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.278+0000 7fef2b51b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef2415f940 0x7fef24143ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:32.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.278+0000 7fef2b51b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fef240b6130 con 0x7fef2406ba20 2024-04-16T15:53:32.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.278+0000 7fef2b51b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fef240b5fb0 con 0x7fef2406be00 2024-04-16T15:53:32.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.278+0000 7fef2b51b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fef2415ed20 con 0x7fef2415f940 2024-04-16T15:53:32.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.278+0000 7fef292b7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fef2406ba20 0x7fef241e93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:32.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.278+0000 7fef292b7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fef2406ba20 0x7fef241e93c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34648/0 (socket says 172.21.15.132:34648) 2024-04-16T15:53:32.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.278+0000 7fef292b7640 1 -- 172.21.15.132:0/897409398 learned_addr learned my addr 172.21.15.132:0/897409398 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:32.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.279+0000 7fef292b7640 1 -- 172.21.15.132:0/897409398 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef2415f940 msgr2=0x7fef24143ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:32.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.279+0000 7fef292b7640 1 --2- 172.21.15.132:0/897409398 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef2415f940 0x7fef24143ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:32.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.279+0000 7fef292b7640 1 -- 172.21.15.132:0/897409398 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef2406be00 msgr2=0x7fef241588f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:32.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.279+0000 7fef292b7640 1 --2- 172.21.15.132:0/897409398 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef2406be00 0x7fef241588f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:32.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.279+0000 7fef292b7640 1 -- 172.21.15.132:0/897409398 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef2415a300 con 0x7fef2406ba20 2024-04-16T15:53:32.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.279+0000 7fef292b7640 1 --2- 172.21.15.132:0/897409398 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fef2406ba20 0x7fef241e93c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fef1c000c00 tx=0x7fef1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:32.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.279+0000 7fef19ffb640 1 -- 172.21.15.132:0/897409398 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef1c034040 con 0x7fef2406ba20 2024-04-16T15:53:32.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.279+0000 7fef19ffb640 1 -- 172.21.15.132:0/897409398 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef1c039d10 con 0x7fef2406ba20 2024-04-16T15:53:32.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.279+0000 7fef2b51b640 1 -- 172.21.15.132:0/897409398 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef24159260 con 0x7fef2406ba20 2024-04-16T15:53:32.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.279+0000 7fef19ffb640 1 -- 172.21.15.132:0/897409398 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef1c043630 con 0x7fef2406ba20 2024-04-16T15:53:32.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.279+0000 7fef2b51b640 1 -- 172.21.15.132:0/897409398 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef24159820 con 0x7fef2406ba20 2024-04-16T15:53:32.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.280+0000 7fef2b51b640 1 -- 172.21.15.132:0/897409398 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef240b2350 con 0x7fef2406ba20 2024-04-16T15:53:32.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.281+0000 7fef19ffb640 1 -- 172.21.15.132:0/897409398 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fef1c04a060 con 0x7fef2406ba20 2024-04-16T15:53:32.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.281+0000 7fef19ffb640 1 --2- 172.21.15.132:0/897409398 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fef0806c8f0 0x7fef0806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:32.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.281+0000 7fef19ffb640 1 -- 172.21.15.132:0/897409398 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fef1c0ad9f0 con 0x7fef2406ba20 2024-04-16T15:53:32.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.281+0000 7fef28ab6640 1 --2- 172.21.15.132:0/897409398 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fef0806c8f0 0x7fef0806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:32.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.282+0000 7fef28ab6640 1 --2- 172.21.15.132:0/897409398 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fef0806c8f0 0x7fef0806edb0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fef14000f60 tx=0x7fef140079d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:32.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.285+0000 7fef19ffb640 1 -- 172.21.15.132:0/897409398 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fef240b2350 con 0x7fef2406ba20 2024-04-16T15:53:32.465 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.466+0000 7fef2b51b640 1 -- 172.21.15.132:0/897409398 --> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fef240d1bb0 con 0x7fef0806c8f0 2024-04-16T15:53:32.465 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.466+0000 7fef19ffb640 1 -- 172.21.15.132:0/897409398 <== mgr.4101 v2:172.21.15.132:6832/3896387465 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fef240d1bb0 con 0x7fef0806c8f0 2024-04-16T15:53:32.465 INFO:teuthology.orchestra.run.smithi132.stderr:instructed osd(s) 1 to deep-scrub 2024-04-16T15:53:32.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.468+0000 7fef2b51b640 1 -- 172.21.15.132:0/897409398 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fef0806c8f0 msgr2=0x7fef0806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:32.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.468+0000 7fef2b51b640 1 --2- 172.21.15.132:0/897409398 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fef0806c8f0 0x7fef0806edb0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fef14000f60 tx=0x7fef140079d0 comp rx=0 tx=0).stop 2024-04-16T15:53:32.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.468+0000 7fef2b51b640 1 -- 172.21.15.132:0/897409398 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fef2406ba20 msgr2=0x7fef241e93c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:32.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.468+0000 7fef2b51b640 1 --2- 172.21.15.132:0/897409398 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fef2406ba20 0x7fef241e93c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fef1c000c00 tx=0x7fef1c0046c0 comp rx=0 tx=0).stop 2024-04-16T15:53:32.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.468+0000 7fef2b51b640 1 -- 172.21.15.132:0/897409398 shutdown_connections 2024-04-16T15:53:32.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.469+0000 7fef2b51b640 1 --2- 172.21.15.132:0/897409398 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fef0806c8f0 0x7fef0806edb0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:32.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.469+0000 7fef2b51b640 1 --2- 172.21.15.132:0/897409398 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef2415f940 0x7fef24143ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:32.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.469+0000 7fef2b51b640 1 --2- 172.21.15.132:0/897409398 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef2406be00 0x7fef241588f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:32.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.469+0000 7fef2b51b640 1 --2- 172.21.15.132:0/897409398 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fef2406ba20 0x7fef241e93c0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:32.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.469+0000 7fef2b51b640 1 -- 172.21.15.132:0/897409398 >> 172.21.15.132:0/897409398 conn(0x7fef2409aa30 msgr2=0x7fef240b00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:32.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.469+0000 7fef2b51b640 1 -- 172.21.15.132:0/897409398 shutdown_connections 2024-04-16T15:53:32.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.469+0000 7fef2b51b640 1 -- 172.21.15.132:0/897409398 wait complete. 2024-04-16T15:53:32.479 INFO:tasks.ceph:Scrubbing osd.2 2024-04-16T15:53:32.479 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-16T15:53:32.587 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.588+0000 7f3ade2a7640 1 Processor -- start 2024-04-16T15:53:32.587 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.588+0000 7f3ade2a7640 1 -- start start 2024-04-16T15:53:32.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.588+0000 7f3ade2a7640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ad8144f10 0x7f3ad815bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:32.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.588+0000 7f3ade2a7640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3ad81452f0 0x7f3ad80cfea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:32.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.588+0000 7f3ade2a7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3ad806f100 0x7f3ad806f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:32.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.588+0000 7f3ade2a7640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f3ad80b00c0 con 0x7f3ad806f100 2024-04-16T15:53:32.590 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.588+0000 7f3ade2a7640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f3ad815c3c0 con 0x7f3ad81452f0 2024-04-16T15:53:32.590 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.588+0000 7f3ade2a7640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f3ad815c6a0 con 0x7f3ad8144f10 2024-04-16T15:53:32.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.589+0000 7f3adc844640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3ad806f100 0x7f3ad806f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:32.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.589+0000 7f3adc844640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3ad806f100 0x7f3ad806f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34652/0 (socket says 172.21.15.132:34652) 2024-04-16T15:53:32.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.589+0000 7f3adc844640 1 -- 172.21.15.132:0/3244787343 learned_addr learned my addr 172.21.15.132:0/3244787343 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:32.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.589+0000 7f3ad7fff640 1 --2- 172.21.15.132:0/3244787343 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ad8144f10 0x7f3ad815bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:32.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.589+0000 7f3ad77fe640 1 --2- 172.21.15.132:0/3244787343 >> v2:172.21.15.179:3300/0 conn(0x7f3ad81452f0 0x7f3ad80cfea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:32.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.589+0000 7f3adc844640 1 -- 172.21.15.132:0/3244787343 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ad8144f10 msgr2=0x7f3ad815bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:32.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.589+0000 7f3adc844640 1 --2- 172.21.15.132:0/3244787343 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ad8144f10 0x7f3ad815bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:32.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.589+0000 7f3adc844640 1 -- 172.21.15.132:0/3244787343 >> v2:172.21.15.179:3300/0 conn(0x7f3ad81452f0 msgr2=0x7f3ad80cfea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:32.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.589+0000 7f3adc844640 1 --2- 172.21.15.132:0/3244787343 >> v2:172.21.15.179:3300/0 conn(0x7f3ad81452f0 0x7f3ad80cfea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:32.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.589+0000 7f3adc844640 1 -- 172.21.15.132:0/3244787343 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ad815c980 con 0x7f3ad806f100 2024-04-16T15:53:32.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.589+0000 7f3ad77fe640 1 --2- 172.21.15.132:0/3244787343 >> v2:172.21.15.179:3300/0 conn(0x7f3ad81452f0 0x7f3ad80cfea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:53:32.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.590+0000 7f3adc844640 1 --2- 172.21.15.132:0/3244787343 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ad806f100 0x7f3ad806f590 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f3ad806fd40 tx=0x7f3ad002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f50d7782ba10625e server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:32.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.590+0000 7f3ad6ffd640 1 -- 172.21.15.132:0/3244787343 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad002ca70 con 0x7f3ad806f100 2024-04-16T15:53:32.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.590+0000 7f3ad6ffd640 1 -- 172.21.15.132:0/3244787343 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ad002cc10 con 0x7f3ad806f100 2024-04-16T15:53:32.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.590+0000 7f3ad6ffd640 1 -- 172.21.15.132:0/3244787343 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad00343f0 con 0x7f3ad806f100 2024-04-16T15:53:32.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.590+0000 7f3ade2a7640 1 -- 172.21.15.132:0/3244787343 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ad806f100 msgr2=0x7f3ad806f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:32.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.590+0000 7f3ade2a7640 1 --2- 172.21.15.132:0/3244787343 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ad806f100 0x7f3ad806f590 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f3ad806fd40 tx=0x7f3ad002bed0 comp rx=0 tx=0).stop 2024-04-16T15:53:32.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.590+0000 7f3ade2a7640 1 -- 172.21.15.132:0/3244787343 shutdown_connections 2024-04-16T15:53:32.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.590+0000 7f3ade2a7640 1 --2- 172.21.15.132:0/3244787343 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ad806f100 0x7f3ad806f590 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:32.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.590+0000 7f3ade2a7640 1 --2- 172.21.15.132:0/3244787343 >> v2:172.21.15.179:3300/0 conn(0x7f3ad81452f0 0x7f3ad80cfea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:32.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.590+0000 7f3ade2a7640 1 --2- 172.21.15.132:0/3244787343 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ad8144f10 0x7f3ad815bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:32.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.591+0000 7f3ade2a7640 1 -- 172.21.15.132:0/3244787343 >> 172.21.15.132:0/3244787343 conn(0x7f3ad8067d90 msgr2=0x7f3ad806ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:32.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.591+0000 7f3ade2a7640 1 -- 172.21.15.132:0/3244787343 shutdown_connections 2024-04-16T15:53:32.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.591+0000 7f3ade2a7640 1 -- 172.21.15.132:0/3244787343 wait complete. 2024-04-16T15:53:32.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.592+0000 7f3ade2a7640 1 Processor -- start 2024-04-16T15:53:32.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.592+0000 7f3ade2a7640 1 -- start start 2024-04-16T15:53:32.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.593+0000 7f3ade2a7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ad806f100 0x7f3ad8138ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:32.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.593+0000 7f3ade2a7640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ad8144f10 0x7f3ad815f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:32.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.593+0000 7f3ade2a7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ad81452f0 0x7f3ad815f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:32.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.593+0000 7f3ade2a7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad80b1b50 con 0x7f3ad81452f0 2024-04-16T15:53:32.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.593+0000 7f3ade2a7640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad815cc60 con 0x7f3ad806f100 2024-04-16T15:53:32.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.593+0000 7f3ade2a7640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f3ad80b1cd0 con 0x7f3ad8144f10 2024-04-16T15:53:32.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.593+0000 7f3adc844640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ad81452f0 0x7f3ad815f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:32.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.593+0000 7f3adc844640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ad81452f0 0x7f3ad815f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34666/0 (socket says 172.21.15.132:34666) 2024-04-16T15:53:32.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.593+0000 7f3adc844640 1 -- 172.21.15.132:0/3412381178 learned_addr learned my addr 172.21.15.132:0/3412381178 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:32.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.593+0000 7f3ad7fff640 1 --2- 172.21.15.132:0/3412381178 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ad806f100 0x7f3ad8138ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:32.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.593+0000 7f3ad77fe640 1 --2- 172.21.15.132:0/3412381178 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ad8144f10 0x7f3ad815f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:32.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.593+0000 7f3adc844640 1 -- 172.21.15.132:0/3412381178 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ad8144f10 msgr2=0x7f3ad815f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:32.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.593+0000 7f3adc844640 1 --2- 172.21.15.132:0/3412381178 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ad8144f10 0x7f3ad815f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:32.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.593+0000 7f3adc844640 1 -- 172.21.15.132:0/3412381178 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ad806f100 msgr2=0x7f3ad8138ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:32.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.593+0000 7f3adc844640 1 --2- 172.21.15.132:0/3412381178 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ad806f100 0x7f3ad8138ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:32.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.593+0000 7f3adc844640 1 -- 172.21.15.132:0/3412381178 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ad815d9f0 con 0x7f3ad81452f0 2024-04-16T15:53:32.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.593+0000 7f3adc844640 1 --2- 172.21.15.132:0/3412381178 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ad81452f0 0x7f3ad815f980 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0036040 tx=0x7f3ad0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:32.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.593+0000 7f3ad4ff9640 1 -- 172.21.15.132:0/3412381178 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad0043020 con 0x7f3ad81452f0 2024-04-16T15:53:32.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.593+0000 7f3ad4ff9640 1 -- 172.21.15.132:0/3412381178 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ad003e450 con 0x7f3ad81452f0 2024-04-16T15:53:32.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.593+0000 7f3ade2a7640 1 -- 172.21.15.132:0/3412381178 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ad8139530 con 0x7f3ad81452f0 2024-04-16T15:53:32.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.593+0000 7f3ad4ff9640 1 -- 172.21.15.132:0/3412381178 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad0009510 con 0x7f3ad81452f0 2024-04-16T15:53:32.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.593+0000 7f3ade2a7640 1 -- 172.21.15.132:0/3412381178 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ad815df70 con 0x7f3ad81452f0 2024-04-16T15:53:32.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.594+0000 7f3ade2a7640 1 -- 172.21.15.132:0/3412381178 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3ad8068b80 con 0x7f3ad81452f0 2024-04-16T15:53:32.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.595+0000 7f3ad4ff9640 1 -- 172.21.15.132:0/3412381178 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3ad0046020 con 0x7f3ad81452f0 2024-04-16T15:53:32.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.595+0000 7f3ad4ff9640 1 --2- 172.21.15.132:0/3412381178 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f3ac406c8f0 0x7f3ac406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:32.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.595+0000 7f3ad4ff9640 1 -- 172.21.15.132:0/3412381178 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f3ad00ae7d0 con 0x7f3ad81452f0 2024-04-16T15:53:32.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.595+0000 7f3ad7fff640 1 --2- 172.21.15.132:0/3412381178 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f3ac406c8f0 0x7f3ac406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:32.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.595+0000 7f3ad4ff9640 1 --2- 172.21.15.132:0/3412381178 >> [v2:172.21.15.132:6824/27655483,v1:172.21.15.132:6825/27655483] conn(0x7f3ac4074a90 0x7f3ac4076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:32.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.595+0000 7f3ad4ff9640 1 -- 172.21.15.132:0/3412381178 --> [v2:172.21.15.132:6824/27655483,v1:172.21.15.132:6825/27655483] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3ac4077560 con 0x7f3ac4074a90 2024-04-16T15:53:32.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.595+0000 7f3ad4ff9640 1 -- 172.21.15.132:0/3412381178 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f3ad00aec60 con 0x7f3ad81452f0 2024-04-16T15:53:32.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.596+0000 7f3ad77fe640 1 --2- 172.21.15.132:0/3412381178 >> [v2:172.21.15.132:6824/27655483,v1:172.21.15.132:6825/27655483] conn(0x7f3ac4074a90 0x7f3ac4076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:32.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.596+0000 7f3ad7fff640 1 --2- 172.21.15.132:0/3412381178 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f3ac406c8f0 0x7f3ac406edb0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3ad81402c0 tx=0x7f3ac8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:32.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.596+0000 7f3ad77fe640 1 --2- 172.21.15.132:0/3412381178 >> [v2:172.21.15.132:6824/27655483,v1:172.21.15.132:6825/27655483] conn(0x7f3ac4074a90 0x7f3ac4076eb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:32.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.597+0000 7f3ad4ff9640 1 -- 172.21.15.132:0/3412381178 <== osd.2 v2:172.21.15.132:6824/27655483 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3ac4077560 con 0x7f3ac4074a90 2024-04-16T15:53:32.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.609+0000 7f3ade2a7640 1 -- 172.21.15.132:0/3412381178 --> [v2:172.21.15.132:6824/27655483,v1:172.21.15.132:6825/27655483] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3ad80b1670 con 0x7f3ac4074a90 2024-04-16T15:53:32.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.610+0000 7f3ad4ff9640 1 -- 172.21.15.132:0/3412381178 <== osd.2 v2:172.21.15.132:6824/27655483 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f3ad80b1670 con 0x7f3ac4074a90 2024-04-16T15:53:32.609 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-16T15:53:32.609 INFO:teuthology.orchestra.run.smithi132.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-16T15:53:32.609 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-16T15:53:32.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.610+0000 7f3ade2a7640 1 -- 172.21.15.132:0/3412381178 >> [v2:172.21.15.132:6824/27655483,v1:172.21.15.132:6825/27655483] conn(0x7f3ac4074a90 msgr2=0x7f3ac4076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:32.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.610+0000 7f3ade2a7640 1 --2- 172.21.15.132:0/3412381178 >> [v2:172.21.15.132:6824/27655483,v1:172.21.15.132:6825/27655483] conn(0x7f3ac4074a90 0x7f3ac4076eb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:32.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.610+0000 7f3ade2a7640 1 -- 172.21.15.132:0/3412381178 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f3ac406c8f0 msgr2=0x7f3ac406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:32.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.610+0000 7f3ade2a7640 1 --2- 172.21.15.132:0/3412381178 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f3ac406c8f0 0x7f3ac406edb0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3ad81402c0 tx=0x7f3ac8008040 comp rx=0 tx=0).stop 2024-04-16T15:53:32.612 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.610+0000 7f3ade2a7640 1 -- 172.21.15.132:0/3412381178 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ad81452f0 msgr2=0x7f3ad815f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:32.612 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.610+0000 7f3ade2a7640 1 --2- 172.21.15.132:0/3412381178 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ad81452f0 0x7f3ad815f980 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0036040 tx=0x7f3ad0004a40 comp rx=0 tx=0).stop 2024-04-16T15:53:32.612 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.610+0000 7f3adc844640 1 -- 172.21.15.132:0/3412381178 reap_dead start 2024-04-16T15:53:32.612 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.610+0000 7f3ade2a7640 1 -- 172.21.15.132:0/3412381178 shutdown_connections 2024-04-16T15:53:32.612 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.610+0000 7f3ade2a7640 1 -- 172.21.15.132:0/3412381178 >> 172.21.15.132:0/3412381178 conn(0x7f3ad8067d90 msgr2=0x7f3ad80b0310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:32.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.610+0000 7f3ade2a7640 1 -- 172.21.15.132:0/3412381178 shutdown_connections 2024-04-16T15:53:32.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.610+0000 7f3ade2a7640 1 -- 172.21.15.132:0/3412381178 wait complete. 2024-04-16T15:53:32.620 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-16T15:53:32.724 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.725+0000 7f398f3f4640 1 Processor -- start 2024-04-16T15:53:32.724 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.725+0000 7f398f3f4640 1 -- start start 2024-04-16T15:53:32.726 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.726+0000 7f398f3f4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f39881621b0 0x7f39880b3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:32.726 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.726+0000 7f398f3f4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39880d0550 0x7f39881629c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:32.726 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.726+0000 7f398f3f4640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3988162590 con 0x7f39880b5d50 2024-04-16T15:53:32.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.726+0000 7f398f3f4640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f39880705d0 con 0x7f39881621b0 2024-04-16T15:53:32.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.726+0000 7f398f3f4640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f3988067ee0 con 0x7f39880d0550 2024-04-16T15:53:32.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.726+0000 7f398d190640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f39881621b0 0x7f39880b3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:32.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.726+0000 7f398c98f640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f39880b5d50 0x7f39880cfe40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:52986/0 (socket says 172.21.15.132:52986) 2024-04-16T15:53:32.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.726+0000 7f398c98f640 1 -- 172.21.15.132:0/3647994855 learned_addr learned my addr 172.21.15.132:0/3647994855 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:53:32.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.726+0000 7f398d991640 1 --2- 172.21.15.132:0/3647994855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39880d0550 0x7f39881629c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:32.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.726+0000 7f398d190640 1 -- 172.21.15.132:0/3647994855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39880d0550 msgr2=0x7f39881629c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:32.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.726+0000 7f398d190640 1 --2- 172.21.15.132:0/3647994855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39880d0550 0x7f39881629c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:32.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.726+0000 7f398d190640 1 -- 172.21.15.132:0/3647994855 >> v1:172.21.15.132:6789/0 conn(0x7f39880b5d50 legacy=0x7f39880cfe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:32.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.726+0000 7f398d190640 1 -- 172.21.15.132:0/3647994855 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39880702f0 con 0x7f39881621b0 2024-04-16T15:53:32.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.726+0000 7f397ffff640 1 -- 172.21.15.132:0/3647994855 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 402443671 0 0) 0x7f3988162590 con 0x7f39880b5d50 2024-04-16T15:53:32.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.727+0000 7f398d190640 1 --2- 172.21.15.132:0/3647994855 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39881621b0 0x7f39880b3d90 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f39840097a0 tx=0x7f398402b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bfe3e1cb14729c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:32.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.727+0000 7f397ffff640 1 -- 172.21.15.132:0/3647994855 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3984038070 con 0x7f39881621b0 2024-04-16T15:53:32.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.727+0000 7f397ffff640 1 -- 172.21.15.132:0/3647994855 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3984031700 con 0x7f39881621b0 2024-04-16T15:53:32.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.727+0000 7f397ffff640 1 -- 172.21.15.132:0/3647994855 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3984031ad0 con 0x7f39881621b0 2024-04-16T15:53:32.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.728+0000 7f398f3f4640 1 -- 172.21.15.132:0/3647994855 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39881621b0 msgr2=0x7f39880b3d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:32.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.728+0000 7f398f3f4640 1 --2- 172.21.15.132:0/3647994855 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39881621b0 0x7f39880b3d90 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f39840097a0 tx=0x7f398402b7a0 comp rx=0 tx=0).stop 2024-04-16T15:53:32.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.728+0000 7f398f3f4640 1 -- 172.21.15.132:0/3647994855 shutdown_connections 2024-04-16T15:53:32.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.728+0000 7f398f3f4640 1 --2- 172.21.15.132:0/3647994855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39880d0550 0x7f39881629c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:32.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.728+0000 7f398f3f4640 1 --2- 172.21.15.132:0/3647994855 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39881621b0 0x7f39880b3d90 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:32.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.728+0000 7f398f3f4640 1 -- 172.21.15.132:0/3647994855 >> 172.21.15.132:0/3647994855 conn(0x7f39880cd7e0 msgr2=0x7f39880cdbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:32.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.728+0000 7f398f3f4640 1 -- 172.21.15.132:0/3647994855 shutdown_connections 2024-04-16T15:53:32.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.728+0000 7f398f3f4640 1 -- 172.21.15.132:0/3647994855 wait complete. 2024-04-16T15:53:32.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.729+0000 7f398f3f4640 1 Processor -- start 2024-04-16T15:53:32.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.729+0000 7f398f3f4640 1 -- start start 2024-04-16T15:53:32.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.730+0000 7f398f3f4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39880b5d50 0x7f3988158230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:32.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.730+0000 7f398f3f4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39880d0550 0x7f39880c6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:32.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.730+0000 7f398f3f4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39881621b0 0x7f39880b3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:32.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.730+0000 7f398f3f4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f39880ce830 con 0x7f39881621b0 2024-04-16T15:53:32.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.730+0000 7f398f3f4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3988067b70 con 0x7f39880b5d50 2024-04-16T15:53:32.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.730+0000 7f398f3f4640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f39880b5800 con 0x7f39880d0550 2024-04-16T15:53:32.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.730+0000 7f398d991640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39881621b0 0x7f39880b3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:32.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.730+0000 7f398d991640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39881621b0 0x7f39880b3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34686/0 (socket says 172.21.15.132:34686) 2024-04-16T15:53:32.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.730+0000 7f398d991640 1 -- 172.21.15.132:0/1526505796 learned_addr learned my addr 172.21.15.132:0/1526505796 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:32.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.730+0000 7f398d190640 1 --2- 172.21.15.132:0/1526505796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39880b5d50 0x7f3988158230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:32.735 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.730+0000 7f398c98f640 1 --2- 172.21.15.132:0/1526505796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39880d0550 0x7f39880c6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:32.735 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.730+0000 7f398d991640 1 -- 172.21.15.132:0/1526505796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39880d0550 msgr2=0x7f39880c6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:32.735 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.730+0000 7f398d991640 1 --2- 172.21.15.132:0/1526505796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39880d0550 0x7f39880c6860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:32.735 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.730+0000 7f398d991640 1 -- 172.21.15.132:0/1526505796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39880b5d50 msgr2=0x7f3988158230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:32.735 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.730+0000 7f398d991640 1 --2- 172.21.15.132:0/1526505796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39880b5d50 0x7f3988158230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:32.735 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.730+0000 7f398d991640 1 -- 172.21.15.132:0/1526505796 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39880c70b0 con 0x7f39881621b0 2024-04-16T15:53:32.735 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.730+0000 7f398d991640 1 --2- 172.21.15.132:0/1526505796 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39881621b0 0x7f39880b3cc0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f3980007e30 tx=0x7f398000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:32.735 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.730+0000 7f397dffb640 1 -- 172.21.15.132:0/1526505796 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3980014620 con 0x7f39881621b0 2024-04-16T15:53:32.735 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.730+0000 7f397dffb640 1 -- 172.21.15.132:0/1526505796 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3980019070 con 0x7f39881621b0 2024-04-16T15:53:32.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.730+0000 7f398f3f4640 1 -- 172.21.15.132:0/1526505796 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39881f7d70 con 0x7f39881621b0 2024-04-16T15:53:32.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.730+0000 7f397dffb640 1 -- 172.21.15.132:0/1526505796 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3980014a00 con 0x7f39881621b0 2024-04-16T15:53:32.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.731+0000 7f398f3f4640 1 -- 172.21.15.132:0/1526505796 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39881f8330 con 0x7f39881621b0 2024-04-16T15:53:32.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.732+0000 7f398f3f4640 1 -- 172.21.15.132:0/1526505796 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39881f8530 con 0x7f39881621b0 2024-04-16T15:53:32.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.732+0000 7f397dffb640 1 -- 172.21.15.132:0/1526505796 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3980014ba0 con 0x7f39881621b0 2024-04-16T15:53:32.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.732+0000 7f397dffb640 1 --2- 172.21.15.132:0/1526505796 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f396c06c8f0 0x7f396c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:32.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.733+0000 7f397dffb640 1 -- 172.21.15.132:0/1526505796 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f398008c3e0 con 0x7f39881621b0 2024-04-16T15:53:32.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.733+0000 7f398d190640 1 --2- 172.21.15.132:0/1526505796 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f396c06c8f0 0x7f396c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:32.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.733+0000 7f398d190640 1 --2- 172.21.15.132:0/1526505796 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f396c06c8f0 0x7f396c06edb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3984035000 tx=0x7f3984008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:32.737 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.737+0000 7f397dffb640 1 -- 172.21.15.132:0/1526505796 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f39881f8530 con 0x7f39881621b0 2024-04-16T15:53:32.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.912+0000 7f398f3f4640 1 -- 172.21.15.132:0/1526505796 --> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f39880c7390 con 0x7f396c06c8f0 2024-04-16T15:53:32.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.912+0000 7f397dffb640 1 -- 172.21.15.132:0/1526505796 <== mgr.4101 v2:172.21.15.132:6832/3896387465 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f39880c7390 con 0x7f396c06c8f0 2024-04-16T15:53:32.912 INFO:teuthology.orchestra.run.smithi132.stderr:instructed osd(s) 2 to deep-scrub 2024-04-16T15:53:32.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.914+0000 7f398f3f4640 1 -- 172.21.15.132:0/1526505796 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f396c06c8f0 msgr2=0x7f396c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:32.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.914+0000 7f398f3f4640 1 --2- 172.21.15.132:0/1526505796 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f396c06c8f0 0x7f396c06edb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3984035000 tx=0x7f3984008030 comp rx=0 tx=0).stop 2024-04-16T15:53:32.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.914+0000 7f398f3f4640 1 -- 172.21.15.132:0/1526505796 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39881621b0 msgr2=0x7f39880b3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:32.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.914+0000 7f398f3f4640 1 --2- 172.21.15.132:0/1526505796 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39881621b0 0x7f39880b3cc0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f3980007e30 tx=0x7f398000e4b0 comp rx=0 tx=0).stop 2024-04-16T15:53:32.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.914+0000 7f398f3f4640 1 -- 172.21.15.132:0/1526505796 shutdown_connections 2024-04-16T15:53:32.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.914+0000 7f398f3f4640 1 --2- 172.21.15.132:0/1526505796 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f396c06c8f0 0x7f396c06edb0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:32.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.914+0000 7f398f3f4640 1 --2- 172.21.15.132:0/1526505796 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39881621b0 0x7f39880b3cc0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:32.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.914+0000 7f398f3f4640 1 --2- 172.21.15.132:0/1526505796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39880d0550 0x7f39880c6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:32.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.914+0000 7f398f3f4640 1 --2- 172.21.15.132:0/1526505796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39880b5d50 0x7f3988158230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:32.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.914+0000 7f398f3f4640 1 -- 172.21.15.132:0/1526505796 >> 172.21.15.132:0/1526505796 conn(0x7f39880cd7e0 msgr2=0x7f39880b0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:32.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.915+0000 7f398f3f4640 1 -- 172.21.15.132:0/1526505796 shutdown_connections 2024-04-16T15:53:32.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:32.915+0000 7f398f3f4640 1 -- 172.21.15.132:0/1526505796 wait complete. 2024-04-16T15:53:32.925 INFO:tasks.ceph:Scrubbing osd.3 2024-04-16T15:53:32.925 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-16T15:53:33.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.032+0000 7fc723d3d640 1 Processor -- start 2024-04-16T15:53:33.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.032+0000 7fc723d3d640 1 -- start start 2024-04-16T15:53:33.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.033+0000 7fc723d3d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc71c0b66d0 0x7fc71c1626c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:33.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.033+0000 7fc723d3d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc71c15edb0 0x7fc71c0ba3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:33.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.033+0000 7fc723d3d640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc71c162dc0 con 0x7fc71c0b6ab0 2024-04-16T15:53:33.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.033+0000 7fc723d3d640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fc71c0ba8f0 con 0x7fc71c0b66d0 2024-04-16T15:53:33.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.033+0000 7fc723d3d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc71c1630a0 con 0x7fc71c15edb0 2024-04-16T15:53:33.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.033+0000 7fc721ad9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc71c0b66d0 0x7fc71c1626c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:33.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.033+0000 7fc721ad9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc71c0b66d0 0x7fc71c1626c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34688/0 (socket says 172.21.15.132:34688) 2024-04-16T15:53:33.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.033+0000 7fc721ad9640 1 -- 172.21.15.132:0/2129175220 learned_addr learned my addr 172.21.15.132:0/2129175220 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:33.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.034+0000 7fc7212d8640 1 --2- 172.21.15.132:0/2129175220 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc71c15edb0 0x7fc71c0ba3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:33.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.034+0000 7fc721ad9640 1 -- 172.21.15.132:0/2129175220 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc71c15edb0 msgr2=0x7fc71c0ba3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:33.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.034+0000 7fc721ad9640 1 --2- 172.21.15.132:0/2129175220 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc71c15edb0 0x7fc71c0ba3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:33.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.034+0000 7fc721ad9640 1 -- 172.21.15.132:0/2129175220 >> v1:172.21.15.179:6789/0 conn(0x7fc71c0b6ab0 legacy=0x7fc71c06ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:33.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.034+0000 7fc721ad9640 1 -- 172.21.15.132:0/2129175220 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc71c163380 con 0x7fc71c0b66d0 2024-04-16T15:53:33.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.034+0000 7fc721ad9640 1 --2- 172.21.15.132:0/2129175220 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc71c0b66d0 0x7fc71c1626c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fc718009e50 tx=0x7fc71802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9836e3f116849e57 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:33.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.034+0000 7fc720ad7640 1 -- 172.21.15.132:0/2129175220 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc71802ca70 con 0x7fc71c0b66d0 2024-04-16T15:53:33.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.035+0000 7fc720ad7640 1 -- 172.21.15.132:0/2129175220 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc71802cc10 con 0x7fc71c0b66d0 2024-04-16T15:53:33.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.035+0000 7fc720ad7640 1 -- 172.21.15.132:0/2129175220 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7180343f0 con 0x7fc71c0b66d0 2024-04-16T15:53:33.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.035+0000 7fc723d3d640 1 -- 172.21.15.132:0/2129175220 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc71c0b66d0 msgr2=0x7fc71c1626c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:33.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.035+0000 7fc723d3d640 1 --2- 172.21.15.132:0/2129175220 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc71c0b66d0 0x7fc71c1626c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fc718009e50 tx=0x7fc71802bed0 comp rx=0 tx=0).stop 2024-04-16T15:53:33.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.035+0000 7fc723d3d640 1 -- 172.21.15.132:0/2129175220 shutdown_connections 2024-04-16T15:53:33.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.035+0000 7fc723d3d640 1 --2- 172.21.15.132:0/2129175220 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc71c15edb0 0x7fc71c0ba3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:33.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.035+0000 7fc723d3d640 1 --2- 172.21.15.132:0/2129175220 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc71c0b66d0 0x7fc71c1626c0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:33.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.035+0000 7fc723d3d640 1 -- 172.21.15.132:0/2129175220 >> 172.21.15.132:0/2129175220 conn(0x7fc71c0d1780 msgr2=0x7fc71c0d1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:33.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.035+0000 7fc723d3d640 1 -- 172.21.15.132:0/2129175220 shutdown_connections 2024-04-16T15:53:33.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.035+0000 7fc723d3d640 1 -- 172.21.15.132:0/2129175220 wait complete. 2024-04-16T15:53:33.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.036+0000 7fc723d3d640 1 Processor -- start 2024-04-16T15:53:33.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.036+0000 7fc723d3d640 1 -- start start 2024-04-16T15:53:33.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.037+0000 7fc723d3d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc71c0b66d0 0x7fc71c144ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:33.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.037+0000 7fc723d3d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc71c0b6ab0 0x7fc71c1450e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:33.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.037+0000 7fc723d3d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc71c15edb0 0x7fc71c145620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:33.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.037+0000 7fc723d3d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fc71c0d4490 con 0x7fc71c15edb0 2024-04-16T15:53:33.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.037+0000 7fc723d3d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc71c0d4310 con 0x7fc71c0b6ab0 2024-04-16T15:53:33.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.037+0000 7fc723d3d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc71c0d4610 con 0x7fc71c0b66d0 2024-04-16T15:53:33.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.037+0000 7fc7222da640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc71c15edb0 0x7fc71c145620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:33.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.037+0000 7fc7222da640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc71c15edb0 0x7fc71c145620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34692/0 (socket says 172.21.15.132:34692) 2024-04-16T15:53:33.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.037+0000 7fc7222da640 1 -- 172.21.15.132:0/3401933699 learned_addr learned my addr 172.21.15.132:0/3401933699 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:33.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.037+0000 7fc7212d8640 1 --2- 172.21.15.132:0/3401933699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc71c0b6ab0 0x7fc71c1450e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:33.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.037+0000 7fc721ad9640 1 --2- 172.21.15.132:0/3401933699 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc71c0b66d0 0x7fc71c144ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:33.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.037+0000 7fc7222da640 1 -- 172.21.15.132:0/3401933699 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc71c0b66d0 msgr2=0x7fc71c144ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:33.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.037+0000 7fc7222da640 1 --2- 172.21.15.132:0/3401933699 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc71c0b66d0 0x7fc71c144ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:33.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.037+0000 7fc7222da640 1 -- 172.21.15.132:0/3401933699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc71c0b6ab0 msgr2=0x7fc71c1450e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:33.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.037+0000 7fc7222da640 1 --2- 172.21.15.132:0/3401933699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc71c0b6ab0 0x7fc71c1450e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:33.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.037+0000 7fc7222da640 1 -- 172.21.15.132:0/3401933699 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc71c0ce5f0 con 0x7fc71c15edb0 2024-04-16T15:53:33.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.038+0000 7fc7222da640 1 --2- 172.21.15.132:0/3401933699 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc71c15edb0 0x7fc71c145620 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fc71400c440 tx=0x7fc71400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:33.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.038+0000 7fc7127fc640 1 -- 172.21.15.132:0/3401933699 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc714011790 con 0x7fc71c15edb0 2024-04-16T15:53:33.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.038+0000 7fc7127fc640 1 -- 172.21.15.132:0/3401933699 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc714017070 con 0x7fc71c15edb0 2024-04-16T15:53:33.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.038+0000 7fc723d3d640 1 -- 172.21.15.132:0/3401933699 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc71c160e70 con 0x7fc71c15edb0 2024-04-16T15:53:33.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.038+0000 7fc7127fc640 1 -- 172.21.15.132:0/3401933699 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc714011b70 con 0x7fc71c15edb0 2024-04-16T15:53:33.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.038+0000 7fc723d3d640 1 -- 172.21.15.132:0/3401933699 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc71c161950 con 0x7fc71c15edb0 2024-04-16T15:53:33.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.039+0000 7fc723d3d640 1 -- 172.21.15.132:0/3401933699 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc71c068b80 con 0x7fc71c15edb0 2024-04-16T15:53:33.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.039+0000 7fc7127fc640 1 -- 172.21.15.132:0/3401933699 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc714011d10 con 0x7fc71c15edb0 2024-04-16T15:53:33.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.040+0000 7fc7127fc640 1 --2- 172.21.15.132:0/3401933699 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fc70006c920 0x7fc70006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:33.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.040+0000 7fc7127fc640 1 -- 172.21.15.132:0/3401933699 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fc71408b8c0 con 0x7fc71c15edb0 2024-04-16T15:53:33.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.040+0000 7fc721ad9640 1 --2- 172.21.15.132:0/3401933699 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fc70006c920 0x7fc70006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:33.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.040+0000 7fc7127fc640 1 --2- 172.21.15.132:0/3401933699 >> [v2:172.21.15.132:6808/3100919191,v1:172.21.15.132:6810/3100919191] conn(0x7fc700074ac0 0x7fc700076ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:33.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.040+0000 7fc7127fc640 1 -- 172.21.15.132:0/3401933699 --> [v2:172.21.15.132:6808/3100919191,v1:172.21.15.132:6810/3100919191] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc700077590 con 0x7fc700074ac0 2024-04-16T15:53:33.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.040+0000 7fc7127fc640 1 -- 172.21.15.132:0/3401933699 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fc7140902c0 con 0x7fc71c15edb0 2024-04-16T15:53:33.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.040+0000 7fc7212d8640 1 --2- 172.21.15.132:0/3401933699 >> [v2:172.21.15.132:6808/3100919191,v1:172.21.15.132:6810/3100919191] conn(0x7fc700074ac0 0x7fc700076ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:33.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.040+0000 7fc721ad9640 1 --2- 172.21.15.132:0/3401933699 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fc70006c920 0x7fc70006ede0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc718035000 tx=0x7fc718030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:33.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.040+0000 7fc7212d8640 1 --2- 172.21.15.132:0/3401933699 >> [v2:172.21.15.132:6808/3100919191,v1:172.21.15.132:6810/3100919191] conn(0x7fc700074ac0 0x7fc700076ee0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:33.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.041+0000 7fc7127fc640 1 -- 172.21.15.132:0/3401933699 <== osd.3 v2:172.21.15.132:6808/3100919191 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc700077590 con 0x7fc700074ac0 2024-04-16T15:53:33.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.054+0000 7fc723d3d640 1 -- 172.21.15.132:0/3401933699 --> [v2:172.21.15.132:6808/3100919191,v1:172.21.15.132:6810/3100919191] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc71c0d24b0 con 0x7fc700074ac0 2024-04-16T15:53:33.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.054+0000 7fc7127fc640 1 -- 172.21.15.132:0/3401933699 <== osd.3 v2:172.21.15.132:6808/3100919191 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc71c0d24b0 con 0x7fc700074ac0 2024-04-16T15:53:33.054 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-16T15:53:33.054 INFO:teuthology.orchestra.run.smithi132.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-16T15:53:33.054 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-16T15:53:33.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.054+0000 7fc723d3d640 1 -- 172.21.15.132:0/3401933699 >> [v2:172.21.15.132:6808/3100919191,v1:172.21.15.132:6810/3100919191] conn(0x7fc700074ac0 msgr2=0x7fc700076ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:33.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.054+0000 7fc723d3d640 1 --2- 172.21.15.132:0/3401933699 >> [v2:172.21.15.132:6808/3100919191,v1:172.21.15.132:6810/3100919191] conn(0x7fc700074ac0 0x7fc700076ee0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:33.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.055+0000 7fc723d3d640 1 -- 172.21.15.132:0/3401933699 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fc70006c920 msgr2=0x7fc70006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:33.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.055+0000 7fc723d3d640 1 --2- 172.21.15.132:0/3401933699 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fc70006c920 0x7fc70006ede0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc718035000 tx=0x7fc718030000 comp rx=0 tx=0).stop 2024-04-16T15:53:33.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.055+0000 7fc723d3d640 1 -- 172.21.15.132:0/3401933699 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc71c15edb0 msgr2=0x7fc71c145620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:33.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.055+0000 7fc723d3d640 1 --2- 172.21.15.132:0/3401933699 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc71c15edb0 0x7fc71c145620 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fc71400c440 tx=0x7fc71400c900 comp rx=0 tx=0).stop 2024-04-16T15:53:33.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.055+0000 7fc7222da640 1 -- 172.21.15.132:0/3401933699 reap_dead start 2024-04-16T15:53:33.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.055+0000 7fc723d3d640 1 -- 172.21.15.132:0/3401933699 shutdown_connections 2024-04-16T15:53:33.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.055+0000 7fc723d3d640 1 -- 172.21.15.132:0/3401933699 >> 172.21.15.132:0/3401933699 conn(0x7fc71c0d1780 msgr2=0x7fc71c0d3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:33.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.055+0000 7fc723d3d640 1 -- 172.21.15.132:0/3401933699 shutdown_connections 2024-04-16T15:53:33.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.055+0000 7fc723d3d640 1 -- 172.21.15.132:0/3401933699 wait complete. 2024-04-16T15:53:33.065 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-16T15:53:33.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.169+0000 7f90d8063640 1 Processor -- start 2024-04-16T15:53:33.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.170+0000 7f90d8063640 1 -- start start 2024-04-16T15:53:33.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.171+0000 7f90d8063640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f90d00cfdf0 0x7f90d00d1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:33.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.171+0000 7f90d8063640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90d00ba2a0 0x7f90d00d2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:33.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.171+0000 7f90d8063640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90d0162780 con 0x7f90d0162080 2024-04-16T15:53:33.172 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.171+0000 7f90d8063640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f90d0162a60 con 0x7f90d00cfdf0 2024-04-16T15:53:33.172 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.171+0000 7f90d8063640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f90d0162d40 con 0x7f90d00ba2a0 2024-04-16T15:53:33.172 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.171+0000 7f90d55fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f90d00cfdf0 0x7f90d00d1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:33.172 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.171+0000 7f90d55fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f90d00cfdf0 0x7f90d00d1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34700/0 (socket says 172.21.15.132:34700) 2024-04-16T15:53:33.172 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.171+0000 7f90d55fe640 1 -- 172.21.15.132:0/1866958936 learned_addr learned my addr 172.21.15.132:0/1866958936 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:33.172 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.171+0000 7f90d6600640 1 --2- 172.21.15.132:0/1866958936 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90d00ba2a0 0x7f90d00d2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:33.172 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.171+0000 7f90d55fe640 1 -- 172.21.15.132:0/1866958936 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90d00ba2a0 msgr2=0x7f90d00d2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:33.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.171+0000 7f90d55fe640 1 --2- 172.21.15.132:0/1866958936 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90d00ba2a0 0x7f90d00d2fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:33.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.171+0000 7f90d55fe640 1 -- 172.21.15.132:0/1866958936 >> v1:172.21.15.179:6789/0 conn(0x7f90d0162080 legacy=0x7f90d00cf6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:33.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.171+0000 7f90d55fe640 1 -- 172.21.15.132:0/1866958936 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90d0163020 con 0x7f90d00cfdf0 2024-04-16T15:53:33.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.171+0000 7f90d6600640 1 --2- 172.21.15.132:0/1866958936 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90d00ba2a0 0x7f90d00d2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:53:33.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.172+0000 7f90d55fe640 1 --2- 172.21.15.132:0/1866958936 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90d00cfdf0 0x7f90d00d1bf0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f90c0009870 tx=0x7f90c002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8e3de998cc9afb6 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:33.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.172+0000 7f90d4dfd640 1 -- 172.21.15.132:0/1866958936 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c0035020 con 0x7f90d00cfdf0 2024-04-16T15:53:33.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.172+0000 7f90d4dfd640 1 -- 172.21.15.132:0/1866958936 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90c0031640 con 0x7f90d00cfdf0 2024-04-16T15:53:33.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.172+0000 7f90d4dfd640 1 -- 172.21.15.132:0/1866958936 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c002d040 con 0x7f90d00cfdf0 2024-04-16T15:53:33.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.173+0000 7f90d8063640 1 -- 172.21.15.132:0/1866958936 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90d00cfdf0 msgr2=0x7f90d00d1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:33.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.173+0000 7f90d8063640 1 --2- 172.21.15.132:0/1866958936 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90d00cfdf0 0x7f90d00d1bf0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f90c0009870 tx=0x7f90c002b8f0 comp rx=0 tx=0).stop 2024-04-16T15:53:33.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.173+0000 7f90d8063640 1 -- 172.21.15.132:0/1866958936 shutdown_connections 2024-04-16T15:53:33.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.173+0000 7f90d8063640 1 --2- 172.21.15.132:0/1866958936 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90d00ba2a0 0x7f90d00d2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:33.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.173+0000 7f90d8063640 1 --2- 172.21.15.132:0/1866958936 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90d00cfdf0 0x7f90d00d1bf0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:33.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.173+0000 7f90d8063640 1 -- 172.21.15.132:0/1866958936 >> 172.21.15.132:0/1866958936 conn(0x7f90d006cea0 msgr2=0x7f90d006d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:33.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.173+0000 7f90d8063640 1 -- 172.21.15.132:0/1866958936 shutdown_connections 2024-04-16T15:53:33.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.173+0000 7f90d8063640 1 -- 172.21.15.132:0/1866958936 wait complete. 2024-04-16T15:53:33.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.174+0000 7f90d8063640 1 Processor -- start 2024-04-16T15:53:33.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.174+0000 7f90d8063640 1 -- start start 2024-04-16T15:53:33.179 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.175+0000 7f90d8063640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90d00ba2a0 0x7f90d0150e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:33.179 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.175+0000 7f90d8063640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90d00cfdf0 0x7f90d00ca2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:33.179 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.175+0000 7f90d8063640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90d0162080 0x7f90d0155c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:33.179 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.175+0000 7f90d8063640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f90d00b7ab0 con 0x7f90d0162080 2024-04-16T15:53:33.179 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.175+0000 7f90d8063640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f90d01635e0 con 0x7f90d00cfdf0 2024-04-16T15:53:33.179 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.175+0000 7f90d8063640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f90d0162460 con 0x7f90d00ba2a0 2024-04-16T15:53:33.179 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.175+0000 7f90d6600640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90d0162080 0x7f90d0155c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:33.179 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.175+0000 7f90d6600640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90d0162080 0x7f90d0155c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34702/0 (socket says 172.21.15.132:34702) 2024-04-16T15:53:33.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.175+0000 7f90d6600640 1 -- 172.21.15.132:0/3303489631 learned_addr learned my addr 172.21.15.132:0/3303489631 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:33.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.175+0000 7f90d55fe640 1 --2- 172.21.15.132:0/3303489631 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90d00cfdf0 0x7f90d00ca2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:33.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.175+0000 7f90d5dff640 1 --2- 172.21.15.132:0/3303489631 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90d00ba2a0 0x7f90d0150e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:33.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.175+0000 7f90d6600640 1 -- 172.21.15.132:0/3303489631 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90d00ba2a0 msgr2=0x7f90d0150e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:33.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.175+0000 7f90d6600640 1 --2- 172.21.15.132:0/3303489631 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90d00ba2a0 0x7f90d0150e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:33.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.175+0000 7f90d6600640 1 -- 172.21.15.132:0/3303489631 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90d00cfdf0 msgr2=0x7f90d00ca2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:33.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.175+0000 7f90d6600640 1 --2- 172.21.15.132:0/3303489631 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90d00cfdf0 0x7f90d00ca2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:33.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.175+0000 7f90d6600640 1 -- 172.21.15.132:0/3303489631 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90d00cabc0 con 0x7f90d0162080 2024-04-16T15:53:33.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.175+0000 7f90d6600640 1 --2- 172.21.15.132:0/3303489631 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90d0162080 0x7f90d0155c50 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f90c800c7f0 tx=0x7f90c800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:33.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.175+0000 7f90c67fc640 1 -- 172.21.15.132:0/3303489631 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c8015020 con 0x7f90d0162080 2024-04-16T15:53:33.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.175+0000 7f90c67fc640 1 -- 172.21.15.132:0/3303489631 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90c8004230 con 0x7f90d0162080 2024-04-16T15:53:33.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.175+0000 7f90d8063640 1 -- 172.21.15.132:0/3303489631 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90d00caea0 con 0x7f90d0162080 2024-04-16T15:53:33.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.175+0000 7f90c67fc640 1 -- 172.21.15.132:0/3303489631 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c8007620 con 0x7f90d0162080 2024-04-16T15:53:33.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.176+0000 7f90d8063640 1 -- 172.21.15.132:0/3303489631 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90d00ca810 con 0x7f90d0162080 2024-04-16T15:53:33.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.177+0000 7f90d8063640 1 -- 172.21.15.132:0/3303489631 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90d0075510 con 0x7f90d0162080 2024-04-16T15:53:33.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.177+0000 7f90c67fc640 1 -- 172.21.15.132:0/3303489631 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f90c8018020 con 0x7f90d0162080 2024-04-16T15:53:33.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.177+0000 7f90c67fc640 1 --2- 172.21.15.132:0/3303489631 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f90b406c920 0x7f90b406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:33.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.177+0000 7f90c67fc640 1 -- 172.21.15.132:0/3303489631 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f90c808bc10 con 0x7f90d0162080 2024-04-16T15:53:33.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.177+0000 7f90d5dff640 1 --2- 172.21.15.132:0/3303489631 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f90b406c920 0x7f90b406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:33.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.178+0000 7f90d5dff640 1 --2- 172.21.15.132:0/3303489631 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f90b406c920 0x7f90b406ede0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f90cc005660 tx=0x7f90cc003d90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:33.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.182+0000 7f90c67fc640 1 -- 172.21.15.132:0/3303489631 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f90c801f020 con 0x7f90d0162080 2024-04-16T15:53:33.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.362+0000 7f90d8063640 1 -- 172.21.15.132:0/3303489631 --> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f90d00d25b0 con 0x7f90b406c920 2024-04-16T15:53:33.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.362+0000 7f90c67fc640 1 -- 172.21.15.132:0/3303489631 <== mgr.4101 v2:172.21.15.132:6832/3896387465 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f90d00d25b0 con 0x7f90b406c920 2024-04-16T15:53:33.362 INFO:teuthology.orchestra.run.smithi132.stderr:instructed osd(s) 3 to deep-scrub 2024-04-16T15:53:33.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.365+0000 7f90d8063640 1 -- 172.21.15.132:0/3303489631 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f90b406c920 msgr2=0x7f90b406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:33.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.365+0000 7f90d8063640 1 --2- 172.21.15.132:0/3303489631 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f90b406c920 0x7f90b406ede0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f90cc005660 tx=0x7f90cc003d90 comp rx=0 tx=0).stop 2024-04-16T15:53:33.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.365+0000 7f90d8063640 1 -- 172.21.15.132:0/3303489631 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90d0162080 msgr2=0x7f90d0155c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:33.367 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.365+0000 7f90d8063640 1 --2- 172.21.15.132:0/3303489631 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90d0162080 0x7f90d0155c50 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f90c800c7f0 tx=0x7f90c800ccb0 comp rx=0 tx=0).stop 2024-04-16T15:53:33.367 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.365+0000 7f90d8063640 1 -- 172.21.15.132:0/3303489631 shutdown_connections 2024-04-16T15:53:33.367 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.365+0000 7f90d8063640 1 --2- 172.21.15.132:0/3303489631 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f90b406c920 0x7f90b406ede0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:33.367 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.365+0000 7f90d8063640 1 --2- 172.21.15.132:0/3303489631 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90d0162080 0x7f90d0155c50 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:33.367 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.365+0000 7f90d8063640 1 --2- 172.21.15.132:0/3303489631 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90d00cfdf0 0x7f90d00ca2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:33.367 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.365+0000 7f90d8063640 1 --2- 172.21.15.132:0/3303489631 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90d00ba2a0 0x7f90d0150e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:33.367 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.365+0000 7f90d8063640 1 -- 172.21.15.132:0/3303489631 >> 172.21.15.132:0/3303489631 conn(0x7f90d006cea0 msgr2=0x7f90d00b9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:33.367 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.365+0000 7f90d8063640 1 -- 172.21.15.132:0/3303489631 shutdown_connections 2024-04-16T15:53:33.368 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.365+0000 7f90d8063640 1 -- 172.21.15.132:0/3303489631 wait complete. 2024-04-16T15:53:33.375 INFO:tasks.ceph:Scrubbing osd.4 2024-04-16T15:53:33.375 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-16T15:53:33.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.484+0000 7f871afe8640 1 Processor -- start 2024-04-16T15:53:33.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.484+0000 7f871afe8640 1 -- start start 2024-04-16T15:53:33.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.484+0000 7f871afe8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87140b66d0 0x7f87141626c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:33.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.484+0000 7f871afe8640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f87140ba3b0 0x7f87140d3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:33.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.484+0000 7f871afe8640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8714162dc0 con 0x7f871415edb0 2024-04-16T15:53:33.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.484+0000 7f871afe8640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f87141630a0 con 0x7f87140ba3b0 2024-04-16T15:53:33.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.484+0000 7f871afe8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f8714163380 con 0x7f87140b66d0 2024-04-16T15:53:33.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.485+0000 7f8719585640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f87140ba3b0 0x7f87140d3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:33.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.485+0000 7f8719585640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f87140ba3b0 0x7f87140d3300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34714/0 (socket says 172.21.15.132:34714) 2024-04-16T15:53:33.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.485+0000 7f8719585640 1 -- 172.21.15.132:0/1164800874 learned_addr learned my addr 172.21.15.132:0/1164800874 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:33.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.485+0000 7f8718d84640 1 --2- 172.21.15.132:0/1164800874 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87140b66d0 0x7f87141626c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:33.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.485+0000 7f8719585640 1 -- 172.21.15.132:0/1164800874 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87140b66d0 msgr2=0x7f87141626c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:33.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.485+0000 7f8719585640 1 --2- 172.21.15.132:0/1164800874 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87140b66d0 0x7f87141626c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:33.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.485+0000 7f8719585640 1 -- 172.21.15.132:0/1164800874 >> v1:172.21.15.179:6789/0 conn(0x7f871415edb0 legacy=0x7f87140b6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:33.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.485+0000 7f8719585640 1 -- 172.21.15.132:0/1164800874 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87140ba830 con 0x7f87140ba3b0 2024-04-16T15:53:33.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.486+0000 7f8719585640 1 --2- 172.21.15.132:0/1164800874 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87140ba3b0 0x7f87140d3300 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f870c009e50 tx=0x7f870c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecc285157a583db5 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:33.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.486+0000 7f870b7fe640 1 -- 172.21.15.132:0/1164800874 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f870c02ca70 con 0x7f87140ba3b0 2024-04-16T15:53:33.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.486+0000 7f870b7fe640 1 -- 172.21.15.132:0/1164800874 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f870c02cc10 con 0x7f87140ba3b0 2024-04-16T15:53:33.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.486+0000 7f870b7fe640 1 -- 172.21.15.132:0/1164800874 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f870c0343f0 con 0x7f87140ba3b0 2024-04-16T15:53:33.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.486+0000 7f871afe8640 1 -- 172.21.15.132:0/1164800874 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87140ba3b0 msgr2=0x7f87140d3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:33.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.486+0000 7f871afe8640 1 --2- 172.21.15.132:0/1164800874 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87140ba3b0 0x7f87140d3300 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f870c009e50 tx=0x7f870c02bed0 comp rx=0 tx=0).stop 2024-04-16T15:53:33.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.486+0000 7f871afe8640 1 -- 172.21.15.132:0/1164800874 shutdown_connections 2024-04-16T15:53:33.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.486+0000 7f871afe8640 1 --2- 172.21.15.132:0/1164800874 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87140ba3b0 0x7f87140d3300 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:33.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.486+0000 7f871afe8640 1 --2- 172.21.15.132:0/1164800874 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87140b66d0 0x7f87141626c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:33.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.486+0000 7f871afe8640 1 -- 172.21.15.132:0/1164800874 >> 172.21.15.132:0/1164800874 conn(0x7f87140d1780 msgr2=0x7f87140d1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:33.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.486+0000 7f871afe8640 1 -- 172.21.15.132:0/1164800874 shutdown_connections 2024-04-16T15:53:33.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.486+0000 7f871afe8640 1 -- 172.21.15.132:0/1164800874 wait complete. 2024-04-16T15:53:33.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.488+0000 7f871afe8640 1 Processor -- start 2024-04-16T15:53:33.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.488+0000 7f871afe8640 1 -- start start 2024-04-16T15:53:33.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.488+0000 7f871afe8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87140b66d0 0x7f87141f4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:33.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.488+0000 7f871afe8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87140ba3b0 0x7f87140ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:33.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.488+0000 7f871afe8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f871415edb0 0x7f87140caa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:33.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.488+0000 7f871afe8640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f87140d3c10 con 0x7f871415edb0 2024-04-16T15:53:33.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.488+0000 7f871afe8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f87140d3a90 con 0x7f87140ba3b0 2024-04-16T15:53:33.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.488+0000 7f871afe8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f87140d3d90 con 0x7f87140b66d0 2024-04-16T15:53:33.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.489+0000 7f8719585640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f871415edb0 0x7f87140caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:33.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.489+0000 7f8719585640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f871415edb0 0x7f87140caa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34722/0 (socket says 172.21.15.132:34722) 2024-04-16T15:53:33.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.489+0000 7f8719585640 1 -- 172.21.15.132:0/2439054118 learned_addr learned my addr 172.21.15.132:0/2439054118 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:33.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.489+0000 7f870bfff640 1 --2- 172.21.15.132:0/2439054118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87140ba3b0 0x7f87140ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:33.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.489+0000 7f8718d84640 1 --2- 172.21.15.132:0/2439054118 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87140b66d0 0x7f87141f4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:33.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.489+0000 7f8719585640 1 -- 172.21.15.132:0/2439054118 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87140b66d0 msgr2=0x7f87141f4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:33.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.489+0000 7f8719585640 1 --2- 172.21.15.132:0/2439054118 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87140b66d0 0x7f87141f4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:33.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.489+0000 7f8719585640 1 -- 172.21.15.132:0/2439054118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87140ba3b0 msgr2=0x7f87140ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:33.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.489+0000 7f8719585640 1 --2- 172.21.15.132:0/2439054118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87140ba3b0 0x7f87140ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:33.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.489+0000 7f8719585640 1 -- 172.21.15.132:0/2439054118 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87141f4bc0 con 0x7f871415edb0 2024-04-16T15:53:33.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.489+0000 7f870bfff640 1 --2- 172.21.15.132:0/2439054118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87140ba3b0 0x7f87140ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:53:33.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.489+0000 7f8719585640 1 --2- 172.21.15.132:0/2439054118 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f871415edb0 0x7f87140caa90 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f870c036040 tx=0x7f870c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:33.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.489+0000 7f87097fa640 1 -- 172.21.15.132:0/2439054118 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f870c043020 con 0x7f871415edb0 2024-04-16T15:53:33.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.489+0000 7f87097fa640 1 -- 172.21.15.132:0/2439054118 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f870c03e450 con 0x7f871415edb0 2024-04-16T15:53:33.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.489+0000 7f87097fa640 1 -- 172.21.15.132:0/2439054118 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f870c009510 con 0x7f871415edb0 2024-04-16T15:53:33.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.489+0000 7f871afe8640 1 -- 172.21.15.132:0/2439054118 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87141f4ea0 con 0x7f871415edb0 2024-04-16T15:53:33.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.490+0000 7f871afe8640 1 -- 172.21.15.132:0/2439054118 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87141f57f0 con 0x7f871415edb0 2024-04-16T15:53:33.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.490+0000 7f871afe8640 1 -- 172.21.15.132:0/2439054118 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8714068b80 con 0x7f871415edb0 2024-04-16T15:53:33.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.491+0000 7f87097fa640 1 -- 172.21.15.132:0/2439054118 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f870c046020 con 0x7f871415edb0 2024-04-16T15:53:33.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.491+0000 7f87097fa640 1 --2- 172.21.15.132:0/2439054118 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f870006c8f0 0x7f870006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:33.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.491+0000 7f87097fa640 1 -- 172.21.15.132:0/2439054118 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f870c0ae4e0 con 0x7f871415edb0 2024-04-16T15:53:33.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.491+0000 7f8718d84640 1 --2- 172.21.15.132:0/2439054118 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f870006c8f0 0x7f870006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:33.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.492+0000 7f87097fa640 1 --2- 172.21.15.132:0/2439054118 >> [v2:172.21.15.179:6824/123637799,v1:172.21.15.179:6825/123637799] conn(0x7f8700074b70 0x7f8700076f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:33.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.492+0000 7f87097fa640 1 -- 172.21.15.132:0/2439054118 --> [v2:172.21.15.179:6824/123637799,v1:172.21.15.179:6825/123637799] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f870c03ae50 con 0x7f8700074b70 2024-04-16T15:53:33.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.492+0000 7f87097fa640 1 -- 172.21.15.132:0/2439054118 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f870c0b5050 con 0x7f871415edb0 2024-04-16T15:53:33.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.492+0000 7f8718d84640 1 --2- 172.21.15.132:0/2439054118 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f870006c8f0 0x7f870006edb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8710006fd0 tx=0x7f8710008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:33.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.492+0000 7f870bfff640 1 --2- 172.21.15.132:0/2439054118 >> [v2:172.21.15.179:6824/123637799,v1:172.21.15.179:6825/123637799] conn(0x7f8700074b70 0x7f8700076f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:33.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.492+0000 7f870bfff640 1 --2- 172.21.15.132:0/2439054118 >> [v2:172.21.15.179:6824/123637799,v1:172.21.15.179:6825/123637799] conn(0x7f8700074b70 0x7f8700076f90 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:33.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.493+0000 7f87097fa640 1 -- 172.21.15.132:0/2439054118 <== osd.4 v2:172.21.15.179:6824/123637799 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f870c03ae50 con 0x7f8700074b70 2024-04-16T15:53:33.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.506+0000 7f871afe8640 1 -- 172.21.15.132:0/2439054118 --> [v2:172.21.15.179:6824/123637799,v1:172.21.15.179:6825/123637799] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f87140d24b0 con 0x7f8700074b70 2024-04-16T15:53:33.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.507+0000 7f87097fa640 1 -- 172.21.15.132:0/2439054118 <== osd.4 v2:172.21.15.179:6824/123637799 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f87140d24b0 con 0x7f8700074b70 2024-04-16T15:53:33.506 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-16T15:53:33.506 INFO:teuthology.orchestra.run.smithi132.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-16T15:53:33.506 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-16T15:53:33.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.507+0000 7f871afe8640 1 -- 172.21.15.132:0/2439054118 >> [v2:172.21.15.179:6824/123637799,v1:172.21.15.179:6825/123637799] conn(0x7f8700074b70 msgr2=0x7f8700076f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:33.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.507+0000 7f871afe8640 1 --2- 172.21.15.132:0/2439054118 >> [v2:172.21.15.179:6824/123637799,v1:172.21.15.179:6825/123637799] conn(0x7f8700074b70 0x7f8700076f90 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:33.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.507+0000 7f871afe8640 1 -- 172.21.15.132:0/2439054118 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f870006c8f0 msgr2=0x7f870006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:33.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.507+0000 7f871afe8640 1 --2- 172.21.15.132:0/2439054118 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f870006c8f0 0x7f870006edb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8710006fd0 tx=0x7f8710008040 comp rx=0 tx=0).stop 2024-04-16T15:53:33.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.507+0000 7f871afe8640 1 -- 172.21.15.132:0/2439054118 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f871415edb0 msgr2=0x7f87140caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:33.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.507+0000 7f871afe8640 1 --2- 172.21.15.132:0/2439054118 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f871415edb0 0x7f87140caa90 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f870c036040 tx=0x7f870c004a40 comp rx=0 tx=0).stop 2024-04-16T15:53:33.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.507+0000 7f8719585640 1 -- 172.21.15.132:0/2439054118 reap_dead start 2024-04-16T15:53:33.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.507+0000 7f871afe8640 1 -- 172.21.15.132:0/2439054118 shutdown_connections 2024-04-16T15:53:33.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.507+0000 7f871afe8640 1 -- 172.21.15.132:0/2439054118 >> 172.21.15.132:0/2439054118 conn(0x7f87140d1780 msgr2=0x7f871415cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:33.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.507+0000 7f871afe8640 1 -- 172.21.15.132:0/2439054118 shutdown_connections 2024-04-16T15:53:33.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.507+0000 7f871afe8640 1 -- 172.21.15.132:0/2439054118 wait complete. 2024-04-16T15:53:33.517 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-16T15:53:33.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.622+0000 7f9a00767640 1 Processor -- start 2024-04-16T15:53:33.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.622+0000 7f9a00767640 1 -- start start 2024-04-16T15:53:33.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.623+0000 7f9a00767640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99f80b7060 0x7f99f80b1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:33.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.623+0000 7f9a00767640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99f80b2c70 con 0x7f99f806c130 2024-04-16T15:53:33.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.623+0000 7f9a00767640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99f80b0ad0 con 0x7f99f8145c90 2024-04-16T15:53:33.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.623+0000 7f9a00767640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f99f80b0880 con 0x7f99f80b7060 2024-04-16T15:53:33.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.623+0000 7f99fdd02640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f99f806c130 0x7f99f80b15b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:53000/0 (socket says 172.21.15.132:53000) 2024-04-16T15:53:33.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.623+0000 7f99fdd02640 1 -- 172.21.15.132:0/79765180 learned_addr learned my addr 172.21.15.132:0/79765180 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:53:33.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.623+0000 7f99fed04640 1 --2- 172.21.15.132:0/79765180 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99f80b7060 0x7f99f80b1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:33.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.623+0000 7f99fd501640 1 -- 172.21.15.132:0/79765180 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3212306017 0 0) 0x7f99f80b2c70 con 0x7f99f806c130 2024-04-16T15:53:33.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.623+0000 7f99fd501640 1 -- 172.21.15.132:0/79765180 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99e4003520 con 0x7f99f806c130 2024-04-16T15:53:33.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.623+0000 7f99fd501640 1 -- 172.21.15.132:0/79765180 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2592879140 0 0) 0x7f99f80b0ad0 con 0x7f99f8145c90 2024-04-16T15:53:33.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.623+0000 7f99fd501640 1 -- 172.21.15.132:0/79765180 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99f80b2c70 con 0x7f99f8145c90 2024-04-16T15:53:33.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.623+0000 7f99fd501640 1 -- 172.21.15.132:0/79765180 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 74488337 0 0) 0x7f99e4003520 con 0x7f99f806c130 2024-04-16T15:53:33.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.623+0000 7f99fd501640 1 -- 172.21.15.132:0/79765180 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99f80b7060 msgr2=0x7f99f80b1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:33.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.623+0000 7f99fd501640 1 --2- 172.21.15.132:0/79765180 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99f80b7060 0x7f99f80b1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:33.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.623+0000 7f99fd501640 1 -- 172.21.15.132:0/79765180 >> v1:172.21.15.179:6789/0 conn(0x7f99f8145c90 legacy=0x7f99f806ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:33.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.623+0000 7f99fd501640 1 -- 172.21.15.132:0/79765180 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99f80b0db0 con 0x7f99f806c130 2024-04-16T15:53:33.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.623+0000 7f99fd501640 1 -- 172.21.15.132:0/79765180 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2803668828 0 0) 0x7f99e80015f0 con 0x7f99f806c130 2024-04-16T15:53:33.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.623+0000 7f99fd501640 1 -- 172.21.15.132:0/79765180 >> v1:172.21.15.132:6789/0 conn(0x7f99f806c130 legacy=0x7f99f80b15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:33.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.623+0000 7f99fd501640 1 --2- 172.21.15.132:0/79765180 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99e4003b70 0x7f99e4003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:33.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.623+0000 7f99fd501640 1 --2- 172.21.15.132:0/79765180 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99e4004800 0x7f99e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:33.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.624+0000 7f99fd501640 1 --2- 172.21.15.132:0/79765180 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99f80b7060 0x7f99e40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:33.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.624+0000 7f99fd501640 1 -- 172.21.15.132:0/79765180 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f99f80b0880 con 0x7f99e4004800 2024-04-16T15:53:33.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.624+0000 7f99fd501640 1 -- 172.21.15.132:0/79765180 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f99e400ba70 con 0x7f99e4003b70 2024-04-16T15:53:33.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.624+0000 7f99fd501640 1 -- 172.21.15.132:0/79765180 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f99e400bc70 con 0x7f99f80b7060 2024-04-16T15:53:33.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.624+0000 7f99fdd02640 1 --2- 172.21.15.132:0/79765180 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99e4004800 0x7f99e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:33.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.624+0000 7f99fed04640 1 --2- 172.21.15.132:0/79765180 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99f80b7060 0x7f99e40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:33.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.624+0000 7f99fe503640 1 --2- 172.21.15.132:0/79765180 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99e4003b70 0x7f99e4003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:33.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.624+0000 7f99fdd02640 1 -- 172.21.15.132:0/79765180 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99f80b7060 msgr2=0x7f99e40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:33.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.624+0000 7f99fdd02640 1 --2- 172.21.15.132:0/79765180 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99f80b7060 0x7f99e40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:33.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.624+0000 7f99fdd02640 1 -- 172.21.15.132:0/79765180 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99e4003b70 msgr2=0x7f99e4003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:33.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.624+0000 7f99fdd02640 1 --2- 172.21.15.132:0/79765180 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99e4003b70 0x7f99e4003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:33.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.624+0000 7f99fdd02640 1 -- 172.21.15.132:0/79765180 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99e4003520 con 0x7f99e4004800 2024-04-16T15:53:33.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.624+0000 7f99fed04640 1 --2- 172.21.15.132:0/79765180 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99f80b7060 0x7f99e40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:53:33.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.624+0000 7f99fe503640 1 --2- 172.21.15.132:0/79765180 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99e4003b70 0x7f99e4003f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:53:33.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.625+0000 7f99fdd02640 1 --2- 172.21.15.132:0/79765180 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99e4004800 0x7f99e4004c80 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f99e8007f80 tx=0x7f99e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ace6d1f7982d1696 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:33.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.625+0000 7f99fd501640 1 -- 172.21.15.132:0/79765180 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99e8007ba0 con 0x7f99e4004800 2024-04-16T15:53:33.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.625+0000 7f99fd501640 1 -- 172.21.15.132:0/79765180 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99e8030070 con 0x7f99e4004800 2024-04-16T15:53:33.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.625+0000 7f99fd501640 1 -- 172.21.15.132:0/79765180 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99e8005df0 con 0x7f99e4004800 2024-04-16T15:53:33.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.625+0000 7f9a00767640 1 -- 172.21.15.132:0/79765180 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99e4004800 msgr2=0x7f99e4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:33.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.625+0000 7f9a00767640 1 --2- 172.21.15.132:0/79765180 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99e4004800 0x7f99e4004c80 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f99e8007f80 tx=0x7f99e4005830 comp rx=0 tx=0).stop 2024-04-16T15:53:33.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.625+0000 7f99fed04640 1 -- 172.21.15.132:0/79765180 reap_dead start 2024-04-16T15:53:33.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.625+0000 7f9a00767640 1 -- 172.21.15.132:0/79765180 shutdown_connections 2024-04-16T15:53:33.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.625+0000 7f9a00767640 1 -- 172.21.15.132:0/79765180 >> 172.21.15.132:0/79765180 conn(0x7f99f809aa30 msgr2=0x7f99f80b6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:33.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.625+0000 7f9a00767640 1 -- 172.21.15.132:0/79765180 shutdown_connections 2024-04-16T15:53:33.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.625+0000 7f9a00767640 1 -- 172.21.15.132:0/79765180 wait complete. 2024-04-16T15:53:33.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.626+0000 7f9a00767640 1 Processor -- start 2024-04-16T15:53:33.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.627+0000 7f9a00767640 1 -- start start 2024-04-16T15:53:33.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.627+0000 7f9a00767640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99e4004800 0x7f99f813bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:33.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.627+0000 7f9a00767640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99f809e4a0 0x7f99f8140b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:33.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.627+0000 7f9a00767640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99f809e920 0x7f99f81410d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:33.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.627+0000 7f9a00767640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f99f815ce30 con 0x7f99f809e4a0 2024-04-16T15:53:33.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.627+0000 7f9a00767640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f99f80b74b0 con 0x7f99f809e920 2024-04-16T15:53:33.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.627+0000 7f9a00767640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f99f8146320 con 0x7f99e4004800 2024-04-16T15:53:33.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.627+0000 7f99fdd02640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99f809e4a0 0x7f99f8140b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:33.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.627+0000 7f99fdd02640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99f809e4a0 0x7f99f8140b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34736/0 (socket says 172.21.15.132:34736) 2024-04-16T15:53:33.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.627+0000 7f99fdd02640 1 -- 172.21.15.132:0/1574957904 learned_addr learned my addr 172.21.15.132:0/1574957904 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:33.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.628+0000 7f99fdd02640 1 -- 172.21.15.132:0/1574957904 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99e4004800 msgr2=0x7f99f813bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:33.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.628+0000 7f99fe503640 1 --2- 172.21.15.132:0/1574957904 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99e4004800 0x7f99f813bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:33.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.628+0000 7f99fdd02640 1 --2- 172.21.15.132:0/1574957904 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99e4004800 0x7f99f813bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:33.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.628+0000 7f99fdd02640 1 -- 172.21.15.132:0/1574957904 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99f809e920 msgr2=0x7f99f81410d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:33.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.628+0000 7f99fed04640 1 --2- 172.21.15.132:0/1574957904 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99f809e920 0x7f99f81410d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:33.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.628+0000 7f99fdd02640 1 --2- 172.21.15.132:0/1574957904 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99f809e920 0x7f99f81410d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:33.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.628+0000 7f99fdd02640 1 -- 172.21.15.132:0/1574957904 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99f81f4dd0 con 0x7f99f809e4a0 2024-04-16T15:53:33.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.628+0000 7f99fdd02640 1 --2- 172.21.15.132:0/1574957904 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99f809e4a0 0x7f99f8140b90 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f99e800c1d0 tx=0x7f99e80018f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:33.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.628+0000 7f99eeffd640 1 -- 172.21.15.132:0/1574957904 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99e8007ba0 con 0x7f99f809e4a0 2024-04-16T15:53:33.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.628+0000 7f99eeffd640 1 -- 172.21.15.132:0/1574957904 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99e8005e10 con 0x7f99f809e4a0 2024-04-16T15:53:33.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.628+0000 7f9a00767640 1 -- 172.21.15.132:0/1574957904 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99f81f50b0 con 0x7f99f809e4a0 2024-04-16T15:53:33.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.628+0000 7f99eeffd640 1 -- 172.21.15.132:0/1574957904 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99e80049e0 con 0x7f99f809e4a0 2024-04-16T15:53:33.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.628+0000 7f9a00767640 1 -- 172.21.15.132:0/1574957904 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99f81f5670 con 0x7f99f809e4a0 2024-04-16T15:53:33.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.629+0000 7f9a00767640 1 -- 172.21.15.132:0/1574957904 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99f8075510 con 0x7f99f809e4a0 2024-04-16T15:53:33.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.629+0000 7f99eeffd640 1 -- 172.21.15.132:0/1574957904 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f99e8004b80 con 0x7f99f809e4a0 2024-04-16T15:53:33.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.630+0000 7f99eeffd640 1 --2- 172.21.15.132:0/1574957904 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f99dc06c8f0 0x7f99dc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:33.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.630+0000 7f99eeffd640 1 -- 172.21.15.132:0/1574957904 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f99e80ad400 con 0x7f99f809e4a0 2024-04-16T15:53:33.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.630+0000 7f99fe503640 1 --2- 172.21.15.132:0/1574957904 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f99dc06c8f0 0x7f99dc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:33.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.630+0000 7f99fe503640 1 --2- 172.21.15.132:0/1574957904 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f99dc06c8f0 0x7f99dc06edb0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f99f80b66f0 tx=0x7f99f4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:33.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.634+0000 7f99eeffd640 1 -- 172.21.15.132:0/1574957904 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f99e807b7a0 con 0x7f99f809e4a0 2024-04-16T15:53:33.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.810+0000 7f9a00767640 1 -- 172.21.15.132:0/1574957904 --> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f99f809af80 con 0x7f99dc06c8f0 2024-04-16T15:53:33.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.811+0000 7f99eeffd640 1 -- 172.21.15.132:0/1574957904 <== mgr.4101 v2:172.21.15.132:6832/3896387465 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f99f809af80 con 0x7f99dc06c8f0 2024-04-16T15:53:33.810 INFO:teuthology.orchestra.run.smithi132.stderr:instructed osd(s) 4 to deep-scrub 2024-04-16T15:53:33.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.812+0000 7f9a00767640 1 -- 172.21.15.132:0/1574957904 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f99dc06c8f0 msgr2=0x7f99dc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:33.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.812+0000 7f9a00767640 1 --2- 172.21.15.132:0/1574957904 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f99dc06c8f0 0x7f99dc06edb0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f99f80b66f0 tx=0x7f99f4009040 comp rx=0 tx=0).stop 2024-04-16T15:53:33.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.812+0000 7f9a00767640 1 -- 172.21.15.132:0/1574957904 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99f809e4a0 msgr2=0x7f99f8140b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:33.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.812+0000 7f9a00767640 1 --2- 172.21.15.132:0/1574957904 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99f809e4a0 0x7f99f8140b90 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f99e800c1d0 tx=0x7f99e80018f0 comp rx=0 tx=0).stop 2024-04-16T15:53:33.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.813+0000 7f9a00767640 1 -- 172.21.15.132:0/1574957904 shutdown_connections 2024-04-16T15:53:33.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.813+0000 7f9a00767640 1 --2- 172.21.15.132:0/1574957904 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f99dc06c8f0 0x7f99dc06edb0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:33.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.813+0000 7f9a00767640 1 --2- 172.21.15.132:0/1574957904 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99f809e920 0x7f99f81410d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:33.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.813+0000 7f9a00767640 1 --2- 172.21.15.132:0/1574957904 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99f809e4a0 0x7f99f8140b90 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:33.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.813+0000 7f9a00767640 1 --2- 172.21.15.132:0/1574957904 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99e4004800 0x7f99f813bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:33.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.813+0000 7f9a00767640 1 -- 172.21.15.132:0/1574957904 >> 172.21.15.132:0/1574957904 conn(0x7f99f809aa30 msgr2=0x7f99f80b1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:33.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.813+0000 7f9a00767640 1 -- 172.21.15.132:0/1574957904 shutdown_connections 2024-04-16T15:53:33.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.813+0000 7f9a00767640 1 -- 172.21.15.132:0/1574957904 wait complete. 2024-04-16T15:53:33.823 INFO:tasks.ceph:Scrubbing osd.5 2024-04-16T15:53:33.823 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-16T15:53:33.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.931+0000 7fda03467640 1 Processor -- start 2024-04-16T15:53:33.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.931+0000 7fda03467640 1 -- start start 2024-04-16T15:53:33.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.932+0000 7fda03467640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd9fc15edb0 0x7fd9fc1626c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:33.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.932+0000 7fda03467640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd9fc0ba3b0 0x7fd9fc0d3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:33.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.932+0000 7fda03467640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9fc0ba860 con 0x7fd9fc0b66d0 2024-04-16T15:53:33.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.932+0000 7fda03467640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fd9fc162dc0 con 0x7fd9fc0ba3b0 2024-04-16T15:53:33.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.932+0000 7fda03467640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fd9fc1630a0 con 0x7fd9fc15edb0 2024-04-16T15:53:33.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.933+0000 7fda01a04640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd9fc0ba3b0 0x7fd9fc0d3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:33.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.933+0000 7fda01203640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fd9fc0b66d0 0x7fd9fc0b6ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:53006/0 (socket says 172.21.15.132:53006) 2024-04-16T15:53:33.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.933+0000 7fda01203640 1 -- 172.21.15.132:0/2643813319 learned_addr learned my addr 172.21.15.132:0/2643813319 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:53:33.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.933+0000 7fda00a02640 1 --2- 172.21.15.132:0/2643813319 >> v2:172.21.15.179:3300/0 conn(0x7fd9fc15edb0 0x7fd9fc1626c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:33.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.933+0000 7fda01a04640 1 -- 172.21.15.132:0/2643813319 >> v2:172.21.15.179:3300/0 conn(0x7fd9fc15edb0 msgr2=0x7fd9fc1626c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:33.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.933+0000 7fda01a04640 1 --2- 172.21.15.132:0/2643813319 >> v2:172.21.15.179:3300/0 conn(0x7fd9fc15edb0 0x7fd9fc1626c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:33.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.933+0000 7fda01a04640 1 -- 172.21.15.132:0/2643813319 >> v1:172.21.15.132:6789/0 conn(0x7fd9fc0b66d0 legacy=0x7fd9fc0b6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:33.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.933+0000 7fd9f3fff640 1 -- 172.21.15.132:0/2643813319 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 687503758 0 0) 0x7fd9fc0ba860 con 0x7fd9fc0b66d0 2024-04-16T15:53:33.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.933+0000 7fda01a04640 1 -- 172.21.15.132:0/2643813319 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9fc163380 con 0x7fd9fc0ba3b0 2024-04-16T15:53:33.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.934+0000 7fda01a04640 1 --2- 172.21.15.132:0/2643813319 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9fc0ba3b0 0x7fd9fc0d3300 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc0d12c0 tx=0x7fd9f402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d1d098e464a14cd server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:33.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.934+0000 7fd9f3fff640 1 -- 172.21.15.132:0/2643813319 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f4035020 con 0x7fd9fc0ba3b0 2024-04-16T15:53:33.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.934+0000 7fd9f3fff640 1 -- 172.21.15.132:0/2643813319 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9f4031830 con 0x7fd9fc0ba3b0 2024-04-16T15:53:33.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.934+0000 7fd9f3fff640 1 -- 172.21.15.132:0/2643813319 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f4031c00 con 0x7fd9fc0ba3b0 2024-04-16T15:53:33.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.935+0000 7fda03467640 1 -- 172.21.15.132:0/2643813319 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9fc0ba3b0 msgr2=0x7fd9fc0d3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:33.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.935+0000 7fda03467640 1 --2- 172.21.15.132:0/2643813319 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9fc0ba3b0 0x7fd9fc0d3300 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc0d12c0 tx=0x7fd9f402b8d0 comp rx=0 tx=0).stop 2024-04-16T15:53:33.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.935+0000 7fda03467640 1 -- 172.21.15.132:0/2643813319 shutdown_connections 2024-04-16T15:53:33.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.935+0000 7fda03467640 1 --2- 172.21.15.132:0/2643813319 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9fc0ba3b0 0x7fd9fc0d3300 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:33.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.935+0000 7fda03467640 1 --2- 172.21.15.132:0/2643813319 >> v2:172.21.15.179:3300/0 conn(0x7fd9fc15edb0 0x7fd9fc1626c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:33.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.935+0000 7fda03467640 1 -- 172.21.15.132:0/2643813319 >> 172.21.15.132:0/2643813319 conn(0x7fd9fc0d1780 msgr2=0x7fd9fc0d1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:33.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.935+0000 7fda03467640 1 -- 172.21.15.132:0/2643813319 shutdown_connections 2024-04-16T15:53:33.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.935+0000 7fda03467640 1 -- 172.21.15.132:0/2643813319 wait complete. 2024-04-16T15:53:33.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.936+0000 7fda03467640 1 Processor -- start 2024-04-16T15:53:33.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.936+0000 7fda03467640 1 -- start start 2024-04-16T15:53:33.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.937+0000 7fda03467640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9fc0b66d0 0x7fd9fc0cad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:33.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.937+0000 7fda03467640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9fc0ba3b0 0x7fd9fc160340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:33.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.937+0000 7fda03467640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9fc15edb0 0x7fd9fc14cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:33.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.937+0000 7fda03467640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fd9fc0d3bd0 con 0x7fd9fc15edb0 2024-04-16T15:53:33.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.937+0000 7fda03467640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd9fc0d3a50 con 0x7fd9fc0ba3b0 2024-04-16T15:53:33.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.937+0000 7fda03467640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fd9fc0d3d50 con 0x7fd9fc0b66d0 2024-04-16T15:53:33.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.937+0000 7fda01a04640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9fc15edb0 0x7fd9fc14cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:33.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.937+0000 7fda01a04640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9fc15edb0 0x7fd9fc14cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34754/0 (socket says 172.21.15.132:34754) 2024-04-16T15:53:33.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.937+0000 7fda01a04640 1 -- 172.21.15.132:0/987196510 learned_addr learned my addr 172.21.15.132:0/987196510 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:33.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.937+0000 7fda01203640 1 --2- 172.21.15.132:0/987196510 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9fc0b66d0 0x7fd9fc0cad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:33.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.937+0000 7fda00a02640 1 --2- 172.21.15.132:0/987196510 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9fc0ba3b0 0x7fd9fc160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:33.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.937+0000 7fda01a04640 1 -- 172.21.15.132:0/987196510 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9fc0b66d0 msgr2=0x7fd9fc0cad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:33.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.937+0000 7fda01a04640 1 --2- 172.21.15.132:0/987196510 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9fc0b66d0 0x7fd9fc0cad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:33.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.937+0000 7fda01a04640 1 -- 172.21.15.132:0/987196510 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9fc0ba3b0 msgr2=0x7fd9fc160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:33.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.937+0000 7fda01a04640 1 --2- 172.21.15.132:0/987196510 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9fc0ba3b0 0x7fd9fc160340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:33.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.937+0000 7fda01a04640 1 -- 172.21.15.132:0/987196510 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9fc160c70 con 0x7fd9fc15edb0 2024-04-16T15:53:33.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.937+0000 7fda01a04640 1 --2- 172.21.15.132:0/987196510 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9fc15edb0 0x7fd9fc14cf30 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fd9f4009860 tx=0x7fd9f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:33.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.937+0000 7fd9f1ffb640 1 -- 172.21.15.132:0/987196510 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f4035040 con 0x7fd9fc15edb0 2024-04-16T15:53:33.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.937+0000 7fd9f1ffb640 1 -- 172.21.15.132:0/987196510 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9f403f070 con 0x7fd9fc15edb0 2024-04-16T15:53:33.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.937+0000 7fd9f1ffb640 1 -- 172.21.15.132:0/987196510 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f403baa0 con 0x7fd9fc15edb0 2024-04-16T15:53:33.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.937+0000 7fda03467640 1 -- 172.21.15.132:0/987196510 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9fc160f50 con 0x7fd9fc15edb0 2024-04-16T15:53:33.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.938+0000 7fda03467640 1 -- 172.21.15.132:0/987196510 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9fc161510 con 0x7fd9fc15edb0 2024-04-16T15:53:33.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.938+0000 7fda03467640 1 -- 172.21.15.132:0/987196510 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd9fc1618f0 con 0x7fd9fc15edb0 2024-04-16T15:53:33.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.939+0000 7fd9f1ffb640 1 -- 172.21.15.132:0/987196510 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd9f4038020 con 0x7fd9fc15edb0 2024-04-16T15:53:33.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.939+0000 7fd9f1ffb640 1 --2- 172.21.15.132:0/987196510 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fd9e006c8f0 0x7fd9e006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:33.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.939+0000 7fd9f1ffb640 1 -- 172.21.15.132:0/987196510 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fd9f40ad850 con 0x7fd9fc15edb0 2024-04-16T15:53:33.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.939+0000 7fda01203640 1 --2- 172.21.15.132:0/987196510 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fd9e006c8f0 0x7fd9e006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:33.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.940+0000 7fd9f1ffb640 1 --2- 172.21.15.132:0/987196510 >> [v2:172.21.15.179:6800/2224750370,v1:172.21.15.179:6801/2224750370] conn(0x7fd9e0074af0 0x7fd9e0076f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:33.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.940+0000 7fd9f1ffb640 1 -- 172.21.15.132:0/987196510 --> [v2:172.21.15.179:6800/2224750370,v1:172.21.15.179:6801/2224750370] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd9f400af30 con 0x7fd9e0074af0 2024-04-16T15:53:33.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.940+0000 7fd9f1ffb640 1 -- 172.21.15.132:0/987196510 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fd9f40b22c0 con 0x7fd9fc15edb0 2024-04-16T15:53:33.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.940+0000 7fda01203640 1 --2- 172.21.15.132:0/987196510 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fd9e006c8f0 0x7fd9e006edb0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd9f80012e0 tx=0x7fd9f8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:33.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.940+0000 7fda00a02640 1 --2- 172.21.15.132:0/987196510 >> [v2:172.21.15.179:6800/2224750370,v1:172.21.15.179:6801/2224750370] conn(0x7fd9e0074af0 0x7fd9e0076f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:33.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.940+0000 7fda00a02640 1 --2- 172.21.15.132:0/987196510 >> [v2:172.21.15.179:6800/2224750370,v1:172.21.15.179:6801/2224750370] conn(0x7fd9e0074af0 0x7fd9e0076f10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:33.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.941+0000 7fd9f1ffb640 1 -- 172.21.15.132:0/987196510 <== osd.5 v2:172.21.15.179:6800/2224750370 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd9f400af30 con 0x7fd9e0074af0 2024-04-16T15:53:33.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.954+0000 7fda03467640 1 -- 172.21.15.132:0/987196510 --> [v2:172.21.15.179:6800/2224750370,v1:172.21.15.179:6801/2224750370] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd9fc068b80 con 0x7fd9e0074af0 2024-04-16T15:53:33.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.954+0000 7fd9f1ffb640 1 -- 172.21.15.132:0/987196510 <== osd.5 v2:172.21.15.179:6800/2224750370 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd9fc068b80 con 0x7fd9e0074af0 2024-04-16T15:53:33.953 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-16T15:53:33.954 INFO:teuthology.orchestra.run.smithi132.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-16T15:53:33.954 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-16T15:53:33.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.955+0000 7fda03467640 1 -- 172.21.15.132:0/987196510 >> [v2:172.21.15.179:6800/2224750370,v1:172.21.15.179:6801/2224750370] conn(0x7fd9e0074af0 msgr2=0x7fd9e0076f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:33.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.955+0000 7fda03467640 1 --2- 172.21.15.132:0/987196510 >> [v2:172.21.15.179:6800/2224750370,v1:172.21.15.179:6801/2224750370] conn(0x7fd9e0074af0 0x7fd9e0076f10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:33.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.955+0000 7fda03467640 1 -- 172.21.15.132:0/987196510 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fd9e006c8f0 msgr2=0x7fd9e006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:33.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.955+0000 7fda03467640 1 --2- 172.21.15.132:0/987196510 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fd9e006c8f0 0x7fd9e006edb0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd9f80012e0 tx=0x7fd9f8009040 comp rx=0 tx=0).stop 2024-04-16T15:53:33.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.955+0000 7fda03467640 1 -- 172.21.15.132:0/987196510 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9fc15edb0 msgr2=0x7fd9fc14cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:33.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.955+0000 7fda03467640 1 --2- 172.21.15.132:0/987196510 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9fc15edb0 0x7fd9fc14cf30 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fd9f4009860 tx=0x7fd9f40046c0 comp rx=0 tx=0).stop 2024-04-16T15:53:33.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.955+0000 7fda01a04640 1 -- 172.21.15.132:0/987196510 reap_dead start 2024-04-16T15:53:33.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.955+0000 7fda03467640 1 -- 172.21.15.132:0/987196510 shutdown_connections 2024-04-16T15:53:33.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.955+0000 7fda03467640 1 -- 172.21.15.132:0/987196510 >> 172.21.15.132:0/987196510 conn(0x7fd9fc0d1780 msgr2=0x7fd9fc0b4d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:33.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.955+0000 7fda03467640 1 -- 172.21.15.132:0/987196510 shutdown_connections 2024-04-16T15:53:33.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:33.955+0000 7fda03467640 1 -- 172.21.15.132:0/987196510 wait complete. 2024-04-16T15:53:33.964 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-16T15:53:34.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.068+0000 7ff77d131640 1 Processor -- start 2024-04-16T15:53:34.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.068+0000 7ff77d131640 1 -- start start 2024-04-16T15:53:34.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.068+0000 7ff77d131640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff7781601f0 0x7ff77809b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:34.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.068+0000 7ff77d131640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff77809aa30 0x7ff77809aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:34.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.068+0000 7ff77d131640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7780b2050 0x7ff7780b24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:34.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.068+0000 7ff77d131640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7ff7780b34f0 con 0x7ff7781601f0 2024-04-16T15:53:34.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.068+0000 7ff77d131640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7ff7780b37d0 con 0x7ff77809aa30 2024-04-16T15:53:34.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.068+0000 7ff77d131640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff7780b3ab0 con 0x7ff7780b2050 2024-04-16T15:53:34.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.069+0000 7ff776d9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff7781601f0 0x7ff77809b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:34.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.069+0000 7ff776d9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff7781601f0 0x7ff77809b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34762/0 (socket says 172.21.15.132:34762) 2024-04-16T15:53:34.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.069+0000 7ff776d9d640 1 -- 172.21.15.132:0/3519242021 learned_addr learned my addr 172.21.15.132:0/3519242021 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:34.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.069+0000 7ff76ffff640 1 --2- 172.21.15.132:0/3519242021 >> v2:172.21.15.179:3300/0 conn(0x7ff77809aa30 0x7ff77809aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:34.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.069+0000 7ff77759e640 1 --2- 172.21.15.132:0/3519242021 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7780b2050 0x7ff7780b24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:34.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.069+0000 7ff776d9d640 1 -- 172.21.15.132:0/3519242021 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7780b2050 msgr2=0x7ff7780b24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:34.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.069+0000 7ff776d9d640 1 --2- 172.21.15.132:0/3519242021 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7780b2050 0x7ff7780b24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:34.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.069+0000 7ff776d9d640 1 -- 172.21.15.132:0/3519242021 >> v2:172.21.15.179:3300/0 conn(0x7ff77809aa30 msgr2=0x7ff77809aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:34.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.069+0000 7ff776d9d640 1 --2- 172.21.15.132:0/3519242021 >> v2:172.21.15.179:3300/0 conn(0x7ff77809aa30 0x7ff77809aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:34.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.069+0000 7ff776d9d640 1 -- 172.21.15.132:0/3519242021 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7780b3d90 con 0x7ff7781601f0 2024-04-16T15:53:34.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.069+0000 7ff77759e640 1 --2- 172.21.15.132:0/3519242021 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7780b2050 0x7ff7780b24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:53:34.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.070+0000 7ff776d9d640 1 --2- 172.21.15.132:0/3519242021 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff7781601f0 0x7ff77809b770 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ff778073560 tx=0x7ff76802b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e49708c2dd27cc55 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:34.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.070+0000 7ff77659c640 1 -- 172.21.15.132:0/3519242021 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff768035020 con 0x7ff7781601f0 2024-04-16T15:53:34.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.070+0000 7ff77659c640 1 -- 172.21.15.132:0/3519242021 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff76802d040 con 0x7ff7781601f0 2024-04-16T15:53:34.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.070+0000 7ff77659c640 1 -- 172.21.15.132:0/3519242021 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff768031a80 con 0x7ff7781601f0 2024-04-16T15:53:34.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.070+0000 7ff77d131640 1 -- 172.21.15.132:0/3519242021 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff7781601f0 msgr2=0x7ff77809b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:34.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.070+0000 7ff77d131640 1 --2- 172.21.15.132:0/3519242021 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff7781601f0 0x7ff77809b770 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ff778073560 tx=0x7ff76802b900 comp rx=0 tx=0).stop 2024-04-16T15:53:34.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.070+0000 7ff77d131640 1 -- 172.21.15.132:0/3519242021 shutdown_connections 2024-04-16T15:53:34.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.070+0000 7ff77d131640 1 --2- 172.21.15.132:0/3519242021 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7780b2050 0x7ff7780b24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:34.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.070+0000 7ff77d131640 1 --2- 172.21.15.132:0/3519242021 >> v2:172.21.15.179:3300/0 conn(0x7ff77809aa30 0x7ff77809aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:34.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.070+0000 7ff77d131640 1 --2- 172.21.15.132:0/3519242021 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff7781601f0 0x7ff77809b770 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:34.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.070+0000 7ff77d131640 1 -- 172.21.15.132:0/3519242021 >> 172.21.15.132:0/3519242021 conn(0x7ff7780b4220 msgr2=0x7ff7780b4630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:34.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.070+0000 7ff77d131640 1 -- 172.21.15.132:0/3519242021 shutdown_connections 2024-04-16T15:53:34.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.070+0000 7ff77d131640 1 -- 172.21.15.132:0/3519242021 wait complete. 2024-04-16T15:53:34.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.072+0000 7ff77d131640 1 Processor -- start 2024-04-16T15:53:34.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.072+0000 7ff77d131640 1 -- start start 2024-04-16T15:53:34.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.072+0000 7ff77d131640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff77809aa30 0x7ff7780ca770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:34.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.072+0000 7ff77d131640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7780b2050 0x7ff7781f3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:34.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.072+0000 7ff77d131640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7781601f0 0x7ff778159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:34.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.072+0000 7ff77d131640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff7780b1760 con 0x7ff77809aa30 2024-04-16T15:53:34.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.072+0000 7ff77d131640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff7780b2a00 con 0x7ff7781601f0 2024-04-16T15:53:34.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.072+0000 7ff77d131640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff7781f45a0 con 0x7ff7780b2050 2024-04-16T15:53:34.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.072+0000 7ff776d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff77809aa30 0x7ff7780ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:34.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.072+0000 7ff776d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff77809aa30 0x7ff7780ca770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34772/0 (socket says 172.21.15.132:34772) 2024-04-16T15:53:34.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.073+0000 7ff776d9d640 1 -- 172.21.15.132:0/3682263393 learned_addr learned my addr 172.21.15.132:0/3682263393 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:34.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.073+0000 7ff76ffff640 1 --2- 172.21.15.132:0/3682263393 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7780b2050 0x7ff7781f3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:34.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.073+0000 7ff77759e640 1 --2- 172.21.15.132:0/3682263393 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7781601f0 0x7ff778159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:34.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.073+0000 7ff776d9d640 1 -- 172.21.15.132:0/3682263393 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7780b2050 msgr2=0x7ff7781f3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:34.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.073+0000 7ff776d9d640 1 --2- 172.21.15.132:0/3682263393 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7780b2050 0x7ff7781f3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:34.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.073+0000 7ff776d9d640 1 -- 172.21.15.132:0/3682263393 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7781601f0 msgr2=0x7ff778159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:34.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.073+0000 7ff776d9d640 1 --2- 172.21.15.132:0/3682263393 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7781601f0 0x7ff778159dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:34.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.073+0000 7ff776d9d640 1 -- 172.21.15.132:0/3682263393 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff77815a310 con 0x7ff77809aa30 2024-04-16T15:53:34.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.073+0000 7ff776d9d640 1 --2- 172.21.15.132:0/3682263393 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff77809aa30 0x7ff7780ca770 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7ff768000c00 tx=0x7ff7680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:34.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.073+0000 7ff76f7fe640 1 -- 172.21.15.132:0/3682263393 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff768035040 con 0x7ff77809aa30 2024-04-16T15:53:34.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.073+0000 7ff76f7fe640 1 -- 172.21.15.132:0/3682263393 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff768039c10 con 0x7ff77809aa30 2024-04-16T15:53:34.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.073+0000 7ff77d131640 1 -- 172.21.15.132:0/3682263393 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7781f3990 con 0x7ff77809aa30 2024-04-16T15:53:34.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.073+0000 7ff76f7fe640 1 -- 172.21.15.132:0/3682263393 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff768045480 con 0x7ff77809aa30 2024-04-16T15:53:34.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.073+0000 7ff77d131640 1 -- 172.21.15.132:0/3682263393 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7781f3f50 con 0x7ff77809aa30 2024-04-16T15:53:34.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.074+0000 7ff77d131640 1 -- 172.21.15.132:0/3682263393 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff778075510 con 0x7ff77809aa30 2024-04-16T15:53:34.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.074+0000 7ff76f7fe640 1 -- 172.21.15.132:0/3682263393 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff768038020 con 0x7ff77809aa30 2024-04-16T15:53:34.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.075+0000 7ff76f7fe640 1 --2- 172.21.15.132:0/3682263393 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7ff75806c920 0x7ff75806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:34.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.075+0000 7ff76ffff640 1 --2- 172.21.15.132:0/3682263393 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7ff75806c920 0x7ff75806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:34.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.075+0000 7ff76f7fe640 1 -- 172.21.15.132:0/3682263393 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7ff7680adcb0 con 0x7ff77809aa30 2024-04-16T15:53:34.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.076+0000 7ff76ffff640 1 --2- 172.21.15.132:0/3682263393 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7ff75806c920 0x7ff75806ede0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff77815f4c0 tx=0x7ff760008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:34.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.080+0000 7ff76f7fe640 1 -- 172.21.15.132:0/3682263393 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff76807c0e0 con 0x7ff77809aa30 2024-04-16T15:53:34.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.255+0000 7ff77d131640 1 -- 172.21.15.132:0/3682263393 --> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7ff778075040 con 0x7ff75806c920 2024-04-16T15:53:34.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.256+0000 7ff76f7fe640 1 -- 172.21.15.132:0/3682263393 <== mgr.4101 v2:172.21.15.132:6832/3896387465 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff778075040 con 0x7ff75806c920 2024-04-16T15:53:34.255 INFO:teuthology.orchestra.run.smithi132.stderr:instructed osd(s) 5 to deep-scrub 2024-04-16T15:53:34.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.258+0000 7ff77d131640 1 -- 172.21.15.132:0/3682263393 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7ff75806c920 msgr2=0x7ff75806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:34.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.258+0000 7ff77d131640 1 --2- 172.21.15.132:0/3682263393 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7ff75806c920 0x7ff75806ede0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff77815f4c0 tx=0x7ff760008040 comp rx=0 tx=0).stop 2024-04-16T15:53:34.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.258+0000 7ff77d131640 1 -- 172.21.15.132:0/3682263393 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff77809aa30 msgr2=0x7ff7780ca770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:34.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.258+0000 7ff77d131640 1 --2- 172.21.15.132:0/3682263393 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff77809aa30 0x7ff7780ca770 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7ff768000c00 tx=0x7ff7680046c0 comp rx=0 tx=0).stop 2024-04-16T15:53:34.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.258+0000 7ff77d131640 1 -- 172.21.15.132:0/3682263393 shutdown_connections 2024-04-16T15:53:34.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.258+0000 7ff77d131640 1 --2- 172.21.15.132:0/3682263393 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7ff75806c920 0x7ff75806ede0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:34.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.258+0000 7ff77d131640 1 --2- 172.21.15.132:0/3682263393 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7781601f0 0x7ff778159dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:34.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.258+0000 7ff77d131640 1 --2- 172.21.15.132:0/3682263393 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7780b2050 0x7ff7781f3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:34.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.258+0000 7ff77d131640 1 --2- 172.21.15.132:0/3682263393 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff77809aa30 0x7ff7780ca770 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:34.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.258+0000 7ff77d131640 1 -- 172.21.15.132:0/3682263393 >> 172.21.15.132:0/3682263393 conn(0x7ff7780b4220 msgr2=0x7ff7780b4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:34.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.258+0000 7ff77d131640 1 -- 172.21.15.132:0/3682263393 shutdown_connections 2024-04-16T15:53:34.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.258+0000 7ff77d131640 1 -- 172.21.15.132:0/3682263393 wait complete. 2024-04-16T15:53:34.268 INFO:tasks.ceph:Scrubbing osd.6 2024-04-16T15:53:34.268 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-16T15:53:34.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.378+0000 7f31ecdba640 1 Processor -- start 2024-04-16T15:53:34.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.378+0000 7f31ecdba640 1 -- start start 2024-04-16T15:53:34.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.379+0000 7f31ecdba640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f31e80ae3c0 0x7f31e80affc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:34.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.379+0000 7f31ecdba640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31e806c120 con 0x7f31e80b5ab0 2024-04-16T15:53:34.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.379+0000 7f31ecdba640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31e806c400 con 0x7f31e80adfe0 2024-04-16T15:53:34.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.379+0000 7f31ecdba640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f31e809ef10 con 0x7f31e80ae3c0 2024-04-16T15:53:34.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.379+0000 7f31e6d9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f31e80ae3c0 0x7f31e80affc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:34.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.379+0000 7f31e5d9b640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f31e80b5ab0 0x7f31e80b3d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:53010/0 (socket says 172.21.15.132:53010) 2024-04-16T15:53:34.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.379+0000 7f31e5d9b640 1 -- 172.21.15.132:0/1043789756 learned_addr learned my addr 172.21.15.132:0/1043789756 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:53:34.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.379+0000 7f31e6d9d640 1 -- 172.21.15.132:0/1043789756 >> v1:172.21.15.179:6789/0 conn(0x7f31e80adfe0 legacy=0x7f31e80b53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:34.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.379+0000 7f31e6d9d640 1 -- 172.21.15.132:0/1043789756 >> v1:172.21.15.132:6789/0 conn(0x7f31e80b5ab0 legacy=0x7f31e80b3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:34.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.379+0000 7f31e6d9d640 1 -- 172.21.15.132:0/1043789756 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31e806c6e0 con 0x7f31e80ae3c0 2024-04-16T15:53:34.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.380+0000 7f31e6d9d640 1 --2- 172.21.15.132:0/1043789756 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31e80ae3c0 0x7f31e80affc0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f31d80097a0 tx=0x7f31d802b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acef1faf5a58b5cf server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:34.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.380+0000 7f31e559a640 1 -- 172.21.15.132:0/1043789756 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d8037070 con 0x7f31e80ae3c0 2024-04-16T15:53:34.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.380+0000 7f31e559a640 1 -- 172.21.15.132:0/1043789756 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31d8030710 con 0x7f31e80ae3c0 2024-04-16T15:53:34.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.380+0000 7f31e559a640 1 -- 172.21.15.132:0/1043789756 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d8030ae0 con 0x7f31e80ae3c0 2024-04-16T15:53:34.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.380+0000 7f31ecdba640 1 -- 172.21.15.132:0/1043789756 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31e80ae3c0 msgr2=0x7f31e80affc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:34.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.380+0000 7f31ecdba640 1 --2- 172.21.15.132:0/1043789756 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31e80ae3c0 0x7f31e80affc0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f31d80097a0 tx=0x7f31d802b710 comp rx=0 tx=0).stop 2024-04-16T15:53:34.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.381+0000 7f31ecdba640 1 -- 172.21.15.132:0/1043789756 shutdown_connections 2024-04-16T15:53:34.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.381+0000 7f31ecdba640 1 --2- 172.21.15.132:0/1043789756 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31e80ae3c0 0x7f31e80affc0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:34.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.381+0000 7f31ecdba640 1 -- 172.21.15.132:0/1043789756 >> 172.21.15.132:0/1043789756 conn(0x7f31e80d0d80 msgr2=0x7f31e80d1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:34.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.381+0000 7f31ecdba640 1 -- 172.21.15.132:0/1043789756 shutdown_connections 2024-04-16T15:53:34.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.381+0000 7f31ecdba640 1 -- 172.21.15.132:0/1043789756 wait complete. 2024-04-16T15:53:34.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.382+0000 7f31ecdba640 1 Processor -- start 2024-04-16T15:53:34.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.382+0000 7f31ecdba640 1 -- start start 2024-04-16T15:53:34.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.383+0000 7f31ecdba640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31e80adfe0 0x7f31e80cf580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:34.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.383+0000 7f31ecdba640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31e80ae3c0 0x7f31e815c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:34.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.383+0000 7f31ecdba640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31e80b5ab0 0x7f31e813d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:34.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.383+0000 7f31ecdba640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f31e806d1c0 con 0x7f31e80ae3c0 2024-04-16T15:53:34.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.383+0000 7f31ecdba640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f31e806cca0 con 0x7f31e80b5ab0 2024-04-16T15:53:34.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.383+0000 7f31ecdba640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f31e813d6d0 con 0x7f31e80adfe0 2024-04-16T15:53:34.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.383+0000 7f31e5d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31e80ae3c0 0x7f31e815c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:34.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.383+0000 7f31e5d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31e80ae3c0 0x7f31e815c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34788/0 (socket says 172.21.15.132:34788) 2024-04-16T15:53:34.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.383+0000 7f31e5d9b640 1 -- 172.21.15.132:0/2952885524 learned_addr learned my addr 172.21.15.132:0/2952885524 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:34.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.383+0000 7f31e6d9d640 1 --2- 172.21.15.132:0/2952885524 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31e80b5ab0 0x7f31e813d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:34.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.383+0000 7f31e659c640 1 --2- 172.21.15.132:0/2952885524 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31e80adfe0 0x7f31e80cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:34.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.383+0000 7f31e5d9b640 1 -- 172.21.15.132:0/2952885524 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31e80adfe0 msgr2=0x7f31e80cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:34.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.383+0000 7f31e5d9b640 1 --2- 172.21.15.132:0/2952885524 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31e80adfe0 0x7f31e80cf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:34.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.383+0000 7f31e5d9b640 1 -- 172.21.15.132:0/2952885524 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31e80b5ab0 msgr2=0x7f31e813d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:34.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.383+0000 7f31e5d9b640 1 --2- 172.21.15.132:0/2952885524 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31e80b5ab0 0x7f31e813d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:34.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.383+0000 7f31e5d9b640 1 -- 172.21.15.132:0/2952885524 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31e813d9a0 con 0x7f31e80ae3c0 2024-04-16T15:53:34.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.383+0000 7f31e5d9b640 1 --2- 172.21.15.132:0/2952885524 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31e80ae3c0 0x7f31e815c490 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f31d000c7b0 tx=0x7f31d000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:34.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.383+0000 7f31deffd640 1 -- 172.21.15.132:0/2952885524 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d0018070 con 0x7f31e80ae3c0 2024-04-16T15:53:34.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.383+0000 7f31deffd640 1 -- 172.21.15.132:0/2952885524 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31d00072d0 con 0x7f31e80ae3c0 2024-04-16T15:53:34.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.383+0000 7f31deffd640 1 -- 172.21.15.132:0/2952885524 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d00047e0 con 0x7f31e80ae3c0 2024-04-16T15:53:34.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.383+0000 7f31ecdba640 1 -- 172.21.15.132:0/2952885524 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31e813dc80 con 0x7f31e80ae3c0 2024-04-16T15:53:34.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.383+0000 7f31ecdba640 1 -- 172.21.15.132:0/2952885524 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31e813e240 con 0x7f31e80ae3c0 2024-04-16T15:53:34.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.384+0000 7f31ecdba640 1 -- 172.21.15.132:0/2952885524 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f31e8068b80 con 0x7f31e80ae3c0 2024-04-16T15:53:34.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.385+0000 7f31deffd640 1 -- 172.21.15.132:0/2952885524 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f31d001b070 con 0x7f31e80ae3c0 2024-04-16T15:53:34.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.385+0000 7f31deffd640 1 --2- 172.21.15.132:0/2952885524 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f31c806c8f0 0x7f31c806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:34.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.385+0000 7f31e659c640 1 --2- 172.21.15.132:0/2952885524 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f31c806c8f0 0x7f31c806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:34.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.385+0000 7f31deffd640 1 -- 172.21.15.132:0/2952885524 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f31d008aef0 con 0x7f31e80ae3c0 2024-04-16T15:53:34.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.385+0000 7f31deffd640 1 --2- 172.21.15.132:0/2952885524 >> [v2:172.21.15.179:6809/101498164,v1:172.21.15.179:6811/101498164] conn(0x7f31c8074a90 0x7f31c8076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:34.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.385+0000 7f31deffd640 1 -- 172.21.15.132:0/2952885524 --> [v2:172.21.15.179:6809/101498164,v1:172.21.15.179:6811/101498164] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f31c8077560 con 0x7f31c8074a90 2024-04-16T15:53:34.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.385+0000 7f31deffd640 1 -- 172.21.15.132:0/2952885524 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f31d008d590 con 0x7f31e80ae3c0 2024-04-16T15:53:34.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.386+0000 7f31e659c640 1 --2- 172.21.15.132:0/2952885524 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f31c806c8f0 0x7f31c806edb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f31e0005520 tx=0x7f31e0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:34.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.386+0000 7f31e6d9d640 1 --2- 172.21.15.132:0/2952885524 >> [v2:172.21.15.179:6809/101498164,v1:172.21.15.179:6811/101498164] conn(0x7f31c8074a90 0x7f31c8076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:34.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.386+0000 7f31e6d9d640 1 --2- 172.21.15.132:0/2952885524 >> [v2:172.21.15.179:6809/101498164,v1:172.21.15.179:6811/101498164] conn(0x7f31c8074a90 0x7f31c8076eb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:34.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.387+0000 7f31deffd640 1 -- 172.21.15.132:0/2952885524 <== osd.6 v2:172.21.15.179:6809/101498164 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f31c8077560 con 0x7f31c8074a90 2024-04-16T15:53:34.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.400+0000 7f31ecdba640 1 -- 172.21.15.132:0/2952885524 --> [v2:172.21.15.179:6809/101498164,v1:172.21.15.179:6811/101498164] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f31e80b15a0 con 0x7f31c8074a90 2024-04-16T15:53:34.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.401+0000 7f31deffd640 1 -- 172.21.15.132:0/2952885524 <== osd.6 v2:172.21.15.179:6809/101498164 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f31e80b15a0 con 0x7f31c8074a90 2024-04-16T15:53:34.400 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-16T15:53:34.400 INFO:teuthology.orchestra.run.smithi132.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-16T15:53:34.401 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-16T15:53:34.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.401+0000 7f31ecdba640 1 -- 172.21.15.132:0/2952885524 >> [v2:172.21.15.179:6809/101498164,v1:172.21.15.179:6811/101498164] conn(0x7f31c8074a90 msgr2=0x7f31c8076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:34.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.401+0000 7f31ecdba640 1 --2- 172.21.15.132:0/2952885524 >> [v2:172.21.15.179:6809/101498164,v1:172.21.15.179:6811/101498164] conn(0x7f31c8074a90 0x7f31c8076eb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:34.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.401+0000 7f31ecdba640 1 -- 172.21.15.132:0/2952885524 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f31c806c8f0 msgr2=0x7f31c806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:34.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.401+0000 7f31ecdba640 1 --2- 172.21.15.132:0/2952885524 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f31c806c8f0 0x7f31c806edb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f31e0005520 tx=0x7f31e0009040 comp rx=0 tx=0).stop 2024-04-16T15:53:34.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.401+0000 7f31ecdba640 1 -- 172.21.15.132:0/2952885524 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31e80ae3c0 msgr2=0x7f31e815c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:34.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.401+0000 7f31ecdba640 1 --2- 172.21.15.132:0/2952885524 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31e80ae3c0 0x7f31e815c490 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f31d000c7b0 tx=0x7f31d000cc70 comp rx=0 tx=0).stop 2024-04-16T15:53:34.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.401+0000 7f31e6d9d640 1 -- 172.21.15.132:0/2952885524 reap_dead start 2024-04-16T15:53:34.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.401+0000 7f31ecdba640 1 -- 172.21.15.132:0/2952885524 shutdown_connections 2024-04-16T15:53:34.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.401+0000 7f31ecdba640 1 -- 172.21.15.132:0/2952885524 >> 172.21.15.132:0/2952885524 conn(0x7f31e80d0d80 msgr2=0x7f31e8067840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:34.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.401+0000 7f31ecdba640 1 -- 172.21.15.132:0/2952885524 shutdown_connections 2024-04-16T15:53:34.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.401+0000 7f31ecdba640 1 -- 172.21.15.132:0/2952885524 wait complete. 2024-04-16T15:53:34.411 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-16T15:53:34.496 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~13s 2024-04-16T15:53:34.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.516+0000 7f7f0b324640 1 Processor -- start 2024-04-16T15:53:34.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.516+0000 7f7f0b324640 1 -- start start 2024-04-16T15:53:34.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.517+0000 7f7f0b324640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7f040d0550 0x7f7f040b3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:34.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.517+0000 7f7f0b324640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f04162590 con 0x7f7f040b5d50 2024-04-16T15:53:34.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.517+0000 7f7f0b324640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f040702f0 con 0x7f7f041621b0 2024-04-16T15:53:34.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.517+0000 7f7f0b324640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f7f040705d0 con 0x7f7f040d0550 2024-04-16T15:53:34.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.517+0000 7f7f088bf640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7f040d0550 0x7f7f040b3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:34.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.517+0000 7f7f098c1640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f7f040b5d50 0x7f7f041629c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:53014/0 (socket says 172.21.15.132:53014) 2024-04-16T15:53:34.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.517+0000 7f7f098c1640 1 -- 172.21.15.132:0/3536727212 learned_addr learned my addr 172.21.15.132:0/3536727212 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:53:34.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.518+0000 7f7f088bf640 1 -- 172.21.15.132:0/3536727212 >> v1:172.21.15.179:6789/0 conn(0x7f7f041621b0 legacy=0x7f7f040cfe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:34.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.518+0000 7f7f088bf640 1 -- 172.21.15.132:0/3536727212 >> v1:172.21.15.132:6789/0 conn(0x7f7f040b5d50 legacy=0x7f7f041629c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:34.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.518+0000 7f7efbfff640 1 -- 172.21.15.132:0/3536727212 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1577883824 0 0) 0x7f7f04162590 con 0x7f7f040b5d50 2024-04-16T15:53:34.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.518+0000 7f7f088bf640 1 -- 172.21.15.132:0/3536727212 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f04067890 con 0x7f7f040d0550 2024-04-16T15:53:34.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.518+0000 7f7f088bf640 1 --2- 172.21.15.132:0/3536727212 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f040d0550 0x7f7f040b3d90 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7ef40097a0 tx=0x7f7ef402b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e5178d4546301dc server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:34.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.518+0000 7f7efbfff640 1 -- 172.21.15.132:0/3536727212 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef4038070 con 0x7f7f040d0550 2024-04-16T15:53:34.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.518+0000 7f7efbfff640 1 -- 172.21.15.132:0/3536727212 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ef4031700 con 0x7f7f040d0550 2024-04-16T15:53:34.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.519+0000 7f7efbfff640 1 -- 172.21.15.132:0/3536727212 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef4031ad0 con 0x7f7f040d0550 2024-04-16T15:53:34.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.519+0000 7f7f0b324640 1 -- 172.21.15.132:0/3536727212 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f040d0550 msgr2=0x7f7f040b3d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:34.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.519+0000 7f7f0b324640 1 --2- 172.21.15.132:0/3536727212 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f040d0550 0x7f7f040b3d90 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7ef40097a0 tx=0x7f7ef402b7a0 comp rx=0 tx=0).stop 2024-04-16T15:53:34.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.520+0000 7f7f0b324640 1 -- 172.21.15.132:0/3536727212 shutdown_connections 2024-04-16T15:53:34.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.520+0000 7f7f0b324640 1 --2- 172.21.15.132:0/3536727212 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f040d0550 0x7f7f040b3d90 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:34.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.520+0000 7f7f0b324640 1 -- 172.21.15.132:0/3536727212 >> 172.21.15.132:0/3536727212 conn(0x7f7f040cd7e0 msgr2=0x7f7f040cdbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:34.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.520+0000 7f7f0b324640 1 -- 172.21.15.132:0/3536727212 shutdown_connections 2024-04-16T15:53:34.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.520+0000 7f7f0b324640 1 -- 172.21.15.132:0/3536727212 wait complete. 2024-04-16T15:53:34.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.521+0000 7f7f0b324640 1 Processor -- start 2024-04-16T15:53:34.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.521+0000 7f7f0b324640 1 -- start start 2024-04-16T15:53:34.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.522+0000 7f7f0b324640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f040b5d50 0x7f7f041f49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:34.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.522+0000 7f7f0b324640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f040d0550 0x7f7f0415a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:34.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.522+0000 7f7f0b324640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f041621b0 0x7f7f04160430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:34.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.522+0000 7f7f0b324640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f7f040ce830 con 0x7f7f041621b0 2024-04-16T15:53:34.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.522+0000 7f7f0b324640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7f04067ee0 con 0x7f7f040d0550 2024-04-16T15:53:34.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.522+0000 7f7f0b324640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f7f040b5800 con 0x7f7f040b5d50 2024-04-16T15:53:34.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.522+0000 7f7f098c1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f041621b0 0x7f7f04160430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:34.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.522+0000 7f7f098c1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f041621b0 0x7f7f04160430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34808/0 (socket says 172.21.15.132:34808) 2024-04-16T15:53:34.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.522+0000 7f7f098c1640 1 -- 172.21.15.132:0/2684277970 learned_addr learned my addr 172.21.15.132:0/2684277970 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:34.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.522+0000 7f7f088bf640 1 --2- 172.21.15.132:0/2684277970 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f040d0550 0x7f7f0415a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:34.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.522+0000 7f7f090c0640 1 --2- 172.21.15.132:0/2684277970 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f040b5d50 0x7f7f041f49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:34.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.522+0000 7f7f098c1640 1 -- 172.21.15.132:0/2684277970 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f040b5d50 msgr2=0x7f7f041f49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:34.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.522+0000 7f7f098c1640 1 --2- 172.21.15.132:0/2684277970 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f040b5d50 0x7f7f041f49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:34.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.522+0000 7f7f098c1640 1 -- 172.21.15.132:0/2684277970 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f040d0550 msgr2=0x7f7f0415a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:34.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.522+0000 7f7f098c1640 1 --2- 172.21.15.132:0/2684277970 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f040d0550 0x7f7f0415a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:34.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.522+0000 7f7f098c1640 1 -- 172.21.15.132:0/2684277970 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f0415ae10 con 0x7f7f041621b0 2024-04-16T15:53:34.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.522+0000 7f7f090c0640 1 --2- 172.21.15.132:0/2684277970 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f040b5d50 0x7f7f041f49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:53:34.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.522+0000 7f7f098c1640 1 --2- 172.21.15.132:0/2684277970 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f041621b0 0x7f7f04160430 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f7efc00c480 tx=0x7f7efc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:34.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.522+0000 7f7ef9ffb640 1 -- 172.21.15.132:0/2684277970 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7efc018070 con 0x7f7f041621b0 2024-04-16T15:53:34.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.522+0000 7f7ef9ffb640 1 -- 172.21.15.132:0/2684277970 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7efc007500 con 0x7f7f041621b0 2024-04-16T15:53:34.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.522+0000 7f7f0b324640 1 -- 172.21.15.132:0/2684277970 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f04160cb0 con 0x7f7f041621b0 2024-04-16T15:53:34.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.522+0000 7f7ef9ffb640 1 -- 172.21.15.132:0/2684277970 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7efc004a20 con 0x7f7f041621b0 2024-04-16T15:53:34.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.523+0000 7f7f0b324640 1 -- 172.21.15.132:0/2684277970 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f04161270 con 0x7f7f041621b0 2024-04-16T15:53:34.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.524+0000 7f7f0b324640 1 -- 172.21.15.132:0/2684277970 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f04075510 con 0x7f7f041621b0 2024-04-16T15:53:34.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.524+0000 7f7ef9ffb640 1 -- 172.21.15.132:0/2684277970 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7efc01b070 con 0x7f7f041621b0 2024-04-16T15:53:34.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.524+0000 7f7ef9ffb640 1 --2- 172.21.15.132:0/2684277970 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f7ee806c8f0 0x7f7ee806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:34.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.525+0000 7f7ef9ffb640 1 -- 172.21.15.132:0/2684277970 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f7efc08ad20 con 0x7f7f041621b0 2024-04-16T15:53:34.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.525+0000 7f7f090c0640 1 --2- 172.21.15.132:0/2684277970 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f7ee806c8f0 0x7f7ee806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:34.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.525+0000 7f7f090c0640 1 --2- 172.21.15.132:0/2684277970 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f7ee806c8f0 0x7f7ee806edb0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7f04161bc0 tx=0x7f7f00009570 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:34.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.529+0000 7f7ef9ffb640 1 -- 172.21.15.132:0/2684277970 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7efc058b90 con 0x7f7f041621b0 2024-04-16T15:53:34.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.706+0000 7f7f0b324640 1 -- 172.21.15.132:0/2684277970 --> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f7f040cfcd0 con 0x7f7ee806c8f0 2024-04-16T15:53:34.706 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.706+0000 7f7ef9ffb640 1 -- 172.21.15.132:0/2684277970 <== mgr.4101 v2:172.21.15.132:6832/3896387465 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f7f040cfcd0 con 0x7f7ee806c8f0 2024-04-16T15:53:34.706 INFO:teuthology.orchestra.run.smithi132.stderr:instructed osd(s) 6 to deep-scrub 2024-04-16T15:53:34.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.708+0000 7f7f0b324640 1 -- 172.21.15.132:0/2684277970 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f7ee806c8f0 msgr2=0x7f7ee806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:34.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.708+0000 7f7f0b324640 1 --2- 172.21.15.132:0/2684277970 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f7ee806c8f0 0x7f7ee806edb0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7f04161bc0 tx=0x7f7f00009570 comp rx=0 tx=0).stop 2024-04-16T15:53:34.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.708+0000 7f7f0b324640 1 -- 172.21.15.132:0/2684277970 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f041621b0 msgr2=0x7f7f04160430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:34.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.708+0000 7f7f0b324640 1 --2- 172.21.15.132:0/2684277970 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f041621b0 0x7f7f04160430 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f7efc00c480 tx=0x7f7efc00c940 comp rx=0 tx=0).stop 2024-04-16T15:53:34.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.708+0000 7f7f0b324640 1 -- 172.21.15.132:0/2684277970 shutdown_connections 2024-04-16T15:53:34.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.708+0000 7f7f0b324640 1 --2- 172.21.15.132:0/2684277970 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f7ee806c8f0 0x7f7ee806edb0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:34.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.708+0000 7f7f0b324640 1 --2- 172.21.15.132:0/2684277970 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f041621b0 0x7f7f04160430 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:34.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.708+0000 7f7f0b324640 1 --2- 172.21.15.132:0/2684277970 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f040d0550 0x7f7f0415a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:34.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.708+0000 7f7f0b324640 1 --2- 172.21.15.132:0/2684277970 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f040b5d50 0x7f7f041f49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:34.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.708+0000 7f7f0b324640 1 -- 172.21.15.132:0/2684277970 >> 172.21.15.132:0/2684277970 conn(0x7f7f040cd7e0 msgr2=0x7f7f040b3900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:34.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.708+0000 7f7f0b324640 1 -- 172.21.15.132:0/2684277970 shutdown_connections 2024-04-16T15:53:34.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.708+0000 7f7f0b324640 1 -- 172.21.15.132:0/2684277970 wait complete. 2024-04-16T15:53:34.719 INFO:tasks.ceph:Scrubbing osd.7 2024-04-16T15:53:34.719 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-16T15:53:34.826 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.827+0000 7f2608596640 1 Processor -- start 2024-04-16T15:53:34.826 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.827+0000 7f2608596640 1 -- start start 2024-04-16T15:53:34.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.828+0000 7f2608596640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2600144f10 0x7f260015bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:34.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.828+0000 7f2608596640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26001452f0 0x7f26000cfea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:34.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.828+0000 7f2608596640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f260015c3c0 con 0x7f260006f100 2024-04-16T15:53:34.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.828+0000 7f2608596640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f26000b00c0 con 0x7f2600144f10 2024-04-16T15:53:34.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.828+0000 7f2608596640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f260015c6a0 con 0x7f26001452f0 2024-04-16T15:53:34.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.828+0000 7f2606332640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2600144f10 0x7f260015bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:34.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.828+0000 7f2605b31640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26001452f0 0x7f26000cfea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:34.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.828+0000 7f2605b31640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26001452f0 0x7f26000cfea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.132:54652/0 (socket says 172.21.15.132:54652) 2024-04-16T15:53:34.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.828+0000 7f2606b33640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f260006f100 0x7f260015f360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.132:56816/0 (socket says 172.21.15.132:56816) 2024-04-16T15:53:34.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.828+0000 7f2605b31640 1 -- 172.21.15.132:0/3928649162 learned_addr learned my addr 172.21.15.132:0/3928649162 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:34.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.829+0000 7f2606332640 1 -- 172.21.15.132:0/3928649162 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26001452f0 msgr2=0x7f26000cfea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:34.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.829+0000 7f2606332640 1 --2- 172.21.15.132:0/3928649162 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26001452f0 0x7f26000cfea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:34.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.829+0000 7f2606332640 1 -- 172.21.15.132:0/3928649162 >> v1:172.21.15.179:6789/0 conn(0x7f260006f100 legacy=0x7f260015f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:34.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.829+0000 7f2606332640 1 -- 172.21.15.132:0/3928649162 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f260015c980 con 0x7f2600144f10 2024-04-16T15:53:34.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.829+0000 7f2605b31640 1 --2- 172.21.15.132:0/3928649162 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26001452f0 0x7f26000cfea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:53:34.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.830+0000 7f2606332640 1 --2- 172.21.15.132:0/3928649162 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2600144f10 0x7f260015bd40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f25f80097a0 tx=0x7f25f802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ce3a502773fb229 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:34.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.830+0000 7f2605330640 1 -- 172.21.15.132:0/3928649162 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f8035020 con 0x7f2600144f10 2024-04-16T15:53:34.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.830+0000 7f2605330640 1 -- 172.21.15.132:0/3928649162 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25f8031830 con 0x7f2600144f10 2024-04-16T15:53:34.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.830+0000 7f2605330640 1 -- 172.21.15.132:0/3928649162 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f8031c00 con 0x7f2600144f10 2024-04-16T15:53:34.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.830+0000 7f2608596640 1 -- 172.21.15.132:0/3928649162 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2600144f10 msgr2=0x7f260015bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:34.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.830+0000 7f2608596640 1 --2- 172.21.15.132:0/3928649162 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2600144f10 0x7f260015bd40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f25f80097a0 tx=0x7f25f802b8d0 comp rx=0 tx=0).stop 2024-04-16T15:53:34.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.830+0000 7f2608596640 1 -- 172.21.15.132:0/3928649162 shutdown_connections 2024-04-16T15:53:34.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.830+0000 7f2608596640 1 --2- 172.21.15.132:0/3928649162 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26001452f0 0x7f26000cfea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:34.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.830+0000 7f2608596640 1 --2- 172.21.15.132:0/3928649162 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2600144f10 0x7f260015bd40 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:34.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.830+0000 7f2608596640 1 -- 172.21.15.132:0/3928649162 >> 172.21.15.132:0/3928649162 conn(0x7f2600067d90 msgr2=0x7f260006ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:34.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.830+0000 7f2608596640 1 -- 172.21.15.132:0/3928649162 shutdown_connections 2024-04-16T15:53:34.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.830+0000 7f2608596640 1 -- 172.21.15.132:0/3928649162 wait complete. 2024-04-16T15:53:34.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.831+0000 7f2608596640 1 Processor -- start 2024-04-16T15:53:34.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.831+0000 7f2608596640 1 -- start start 2024-04-16T15:53:34.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.832+0000 7f2608596640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f260006f100 0x7f260015f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:34.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.832+0000 7f2608596640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2600144f10 0x7f260015aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:34.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.832+0000 7f2608596640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26001452f0 0x7f2600139850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:34.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.832+0000 7f2608596640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f26000b1b50 con 0x7f2600144f10 2024-04-16T15:53:34.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.832+0000 7f2608596640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f260015cc60 con 0x7f260006f100 2024-04-16T15:53:34.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.832+0000 7f2608596640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f26000b1cd0 con 0x7f26001452f0 2024-04-16T15:53:34.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.832+0000 7f2605b31640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2600144f10 0x7f260015aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:34.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.832+0000 7f2605b31640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2600144f10 0x7f260015aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34810/0 (socket says 172.21.15.132:34810) 2024-04-16T15:53:34.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.832+0000 7f2605b31640 1 -- 172.21.15.132:0/3767914967 learned_addr learned my addr 172.21.15.132:0/3767914967 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:34.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.833+0000 7f2606332640 1 --2- 172.21.15.132:0/3767914967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f260006f100 0x7f260015f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:34.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.833+0000 7f2605b31640 1 -- 172.21.15.132:0/3767914967 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26001452f0 msgr2=0x7f2600139850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:34.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.833+0000 7f2606b33640 1 --2- 172.21.15.132:0/3767914967 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26001452f0 0x7f2600139850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:34.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.833+0000 7f2605b31640 1 --2- 172.21.15.132:0/3767914967 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26001452f0 0x7f2600139850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:34.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.833+0000 7f2605b31640 1 -- 172.21.15.132:0/3767914967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f260006f100 msgr2=0x7f260015f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:34.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.833+0000 7f2605b31640 1 --2- 172.21.15.132:0/3767914967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f260006f100 0x7f260015f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:34.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.833+0000 7f2605b31640 1 -- 172.21.15.132:0/3767914967 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f260015e650 con 0x7f2600144f10 2024-04-16T15:53:34.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.833+0000 7f2605b31640 1 --2- 172.21.15.132:0/3767914967 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2600144f10 0x7f260015aae0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f25f400e9b0 tx=0x7f25f400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:34.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.833+0000 7f25feffd640 1 -- 172.21.15.132:0/3767914967 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f4017070 con 0x7f2600144f10 2024-04-16T15:53:34.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.833+0000 7f25feffd640 1 -- 172.21.15.132:0/3767914967 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25f400c9a0 con 0x7f2600144f10 2024-04-16T15:53:34.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.833+0000 7f2608596640 1 -- 172.21.15.132:0/3767914967 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f260015e930 con 0x7f2600144f10 2024-04-16T15:53:34.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.833+0000 7f25feffd640 1 -- 172.21.15.132:0/3767914967 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f400cd50 con 0x7f2600144f10 2024-04-16T15:53:34.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.833+0000 7f2608596640 1 -- 172.21.15.132:0/3767914967 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f260015eef0 con 0x7f2600144f10 2024-04-16T15:53:34.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.834+0000 7f2608596640 1 -- 172.21.15.132:0/3767914967 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2600068b80 con 0x7f2600144f10 2024-04-16T15:53:34.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.834+0000 7f25feffd640 1 -- 172.21.15.132:0/3767914967 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f25f401a070 con 0x7f2600144f10 2024-04-16T15:53:34.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.835+0000 7f25feffd640 1 --2- 172.21.15.132:0/3767914967 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f25ec06c8f0 0x7f25ec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:34.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.835+0000 7f25feffd640 1 -- 172.21.15.132:0/3767914967 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f25f408bd60 con 0x7f2600144f10 2024-04-16T15:53:34.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.835+0000 7f2606332640 1 --2- 172.21.15.132:0/3767914967 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f25ec06c8f0 0x7f25ec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:34.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.835+0000 7f25feffd640 1 --2- 172.21.15.132:0/3767914967 >> [v2:172.21.15.179:6808/872148365,v1:172.21.15.179:6810/872148365] conn(0x7f25ec074a90 0x7f25ec076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:34.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.835+0000 7f25feffd640 1 -- 172.21.15.132:0/3767914967 --> [v2:172.21.15.179:6808/872148365,v1:172.21.15.179:6810/872148365] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f25ec077560 con 0x7f25ec074a90 2024-04-16T15:53:34.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.835+0000 7f25feffd640 1 -- 172.21.15.132:0/3767914967 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f25f408e460 con 0x7f2600144f10 2024-04-16T15:53:34.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.835+0000 7f2606332640 1 --2- 172.21.15.132:0/3767914967 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f25ec06c8f0 0x7f25ec06edb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f25f8036000 tx=0x7f25f8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:34.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.835+0000 7f2606b33640 1 --2- 172.21.15.132:0/3767914967 >> [v2:172.21.15.179:6808/872148365,v1:172.21.15.179:6810/872148365] conn(0x7f25ec074a90 0x7f25ec076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:34.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.836+0000 7f2606b33640 1 --2- 172.21.15.132:0/3767914967 >> [v2:172.21.15.179:6808/872148365,v1:172.21.15.179:6810/872148365] conn(0x7f25ec074a90 0x7f25ec076eb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:34.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.836+0000 7f25feffd640 1 -- 172.21.15.132:0/3767914967 <== osd.7 v2:172.21.15.179:6808/872148365 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f25ec077560 con 0x7f25ec074a90 2024-04-16T15:53:34.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.849+0000 7f2608596640 1 -- 172.21.15.132:0/3767914967 --> [v2:172.21.15.179:6808/872148365,v1:172.21.15.179:6810/872148365] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f260015bfe0 con 0x7f25ec074a90 2024-04-16T15:53:34.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.850+0000 7f25feffd640 1 -- 172.21.15.132:0/3767914967 <== osd.7 v2:172.21.15.179:6808/872148365 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f260015bfe0 con 0x7f25ec074a90 2024-04-16T15:53:34.849 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-16T15:53:34.850 INFO:teuthology.orchestra.run.smithi132.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-16T15:53:34.850 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-16T15:53:34.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.850+0000 7f2608596640 1 -- 172.21.15.132:0/3767914967 >> [v2:172.21.15.179:6808/872148365,v1:172.21.15.179:6810/872148365] conn(0x7f25ec074a90 msgr2=0x7f25ec076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:34.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.850+0000 7f2608596640 1 --2- 172.21.15.132:0/3767914967 >> [v2:172.21.15.179:6808/872148365,v1:172.21.15.179:6810/872148365] conn(0x7f25ec074a90 0x7f25ec076eb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:34.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.850+0000 7f2608596640 1 -- 172.21.15.132:0/3767914967 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f25ec06c8f0 msgr2=0x7f25ec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:34.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.850+0000 7f2608596640 1 --2- 172.21.15.132:0/3767914967 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f25ec06c8f0 0x7f25ec06edb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f25f8036000 tx=0x7f25f8008030 comp rx=0 tx=0).stop 2024-04-16T15:53:34.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.850+0000 7f2608596640 1 -- 172.21.15.132:0/3767914967 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2600144f10 msgr2=0x7f260015aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:34.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.850+0000 7f2608596640 1 --2- 172.21.15.132:0/3767914967 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2600144f10 0x7f260015aae0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f25f400e9b0 tx=0x7f25f400ee70 comp rx=0 tx=0).stop 2024-04-16T15:53:34.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.850+0000 7f2606b33640 1 -- 172.21.15.132:0/3767914967 reap_dead start 2024-04-16T15:53:34.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.850+0000 7f2608596640 1 -- 172.21.15.132:0/3767914967 shutdown_connections 2024-04-16T15:53:34.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.850+0000 7f2608596640 1 -- 172.21.15.132:0/3767914967 >> 172.21.15.132:0/3767914967 conn(0x7f2600067d90 msgr2=0x7f260006dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:34.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.851+0000 7f2608596640 1 -- 172.21.15.132:0/3767914967 shutdown_connections 2024-04-16T15:53:34.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.851+0000 7f2608596640 1 -- 172.21.15.132:0/3767914967 wait complete. 2024-04-16T15:53:34.861 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-16T15:53:34.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.966+0000 7f13c642a640 1 Processor -- start 2024-04-16T15:53:34.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.966+0000 7f13c642a640 1 -- start start 2024-04-16T15:53:34.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.966+0000 7f13c642a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f13c015eea0 0x7f13c00b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:34.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.966+0000 7f13c642a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13c0070e40 0x7f13c00cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:34.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.966+0000 7f13c642a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f13c00cfd10 0x7f13c006f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:34.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.966+0000 7f13c642a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f13c00703a0 con 0x7f13c00cfd10 2024-04-16T15:53:34.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.966+0000 7f13c642a640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f13c00d01c0 con 0x7f13c015eea0 2024-04-16T15:53:34.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.966+0000 7f13c642a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f13c00705f0 con 0x7f13c0070e40 2024-04-16T15:53:34.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.966+0000 7f13c49c7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f13c00cfd10 0x7f13c006f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:34.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.967+0000 7f13c49c7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f13c00cfd10 0x7f13c006f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34824/0 (socket says 172.21.15.132:34824) 2024-04-16T15:53:34.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.967+0000 7f13c49c7640 1 -- 172.21.15.132:0/4101403157 learned_addr learned my addr 172.21.15.132:0/4101403157 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:34.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.967+0000 7f13b7fff640 1 --2- 172.21.15.132:0/4101403157 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13c0070e40 0x7f13c00cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:34.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.967+0000 7f13bffff640 1 --2- 172.21.15.132:0/4101403157 >> v2:172.21.15.179:3300/0 conn(0x7f13c015eea0 0x7f13c00b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:34.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.967+0000 7f13c49c7640 1 -- 172.21.15.132:0/4101403157 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13c0070e40 msgr2=0x7f13c00cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:34.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.967+0000 7f13c49c7640 1 --2- 172.21.15.132:0/4101403157 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13c0070e40 0x7f13c00cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:34.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.967+0000 7f13c49c7640 1 -- 172.21.15.132:0/4101403157 >> v2:172.21.15.179:3300/0 conn(0x7f13c015eea0 msgr2=0x7f13c00b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:34.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.967+0000 7f13c49c7640 1 --2- 172.21.15.132:0/4101403157 >> v2:172.21.15.179:3300/0 conn(0x7f13c015eea0 0x7f13c00b38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:34.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.967+0000 7f13c49c7640 1 -- 172.21.15.132:0/4101403157 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13c00708d0 con 0x7f13c00cfd10 2024-04-16T15:53:34.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.967+0000 7f13c49c7640 1 --2- 172.21.15.132:0/4101403157 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13c00cfd10 0x7f13c006f100 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f13c0071350 tx=0x7f13b802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48b1794e54614bb5 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:34.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.968+0000 7f13bf7fe640 1 -- 172.21.15.132:0/4101403157 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b802cb00 con 0x7f13c00cfd10 2024-04-16T15:53:34.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.968+0000 7f13bf7fe640 1 -- 172.21.15.132:0/4101403157 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13b802cca0 con 0x7f13c00cfd10 2024-04-16T15:53:34.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.968+0000 7f13bf7fe640 1 -- 172.21.15.132:0/4101403157 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b8034610 con 0x7f13c00cfd10 2024-04-16T15:53:34.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.968+0000 7f13c642a640 1 -- 172.21.15.132:0/4101403157 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13c00cfd10 msgr2=0x7f13c006f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:34.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.968+0000 7f13c642a640 1 --2- 172.21.15.132:0/4101403157 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13c00cfd10 0x7f13c006f100 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f13c0071350 tx=0x7f13b802bf60 comp rx=0 tx=0).stop 2024-04-16T15:53:34.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.968+0000 7f13c642a640 1 -- 172.21.15.132:0/4101403157 shutdown_connections 2024-04-16T15:53:34.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.968+0000 7f13c642a640 1 --2- 172.21.15.132:0/4101403157 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13c00cfd10 0x7f13c006f100 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:34.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.968+0000 7f13c642a640 1 --2- 172.21.15.132:0/4101403157 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13c0070e40 0x7f13c00cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:34.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.968+0000 7f13c642a640 1 --2- 172.21.15.132:0/4101403157 >> v2:172.21.15.179:3300/0 conn(0x7f13c015eea0 0x7f13c00b38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:34.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.968+0000 7f13c642a640 1 -- 172.21.15.132:0/4101403157 >> 172.21.15.132:0/4101403157 conn(0x7f13c009aa30 msgr2=0x7f13c00b31a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:34.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.968+0000 7f13c642a640 1 -- 172.21.15.132:0/4101403157 shutdown_connections 2024-04-16T15:53:34.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.968+0000 7f13c642a640 1 -- 172.21.15.132:0/4101403157 wait complete. 2024-04-16T15:53:34.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.969+0000 7f13c642a640 1 Processor -- start 2024-04-16T15:53:34.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.969+0000 7f13c642a640 1 -- start start 2024-04-16T15:53:34.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.970+0000 7f13c642a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13c0070e40 0x7f13c014b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:34.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.970+0000 7f13c642a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13c00cfd10 0x7f13c014ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:34.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.970+0000 7f13c642a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13c015eea0 0x7f13c00c7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:34.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.970+0000 7f13c642a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f13c015f280 con 0x7f13c00cfd10 2024-04-16T15:53:34.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.970+0000 7f13c642a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f13c00ccef0 con 0x7f13c0070e40 2024-04-16T15:53:34.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.970+0000 7f13c642a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f13c015f400 con 0x7f13c015eea0 2024-04-16T15:53:34.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.970+0000 7f13b7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13c00cfd10 0x7f13c014ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:34.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.970+0000 7f13b7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13c00cfd10 0x7f13c014ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34834/0 (socket says 172.21.15.132:34834) 2024-04-16T15:53:34.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.970+0000 7f13b7fff640 1 -- 172.21.15.132:0/1781225131 learned_addr learned my addr 172.21.15.132:0/1781225131 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:34.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.971+0000 7f13bffff640 1 --2- 172.21.15.132:0/1781225131 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13c0070e40 0x7f13c014b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:34.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.971+0000 7f13c49c7640 1 --2- 172.21.15.132:0/1781225131 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13c015eea0 0x7f13c00c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:34.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.971+0000 7f13b7fff640 1 -- 172.21.15.132:0/1781225131 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13c015eea0 msgr2=0x7f13c00c7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:34.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.971+0000 7f13b7fff640 1 --2- 172.21.15.132:0/1781225131 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13c015eea0 0x7f13c00c7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:34.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.971+0000 7f13b7fff640 1 -- 172.21.15.132:0/1781225131 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13c0070e40 msgr2=0x7f13c014b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:34.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.971+0000 7f13b7fff640 1 --2- 172.21.15.132:0/1781225131 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13c0070e40 0x7f13c014b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:34.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.971+0000 7f13b7fff640 1 -- 172.21.15.132:0/1781225131 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13c014bf20 con 0x7f13c00cfd10 2024-04-16T15:53:34.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.971+0000 7f13b7fff640 1 --2- 172.21.15.132:0/1781225131 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13c00cfd10 0x7f13c014ec80 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f13a800d5d0 tx=0x7f13a800da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:34.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.971+0000 7f13bd7fa640 1 -- 172.21.15.132:0/1781225131 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a8004240 con 0x7f13c00cfd10 2024-04-16T15:53:34.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.971+0000 7f13bd7fa640 1 -- 172.21.15.132:0/1781225131 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13a80043e0 con 0x7f13c00cfd10 2024-04-16T15:53:34.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.971+0000 7f13c642a640 1 -- 172.21.15.132:0/1781225131 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13c014f1c0 con 0x7f13c00cfd10 2024-04-16T15:53:34.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.971+0000 7f13bd7fa640 1 -- 172.21.15.132:0/1781225131 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a8003830 con 0x7f13c00cfd10 2024-04-16T15:53:34.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.971+0000 7f13c642a640 1 -- 172.21.15.132:0/1781225131 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13c00caec0 con 0x7f13c00cfd10 2024-04-16T15:53:34.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.972+0000 7f13c642a640 1 -- 172.21.15.132:0/1781225131 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13c0075510 con 0x7f13c00cfd10 2024-04-16T15:53:34.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.972+0000 7f13bd7fa640 1 -- 172.21.15.132:0/1781225131 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f13a80039d0 con 0x7f13c00cfd10 2024-04-16T15:53:34.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.973+0000 7f13bd7fa640 1 --2- 172.21.15.132:0/1781225131 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f13a006c8f0 0x7f13a006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:34.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.973+0000 7f13bffff640 1 --2- 172.21.15.132:0/1781225131 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f13a006c8f0 0x7f13a006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:34.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.973+0000 7f13bd7fa640 1 -- 172.21.15.132:0/1781225131 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f13a808bdd0 con 0x7f13c00cfd10 2024-04-16T15:53:34.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.973+0000 7f13bffff640 1 --2- 172.21.15.132:0/1781225131 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f13a006c8f0 0x7f13a006edb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f13b0006fd0 tx=0x7f13b0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:34.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:34.977+0000 7f13bd7fa640 1 -- 172.21.15.132:0/1781225131 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f13a801c360 con 0x7f13c00cfd10 2024-04-16T15:53:35.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.152+0000 7f13c642a640 1 -- 172.21.15.132:0/1781225131 --> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f13c00b3bd0 con 0x7f13a006c8f0 2024-04-16T15:53:35.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.153+0000 7f13bd7fa640 1 -- 172.21.15.132:0/1781225131 <== mgr.4101 v2:172.21.15.132:6832/3896387465 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f13c00b3bd0 con 0x7f13a006c8f0 2024-04-16T15:53:35.152 INFO:teuthology.orchestra.run.smithi132.stderr:instructed osd(s) 7 to deep-scrub 2024-04-16T15:53:35.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.155+0000 7f13c642a640 1 -- 172.21.15.132:0/1781225131 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f13a006c8f0 msgr2=0x7f13a006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:35.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.155+0000 7f13c642a640 1 --2- 172.21.15.132:0/1781225131 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f13a006c8f0 0x7f13a006edb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f13b0006fd0 tx=0x7f13b0008040 comp rx=0 tx=0).stop 2024-04-16T15:53:35.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.155+0000 7f13c642a640 1 -- 172.21.15.132:0/1781225131 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13c00cfd10 msgr2=0x7f13c014ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:35.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.155+0000 7f13c642a640 1 --2- 172.21.15.132:0/1781225131 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13c00cfd10 0x7f13c014ec80 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f13a800d5d0 tx=0x7f13a800da90 comp rx=0 tx=0).stop 2024-04-16T15:53:35.155 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.155+0000 7f13c642a640 1 -- 172.21.15.132:0/1781225131 shutdown_connections 2024-04-16T15:53:35.155 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.155+0000 7f13c642a640 1 --2- 172.21.15.132:0/1781225131 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f13a006c8f0 0x7f13a006edb0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:35.155 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.155+0000 7f13c642a640 1 --2- 172.21.15.132:0/1781225131 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13c015eea0 0x7f13c00c7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:35.155 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.155+0000 7f13c642a640 1 --2- 172.21.15.132:0/1781225131 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13c00cfd10 0x7f13c014ec80 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:35.155 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.155+0000 7f13c642a640 1 --2- 172.21.15.132:0/1781225131 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13c0070e40 0x7f13c014b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:35.155 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.155+0000 7f13c642a640 1 -- 172.21.15.132:0/1781225131 >> 172.21.15.132:0/1781225131 conn(0x7f13c009aa30 msgr2=0x7f13c00b0690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:35.155 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.155+0000 7f13c642a640 1 -- 172.21.15.132:0/1781225131 shutdown_connections 2024-04-16T15:53:35.155 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.155+0000 7f13c642a640 1 -- 172.21.15.132:0/1781225131 wait complete. 2024-04-16T15:53:35.165 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T15:53:35.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.271+0000 7f788e435640 1 Processor -- start 2024-04-16T15:53:35.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.271+0000 7f788e435640 1 -- start start 2024-04-16T15:53:35.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.272+0000 7f788e435640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f78880b6060 0x7f78880ce570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:35.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.272+0000 7f788e435640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78880ceab0 0x7f78881602b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:35.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.272+0000 7f788e435640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7888142070 con 0x7f788813f7f0 2024-04-16T15:53:35.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.272+0000 7f788e435640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f7888142350 con 0x7f78880b6060 2024-04-16T15:53:35.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.272+0000 7f788e435640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f7888142630 con 0x7f78880ceab0 2024-04-16T15:53:35.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.273+0000 7f78877fe640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f78880b6060 0x7f78880ce570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:35.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.273+0000 7f7887fff640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f788813f7f0 0x7f78880b5950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.132:56822/0 (socket says 172.21.15.132:56822) 2024-04-16T15:53:35.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.273+0000 7f788c9d2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78880ceab0 0x7f78881602b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:35.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.273+0000 7f7887fff640 1 -- 172.21.15.132:0/3181569636 learned_addr learned my addr 172.21.15.132:0/3181569636 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:53:35.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.273+0000 7f788c9d2640 1 -- 172.21.15.132:0/3181569636 >> v2:172.21.15.179:3300/0 conn(0x7f78880b6060 msgr2=0x7f78880ce570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:35.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.273+0000 7f788c9d2640 1 --2- 172.21.15.132:0/3181569636 >> v2:172.21.15.179:3300/0 conn(0x7f78880b6060 0x7f78880ce570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:35.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.273+0000 7f788c9d2640 1 -- 172.21.15.132:0/3181569636 >> v1:172.21.15.179:6789/0 conn(0x7f788813f7f0 legacy=0x7f78880b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:35.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.273+0000 7f788c9d2640 1 -- 172.21.15.132:0/3181569636 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78880cef60 con 0x7f78880ceab0 2024-04-16T15:53:35.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.273+0000 7f78877fe640 1 --2- 172.21.15.132:0/3181569636 >> v2:172.21.15.179:3300/0 conn(0x7f78880b6060 0x7f78880ce570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:53:35.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.274+0000 7f788c9d2640 1 --2- 172.21.15.132:0/3181569636 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78880ceab0 0x7f78881602b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7880009d90 tx=0x7f788002bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a9d9868168c4722 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:35.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.274+0000 7f7886ffd640 1 -- 172.21.15.132:0/3181569636 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7880039070 con 0x7f78880ceab0 2024-04-16T15:53:35.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.274+0000 7f7886ffd640 1 -- 172.21.15.132:0/3181569636 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f788002cc50 con 0x7f78880ceab0 2024-04-16T15:53:35.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.274+0000 7f7886ffd640 1 -- 172.21.15.132:0/3181569636 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7880034440 con 0x7f78880ceab0 2024-04-16T15:53:35.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.274+0000 7f788e435640 1 -- 172.21.15.132:0/3181569636 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78880ceab0 msgr2=0x7f78881602b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:35.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.274+0000 7f788e435640 1 --2- 172.21.15.132:0/3181569636 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78880ceab0 0x7f78881602b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7880009d90 tx=0x7f788002bea0 comp rx=0 tx=0).stop 2024-04-16T15:53:35.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.275+0000 7f788e435640 1 -- 172.21.15.132:0/3181569636 shutdown_connections 2024-04-16T15:53:35.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.275+0000 7f788e435640 1 --2- 172.21.15.132:0/3181569636 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78880ceab0 0x7f78881602b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:35.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.275+0000 7f788e435640 1 --2- 172.21.15.132:0/3181569636 >> v2:172.21.15.179:3300/0 conn(0x7f78880b6060 0x7f78880ce570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:35.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.275+0000 7f788e435640 1 -- 172.21.15.132:0/3181569636 >> 172.21.15.132:0/3181569636 conn(0x7f78880b2d50 msgr2=0x7f788806ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:35.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.275+0000 7f788e435640 1 -- 172.21.15.132:0/3181569636 shutdown_connections 2024-04-16T15:53:35.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.275+0000 7f788e435640 1 -- 172.21.15.132:0/3181569636 wait complete. 2024-04-16T15:53:35.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.276+0000 7f788e435640 1 Processor -- start 2024-04-16T15:53:35.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.276+0000 7f788e435640 1 -- start start 2024-04-16T15:53:35.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.277+0000 7f788e435640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78880b6060 0x7f788813ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:35.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.277+0000 7f788e435640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78880ceab0 0x7f788815eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:35.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.277+0000 7f788e435640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f788813f7f0 0x7f788815f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:35.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.277+0000 7f788e435640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f7888160970 con 0x7f78880ceab0 2024-04-16T15:53:35.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.277+0000 7f788e435640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f78881607f0 con 0x7f78880b6060 2024-04-16T15:53:35.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.277+0000 7f788e435640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f7888160af0 con 0x7f788813f7f0 2024-04-16T15:53:35.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.277+0000 7f78877fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78880ceab0 0x7f788815eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:35.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.277+0000 7f78877fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78880ceab0 0x7f788815eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34844/0 (socket says 172.21.15.132:34844) 2024-04-16T15:53:35.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.277+0000 7f78877fe640 1 -- 172.21.15.132:0/777566588 learned_addr learned my addr 172.21.15.132:0/777566588 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:35.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.277+0000 7f7887fff640 1 --2- 172.21.15.132:0/777566588 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78880b6060 0x7f788813ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:35.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.277+0000 7f788c9d2640 1 --2- 172.21.15.132:0/777566588 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f788813f7f0 0x7f788815f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:35.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.277+0000 7f78877fe640 1 -- 172.21.15.132:0/777566588 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f788813f7f0 msgr2=0x7f788815f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:35.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.277+0000 7f78877fe640 1 --2- 172.21.15.132:0/777566588 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f788813f7f0 0x7f788815f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:35.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.277+0000 7f78877fe640 1 -- 172.21.15.132:0/777566588 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78880b6060 msgr2=0x7f788813ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:35.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.277+0000 7f78877fe640 1 --2- 172.21.15.132:0/777566588 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78880b6060 0x7f788813ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:35.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.277+0000 7f78877fe640 1 -- 172.21.15.132:0/777566588 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78881574b0 con 0x7f78880ceab0 2024-04-16T15:53:35.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.277+0000 7f78877fe640 1 --2- 172.21.15.132:0/777566588 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78880ceab0 0x7f788815eeb0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f787c00ebe0 tx=0x7f787c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:35.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.277+0000 7f7884ff9640 1 -- 172.21.15.132:0/777566588 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f787c017070 con 0x7f78880ceab0 2024-04-16T15:53:35.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.277+0000 7f7884ff9640 1 -- 172.21.15.132:0/777566588 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f787c00cc30 con 0x7f78880ceab0 2024-04-16T15:53:35.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.278+0000 7f788e435640 1 -- 172.21.15.132:0/777566588 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7888157790 con 0x7f78880ceab0 2024-04-16T15:53:35.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.278+0000 7f7884ff9640 1 -- 172.21.15.132:0/777566588 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f787c013470 con 0x7f78880ceab0 2024-04-16T15:53:35.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.278+0000 7f788e435640 1 -- 172.21.15.132:0/777566588 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7888157d50 con 0x7f78880ceab0 2024-04-16T15:53:35.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.279+0000 7f788e435640 1 -- 172.21.15.132:0/777566588 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7888075510 con 0x7f78880ceab0 2024-04-16T15:53:35.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.279+0000 7f7884ff9640 1 -- 172.21.15.132:0/777566588 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f787c01a070 con 0x7f78880ceab0 2024-04-16T15:53:35.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.279+0000 7f7884ff9640 1 --2- 172.21.15.132:0/777566588 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f787406c920 0x7f787406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:35.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.280+0000 7f7884ff9640 1 -- 172.21.15.132:0/777566588 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f787c08bcc0 con 0x7f78880ceab0 2024-04-16T15:53:35.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.280+0000 7f7887fff640 1 --2- 172.21.15.132:0/777566588 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f787406c920 0x7f787406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:35.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.280+0000 7f7887fff640 1 --2- 172.21.15.132:0/777566588 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f787406c920 0x7f787406ede0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7878007fd0 tx=0x7f7878007e80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:35.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.284+0000 7f7884ff9640 1 -- 172.21.15.132:0/777566588 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f787c059b30 con 0x7f78880ceab0 2024-04-16T15:53:35.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.458+0000 7f788e435640 1 -- 172.21.15.132:0/777566588 --> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f788815a670 con 0x7f787406c920 2024-04-16T15:53:35.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.463+0000 7f7884ff9640 1 -- 172.21.15.132:0/777566588 <== mgr.4101 v2:172.21.15.132:6832/3896387465 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251168 (secure 0 0 0) 0x7f788815a670 con 0x7f787406c920 2024-04-16T15:53:35.466 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:53:35.467 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2024-04-16T15:53:35.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.467+0000 7f788e435640 1 -- 172.21.15.132:0/777566588 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f787406c920 msgr2=0x7f787406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:35.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.467+0000 7f788e435640 1 --2- 172.21.15.132:0/777566588 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f787406c920 0x7f787406ede0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7878007fd0 tx=0x7f7878007e80 comp rx=0 tx=0).stop 2024-04-16T15:53:35.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.467+0000 7f788e435640 1 -- 172.21.15.132:0/777566588 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78880ceab0 msgr2=0x7f788815eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:35.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.467+0000 7f788e435640 1 --2- 172.21.15.132:0/777566588 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78880ceab0 0x7f788815eeb0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f787c00ebe0 tx=0x7f787c00c520 comp rx=0 tx=0).stop 2024-04-16T15:53:35.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.467+0000 7f788e435640 1 -- 172.21.15.132:0/777566588 shutdown_connections 2024-04-16T15:53:35.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.467+0000 7f788e435640 1 --2- 172.21.15.132:0/777566588 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f787406c920 0x7f787406ede0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:35.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.467+0000 7f788e435640 1 --2- 172.21.15.132:0/777566588 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f788813f7f0 0x7f788815f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:35.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.467+0000 7f788e435640 1 --2- 172.21.15.132:0/777566588 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78880ceab0 0x7f788815eeb0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:35.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.467+0000 7f788e435640 1 --2- 172.21.15.132:0/777566588 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78880b6060 0x7f788813ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:35.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.467+0000 7f788e435640 1 -- 172.21.15.132:0/777566588 >> 172.21.15.132:0/777566588 conn(0x7f78880b2d50 msgr2=0x7f788815acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:35.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.467+0000 7f788e435640 1 -- 172.21.15.132:0/777566588 shutdown_connections 2024-04-16T15:53:35.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:35.467+0000 7f788e435640 1 -- 172.21.15.132:0/777566588 wait complete. 2024-04-16T15:53:35.477 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2024-04-16T15:53:35.284853+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224584,"kb_used_data":4232,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750136,"statfs":{"total":773094113280,"available":772864139264,"internally_reserved":0,"allocated":4333568,"data_stored":2401004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":672,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002591"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464477+0000","last_change":"2024-04-16T15:53:19.219500+0000","last_active":"2024-04-16T15:53:20.464477+0000","last_peered":"2024-04-16T15:53:20.464477+0000","last_clean":"2024-04-16T15:53:20.464477+0000","last_became_active":"2024-04-16T15:53:19.219026+0000","last_became_peered":"2024-04-16T15:53:19.219026+0000","last_unstale":"2024-04-16T15:53:20.464477+0000","last_undegraded":"2024-04-16T15:53:20.464477+0000","last_fullsized":"2024-04-16T15:53:20.464477+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:14:20.343340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195457+0000","last_change":"2024-04-16T15:53:19.226148+0000","last_active":"2024-04-16T15:53:20.195457+0000","last_peered":"2024-04-16T15:53:20.195457+0000","last_clean":"2024-04-16T15:53:20.195457+0000","last_became_active":"2024-04-16T15:53:19.225869+0000","last_became_peered":"2024-04-16T15:53:19.225869+0000","last_unstale":"2024-04-16T15:53:20.195457+0000","last_undegraded":"2024-04-16T15:53:20.195457+0000","last_fullsized":"2024-04-16T15:53:20.195457+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:00:13.986513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464246+0000","last_change":"2024-04-16T15:53:19.209925+0000","last_active":"2024-04-16T15:53:20.464246+0000","last_peered":"2024-04-16T15:53:20.464246+0000","last_clean":"2024-04-16T15:53:20.464246+0000","last_became_active":"2024-04-16T15:53:19.209186+0000","last_became_peered":"2024-04-16T15:53:19.209186+0000","last_unstale":"2024-04-16T15:53:20.464246+0000","last_undegraded":"2024-04-16T15:53:20.464246+0000","last_fullsized":"2024-04-16T15:53:20.464246+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:12:25.656341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277237+0000","last_change":"2024-04-16T15:53:19.214711+0000","last_active":"2024-04-16T15:53:20.277237+0000","last_peered":"2024-04-16T15:53:20.277237+0000","last_clean":"2024-04-16T15:53:20.277237+0000","last_became_active":"2024-04-16T15:53:19.214414+0000","last_became_peered":"2024-04-16T15:53:19.214414+0000","last_unstale":"2024-04-16T15:53:20.277237+0000","last_undegraded":"2024-04-16T15:53:20.277237+0000","last_fullsized":"2024-04-16T15:53:20.277237+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:09:09.369395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463976+0000","last_change":"2024-04-16T15:53:19.218064+0000","last_active":"2024-04-16T15:53:20.463976+0000","last_peered":"2024-04-16T15:53:20.463976+0000","last_clean":"2024-04-16T15:53:20.463976+0000","last_became_active":"2024-04-16T15:53:19.217808+0000","last_became_peered":"2024-04-16T15:53:19.217808+0000","last_unstale":"2024-04-16T15:53:20.463976+0000","last_undegraded":"2024-04-16T15:53:20.463976+0000","last_fullsized":"2024-04-16T15:53:20.463976+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195195+0000","last_change":"2024-04-16T15:53:19.214250+0000","last_active":"2024-04-16T15:53:20.195195+0000","last_peered":"2024-04-16T15:53:20.195195+0000","last_clean":"2024-04-16T15:53:20.195195+0000","last_became_active":"2024-04-16T15:53:19.213980+0000","last_became_peered":"2024-04-16T15:53:19.213980+0000","last_unstale":"2024-04-16T15:53:20.195195+0000","last_undegraded":"2024-04-16T15:53:20.195195+0000","last_fullsized":"2024-04-16T15:53:20.195195+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:55:20.146233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197135+0000","last_change":"2024-04-16T15:53:19.221453+0000","last_active":"2024-04-16T15:53:20.197135+0000","last_peered":"2024-04-16T15:53:20.197135+0000","last_clean":"2024-04-16T15:53:20.197135+0000","last_became_active":"2024-04-16T15:53:19.221101+0000","last_became_peered":"2024-04-16T15:53:19.221101+0000","last_unstale":"2024-04-16T15:53:20.197135+0000","last_undegraded":"2024-04-16T15:53:20.197135+0000","last_fullsized":"2024-04-16T15:53:20.197135+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:47:53.262802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197388+0000","last_change":"2024-04-16T15:53:19.214371+0000","last_active":"2024-04-16T15:53:20.197388+0000","last_peered":"2024-04-16T15:53:20.197388+0000","last_clean":"2024-04-16T15:53:20.197388+0000","last_became_active":"2024-04-16T15:53:19.213544+0000","last_became_peered":"2024-04-16T15:53:19.213544+0000","last_unstale":"2024-04-16T15:53:20.197388+0000","last_undegraded":"2024-04-16T15:53:20.197388+0000","last_fullsized":"2024-04-16T15:53:20.197388+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:55:20.146233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197066+0000","last_change":"2024-04-16T15:53:19.207377+0000","last_active":"2024-04-16T15:53:20.197066+0000","last_peered":"2024-04-16T15:53:20.197066+0000","last_clean":"2024-04-16T15:53:20.197066+0000","last_became_active":"2024-04-16T15:53:19.206972+0000","last_became_peered":"2024-04-16T15:53:19.206972+0000","last_unstale":"2024-04-16T15:53:20.197066+0000","last_undegraded":"2024-04-16T15:53:20.197066+0000","last_fullsized":"2024-04-16T15:53:20.197066+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:41:40.266044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277465+0000","last_change":"2024-04-16T15:53:19.216192+0000","last_active":"2024-04-16T15:53:20.277465+0000","last_peered":"2024-04-16T15:53:20.277465+0000","last_clean":"2024-04-16T15:53:20.277465+0000","last_became_active":"2024-04-16T15:53:19.215441+0000","last_became_peered":"2024-04-16T15:53:19.215441+0000","last_unstale":"2024-04-16T15:53:20.277465+0000","last_undegraded":"2024-04-16T15:53:20.277465+0000","last_fullsized":"2024-04-16T15:53:20.277465+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:41:40.266044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196998+0000","last_change":"2024-04-16T15:53:19.219404+0000","last_active":"2024-04-16T15:53:20.196998+0000","last_peered":"2024-04-16T15:53:20.196998+0000","last_clean":"2024-04-16T15:53:20.196998+0000","last_became_active":"2024-04-16T15:53:19.219142+0000","last_became_peered":"2024-04-16T15:53:19.219142+0000","last_unstale":"2024-04-16T15:53:20.196998+0000","last_undegraded":"2024-04-16T15:53:20.196998+0000","last_fullsized":"2024-04-16T15:53:20.196998+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:40:00.074304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464668+0000","last_change":"2024-04-16T15:53:19.215861+0000","last_active":"2024-04-16T15:53:20.464668+0000","last_peered":"2024-04-16T15:53:20.464668+0000","last_clean":"2024-04-16T15:53:20.464668+0000","last_became_active":"2024-04-16T15:53:19.215574+0000","last_became_peered":"2024-04-16T15:53:19.215574+0000","last_unstale":"2024-04-16T15:53:20.464668+0000","last_undegraded":"2024-04-16T15:53:20.464668+0000","last_fullsized":"2024-04-16T15:53:20.464668+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:55:20.146233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463990+0000","last_change":"2024-04-16T15:53:19.219125+0000","last_active":"2024-04-16T15:53:20.463990+0000","last_peered":"2024-04-16T15:53:20.463990+0000","last_clean":"2024-04-16T15:53:20.463990+0000","last_became_active":"2024-04-16T15:53:19.218503+0000","last_became_peered":"2024-04-16T15:53:19.218503+0000","last_unstale":"2024-04-16T15:53:20.463990+0000","last_undegraded":"2024-04-16T15:53:20.463990+0000","last_fullsized":"2024-04-16T15:53:20.463990+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195100+0000","last_change":"2024-04-16T15:53:19.214790+0000","last_active":"2024-04-16T15:53:20.195100+0000","last_peered":"2024-04-16T15:53:20.195100+0000","last_clean":"2024-04-16T15:53:20.195100+0000","last_became_active":"2024-04-16T15:53:19.214539+0000","last_became_peered":"2024-04-16T15:53:19.214539+0000","last_unstale":"2024-04-16T15:53:20.195100+0000","last_undegraded":"2024-04-16T15:53:20.195100+0000","last_fullsized":"2024-04-16T15:53:20.195100+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:09:12.444137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464200+0000","last_change":"2024-04-16T15:53:19.215379+0000","last_active":"2024-04-16T15:53:20.464200+0000","last_peered":"2024-04-16T15:53:20.464200+0000","last_clean":"2024-04-16T15:53:20.464200+0000","last_became_active":"2024-04-16T15:53:19.215064+0000","last_became_peered":"2024-04-16T15:53:19.215064+0000","last_unstale":"2024-04-16T15:53:20.464200+0000","last_undegraded":"2024-04-16T15:53:20.464200+0000","last_fullsized":"2024-04-16T15:53:20.464200+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:32:14.472011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196790+0000","last_change":"2024-04-16T15:53:19.226607+0000","last_active":"2024-04-16T15:53:20.196790+0000","last_peered":"2024-04-16T15:53:20.196790+0000","last_clean":"2024-04-16T15:53:20.196790+0000","last_became_active":"2024-04-16T15:53:19.226349+0000","last_became_peered":"2024-04-16T15:53:19.226349+0000","last_unstale":"2024-04-16T15:53:20.196790+0000","last_undegraded":"2024-04-16T15:53:20.196790+0000","last_fullsized":"2024-04-16T15:53:20.196790+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:19.727876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197376+0000","last_change":"2024-04-16T15:53:19.222520+0000","last_active":"2024-04-16T15:53:20.197376+0000","last_peered":"2024-04-16T15:53:20.197376+0000","last_clean":"2024-04-16T15:53:20.197376+0000","last_became_active":"2024-04-16T15:53:19.222235+0000","last_became_peered":"2024-04-16T15:53:19.222235+0000","last_unstale":"2024-04-16T15:53:20.197376+0000","last_undegraded":"2024-04-16T15:53:20.197376+0000","last_fullsized":"2024-04-16T15:53:20.197376+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:26:17.244174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195538+0000","last_change":"2024-04-16T15:53:19.218035+0000","last_active":"2024-04-16T15:53:20.195538+0000","last_peered":"2024-04-16T15:53:20.195538+0000","last_clean":"2024-04-16T15:53:20.195538+0000","last_became_active":"2024-04-16T15:53:19.217745+0000","last_became_peered":"2024-04-16T15:53:19.217745+0000","last_unstale":"2024-04-16T15:53:20.195538+0000","last_undegraded":"2024-04-16T15:53:20.195538+0000","last_fullsized":"2024-04-16T15:53:20.195538+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:15:31.542491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195338+0000","last_change":"2024-04-16T15:53:19.217634+0000","last_active":"2024-04-16T15:53:20.195338+0000","last_peered":"2024-04-16T15:53:20.195338+0000","last_clean":"2024-04-16T15:53:20.195338+0000","last_became_active":"2024-04-16T15:53:19.217373+0000","last_became_peered":"2024-04-16T15:53:19.217373+0000","last_unstale":"2024-04-16T15:53:20.195338+0000","last_undegraded":"2024-04-16T15:53:20.195338+0000","last_fullsized":"2024-04-16T15:53:20.195338+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:48:31.729009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464143+0000","last_change":"2024-04-16T15:53:19.211323+0000","last_active":"2024-04-16T15:53:20.464143+0000","last_peered":"2024-04-16T15:53:20.464143+0000","last_clean":"2024-04-16T15:53:20.464143+0000","last_became_active":"2024-04-16T15:53:19.210812+0000","last_became_peered":"2024-04-16T15:53:19.210812+0000","last_unstale":"2024-04-16T15:53:20.464143+0000","last_undegraded":"2024-04-16T15:53:20.464143+0000","last_fullsized":"2024-04-16T15:53:20.464143+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196930+0000","last_change":"2024-04-16T15:53:19.199390+0000","last_active":"2024-04-16T15:53:20.196930+0000","last_peered":"2024-04-16T15:53:20.196930+0000","last_clean":"2024-04-16T15:53:20.196930+0000","last_became_active":"2024-04-16T15:53:19.199066+0000","last_became_peered":"2024-04-16T15:53:19.199066+0000","last_unstale":"2024-04-16T15:53:20.196930+0000","last_undegraded":"2024-04-16T15:53:20.196930+0000","last_fullsized":"2024-04-16T15:53:20.196930+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:01:01.640923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197022+0000","last_change":"2024-04-16T15:53:19.219587+0000","last_active":"2024-04-16T15:53:20.197022+0000","last_peered":"2024-04-16T15:53:20.197022+0000","last_clean":"2024-04-16T15:53:20.197022+0000","last_became_active":"2024-04-16T15:53:19.219150+0000","last_became_peered":"2024-04-16T15:53:19.219150+0000","last_unstale":"2024-04-16T15:53:20.197022+0000","last_undegraded":"2024-04-16T15:53:20.197022+0000","last_fullsized":"2024-04-16T15:53:20.197022+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:09:09.369395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:22.296698+0000","last_change":"2024-04-16T15:53:19.211517+0000","last_active":"2024-04-16T15:53:22.296698+0000","last_peered":"2024-04-16T15:53:22.296698+0000","last_clean":"2024-04-16T15:53:22.296698+0000","last_became_active":"2024-04-16T15:53:19.211260+0000","last_became_peered":"2024-04-16T15:53:19.211260+0000","last_unstale":"2024-04-16T15:53:22.296698+0000","last_undegraded":"2024-04-16T15:53:22.296698+0000","last_fullsized":"2024-04-16T15:53:22.296698+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464423+0000","last_change":"2024-04-16T15:53:19.204402+0000","last_active":"2024-04-16T15:53:20.464423+0000","last_peered":"2024-04-16T15:53:20.464423+0000","last_clean":"2024-04-16T15:53:20.464423+0000","last_became_active":"2024-04-16T15:53:19.204086+0000","last_became_peered":"2024-04-16T15:53:19.204086+0000","last_unstale":"2024-04-16T15:53:20.464423+0000","last_undegraded":"2024-04-16T15:53:20.464423+0000","last_fullsized":"2024-04-16T15:53:20.464423+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:09:12.444137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277504+0000","last_change":"2024-04-16T15:53:19.214478+0000","last_active":"2024-04-16T15:53:20.277504+0000","last_peered":"2024-04-16T15:53:20.277504+0000","last_clean":"2024-04-16T15:53:20.277504+0000","last_became_active":"2024-04-16T15:53:19.214199+0000","last_became_peered":"2024-04-16T15:53:19.214199+0000","last_unstale":"2024-04-16T15:53:20.277504+0000","last_undegraded":"2024-04-16T15:53:20.277504+0000","last_fullsized":"2024-04-16T15:53:20.277504+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:38:12.802270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195587+0000","last_change":"2024-04-16T15:53:19.223834+0000","last_active":"2024-04-16T15:53:20.195587+0000","last_peered":"2024-04-16T15:53:20.195587+0000","last_clean":"2024-04-16T15:53:20.195587+0000","last_became_active":"2024-04-16T15:53:19.223467+0000","last_became_peered":"2024-04-16T15:53:19.223467+0000","last_unstale":"2024-04-16T15:53:20.195587+0000","last_undegraded":"2024-04-16T15:53:20.195587+0000","last_fullsized":"2024-04-16T15:53:20.195587+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:20:36.722580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277601+0000","last_change":"2024-04-16T15:53:19.215061+0000","last_active":"2024-04-16T15:53:20.277601+0000","last_peered":"2024-04-16T15:53:20.277601+0000","last_clean":"2024-04-16T15:53:20.277601+0000","last_became_active":"2024-04-16T15:53:19.214786+0000","last_became_peered":"2024-04-16T15:53:19.214786+0000","last_unstale":"2024-04-16T15:53:20.277601+0000","last_undegraded":"2024-04-16T15:53:20.277601+0000","last_fullsized":"2024-04-16T15:53:20.277601+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:24:52.885269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464800+0000","last_change":"2024-04-16T15:53:19.199651+0000","last_active":"2024-04-16T15:53:20.464800+0000","last_peered":"2024-04-16T15:53:20.464800+0000","last_clean":"2024-04-16T15:53:20.464800+0000","last_became_active":"2024-04-16T15:53:19.199270+0000","last_became_peered":"2024-04-16T15:53:19.199270+0000","last_unstale":"2024-04-16T15:53:20.464800+0000","last_undegraded":"2024-04-16T15:53:20.464800+0000","last_fullsized":"2024-04-16T15:53:20.464800+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:48:31.729009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197108+0000","last_change":"2024-04-16T15:53:19.218009+0000","last_active":"2024-04-16T15:53:20.197108+0000","last_peered":"2024-04-16T15:53:20.197108+0000","last_clean":"2024-04-16T15:53:20.197108+0000","last_became_active":"2024-04-16T15:53:19.217749+0000","last_became_peered":"2024-04-16T15:53:19.217749+0000","last_unstale":"2024-04-16T15:53:20.197108+0000","last_undegraded":"2024-04-16T15:53:20.197108+0000","last_fullsized":"2024-04-16T15:53:20.197108+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:38:12.802270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196284+0000","last_change":"2024-04-16T15:53:19.215554+0000","last_active":"2024-04-16T15:53:20.196284+0000","last_peered":"2024-04-16T15:53:20.196284+0000","last_clean":"2024-04-16T15:53:20.196284+0000","last_became_active":"2024-04-16T15:53:19.215243+0000","last_became_peered":"2024-04-16T15:53:19.215243+0000","last_unstale":"2024-04-16T15:53:20.196284+0000","last_undegraded":"2024-04-16T15:53:20.196284+0000","last_fullsized":"2024-04-16T15:53:20.196284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:24:52.885269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463993+0000","last_change":"2024-04-16T15:53:19.213628+0000","last_active":"2024-04-16T15:53:20.463993+0000","last_peered":"2024-04-16T15:53:20.463993+0000","last_clean":"2024-04-16T15:53:20.463993+0000","last_became_active":"2024-04-16T15:53:19.213345+0000","last_became_peered":"2024-04-16T15:53:19.213345+0000","last_unstale":"2024-04-16T15:53:20.463993+0000","last_undegraded":"2024-04-16T15:53:20.463993+0000","last_fullsized":"2024-04-16T15:53:20.463993+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:34:49.536139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196294+0000","last_change":"2024-04-16T15:53:19.212569+0000","last_active":"2024-04-16T15:53:20.196294+0000","last_peered":"2024-04-16T15:53:20.196294+0000","last_clean":"2024-04-16T15:53:20.196294+0000","last_became_active":"2024-04-16T15:53:19.212198+0000","last_became_peered":"2024-04-16T15:53:19.212198+0000","last_unstale":"2024-04-16T15:53:20.196294+0000","last_undegraded":"2024-04-16T15:53:20.196294+0000","last_fullsized":"2024-04-16T15:53:20.196294+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:27:57.263921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:22.296755+0000","last_change":"2024-04-16T15:53:19.212160+0000","last_active":"2024-04-16T15:53:22.296755+0000","last_peered":"2024-04-16T15:53:22.296755+0000","last_clean":"2024-04-16T15:53:22.296755+0000","last_became_active":"2024-04-16T15:53:19.211902+0000","last_became_peered":"2024-04-16T15:53:19.211902+0000","last_unstale":"2024-04-16T15:53:22.296755+0000","last_undegraded":"2024-04-16T15:53:22.296755+0000","last_fullsized":"2024-04-16T15:53:22.296755+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464727+0000","last_change":"2024-04-16T15:53:18.210743+0000","last_active":"2024-04-16T15:53:20.464727+0000","last_peered":"2024-04-16T15:53:20.464727+0000","last_clean":"2024-04-16T15:53:20.464727+0000","last_became_active":"2024-04-16T15:53:18.210466+0000","last_became_peered":"2024-04-16T15:53:18.210466+0000","last_unstale":"2024-04-16T15:53:20.464727+0000","last_undegraded":"2024-04-16T15:53:20.464727+0000","last_fullsized":"2024-04-16T15:53:20.464727+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:03:51.897303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464638+0000","last_change":"2024-04-16T15:53:19.214490+0000","last_active":"2024-04-16T15:53:20.464638+0000","last_peered":"2024-04-16T15:53:20.464638+0000","last_clean":"2024-04-16T15:53:20.464638+0000","last_became_active":"2024-04-16T15:53:19.214206+0000","last_became_peered":"2024-04-16T15:53:19.214206+0000","last_unstale":"2024-04-16T15:53:20.464638+0000","last_undegraded":"2024-04-16T15:53:20.464638+0000","last_fullsized":"2024-04-16T15:53:20.464638+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:54:25.966875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463804+0000","last_change":"2024-04-16T15:53:18.213622+0000","last_active":"2024-04-16T15:53:20.463804+0000","last_peered":"2024-04-16T15:53:20.463804+0000","last_clean":"2024-04-16T15:53:20.463804+0000","last_became_active":"2024-04-16T15:53:18.213368+0000","last_became_peered":"2024-04-16T15:53:18.213368+0000","last_unstale":"2024-04-16T15:53:20.463804+0000","last_undegraded":"2024-04-16T15:53:20.463804+0000","last_fullsized":"2024-04-16T15:53:20.463804+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196775+0000","last_change":"2024-04-16T15:53:19.217908+0000","last_active":"2024-04-16T15:53:20.196775+0000","last_peered":"2024-04-16T15:53:20.196775+0000","last_clean":"2024-04-16T15:53:20.196775+0000","last_became_active":"2024-04-16T15:53:19.217659+0000","last_became_peered":"2024-04-16T15:53:19.217659+0000","last_unstale":"2024-04-16T15:53:20.196775+0000","last_undegraded":"2024-04-16T15:53:20.196775+0000","last_fullsized":"2024-04-16T15:53:20.196775+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:18:05.482765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195229+0000","last_change":"2024-04-16T15:53:18.206967+0000","last_active":"2024-04-16T15:53:20.195229+0000","last_peered":"2024-04-16T15:53:20.195229+0000","last_clean":"2024-04-16T15:53:20.195229+0000","last_became_active":"2024-04-16T15:53:18.206684+0000","last_became_peered":"2024-04-16T15:53:18.206684+0000","last_unstale":"2024-04-16T15:53:20.195229+0000","last_undegraded":"2024-04-16T15:53:20.195229+0000","last_fullsized":"2024-04-16T15:53:20.195229+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:14:19.341087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277619+0000","last_change":"2024-04-16T15:53:19.214612+0000","last_active":"2024-04-16T15:53:20.277619+0000","last_peered":"2024-04-16T15:53:20.277619+0000","last_clean":"2024-04-16T15:53:20.277619+0000","last_became_active":"2024-04-16T15:53:19.214331+0000","last_became_peered":"2024-04-16T15:53:19.214331+0000","last_unstale":"2024-04-16T15:53:20.277619+0000","last_undegraded":"2024-04-16T15:53:20.277619+0000","last_fullsized":"2024-04-16T15:53:20.277619+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:27:57.263921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464167+0000","last_change":"2024-04-16T15:53:18.210644+0000","last_active":"2024-04-16T15:53:20.464167+0000","last_peered":"2024-04-16T15:53:20.464167+0000","last_clean":"2024-04-16T15:53:20.464167+0000","last_became_active":"2024-04-16T15:53:18.210390+0000","last_became_peered":"2024-04-16T15:53:18.210390+0000","last_unstale":"2024-04-16T15:53:20.464167+0000","last_undegraded":"2024-04-16T15:53:20.464167+0000","last_fullsized":"2024-04-16T15:53:20.464167+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196471+0000","last_change":"2024-04-16T15:53:19.218628+0000","last_active":"2024-04-16T15:53:20.196471+0000","last_peered":"2024-04-16T15:53:20.196471+0000","last_clean":"2024-04-16T15:53:20.196471+0000","last_became_active":"2024-04-16T15:53:19.218185+0000","last_became_peered":"2024-04-16T15:53:19.218185+0000","last_unstale":"2024-04-16T15:53:20.196471+0000","last_undegraded":"2024-04-16T15:53:20.196471+0000","last_fullsized":"2024-04-16T15:53:20.196471+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:20:34.974674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197176+0000","last_change":"2024-04-16T15:53:18.210540+0000","last_active":"2024-04-16T15:53:20.197176+0000","last_peered":"2024-04-16T15:53:20.197176+0000","last_clean":"2024-04-16T15:53:20.197176+0000","last_became_active":"2024-04-16T15:53:18.210271+0000","last_became_peered":"2024-04-16T15:53:18.210271+0000","last_unstale":"2024-04-16T15:53:20.197176+0000","last_undegraded":"2024-04-16T15:53:20.197176+0000","last_fullsized":"2024-04-16T15:53:20.197176+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:08:37.253061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464363+0000","last_change":"2024-04-16T15:53:19.200361+0000","last_active":"2024-04-16T15:53:20.464363+0000","last_peered":"2024-04-16T15:53:20.464363+0000","last_clean":"2024-04-16T15:53:20.464363+0000","last_became_active":"2024-04-16T15:53:19.200086+0000","last_became_peered":"2024-04-16T15:53:19.200086+0000","last_unstale":"2024-04-16T15:53:20.464363+0000","last_undegraded":"2024-04-16T15:53:20.464363+0000","last_fullsized":"2024-04-16T15:53:20.464363+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:40:00.074304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196830+0000","last_change":"2024-04-16T15:53:18.210491+0000","last_active":"2024-04-16T15:53:20.196830+0000","last_peered":"2024-04-16T15:53:20.196830+0000","last_clean":"2024-04-16T15:53:20.196830+0000","last_became_active":"2024-04-16T15:53:18.210234+0000","last_became_peered":"2024-04-16T15:53:18.210234+0000","last_unstale":"2024-04-16T15:53:20.196830+0000","last_undegraded":"2024-04-16T15:53:20.196830+0000","last_fullsized":"2024-04-16T15:53:20.196830+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:28:44.787593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196717+0000","last_change":"2024-04-16T15:53:19.210713+0000","last_active":"2024-04-16T15:53:20.196717+0000","last_peered":"2024-04-16T15:53:20.196717+0000","last_clean":"2024-04-16T15:53:20.196717+0000","last_became_active":"2024-04-16T15:53:19.210425+0000","last_became_peered":"2024-04-16T15:53:19.210425+0000","last_unstale":"2024-04-16T15:53:20.196717+0000","last_undegraded":"2024-04-16T15:53:20.196717+0000","last_fullsized":"2024-04-16T15:53:20.196717+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:42:06.870549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.194850+0000","last_change":"2024-04-16T15:53:18.210535+0000","last_active":"2024-04-16T15:53:20.194850+0000","last_peered":"2024-04-16T15:53:20.194850+0000","last_clean":"2024-04-16T15:53:20.194850+0000","last_became_active":"2024-04-16T15:53:18.210282+0000","last_became_peered":"2024-04-16T15:53:18.210282+0000","last_unstale":"2024-04-16T15:53:20.194850+0000","last_undegraded":"2024-04-16T15:53:20.194850+0000","last_fullsized":"2024-04-16T15:53:20.194850+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:09:56.208391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277154+0000","last_change":"2024-04-16T15:53:19.212496+0000","last_active":"2024-04-16T15:53:20.277154+0000","last_peered":"2024-04-16T15:53:20.277154+0000","last_clean":"2024-04-16T15:53:20.277154+0000","last_became_active":"2024-04-16T15:53:19.212239+0000","last_became_peered":"2024-04-16T15:53:19.212239+0000","last_unstale":"2024-04-16T15:53:20.277154+0000","last_undegraded":"2024-04-16T15:53:20.277154+0000","last_fullsized":"2024-04-16T15:53:20.277154+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:18:05.482765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195756+0000","last_change":"2024-04-16T15:53:18.208530+0000","last_active":"2024-04-16T15:53:20.195756+0000","last_peered":"2024-04-16T15:53:20.195756+0000","last_clean":"2024-04-16T15:53:20.195756+0000","last_became_active":"2024-04-16T15:53:18.208225+0000","last_became_peered":"2024-04-16T15:53:18.208225+0000","last_unstale":"2024-04-16T15:53:20.195756+0000","last_undegraded":"2024-04-16T15:53:20.195756+0000","last_fullsized":"2024-04-16T15:53:20.195756+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:01:02.783464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464310+0000","last_change":"2024-04-16T15:53:19.215852+0000","last_active":"2024-04-16T15:53:20.464310+0000","last_peered":"2024-04-16T15:53:20.464310+0000","last_clean":"2024-04-16T15:53:20.464310+0000","last_became_active":"2024-04-16T15:53:19.215600+0000","last_became_peered":"2024-04-16T15:53:19.215600+0000","last_unstale":"2024-04-16T15:53:20.464310+0000","last_undegraded":"2024-04-16T15:53:20.464310+0000","last_fullsized":"2024-04-16T15:53:20.464310+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:19.727876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195485+0000","last_change":"2024-04-16T15:53:18.209410+0000","last_active":"2024-04-16T15:53:20.195485+0000","last_peered":"2024-04-16T15:53:20.195485+0000","last_clean":"2024-04-16T15:53:20.195485+0000","last_became_active":"2024-04-16T15:53:18.209128+0000","last_became_peered":"2024-04-16T15:53:18.209128+0000","last_unstale":"2024-04-16T15:53:20.195485+0000","last_undegraded":"2024-04-16T15:53:20.195485+0000","last_fullsized":"2024-04-16T15:53:20.195485+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:18:04.480511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195481+0000","last_change":"2024-04-16T15:53:19.218196+0000","last_active":"2024-04-16T15:53:20.195481+0000","last_peered":"2024-04-16T15:53:20.195481+0000","last_clean":"2024-04-16T15:53:20.195481+0000","last_became_active":"2024-04-16T15:53:19.217938+0000","last_became_peered":"2024-04-16T15:53:19.217938+0000","last_unstale":"2024-04-16T15:53:20.195481+0000","last_undegraded":"2024-04-16T15:53:20.195481+0000","last_fullsized":"2024-04-16T15:53:20.195481+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:15:54.665161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463789+0000","last_change":"2024-04-16T15:53:18.212761+0000","last_active":"2024-04-16T15:53:20.463789+0000","last_peered":"2024-04-16T15:53:20.463789+0000","last_clean":"2024-04-16T15:53:20.463789+0000","last_became_active":"2024-04-16T15:53:18.212427+0000","last_became_peered":"2024-04-16T15:53:18.212427+0000","last_unstale":"2024-04-16T15:53:20.463789+0000","last_undegraded":"2024-04-16T15:53:20.463789+0000","last_fullsized":"2024-04-16T15:53:20.463789+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195317+0000","last_change":"2024-04-16T15:53:19.223760+0000","last_active":"2024-04-16T15:53:20.195317+0000","last_peered":"2024-04-16T15:53:20.195317+0000","last_clean":"2024-04-16T15:53:20.195317+0000","last_became_active":"2024-04-16T15:53:19.223461+0000","last_became_peered":"2024-04-16T15:53:19.223461+0000","last_unstale":"2024-04-16T15:53:20.195317+0000","last_undegraded":"2024-04-16T15:53:20.195317+0000","last_fullsized":"2024-04-16T15:53:20.195317+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:19:47.160288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464486+0000","last_change":"2024-04-16T15:53:18.208880+0000","last_active":"2024-04-16T15:53:20.464486+0000","last_peered":"2024-04-16T15:53:20.464486+0000","last_clean":"2024-04-16T15:53:20.464486+0000","last_became_active":"2024-04-16T15:53:18.208317+0000","last_became_peered":"2024-04-16T15:53:18.208317+0000","last_unstale":"2024-04-16T15:53:20.464486+0000","last_undegraded":"2024-04-16T15:53:20.464486+0000","last_fullsized":"2024-04-16T15:53:20.464486+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:09:56.208391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464325+0000","last_change":"2024-04-16T15:53:19.218075+0000","last_active":"2024-04-16T15:53:20.464325+0000","last_peered":"2024-04-16T15:53:20.464325+0000","last_clean":"2024-04-16T15:53:20.464325+0000","last_became_active":"2024-04-16T15:53:19.217805+0000","last_became_peered":"2024-04-16T15:53:19.217805+0000","last_unstale":"2024-04-16T15:53:20.464325+0000","last_undegraded":"2024-04-16T15:53:20.464325+0000","last_fullsized":"2024-04-16T15:53:20.464325+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:47:53.262802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195193+0000","last_change":"2024-04-16T15:53:18.206853+0000","last_active":"2024-04-16T15:53:20.195193+0000","last_peered":"2024-04-16T15:53:20.195193+0000","last_clean":"2024-04-16T15:53:20.195193+0000","last_became_active":"2024-04-16T15:53:18.206613+0000","last_became_peered":"2024-04-16T15:53:18.206613+0000","last_unstale":"2024-04-16T15:53:20.195193+0000","last_undegraded":"2024-04-16T15:53:20.195193+0000","last_fullsized":"2024-04-16T15:53:20.195193+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:54:24.964622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277187+0000","last_change":"2024-04-16T15:53:19.222111+0000","last_active":"2024-04-16T15:53:20.277187+0000","last_peered":"2024-04-16T15:53:20.277187+0000","last_clean":"2024-04-16T15:53:20.277187+0000","last_became_active":"2024-04-16T15:53:19.221536+0000","last_became_peered":"2024-04-16T15:53:19.221536+0000","last_unstale":"2024-04-16T15:53:20.277187+0000","last_undegraded":"2024-04-16T15:53:20.277187+0000","last_fullsized":"2024-04-16T15:53:20.277187+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:01:01.640923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197189+0000","last_change":"2024-04-16T15:53:18.207932+0000","last_active":"2024-04-16T15:53:20.197189+0000","last_peered":"2024-04-16T15:53:20.197189+0000","last_clean":"2024-04-16T15:53:20.197189+0000","last_became_active":"2024-04-16T15:53:18.207445+0000","last_became_peered":"2024-04-16T15:53:18.207445+0000","last_unstale":"2024-04-16T15:53:20.197189+0000","last_undegraded":"2024-04-16T15:53:20.197189+0000","last_fullsized":"2024-04-16T15:53:20.197189+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:26:09.897432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195254+0000","last_change":"2024-04-16T15:53:19.215660+0000","last_active":"2024-04-16T15:53:20.195254+0000","last_peered":"2024-04-16T15:53:20.195254+0000","last_clean":"2024-04-16T15:53:20.195254+0000","last_became_active":"2024-04-16T15:53:19.215415+0000","last_became_peered":"2024-04-16T15:53:19.215415+0000","last_unstale":"2024-04-16T15:53:20.195254+0000","last_undegraded":"2024-04-16T15:53:20.195254+0000","last_fullsized":"2024-04-16T15:53:20.195254+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:26:17.244174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277262+0000","last_change":"2024-04-16T15:53:18.207023+0000","last_active":"2024-04-16T15:53:20.277262+0000","last_peered":"2024-04-16T15:53:20.277262+0000","last_clean":"2024-04-16T15:53:20.277262+0000","last_became_active":"2024-04-16T15:53:18.206764+0000","last_became_peered":"2024-04-16T15:53:18.206764+0000","last_unstale":"2024-04-16T15:53:20.277262+0000","last_undegraded":"2024-04-16T15:53:20.277262+0000","last_fullsized":"2024-04-16T15:53:20.277262+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:49:24.686045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196471+0000","last_change":"2024-04-16T15:53:19.218507+0000","last_active":"2024-04-16T15:53:20.196471+0000","last_peered":"2024-04-16T15:53:20.196471+0000","last_clean":"2024-04-16T15:53:20.196471+0000","last_became_active":"2024-04-16T15:53:19.218250+0000","last_became_peered":"2024-04-16T15:53:19.218250+0000","last_unstale":"2024-04-16T15:53:20.196471+0000","last_undegraded":"2024-04-16T15:53:20.196471+0000","last_fullsized":"2024-04-16T15:53:20.196471+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:12:25.656341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.194904+0000","last_change":"2024-04-16T15:53:18.207895+0000","last_active":"2024-04-16T15:53:20.194904+0000","last_peered":"2024-04-16T15:53:20.194904+0000","last_clean":"2024-04-16T15:53:20.194904+0000","last_became_active":"2024-04-16T15:53:18.207633+0000","last_became_peered":"2024-04-16T15:53:18.207633+0000","last_unstale":"2024-04-16T15:53:20.194904+0000","last_undegraded":"2024-04-16T15:53:20.194904+0000","last_fullsized":"2024-04-16T15:53:20.194904+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:42:05.868295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464143+0000","last_change":"2024-04-16T15:53:19.212616+0000","last_active":"2024-04-16T15:53:20.464143+0000","last_peered":"2024-04-16T15:53:20.464143+0000","last_clean":"2024-04-16T15:53:20.464143+0000","last_became_active":"2024-04-16T15:53:19.212171+0000","last_became_peered":"2024-04-16T15:53:19.212171+0000","last_unstale":"2024-04-16T15:53:20.464143+0000","last_undegraded":"2024-04-16T15:53:20.464143+0000","last_fullsized":"2024-04-16T15:53:20.464143+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:13:11.997144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.194904+0000","last_change":"2024-04-16T15:53:18.207615+0000","last_active":"2024-04-16T15:53:20.194904+0000","last_peered":"2024-04-16T15:53:20.194904+0000","last_clean":"2024-04-16T15:53:20.194904+0000","last_became_active":"2024-04-16T15:53:18.207332+0000","last_became_peered":"2024-04-16T15:53:18.207332+0000","last_unstale":"2024-04-16T15:53:20.194904+0000","last_undegraded":"2024-04-16T15:53:20.194904+0000","last_fullsized":"2024-04-16T15:53:20.194904+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:01:00.638669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196700+0000","last_change":"2024-04-16T15:53:19.202791+0000","last_active":"2024-04-16T15:53:20.196700+0000","last_peered":"2024-04-16T15:53:20.196700+0000","last_clean":"2024-04-16T15:53:20.196700+0000","last_became_active":"2024-04-16T15:53:19.202414+0000","last_became_peered":"2024-04-16T15:53:19.202414+0000","last_unstale":"2024-04-16T15:53:20.196700+0000","last_undegraded":"2024-04-16T15:53:20.196700+0000","last_fullsized":"2024-04-16T15:53:20.196700+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:09:57.210644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277536+0000","last_change":"2024-04-16T15:53:18.211975+0000","last_active":"2024-04-16T15:53:20.277536+0000","last_peered":"2024-04-16T15:53:20.277536+0000","last_clean":"2024-04-16T15:53:20.277536+0000","last_became_active":"2024-04-16T15:53:18.211709+0000","last_became_peered":"2024-04-16T15:53:18.211709+0000","last_unstale":"2024-04-16T15:53:20.277536+0000","last_undegraded":"2024-04-16T15:53:20.277536+0000","last_fullsized":"2024-04-16T15:53:20.277536+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:03:51.897303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464666+0000","last_change":"2024-04-16T15:53:19.202854+0000","last_active":"2024-04-16T15:53:20.464666+0000","last_peered":"2024-04-16T15:53:20.464666+0000","last_clean":"2024-04-16T15:53:20.464666+0000","last_became_active":"2024-04-16T15:53:19.202530+0000","last_became_peered":"2024-04-16T15:53:19.202530+0000","last_unstale":"2024-04-16T15:53:20.464666+0000","last_undegraded":"2024-04-16T15:53:20.464666+0000","last_fullsized":"2024-04-16T15:53:20.464666+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:26:17.244174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196884+0000","last_change":"2024-04-16T15:53:18.208018+0000","last_active":"2024-04-16T15:53:20.196884+0000","last_peered":"2024-04-16T15:53:20.196884+0000","last_clean":"2024-04-16T15:53:20.196884+0000","last_became_active":"2024-04-16T15:53:18.207596+0000","last_became_peered":"2024-04-16T15:53:18.207596+0000","last_unstale":"2024-04-16T15:53:20.196884+0000","last_undegraded":"2024-04-16T15:53:20.196884+0000","last_fullsized":"2024-04-16T15:53:20.196884+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:03:51.897303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277265+0000","last_change":"2024-04-16T15:53:19.215051+0000","last_active":"2024-04-16T15:53:20.277265+0000","last_peered":"2024-04-16T15:53:20.277265+0000","last_clean":"2024-04-16T15:53:20.277265+0000","last_became_active":"2024-04-16T15:53:19.214161+0000","last_became_peered":"2024-04-16T15:53:19.214161+0000","last_unstale":"2024-04-16T15:53:20.277265+0000","last_undegraded":"2024-04-16T15:53:20.277265+0000","last_fullsized":"2024-04-16T15:53:20.277265+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:21:33.438988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196677+0000","last_change":"2024-04-16T15:53:18.210890+0000","last_active":"2024-04-16T15:53:20.196677+0000","last_peered":"2024-04-16T15:53:20.196677+0000","last_clean":"2024-04-16T15:53:20.196677+0000","last_became_active":"2024-04-16T15:53:18.210498+0000","last_became_peered":"2024-04-16T15:53:18.210498+0000","last_unstale":"2024-04-16T15:53:20.196677+0000","last_undegraded":"2024-04-16T15:53:20.196677+0000","last_fullsized":"2024-04-16T15:53:20.196677+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:31:41.162544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463930+0000","last_change":"2024-04-16T15:53:19.212904+0000","last_active":"2024-04-16T15:53:20.463930+0000","last_peered":"2024-04-16T15:53:20.463930+0000","last_clean":"2024-04-16T15:53:20.463930+0000","last_became_active":"2024-04-16T15:53:19.212661+0000","last_became_peered":"2024-04-16T15:53:19.212661+0000","last_unstale":"2024-04-16T15:53:20.463930+0000","last_undegraded":"2024-04-16T15:53:20.463930+0000","last_fullsized":"2024-04-16T15:53:20.463930+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196432+0000","last_change":"2024-04-16T15:53:18.212722+0000","last_active":"2024-04-16T15:53:20.196432+0000","last_peered":"2024-04-16T15:53:20.196432+0000","last_clean":"2024-04-16T15:53:20.196432+0000","last_became_active":"2024-04-16T15:53:18.212434+0000","last_became_peered":"2024-04-16T15:53:18.212434+0000","last_unstale":"2024-04-16T15:53:20.196432+0000","last_undegraded":"2024-04-16T15:53:20.196432+0000","last_fullsized":"2024-04-16T15:53:20.196432+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:46:28.763927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463764+0000","last_change":"2024-04-16T15:53:19.212150+0000","last_active":"2024-04-16T15:53:20.463764+0000","last_peered":"2024-04-16T15:53:20.463764+0000","last_clean":"2024-04-16T15:53:20.463764+0000","last_became_active":"2024-04-16T15:53:19.211842+0000","last_became_peered":"2024-04-16T15:53:19.211842+0000","last_unstale":"2024-04-16T15:53:20.463764+0000","last_undegraded":"2024-04-16T15:53:20.463764+0000","last_fullsized":"2024-04-16T15:53:20.463764+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464095+0000","last_change":"2024-04-16T15:53:18.210794+0000","last_active":"2024-04-16T15:53:20.464095+0000","last_peered":"2024-04-16T15:53:20.464095+0000","last_clean":"2024-04-16T15:53:20.464095+0000","last_became_active":"2024-04-16T15:53:18.210087+0000","last_became_peered":"2024-04-16T15:53:18.210087+0000","last_unstale":"2024-04-16T15:53:20.464095+0000","last_undegraded":"2024-04-16T15:53:20.464095+0000","last_fullsized":"2024-04-16T15:53:20.464095+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464120+0000","last_change":"2024-04-16T15:53:19.206926+0000","last_active":"2024-04-16T15:53:20.464120+0000","last_peered":"2024-04-16T15:53:20.464120+0000","last_clean":"2024-04-16T15:53:20.464120+0000","last_became_active":"2024-04-16T15:53:19.206660+0000","last_became_peered":"2024-04-16T15:53:19.206660+0000","last_unstale":"2024-04-16T15:53:20.464120+0000","last_undegraded":"2024-04-16T15:53:20.464120+0000","last_fullsized":"2024-04-16T15:53:20.464120+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464223+0000","last_change":"2024-04-16T15:53:18.210087+0000","last_active":"2024-04-16T15:53:20.464223+0000","last_peered":"2024-04-16T15:53:20.464223+0000","last_clean":"2024-04-16T15:53:20.464223+0000","last_became_active":"2024-04-16T15:53:18.209539+0000","last_became_peered":"2024-04-16T15:53:18.209539+0000","last_unstale":"2024-04-16T15:53:20.464223+0000","last_undegraded":"2024-04-16T15:53:20.464223+0000","last_fullsized":"2024-04-16T15:53:20.464223+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:31:41.162544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463562+0000","last_change":"2024-04-16T15:53:19.206275+0000","last_active":"2024-04-16T15:53:20.463562+0000","last_peered":"2024-04-16T15:53:20.463562+0000","last_clean":"2024-04-16T15:53:20.463562+0000","last_became_active":"2024-04-16T15:53:19.205995+0000","last_became_peered":"2024-04-16T15:53:19.205995+0000","last_unstale":"2024-04-16T15:53:20.463562+0000","last_undegraded":"2024-04-16T15:53:20.463562+0000","last_fullsized":"2024-04-16T15:53:20.463562+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195767+0000","last_change":"2024-04-16T15:53:18.204767+0000","last_active":"2024-04-16T15:53:20.195767+0000","last_peered":"2024-04-16T15:53:20.195767+0000","last_clean":"2024-04-16T15:53:20.195767+0000","last_became_active":"2024-04-16T15:53:18.204142+0000","last_became_peered":"2024-04-16T15:53:18.204142+0000","last_unstale":"2024-04-16T15:53:20.195767+0000","last_undegraded":"2024-04-16T15:53:20.195767+0000","last_fullsized":"2024-04-16T15:53:20.195767+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:27:13.923490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197141+0000","last_change":"2024-04-16T15:53:19.215530+0000","last_active":"2024-04-16T15:53:20.197141+0000","last_peered":"2024-04-16T15:53:20.197141+0000","last_clean":"2024-04-16T15:53:20.197141+0000","last_became_active":"2024-04-16T15:53:19.215227+0000","last_became_peered":"2024-04-16T15:53:19.215227+0000","last_unstale":"2024-04-16T15:53:20.197141+0000","last_undegraded":"2024-04-16T15:53:20.197141+0000","last_fullsized":"2024-04-16T15:53:20.197141+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:09:12.444137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464488+0000","last_change":"2024-04-16T15:53:18.209377+0000","last_active":"2024-04-16T15:53:20.464488+0000","last_peered":"2024-04-16T15:53:20.464488+0000","last_clean":"2024-04-16T15:53:20.464488+0000","last_became_active":"2024-04-16T15:53:18.209092+0000","last_became_peered":"2024-04-16T15:53:18.209092+0000","last_unstale":"2024-04-16T15:53:20.464488+0000","last_undegraded":"2024-04-16T15:53:20.464488+0000","last_fullsized":"2024-04-16T15:53:20.464488+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:54:24.964622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463758+0000","last_change":"2024-04-16T15:53:19.210213+0000","last_active":"2024-04-16T15:53:20.463758+0000","last_peered":"2024-04-16T15:53:20.463758+0000","last_clean":"2024-04-16T15:53:20.463758+0000","last_became_active":"2024-04-16T15:53:19.209941+0000","last_became_peered":"2024-04-16T15:53:19.209941+0000","last_unstale":"2024-04-16T15:53:20.463758+0000","last_undegraded":"2024-04-16T15:53:20.463758+0000","last_fullsized":"2024-04-16T15:53:20.463758+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277554+0000","last_change":"2024-04-16T15:53:18.204255+0000","last_active":"2024-04-16T15:53:20.277554+0000","last_peered":"2024-04-16T15:53:20.277554+0000","last_clean":"2024-04-16T15:53:20.277554+0000","last_became_active":"2024-04-16T15:53:18.203960+0000","last_became_peered":"2024-04-16T15:53:18.203960+0000","last_unstale":"2024-04-16T15:53:20.277554+0000","last_undegraded":"2024-04-16T15:53:20.277554+0000","last_fullsized":"2024-04-16T15:53:20.277554+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:46:28.763927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464698+0000","last_change":"2024-04-16T15:53:19.218513+0000","last_active":"2024-04-16T15:53:20.464698+0000","last_peered":"2024-04-16T15:53:20.464698+0000","last_clean":"2024-04-16T15:53:20.464698+0000","last_became_active":"2024-04-16T15:53:19.217646+0000","last_became_peered":"2024-04-16T15:53:19.217646+0000","last_unstale":"2024-04-16T15:53:20.464698+0000","last_undegraded":"2024-04-16T15:53:20.464698+0000","last_fullsized":"2024-04-16T15:53:20.464698+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:19:47.160288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.463988+0000","last_change":"2024-04-16T15:53:18.208864+0000","last_active":"2024-04-16T15:53:20.463988+0000","last_peered":"2024-04-16T15:53:20.463988+0000","last_clean":"2024-04-16T15:53:20.463988+0000","last_became_active":"2024-04-16T15:53:18.208576+0000","last_became_peered":"2024-04-16T15:53:18.208576+0000","last_unstale":"2024-04-16T15:53:20.463988+0000","last_undegraded":"2024-04-16T15:53:20.463988+0000","last_fullsized":"2024-04-16T15:53:20.463988+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:22.296742+0000","last_change":"2024-04-16T15:53:19.220923+0000","last_active":"2024-04-16T15:53:22.296742+0000","last_peered":"2024-04-16T15:53:22.296742+0000","last_clean":"2024-04-16T15:53:22.296742+0000","last_became_active":"2024-04-16T15:53:19.218050+0000","last_became_peered":"2024-04-16T15:53:19.218050+0000","last_unstale":"2024-04-16T15:53:22.296742+0000","last_undegraded":"2024-04-16T15:53:22.296742+0000","last_fullsized":"2024-04-16T15:53:22.296742+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277301+0000","last_change":"2024-04-16T15:53:18.211328+0000","last_active":"2024-04-16T15:53:20.277301+0000","last_peered":"2024-04-16T15:53:20.277301+0000","last_clean":"2024-04-16T15:53:20.277301+0000","last_became_active":"2024-04-16T15:53:18.211063+0000","last_became_peered":"2024-04-16T15:53:18.211063+0000","last_unstale":"2024-04-16T15:53:20.277301+0000","last_undegraded":"2024-04-16T15:53:20.277301+0000","last_fullsized":"2024-04-16T15:53:20.277301+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:27:13.923490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464047+0000","last_change":"2024-04-16T15:53:19.210169+0000","last_active":"2024-04-16T15:53:20.464047+0000","last_peered":"2024-04-16T15:53:20.464047+0000","last_clean":"2024-04-16T15:53:20.464047+0000","last_became_active":"2024-04-16T15:53:19.209882+0000","last_became_peered":"2024-04-16T15:53:19.209882+0000","last_unstale":"2024-04-16T15:53:20.464047+0000","last_undegraded":"2024-04-16T15:53:20.464047+0000","last_fullsized":"2024-04-16T15:53:20.464047+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:34:17.258739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464254+0000","last_change":"2024-04-16T15:53:18.204297+0000","last_active":"2024-04-16T15:53:20.464254+0000","last_peered":"2024-04-16T15:53:20.464254+0000","last_clean":"2024-04-16T15:53:20.464254+0000","last_became_active":"2024-04-16T15:53:18.204054+0000","last_became_peered":"2024-04-16T15:53:18.204054+0000","last_unstale":"2024-04-16T15:53:20.464254+0000","last_undegraded":"2024-04-16T15:53:20.464254+0000","last_fullsized":"2024-04-16T15:53:20.464254+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:22.296722+0000","last_change":"2024-04-16T15:53:19.211221+0000","last_active":"2024-04-16T15:53:22.296722+0000","last_peered":"2024-04-16T15:53:22.296722+0000","last_clean":"2024-04-16T15:53:22.296722+0000","last_became_active":"2024-04-16T15:53:19.210969+0000","last_became_peered":"2024-04-16T15:53:19.210969+0000","last_unstale":"2024-04-16T15:53:22.296722+0000","last_undegraded":"2024-04-16T15:53:22.296722+0000","last_fullsized":"2024-04-16T15:53:22.296722+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.277362+0000","last_change":"2024-04-16T15:53:18.204310+0000","last_active":"2024-04-16T15:53:20.277362+0000","last_peered":"2024-04-16T15:53:20.277362+0000","last_clean":"2024-04-16T15:53:20.277362+0000","last_became_active":"2024-04-16T15:53:18.204031+0000","last_became_peered":"2024-04-16T15:53:18.204031+0000","last_unstale":"2024-04-16T15:53:20.277362+0000","last_undegraded":"2024-04-16T15:53:20.277362+0000","last_fullsized":"2024-04-16T15:53:20.277362+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:20:16.994654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.194938+0000","last_change":"2024-04-16T15:53:19.218748+0000","last_active":"2024-04-16T15:53:20.194938+0000","last_peered":"2024-04-16T15:53:20.194938+0000","last_clean":"2024-04-16T15:53:20.194938+0000","last_became_active":"2024-04-16T15:53:19.218474+0000","last_became_peered":"2024-04-16T15:53:19.218474+0000","last_unstale":"2024-04-16T15:53:20.194938+0000","last_undegraded":"2024-04-16T15:53:20.194938+0000","last_fullsized":"2024-04-16T15:53:20.194938+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:47:53.262802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.195914+0000","last_change":"2024-04-16T15:53:18.204483+0000","last_active":"2024-04-16T15:53:20.195914+0000","last_peered":"2024-04-16T15:53:20.195914+0000","last_clean":"2024-04-16T15:53:20.195914+0000","last_became_active":"2024-04-16T15:53:18.203790+0000","last_became_peered":"2024-04-16T15:53:18.203790+0000","last_unstale":"2024-04-16T15:53:20.195914+0000","last_undegraded":"2024-04-16T15:53:20.195914+0000","last_fullsized":"2024-04-16T15:53:20.195914+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:49:24.686045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.197045+0000","last_change":"2024-04-16T15:53:19.218646+0000","last_active":"2024-04-16T15:53:20.197045+0000","last_peered":"2024-04-16T15:53:20.197045+0000","last_clean":"2024-04-16T15:53:20.197045+0000","last_became_active":"2024-04-16T15:53:19.218379+0000","last_became_peered":"2024-04-16T15:53:19.218379+0000","last_unstale":"2024-04-16T15:53:20.197045+0000","last_undegraded":"2024-04-16T15:53:20.197045+0000","last_fullsized":"2024-04-16T15:53:20.197045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:21:33.438988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.194988+0000","last_change":"2024-04-16T15:53:18.211846+0000","last_active":"2024-04-16T15:53:20.194988+0000","last_peered":"2024-04-16T15:53:20.194988+0000","last_clean":"2024-04-16T15:53:20.194988+0000","last_became_active":"2024-04-16T15:53:18.211604+0000","last_became_peered":"2024-04-16T15:53:18.211604+0000","last_unstale":"2024-04-16T15:53:20.194988+0000","last_undegraded":"2024-04-16T15:53:20.194988+0000","last_fullsized":"2024-04-16T15:53:20.194988+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:09:08.367141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196459+0000","last_change":"2024-04-16T15:53:19.213036+0000","last_active":"2024-04-16T15:53:20.196459+0000","last_peered":"2024-04-16T15:53:20.196459+0000","last_clean":"2024-04-16T15:53:20.196459+0000","last_became_active":"2024-04-16T15:53:19.212758+0000","last_became_peered":"2024-04-16T15:53:19.212758+0000","last_unstale":"2024-04-16T15:53:20.196459+0000","last_undegraded":"2024-04-16T15:53:20.196459+0000","last_fullsized":"2024-04-16T15:53:20.196459+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:18.183405+0000","last_clean_scrub_stamp":"2024-04-16T15:53:18.183405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:32:14.472011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.464513+0000","last_change":"2024-04-16T15:53:18.213907+0000","last_active":"2024-04-16T15:53:20.464513+0000","last_peered":"2024-04-16T15:53:20.464513+0000","last_clean":"2024-04-16T15:53:20.464513+0000","last_became_active":"2024-04-16T15:53:18.213572+0000","last_became_peered":"2024-04-16T15:53:18.213572+0000","last_unstale":"2024-04-16T15:53:20.464513+0000","last_undegraded":"2024-04-16T15:53:20.464513+0000","last_fullsized":"2024-04-16T15:53:20.464513+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:17.181152+0000","last_clean_scrub_stamp":"2024-04-16T15:53:17.181152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:08:37.253061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":196,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-16T15:53:20.196856+0000","last_change":"2024-04-16T15:52:04.356095+0000","last_active":"2024-04-16T15:53:20.196856+0000","last_peered":"2024-04-16T15:53:20.196856+0000","last_clean":"2024-04-16T15:53:20.196856+0000","last_became_active":"2024-04-16T15:52:04.355126+0000","last_became_peered":"2024-04-16T15:52:04.355126+0000","last_unstale":"2024-04-16T15:53:20.196856+0000","last_undegraded":"2024-04-16T15:53:20.196856+0000","last_fullsized":"2024-04-16T15:53:20.196856+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:52:03.285037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:52:03.285037+0000","last_clean_scrub_stamp":"2024-04-16T15:52:03.285037+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:19.005024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":983040,"data_stored":742389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":152547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31560,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340280,"statfs":{"total":96636764160,"available":96604446720,"internally_reserved":0,"allocated":393216,"data_stored":152603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":152035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":401408,"data_stored":153565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":152001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":401408,"data_stored":153565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":978944,"data_stored":742299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T15:53:35.484 INFO:tasks.ceph:pgid 5.3f last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.484 INFO:tasks.ceph:pgid 5.3e last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.485 INFO:tasks.ceph:pgid 5.3d last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.485 INFO:tasks.ceph:pgid 5.3c last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.485 INFO:tasks.ceph:pgid 5.3b last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.485 INFO:tasks.ceph:pgid 5.3a last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.485 INFO:tasks.ceph:pgid 5.39 last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.485 INFO:tasks.ceph:pgid 5.38 last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.486 INFO:tasks.ceph:pgid 5.37 last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.486 INFO:tasks.ceph:pgid 5.36 last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.486 INFO:tasks.ceph:pgid 5.35 last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.486 INFO:tasks.ceph:pgid 5.34 last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.486 INFO:tasks.ceph:pgid 5.33 last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.487 INFO:tasks.ceph:pgid 5.32 last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.487 INFO:tasks.ceph:pgid 5.31 last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.487 INFO:tasks.ceph:pgid 5.30 last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.487 INFO:tasks.ceph:pgid 5.2f last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.487 INFO:tasks.ceph:pgid 5.2e last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.487 INFO:tasks.ceph:pgid 5.2d last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.487 INFO:tasks.ceph:pgid 5.2c last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.488 INFO:tasks.ceph:pgid 5.2b last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.488 INFO:tasks.ceph:pgid 5.2a last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.488 INFO:tasks.ceph:pgid 5.29 last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.488 INFO:tasks.ceph:pgid 5.28 last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.488 INFO:tasks.ceph:pgid 5.27 last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.489 INFO:tasks.ceph:pgid 5.26 last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.489 INFO:tasks.ceph:pgid 5.25 last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.489 INFO:tasks.ceph:pgid 5.24 last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.489 INFO:tasks.ceph:pgid 5.23 last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.489 INFO:tasks.ceph:pgid 5.22 last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.489 INFO:tasks.ceph:pgid 5.21 last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.490 INFO:tasks.ceph:pgid 5.20 last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.490 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.490 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-16T15:53:17.181152+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=17, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.490 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.490 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-16T15:53:17.181152+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=17, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.491 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.491 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-16T15:53:17.181152+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=17, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.491 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.491 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-16T15:53:17.181152+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=17, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.491 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.491 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-16T15:53:17.181152+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=17, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.492 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.492 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-16T15:53:17.181152+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=17, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.492 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.492 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-16T15:53:17.181152+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=17, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.492 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.492 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-16T15:53:17.181152+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=17, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.493 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.493 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-16T15:53:17.181152+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=17, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.493 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.493 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-16T15:53:17.181152+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=17, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.493 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.493 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-16T15:53:17.181152+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=17, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.494 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.494 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-16T15:53:17.181152+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=17, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.494 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.494 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-16T15:53:17.181152+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=17, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.494 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.495 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-16T15:53:17.181152+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=17, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.495 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.495 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-16T15:53:17.181152+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=17, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.496 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.496 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-16T15:53:17.181152+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=17, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.496 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.497 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-16T15:53:17.181152+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=17, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.497 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.497 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-16T15:53:17.181152+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=17, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.498 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.498 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-16T15:53:17.181152+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=17, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.498 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.499 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-16T15:53:17.181152+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=17, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.499 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.499 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-16T15:53:17.181152+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=17, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.500 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.500 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-16T15:53:17.181152+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=17, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.500 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.501 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-16T15:53:17.181152+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=17, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.501 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.501 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-16T15:53:17.181152+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=17, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.502 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.502 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-16T15:53:17.181152+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=17, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.502 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.503 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-16T15:53:17.181152+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=17, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.503 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.503 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-16T15:53:17.181152+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=17, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.504 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.504 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-16T15:53:17.181152+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=17, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.505 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.505 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-16T15:53:17.181152+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=17, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.505 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.505 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-16T15:53:17.181152+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=17, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.506 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.506 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-16T15:53:17.181152+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=17, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.506 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-04-16T15:53:18.183405+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=18, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.507 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-16T15:53:17.181152+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=17, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.507 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-16T15:52:03.285037+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=52, tm_sec=3, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=53, tm_sec=30, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:53:35.507 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-16T15:53:35.879 INFO:tasks.ceph.mds.c.smithi132.stderr:2024-04-16T15:53:35.880+0000 7fc373da7640 -1 mds.0.openfiles _load_finish got (2) No such file or directory 2024-04-16T15:53:40.513 INFO:tasks.ceph.mds.c.smithi132.stderr:2024-04-16T15:53:40.514+0000 7fc377daf640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-16T15:53:41.110 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~20s 2024-04-16T15:53:44.940 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T15:53:44.943 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T15:53:47.722 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~26s 2024-04-16T15:53:54.334 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~33s 2024-04-16T15:53:55.508 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T15:53:55.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.624+0000 7f761a088640 1 Processor -- start 2024-04-16T15:53:55.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.624+0000 7f761a088640 1 -- start start 2024-04-16T15:53:55.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.625+0000 7f761a088640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7614144f50 0x7f76140b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:55.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.625+0000 7f761a088640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f761406f4b0 0x7f76140cd730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:55.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.625+0000 7f761a088640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76140cdd60 con 0x7f76140cd2a0 2024-04-16T15:53:55.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.625+0000 7f761a088640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f76140ce040 con 0x7f7614144f50 2024-04-16T15:53:55.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.625+0000 7f761a088640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f76140b3770 con 0x7f761406f4b0 2024-04-16T15:53:55.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.625+0000 7f76137fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7614144f50 0x7f76140b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:55.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.625+0000 7f76137fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7614144f50 0x7f76140b4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38724/0 (socket says 172.21.15.132:38724) 2024-04-16T15:53:55.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.625+0000 7f7612ffd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f76140cd2a0 0x7f761406eda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43314/0 (socket says 172.21.15.132:43314) 2024-04-16T15:53:55.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.625+0000 7f76137fe640 1 -- 172.21.15.132:0/2171989901 learned_addr learned my addr 172.21.15.132:0/2171989901 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:55.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.625+0000 7f7613fff640 1 --2- 172.21.15.132:0/2171989901 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f761406f4b0 0x7f76140cd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:55.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.625+0000 7f76137fe640 1 -- 172.21.15.132:0/2171989901 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f761406f4b0 msgr2=0x7f76140cd730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:55.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.626+0000 7f76137fe640 1 --2- 172.21.15.132:0/2171989901 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f761406f4b0 0x7f76140cd730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:55.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.626+0000 7f76137fe640 1 -- 172.21.15.132:0/2171989901 >> v1:172.21.15.132:6789/0 conn(0x7f76140cd2a0 legacy=0x7f761406eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:55.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.626+0000 7f76127fc640 1 -- 172.21.15.132:0/2171989901 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 621366164 0 0) 0x7f76140cdd60 con 0x7f76140cd2a0 2024-04-16T15:53:55.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.626+0000 7f76137fe640 1 -- 172.21.15.132:0/2171989901 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76140b3a50 con 0x7f7614144f50 2024-04-16T15:53:55.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.626+0000 7f7613fff640 1 --2- 172.21.15.132:0/2171989901 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f761406f4b0 0x7f76140cd730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:53:55.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.626+0000 7f76137fe640 1 --2- 172.21.15.132:0/2171989901 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7614144f50 0x7f76140b4250 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f7604009870 tx=0x7f760402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1a15cbb8b1c17ce server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:55.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.626+0000 7f76127fc640 1 -- 172.21.15.132:0/2171989901 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7604035020 con 0x7f7614144f50 2024-04-16T15:53:55.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.626+0000 7f76127fc640 1 -- 172.21.15.132:0/2171989901 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7604031640 con 0x7f7614144f50 2024-04-16T15:53:55.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.627+0000 7f76127fc640 1 -- 172.21.15.132:0/2171989901 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f760402d040 con 0x7f7614144f50 2024-04-16T15:53:55.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.627+0000 7f761a088640 1 -- 172.21.15.132:0/2171989901 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7614144f50 msgr2=0x7f76140b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:55.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.627+0000 7f761a088640 1 --2- 172.21.15.132:0/2171989901 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7614144f50 0x7f76140b4250 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f7604009870 tx=0x7f760402b8f0 comp rx=0 tx=0).stop 2024-04-16T15:53:55.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.627+0000 7f761a088640 1 -- 172.21.15.132:0/2171989901 shutdown_connections 2024-04-16T15:53:55.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.627+0000 7f761a088640 1 --2- 172.21.15.132:0/2171989901 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f761406f4b0 0x7f76140cd730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:55.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.627+0000 7f761a088640 1 --2- 172.21.15.132:0/2171989901 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7614144f50 0x7f76140b4250 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:55.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.627+0000 7f761a088640 1 -- 172.21.15.132:0/2171989901 >> 172.21.15.132:0/2171989901 conn(0x7f76140b2d50 msgr2=0x7f761406ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:55.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.627+0000 7f761a088640 1 -- 172.21.15.132:0/2171989901 shutdown_connections 2024-04-16T15:53:55.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.627+0000 7f761a088640 1 -- 172.21.15.132:0/2171989901 wait complete. 2024-04-16T15:53:55.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.628+0000 7f761a088640 1 Processor -- start 2024-04-16T15:53:55.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.629+0000 7f761a088640 1 -- start start 2024-04-16T15:53:55.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.629+0000 7f761a088640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f761406f4b0 0x7f761415b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:55.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.629+0000 7f761a088640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76140cd2a0 0x7f76140aeae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:55.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.629+0000 7f761a088640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7614144f50 0x7f76140af020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:55.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.629+0000 7f761a088640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f7614145330 con 0x7f761406f4b0 2024-04-16T15:53:55.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.629+0000 7f761a088640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f76140afda0 con 0x7f76140cd2a0 2024-04-16T15:53:55.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.629+0000 7f761a088640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f76140b4c60 con 0x7f7614144f50 2024-04-16T15:53:55.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.629+0000 7f76137fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f761406f4b0 0x7f761415b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:55.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.629+0000 7f76137fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f761406f4b0 0x7f761415b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38732/0 (socket says 172.21.15.132:38732) 2024-04-16T15:53:55.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.629+0000 7f76137fe640 1 -- 172.21.15.132:0/1321525982 learned_addr learned my addr 172.21.15.132:0/1321525982 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:55.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.630+0000 7f7613fff640 1 --2- 172.21.15.132:0/1321525982 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7614144f50 0x7f76140af020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:55.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.630+0000 7f7612ffd640 1 --2- 172.21.15.132:0/1321525982 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76140cd2a0 0x7f76140aeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:55.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.630+0000 7f76137fe640 1 -- 172.21.15.132:0/1321525982 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7614144f50 msgr2=0x7f76140af020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:55.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.630+0000 7f76137fe640 1 --2- 172.21.15.132:0/1321525982 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7614144f50 0x7f76140af020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:55.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.630+0000 7f76137fe640 1 -- 172.21.15.132:0/1321525982 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76140cd2a0 msgr2=0x7f76140aeae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:55.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.630+0000 7f76137fe640 1 --2- 172.21.15.132:0/1321525982 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76140cd2a0 0x7f76140aeae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:55.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.630+0000 7f76137fe640 1 -- 172.21.15.132:0/1321525982 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76140adbc0 con 0x7f761406f4b0 2024-04-16T15:53:55.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.630+0000 7f7612ffd640 1 --2- 172.21.15.132:0/1321525982 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76140cd2a0 0x7f76140aeae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:53:55.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.630+0000 7f76137fe640 1 --2- 172.21.15.132:0/1321525982 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f761406f4b0 0x7f761415b110 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f7604000c00 tx=0x7f76040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:55.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.630+0000 7f75fbfff640 1 -- 172.21.15.132:0/1321525982 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7604040070 con 0x7f761406f4b0 2024-04-16T15:53:55.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.630+0000 7f75fbfff640 1 -- 172.21.15.132:0/1321525982 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76040399f0 con 0x7f761406f4b0 2024-04-16T15:53:55.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.630+0000 7f75fbfff640 1 -- 172.21.15.132:0/1321525982 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7604035040 con 0x7f761406f4b0 2024-04-16T15:53:55.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.630+0000 7f761a088640 1 -- 172.21.15.132:0/1321525982 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76140adea0 con 0x7f761406f4b0 2024-04-16T15:53:55.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.630+0000 7f761a088640 1 -- 172.21.15.132:0/1321525982 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76140c5890 con 0x7f761406f4b0 2024-04-16T15:53:55.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.631+0000 7f761a088640 1 -- 172.21.15.132:0/1321525982 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7614075510 con 0x7f761406f4b0 2024-04-16T15:53:55.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.632+0000 7f75fbfff640 1 -- 172.21.15.132:0/1321525982 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f760404b060 con 0x7f761406f4b0 2024-04-16T15:53:55.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.632+0000 7f75fbfff640 1 --2- 172.21.15.132:0/1321525982 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f760006c8f0 0x7f760006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:55.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.632+0000 7f75fbfff640 1 -- 172.21.15.132:0/1321525982 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5795+0+0 (secure 0 0 0) 0x7f76040ad3e0 con 0x7f761406f4b0 2024-04-16T15:53:55.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.632+0000 7f7612ffd640 1 --2- 172.21.15.132:0/1321525982 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f760006c8f0 0x7f760006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:55.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.633+0000 7f7612ffd640 1 --2- 172.21.15.132:0/1321525982 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f760006c8f0 0x7f760006edb0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f76140b6af0 tx=0x7f7608009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:55.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.637+0000 7f75fbfff640 1 -- 172.21.15.132:0/1321525982 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f760407b840 con 0x7f761406f4b0 2024-04-16T15:53:55.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.809+0000 7f761a088640 1 -- 172.21.15.132:0/1321525982 --> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f76140b1db0 con 0x7f760006c8f0 2024-04-16T15:53:55.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.814+0000 7f75fbfff640 1 -- 172.21.15.132:0/1321525982 <== mgr.4101 v2:172.21.15.132:6832/3896387465 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251910 (secure 0 0 0) 0x7f76140b1db0 con 0x7f760006c8f0 2024-04-16T15:53:55.817 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:53:55.818 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2024-04-16T15:53:55.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.818+0000 7f761a088640 1 -- 172.21.15.132:0/1321525982 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f760006c8f0 msgr2=0x7f760006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:55.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.818+0000 7f761a088640 1 --2- 172.21.15.132:0/1321525982 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f760006c8f0 0x7f760006edb0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f76140b6af0 tx=0x7f7608009040 comp rx=0 tx=0).stop 2024-04-16T15:53:55.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.818+0000 7f761a088640 1 -- 172.21.15.132:0/1321525982 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f761406f4b0 msgr2=0x7f761415b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:55.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.818+0000 7f761a088640 1 --2- 172.21.15.132:0/1321525982 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f761406f4b0 0x7f761415b110 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f7604000c00 tx=0x7f76040046c0 comp rx=0 tx=0).stop 2024-04-16T15:53:55.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.818+0000 7f761a088640 1 -- 172.21.15.132:0/1321525982 shutdown_connections 2024-04-16T15:53:55.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.818+0000 7f761a088640 1 --2- 172.21.15.132:0/1321525982 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f760006c8f0 0x7f760006edb0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:55.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.818+0000 7f761a088640 1 --2- 172.21.15.132:0/1321525982 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7614144f50 0x7f76140af020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:55.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.818+0000 7f761a088640 1 --2- 172.21.15.132:0/1321525982 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76140cd2a0 0x7f76140aeae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:55.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.818+0000 7f761a088640 1 --2- 172.21.15.132:0/1321525982 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f761406f4b0 0x7f761415b110 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:55.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.818+0000 7f761a088640 1 -- 172.21.15.132:0/1321525982 >> 172.21.15.132:0/1321525982 conn(0x7f76140b2d50 msgr2=0x7f761415de90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:55.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.818+0000 7f761a088640 1 -- 172.21.15.132:0/1321525982 shutdown_connections 2024-04-16T15:53:55.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.818+0000 7f761a088640 1 -- 172.21.15.132:0/1321525982 wait complete. 2024-04-16T15:53:55.828 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2024-04-16T15:53:55.289620+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":193,"num_read_kb":180,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":164,"ondisk_log_size":164,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224616,"kb_used_data":4328,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750104,"statfs":{"total":773094113280,"available":772864106496,"internally_reserved":0,"allocated":4431872,"data_stored":2449652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002943"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:42.384690+0000","last_change":"2024-04-16T15:53:42.384716+0000","last_active":"2024-04-16T15:53:42.384690+0000","last_peered":"2024-04-16T15:53:42.384690+0000","last_clean":"2024-04-16T15:53:42.384690+0000","last_became_active":"2024-04-16T15:53:19.219026+0000","last_became_peered":"2024-04-16T15:53:19.219026+0000","last_unstale":"2024-04-16T15:53:42.384690+0000","last_undegraded":"2024-04-16T15:53:42.384690+0000","last_fullsized":"2024-04-16T15:53:42.384690+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:42.384595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:42.384595+0000","last_clean_scrub_stamp":"2024-04-16T15:53:42.384595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:15:55.743681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:49.466755+0000","last_change":"2024-04-16T15:53:49.466782+0000","last_active":"2024-04-16T15:53:49.466755+0000","last_peered":"2024-04-16T15:53:49.466755+0000","last_clean":"2024-04-16T15:53:49.466755+0000","last_became_active":"2024-04-16T15:53:19.225869+0000","last_became_peered":"2024-04-16T15:53:19.225869+0000","last_unstale":"2024-04-16T15:53:49.466755+0000","last_undegraded":"2024-04-16T15:53:49.466755+0000","last_fullsized":"2024-04-16T15:53:49.466755+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:49.466660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:49.466660+0000","last_clean_scrub_stamp":"2024-04-16T15:53:49.466660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:29:33.275251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:40.648699+0000","last_change":"2024-04-16T15:53:40.648718+0000","last_active":"2024-04-16T15:53:40.648699+0000","last_peered":"2024-04-16T15:53:40.648699+0000","last_clean":"2024-04-16T15:53:40.648699+0000","last_became_active":"2024-04-16T15:53:19.209186+0000","last_became_peered":"2024-04-16T15:53:19.209186+0000","last_unstale":"2024-04-16T15:53:40.648699+0000","last_undegraded":"2024-04-16T15:53:40.648699+0000","last_fullsized":"2024-04-16T15:53:40.648699+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:40.648630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:40.648630+0000","last_clean_scrub_stamp":"2024-04-16T15:53:40.648630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:18:20.348103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:40.558306+0000","last_change":"2024-04-16T15:53:40.558330+0000","last_active":"2024-04-16T15:53:40.558306+0000","last_peered":"2024-04-16T15:53:40.558306+0000","last_clean":"2024-04-16T15:53:40.558306+0000","last_became_active":"2024-04-16T15:53:19.214414+0000","last_became_peered":"2024-04-16T15:53:19.214414+0000","last_unstale":"2024-04-16T15:53:40.558306+0000","last_undegraded":"2024-04-16T15:53:40.558306+0000","last_fullsized":"2024-04-16T15:53:40.558306+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:40.558181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:40.558181+0000","last_clean_scrub_stamp":"2024-04-16T15:53:40.558181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:23:07.303070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:40.910336+0000","last_change":"2024-04-16T15:53:40.910374+0000","last_active":"2024-04-16T15:53:40.910336+0000","last_peered":"2024-04-16T15:53:40.910336+0000","last_clean":"2024-04-16T15:53:40.910336+0000","last_became_active":"2024-04-16T15:53:19.217808+0000","last_became_peered":"2024-04-16T15:53:19.217808+0000","last_unstale":"2024-04-16T15:53:40.910336+0000","last_undegraded":"2024-04-16T15:53:40.910336+0000","last_fullsized":"2024-04-16T15:53:40.910336+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:40.910223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:40.910223+0000","last_clean_scrub_stamp":"2024-04-16T15:53:40.910223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:40:22.801122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:41.358283+0000","last_change":"2024-04-16T15:53:41.358312+0000","last_active":"2024-04-16T15:53:41.358283+0000","last_peered":"2024-04-16T15:53:41.358283+0000","last_clean":"2024-04-16T15:53:41.358283+0000","last_became_active":"2024-04-16T15:53:19.213980+0000","last_became_peered":"2024-04-16T15:53:19.213980+0000","last_unstale":"2024-04-16T15:53:41.358283+0000","last_undegraded":"2024-04-16T15:53:41.358283+0000","last_fullsized":"2024-04-16T15:53:41.358283+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:41.358181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:41.358181+0000","last_clean_scrub_stamp":"2024-04-16T15:53:41.358181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:00:44.295249+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:45.107782+0000","last_change":"2024-04-16T15:53:45.107807+0000","last_active":"2024-04-16T15:53:45.107782+0000","last_peered":"2024-04-16T15:53:45.107782+0000","last_clean":"2024-04-16T15:53:45.107782+0000","last_became_active":"2024-04-16T15:53:19.221101+0000","last_became_peered":"2024-04-16T15:53:19.221101+0000","last_unstale":"2024-04-16T15:53:45.107782+0000","last_undegraded":"2024-04-16T15:53:45.107782+0000","last_fullsized":"2024-04-16T15:53:45.107782+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:45.107684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:45.107684+0000","last_clean_scrub_stamp":"2024-04-16T15:53:45.107684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:50:41.450349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:39.145068+0000","last_change":"2024-04-16T15:53:39.145091+0000","last_active":"2024-04-16T15:53:39.145068+0000","last_peered":"2024-04-16T15:53:39.145068+0000","last_clean":"2024-04-16T15:53:39.145068+0000","last_became_active":"2024-04-16T15:53:19.213544+0000","last_became_peered":"2024-04-16T15:53:19.213544+0000","last_unstale":"2024-04-16T15:53:39.145068+0000","last_undegraded":"2024-04-16T15:53:39.145068+0000","last_fullsized":"2024-04-16T15:53:39.145068+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:39.144976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:39.144976+0000","last_clean_scrub_stamp":"2024-04-16T15:53:39.144976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:24:50.137188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:45.598500+0000","last_change":"2024-04-16T15:53:45.598539+0000","last_active":"2024-04-16T15:53:45.598500+0000","last_peered":"2024-04-16T15:53:45.598500+0000","last_clean":"2024-04-16T15:53:45.598500+0000","last_became_active":"2024-04-16T15:53:19.206972+0000","last_became_peered":"2024-04-16T15:53:19.206972+0000","last_unstale":"2024-04-16T15:53:45.598500+0000","last_undegraded":"2024-04-16T15:53:45.598500+0000","last_fullsized":"2024-04-16T15:53:45.598500+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:45.598366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:45.598366+0000","last_clean_scrub_stamp":"2024-04-16T15:53:45.598366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:35:23.753368+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:43.567136+0000","last_change":"2024-04-16T15:53:43.567185+0000","last_active":"2024-04-16T15:53:43.567136+0000","last_peered":"2024-04-16T15:53:43.567136+0000","last_clean":"2024-04-16T15:53:43.567136+0000","last_became_active":"2024-04-16T15:53:19.215441+0000","last_became_peered":"2024-04-16T15:53:19.215441+0000","last_unstale":"2024-04-16T15:53:43.567136+0000","last_undegraded":"2024-04-16T15:53:43.567136+0000","last_fullsized":"2024-04-16T15:53:43.567136+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:43.567023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:43.567023+0000","last_clean_scrub_stamp":"2024-04-16T15:53:43.567023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:18:41.112706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:43.191869+0000","last_change":"2024-04-16T15:53:43.191916+0000","last_active":"2024-04-16T15:53:43.191869+0000","last_peered":"2024-04-16T15:53:43.191869+0000","last_clean":"2024-04-16T15:53:43.191869+0000","last_became_active":"2024-04-16T15:53:19.219142+0000","last_became_peered":"2024-04-16T15:53:19.219142+0000","last_unstale":"2024-04-16T15:53:43.191869+0000","last_undegraded":"2024-04-16T15:53:43.191869+0000","last_fullsized":"2024-04-16T15:53:43.191869+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:43.191761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:43.191761+0000","last_clean_scrub_stamp":"2024-04-16T15:53:43.191761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:34:17.151946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:43.648863+0000","last_change":"2024-04-16T15:53:43.648890+0000","last_active":"2024-04-16T15:53:43.648863+0000","last_peered":"2024-04-16T15:53:43.648863+0000","last_clean":"2024-04-16T15:53:43.648863+0000","last_became_active":"2024-04-16T15:53:19.215574+0000","last_became_peered":"2024-04-16T15:53:19.215574+0000","last_unstale":"2024-04-16T15:53:43.648863+0000","last_undegraded":"2024-04-16T15:53:43.648863+0000","last_fullsized":"2024-04-16T15:53:43.648863+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:43.648761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:43.648761+0000","last_clean_scrub_stamp":"2024-04-16T15:53:43.648761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:50:39.991425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:41.884862+0000","last_change":"2024-04-16T15:53:41.884890+0000","last_active":"2024-04-16T15:53:41.884862+0000","last_peered":"2024-04-16T15:53:41.884862+0000","last_clean":"2024-04-16T15:53:41.884862+0000","last_became_active":"2024-04-16T15:53:19.218503+0000","last_became_peered":"2024-04-16T15:53:19.218503+0000","last_unstale":"2024-04-16T15:53:41.884862+0000","last_undegraded":"2024-04-16T15:53:41.884862+0000","last_fullsized":"2024-04-16T15:53:41.884862+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:41.884754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:41.884754+0000","last_clean_scrub_stamp":"2024-04-16T15:53:41.884754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:09:36.145486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:35.883259+0000","last_change":"2024-04-16T15:53:33.426273+0000","last_active":"2024-04-16T15:53:35.883259+0000","last_peered":"2024-04-16T15:53:35.883259+0000","last_clean":"2024-04-16T15:53:35.883259+0000","last_became_active":"2024-04-16T15:53:19.214539+0000","last_became_peered":"2024-04-16T15:53:19.214539+0000","last_unstale":"2024-04-16T15:53:35.883259+0000","last_undegraded":"2024-04-16T15:53:35.883259+0000","last_fullsized":"2024-04-16T15:53:35.883259+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:33.426179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:33.426179+0000","last_clean_scrub_stamp":"2024-04-16T15:53:33.426179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:28:38.878253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:41.639063+0000","last_change":"2024-04-16T15:53:41.639088+0000","last_active":"2024-04-16T15:53:41.639063+0000","last_peered":"2024-04-16T15:53:41.639063+0000","last_clean":"2024-04-16T15:53:41.639063+0000","last_became_active":"2024-04-16T15:53:19.215064+0000","last_became_peered":"2024-04-16T15:53:19.215064+0000","last_unstale":"2024-04-16T15:53:41.639063+0000","last_undegraded":"2024-04-16T15:53:41.639063+0000","last_fullsized":"2024-04-16T15:53:41.639063+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:41.638985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:41.638985+0000","last_clean_scrub_stamp":"2024-04-16T15:53:41.638985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:34:15.599170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:47.107609+0000","last_change":"2024-04-16T15:53:47.107635+0000","last_active":"2024-04-16T15:53:47.107609+0000","last_peered":"2024-04-16T15:53:47.107609+0000","last_clean":"2024-04-16T15:53:47.107609+0000","last_became_active":"2024-04-16T15:53:19.226349+0000","last_became_peered":"2024-04-16T15:53:19.226349+0000","last_unstale":"2024-04-16T15:53:47.107609+0000","last_undegraded":"2024-04-16T15:53:47.107609+0000","last_fullsized":"2024-04-16T15:53:47.107609+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:47.107516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:47.107516+0000","last_clean_scrub_stamp":"2024-04-16T15:53:47.107516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:20:33.135609+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:46.068626+0000","last_change":"2024-04-16T15:53:46.068651+0000","last_active":"2024-04-16T15:53:46.068626+0000","last_peered":"2024-04-16T15:53:46.068626+0000","last_clean":"2024-04-16T15:53:46.068626+0000","last_became_active":"2024-04-16T15:53:19.222235+0000","last_became_peered":"2024-04-16T15:53:19.222235+0000","last_unstale":"2024-04-16T15:53:46.068626+0000","last_undegraded":"2024-04-16T15:53:46.068626+0000","last_fullsized":"2024-04-16T15:53:46.068626+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:46.068539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:46.068539+0000","last_clean_scrub_stamp":"2024-04-16T15:53:46.068539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:23:25.487383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:44.451903+0000","last_change":"2024-04-16T15:53:44.451941+0000","last_active":"2024-04-16T15:53:44.451903+0000","last_peered":"2024-04-16T15:53:44.451903+0000","last_clean":"2024-04-16T15:53:44.451903+0000","last_became_active":"2024-04-16T15:53:19.217745+0000","last_became_peered":"2024-04-16T15:53:19.217745+0000","last_unstale":"2024-04-16T15:53:44.451903+0000","last_undegraded":"2024-04-16T15:53:44.451903+0000","last_fullsized":"2024-04-16T15:53:44.451903+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:44.451799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:44.451799+0000","last_clean_scrub_stamp":"2024-04-16T15:53:44.451799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:21:56.481719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:43.440465+0000","last_change":"2024-04-16T15:53:43.440509+0000","last_active":"2024-04-16T15:53:43.440465+0000","last_peered":"2024-04-16T15:53:43.440465+0000","last_clean":"2024-04-16T15:53:43.440465+0000","last_became_active":"2024-04-16T15:53:19.217373+0000","last_became_peered":"2024-04-16T15:53:19.217373+0000","last_unstale":"2024-04-16T15:53:43.440465+0000","last_undegraded":"2024-04-16T15:53:43.440465+0000","last_fullsized":"2024-04-16T15:53:43.440465+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:43.440351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:43.440351+0000","last_clean_scrub_stamp":"2024-04-16T15:53:43.440351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:12:53.142081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:37.932524+0000","last_change":"2024-04-16T15:53:37.932554+0000","last_active":"2024-04-16T15:53:37.932524+0000","last_peered":"2024-04-16T15:53:37.932524+0000","last_clean":"2024-04-16T15:53:37.932524+0000","last_became_active":"2024-04-16T15:53:19.210812+0000","last_became_peered":"2024-04-16T15:53:19.210812+0000","last_unstale":"2024-04-16T15:53:37.932524+0000","last_undegraded":"2024-04-16T15:53:37.932524+0000","last_fullsized":"2024-04-16T15:53:37.932524+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:37.932427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:37.932427+0000","last_clean_scrub_stamp":"2024-04-16T15:53:37.932427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:38:32.551292+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:43.635443+0000","last_change":"2024-04-16T15:53:43.635467+0000","last_active":"2024-04-16T15:53:43.635443+0000","last_peered":"2024-04-16T15:53:43.635443+0000","last_clean":"2024-04-16T15:53:43.635443+0000","last_became_active":"2024-04-16T15:53:19.199066+0000","last_became_peered":"2024-04-16T15:53:19.199066+0000","last_unstale":"2024-04-16T15:53:43.635443+0000","last_undegraded":"2024-04-16T15:53:43.635443+0000","last_fullsized":"2024-04-16T15:53:43.635443+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:43.635351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:43.635351+0000","last_clean_scrub_stamp":"2024-04-16T15:53:43.635351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:23:10.380239+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:50.480524+0000","last_change":"2024-04-16T15:53:50.480550+0000","last_active":"2024-04-16T15:53:50.480524+0000","last_peered":"2024-04-16T15:53:50.480524+0000","last_clean":"2024-04-16T15:53:50.480524+0000","last_became_active":"2024-04-16T15:53:19.219150+0000","last_became_peered":"2024-04-16T15:53:19.219150+0000","last_unstale":"2024-04-16T15:53:50.480524+0000","last_undegraded":"2024-04-16T15:53:50.480524+0000","last_fullsized":"2024-04-16T15:53:50.480524+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:50.480370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:50.480370+0000","last_clean_scrub_stamp":"2024-04-16T15:53:50.480370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:53:17.969307+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:38.580758+0000","last_change":"2024-04-16T15:53:38.580817+0000","last_active":"2024-04-16T15:53:38.580758+0000","last_peered":"2024-04-16T15:53:38.580758+0000","last_clean":"2024-04-16T15:53:38.580758+0000","last_became_active":"2024-04-16T15:53:19.211260+0000","last_became_peered":"2024-04-16T15:53:19.211260+0000","last_unstale":"2024-04-16T15:53:38.580758+0000","last_undegraded":"2024-04-16T15:53:38.580758+0000","last_fullsized":"2024-04-16T15:53:38.580758+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:38.580638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:38.580638+0000","last_clean_scrub_stamp":"2024-04-16T15:53:38.580638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:26:37.641408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:39.648479+0000","last_change":"2024-04-16T15:53:39.648499+0000","last_active":"2024-04-16T15:53:39.648479+0000","last_peered":"2024-04-16T15:53:39.648479+0000","last_clean":"2024-04-16T15:53:39.648479+0000","last_became_active":"2024-04-16T15:53:19.204086+0000","last_became_peered":"2024-04-16T15:53:19.204086+0000","last_unstale":"2024-04-16T15:53:39.648479+0000","last_undegraded":"2024-04-16T15:53:39.648479+0000","last_fullsized":"2024-04-16T15:53:39.648479+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:39.648393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:39.648393+0000","last_clean_scrub_stamp":"2024-04-16T15:53:39.648393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:06:38.591726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:38.597819+0000","last_change":"2024-04-16T15:53:38.597839+0000","last_active":"2024-04-16T15:53:38.597819+0000","last_peered":"2024-04-16T15:53:38.597819+0000","last_clean":"2024-04-16T15:53:38.597819+0000","last_became_active":"2024-04-16T15:53:19.214199+0000","last_became_peered":"2024-04-16T15:53:19.214199+0000","last_unstale":"2024-04-16T15:53:38.597819+0000","last_undegraded":"2024-04-16T15:53:38.597819+0000","last_fullsized":"2024-04-16T15:53:38.597819+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:38.597715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:38.597715+0000","last_clean_scrub_stamp":"2024-04-16T15:53:38.597715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:03:03.995654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:48.456585+0000","last_change":"2024-04-16T15:53:48.456634+0000","last_active":"2024-04-16T15:53:48.456585+0000","last_peered":"2024-04-16T15:53:48.456585+0000","last_clean":"2024-04-16T15:53:48.456585+0000","last_became_active":"2024-04-16T15:53:19.223467+0000","last_became_peered":"2024-04-16T15:53:19.223467+0000","last_unstale":"2024-04-16T15:53:48.456585+0000","last_undegraded":"2024-04-16T15:53:48.456585+0000","last_fullsized":"2024-04-16T15:53:48.456585+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:48.456481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:48.456481+0000","last_clean_scrub_stamp":"2024-04-16T15:53:48.456481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:24:32.045596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:42.584023+0000","last_change":"2024-04-16T15:53:42.584051+0000","last_active":"2024-04-16T15:53:42.584023+0000","last_peered":"2024-04-16T15:53:42.584023+0000","last_clean":"2024-04-16T15:53:42.584023+0000","last_became_active":"2024-04-16T15:53:19.214786+0000","last_became_peered":"2024-04-16T15:53:19.214786+0000","last_unstale":"2024-04-16T15:53:42.584023+0000","last_undegraded":"2024-04-16T15:53:42.584023+0000","last_fullsized":"2024-04-16T15:53:42.584023+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:42.583917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:42.583917+0000","last_clean_scrub_stamp":"2024-04-16T15:53:42.583917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:35:20.738919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:36.674988+0000","last_change":"2024-04-16T15:53:36.675010+0000","last_active":"2024-04-16T15:53:36.674988+0000","last_peered":"2024-04-16T15:53:36.674988+0000","last_clean":"2024-04-16T15:53:36.674988+0000","last_became_active":"2024-04-16T15:53:19.199270+0000","last_became_peered":"2024-04-16T15:53:19.199270+0000","last_unstale":"2024-04-16T15:53:36.674988+0000","last_undegraded":"2024-04-16T15:53:36.674988+0000","last_fullsized":"2024-04-16T15:53:36.674988+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:36.674891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:36.674891+0000","last_clean_scrub_stamp":"2024-04-16T15:53:36.674891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:23:03.419780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:48.521253+0000","last_change":"2024-04-16T15:53:48.521278+0000","last_active":"2024-04-16T15:53:48.521253+0000","last_peered":"2024-04-16T15:53:48.521253+0000","last_clean":"2024-04-16T15:53:48.521253+0000","last_became_active":"2024-04-16T15:53:19.217749+0000","last_became_peered":"2024-04-16T15:53:19.217749+0000","last_unstale":"2024-04-16T15:53:48.521253+0000","last_undegraded":"2024-04-16T15:53:48.521253+0000","last_fullsized":"2024-04-16T15:53:48.521253+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:48.521150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:48.521150+0000","last_clean_scrub_stamp":"2024-04-16T15:53:48.521150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:34:22.481334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:41.175774+0000","last_change":"2024-04-16T15:53:41.175803+0000","last_active":"2024-04-16T15:53:41.175774+0000","last_peered":"2024-04-16T15:53:41.175774+0000","last_clean":"2024-04-16T15:53:41.175774+0000","last_became_active":"2024-04-16T15:53:19.215243+0000","last_became_peered":"2024-04-16T15:53:19.215243+0000","last_unstale":"2024-04-16T15:53:41.175774+0000","last_undegraded":"2024-04-16T15:53:41.175774+0000","last_fullsized":"2024-04-16T15:53:41.175774+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:41.175692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:41.175692+0000","last_clean_scrub_stamp":"2024-04-16T15:53:41.175692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:06:40.119025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:40.442014+0000","last_change":"2024-04-16T15:53:40.442036+0000","last_active":"2024-04-16T15:53:40.442014+0000","last_peered":"2024-04-16T15:53:40.442014+0000","last_clean":"2024-04-16T15:53:40.442014+0000","last_became_active":"2024-04-16T15:53:19.213345+0000","last_became_peered":"2024-04-16T15:53:19.213345+0000","last_unstale":"2024-04-16T15:53:40.442014+0000","last_undegraded":"2024-04-16T15:53:40.442014+0000","last_fullsized":"2024-04-16T15:53:40.442014+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:40.441933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:40.441933+0000","last_clean_scrub_stamp":"2024-04-16T15:53:40.441933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:20:09.418816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:37.131832+0000","last_change":"2024-04-16T15:53:37.131873+0000","last_active":"2024-04-16T15:53:37.131832+0000","last_peered":"2024-04-16T15:53:37.131832+0000","last_clean":"2024-04-16T15:53:37.131832+0000","last_became_active":"2024-04-16T15:53:19.212198+0000","last_became_peered":"2024-04-16T15:53:19.212198+0000","last_unstale":"2024-04-16T15:53:37.131832+0000","last_undegraded":"2024-04-16T15:53:37.131832+0000","last_fullsized":"2024-04-16T15:53:37.131832+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:37.131715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:37.131715+0000","last_clean_scrub_stamp":"2024-04-16T15:53:37.131715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:07:12.690614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:39.568216+0000","last_change":"2024-04-16T15:53:39.568239+0000","last_active":"2024-04-16T15:53:39.568216+0000","last_peered":"2024-04-16T15:53:39.568216+0000","last_clean":"2024-04-16T15:53:39.568216+0000","last_became_active":"2024-04-16T15:53:19.211902+0000","last_became_peered":"2024-04-16T15:53:19.211902+0000","last_unstale":"2024-04-16T15:53:39.568216+0000","last_undegraded":"2024-04-16T15:53:39.568216+0000","last_fullsized":"2024-04-16T15:53:39.568216+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:39.568134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:39.568134+0000","last_clean_scrub_stamp":"2024-04-16T15:53:39.568134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:00:35.371241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"35'5","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:36.560240+0000","last_change":"2024-04-16T15:53:36.560240+0000","last_active":"2024-04-16T15:53:36.560240+0000","last_peered":"2024-04-16T15:53:36.560240+0000","last_clean":"2024-04-16T15:53:36.560240+0000","last_became_active":"2024-04-16T15:53:18.210466+0000","last_became_peered":"2024-04-16T15:53:18.210466+0000","last_unstale":"2024-04-16T15:53:36.560240+0000","last_undegraded":"2024-04-16T15:53:36.560240+0000","last_fullsized":"2024-04-16T15:53:36.560240+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2024-04-16T15:53:36.560107+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2024-04-16T15:53:36.560107+0000","last_clean_scrub_stamp":"2024-04-16T15:53:36.560107+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:25:11.261972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:41.426663+0000","last_change":"2024-04-16T15:53:41.426685+0000","last_active":"2024-04-16T15:53:41.426663+0000","last_peered":"2024-04-16T15:53:41.426663+0000","last_clean":"2024-04-16T15:53:41.426663+0000","last_became_active":"2024-04-16T15:53:19.214206+0000","last_became_peered":"2024-04-16T15:53:19.214206+0000","last_unstale":"2024-04-16T15:53:41.426663+0000","last_undegraded":"2024-04-16T15:53:41.426663+0000","last_fullsized":"2024-04-16T15:53:41.426663+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:41.426586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:41.426586+0000","last_clean_scrub_stamp":"2024-04-16T15:53:41.426586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:00:37.229694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"35'2","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:36.587539+0000","last_change":"2024-04-16T15:53:36.587564+0000","last_active":"2024-04-16T15:53:36.587539+0000","last_peered":"2024-04-16T15:53:36.587539+0000","last_clean":"2024-04-16T15:53:36.587539+0000","last_became_active":"2024-04-16T15:53:18.213368+0000","last_became_peered":"2024-04-16T15:53:18.213368+0000","last_unstale":"2024-04-16T15:53:36.587539+0000","last_undegraded":"2024-04-16T15:53:36.587539+0000","last_fullsized":"2024-04-16T15:53:36.587539+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-16T15:53:36.587459+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-16T15:53:36.587459+0000","last_clean_scrub_stamp":"2024-04-16T15:53:36.587459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:40:18.478358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:47.552846+0000","last_change":"2024-04-16T15:53:47.552890+0000","last_active":"2024-04-16T15:53:47.552846+0000","last_peered":"2024-04-16T15:53:47.552846+0000","last_clean":"2024-04-16T15:53:47.552846+0000","last_became_active":"2024-04-16T15:53:19.217659+0000","last_became_peered":"2024-04-16T15:53:19.217659+0000","last_unstale":"2024-04-16T15:53:47.552846+0000","last_undegraded":"2024-04-16T15:53:47.552846+0000","last_fullsized":"2024-04-16T15:53:47.552846+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:47.552727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:47.552727+0000","last_clean_scrub_stamp":"2024-04-16T15:53:47.552727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:28.386959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:38.888859+0000","last_change":"2024-04-16T15:53:35.363875+0000","last_active":"2024-04-16T15:53:38.888859+0000","last_peered":"2024-04-16T15:53:38.888859+0000","last_clean":"2024-04-16T15:53:38.888859+0000","last_became_active":"2024-04-16T15:53:18.206684+0000","last_became_peered":"2024-04-16T15:53:18.206684+0000","last_unstale":"2024-04-16T15:53:38.888859+0000","last_undegraded":"2024-04-16T15:53:38.888859+0000","last_fullsized":"2024-04-16T15:53:38.888859+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-04-16T15:53:35.363713+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-04-16T15:53:35.363713+0000","last_clean_scrub_stamp":"2024-04-16T15:53:35.363713+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:56:03.316595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:39.558199+0000","last_change":"2024-04-16T15:53:39.558224+0000","last_active":"2024-04-16T15:53:39.558199+0000","last_peered":"2024-04-16T15:53:39.558199+0000","last_clean":"2024-04-16T15:53:39.558199+0000","last_became_active":"2024-04-16T15:53:19.214331+0000","last_became_peered":"2024-04-16T15:53:19.214331+0000","last_unstale":"2024-04-16T15:53:39.558199+0000","last_undegraded":"2024-04-16T15:53:39.558199+0000","last_fullsized":"2024-04-16T15:53:39.558199+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:39.558117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:39.558117+0000","last_clean_scrub_stamp":"2024-04-16T15:53:39.558117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:27:52.255416+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:38.890571+0000","last_change":"2024-04-16T15:53:33.895539+0000","last_active":"2024-04-16T15:53:38.890571+0000","last_peered":"2024-04-16T15:53:38.890571+0000","last_clean":"2024-04-16T15:53:38.890571+0000","last_became_active":"2024-04-16T15:53:18.210390+0000","last_became_peered":"2024-04-16T15:53:18.210390+0000","last_unstale":"2024-04-16T15:53:38.890571+0000","last_undegraded":"2024-04-16T15:53:38.890571+0000","last_fullsized":"2024-04-16T15:53:38.890571+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-04-16T15:53:33.895382+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-04-16T15:53:33.895382+0000","last_clean_scrub_stamp":"2024-04-16T15:53:33.895382+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:14:36.055318+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:44.144245+0000","last_change":"2024-04-16T15:53:44.144270+0000","last_active":"2024-04-16T15:53:44.144245+0000","last_peered":"2024-04-16T15:53:44.144245+0000","last_clean":"2024-04-16T15:53:44.144245+0000","last_became_active":"2024-04-16T15:53:19.218185+0000","last_became_peered":"2024-04-16T15:53:19.218185+0000","last_unstale":"2024-04-16T15:53:44.144245+0000","last_undegraded":"2024-04-16T15:53:44.144245+0000","last_fullsized":"2024-04-16T15:53:44.144245+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:44.144133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:44.144133+0000","last_clean_scrub_stamp":"2024-04-16T15:53:44.144133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:46:15.829983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"35'2","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:41.585097+0000","last_change":"2024-04-16T15:53:41.585121+0000","last_active":"2024-04-16T15:53:41.585097+0000","last_peered":"2024-04-16T15:53:41.585097+0000","last_clean":"2024-04-16T15:53:41.585097+0000","last_became_active":"2024-04-16T15:53:18.210271+0000","last_became_peered":"2024-04-16T15:53:18.210271+0000","last_unstale":"2024-04-16T15:53:41.585097+0000","last_undegraded":"2024-04-16T15:53:41.585097+0000","last_fullsized":"2024-04-16T15:53:41.585097+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-16T15:53:41.585015+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-16T15:53:41.585015+0000","last_clean_scrub_stamp":"2024-04-16T15:53:41.585015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:03:06.982954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:37.666408+0000","last_change":"2024-04-16T15:53:37.666446+0000","last_active":"2024-04-16T15:53:37.666408+0000","last_peered":"2024-04-16T15:53:37.666408+0000","last_clean":"2024-04-16T15:53:37.666408+0000","last_became_active":"2024-04-16T15:53:19.200086+0000","last_became_peered":"2024-04-16T15:53:19.200086+0000","last_unstale":"2024-04-16T15:53:37.666408+0000","last_undegraded":"2024-04-16T15:53:37.666408+0000","last_fullsized":"2024-04-16T15:53:37.666408+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:37.666314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:37.666314+0000","last_clean_scrub_stamp":"2024-04-16T15:53:37.666314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:24:48.658525+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"35'2","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:40.587546+0000","last_change":"2024-04-16T15:53:40.587566+0000","last_active":"2024-04-16T15:53:40.587546+0000","last_peered":"2024-04-16T15:53:40.587546+0000","last_clean":"2024-04-16T15:53:40.587546+0000","last_became_active":"2024-04-16T15:53:18.210234+0000","last_became_peered":"2024-04-16T15:53:18.210234+0000","last_unstale":"2024-04-16T15:53:40.587546+0000","last_undegraded":"2024-04-16T15:53:40.587546+0000","last_fullsized":"2024-04-16T15:53:40.587546+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-16T15:53:40.587473+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-16T15:53:40.587473+0000","last_clean_scrub_stamp":"2024-04-16T15:53:40.587473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:12:07.012288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:46.558223+0000","last_change":"2024-04-16T15:53:46.558252+0000","last_active":"2024-04-16T15:53:46.558223+0000","last_peered":"2024-04-16T15:53:46.558223+0000","last_clean":"2024-04-16T15:53:46.558223+0000","last_became_active":"2024-04-16T15:53:19.210425+0000","last_became_peered":"2024-04-16T15:53:19.210425+0000","last_unstale":"2024-04-16T15:53:46.558223+0000","last_undegraded":"2024-04-16T15:53:46.558223+0000","last_fullsized":"2024-04-16T15:53:46.558223+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:46.558117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:46.558117+0000","last_clean_scrub_stamp":"2024-04-16T15:53:46.558117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:18:44.103800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:39.414032+0000","last_change":"2024-04-16T15:53:39.414065+0000","last_active":"2024-04-16T15:53:39.414032+0000","last_peered":"2024-04-16T15:53:39.414032+0000","last_clean":"2024-04-16T15:53:39.414032+0000","last_became_active":"2024-04-16T15:53:18.210282+0000","last_became_peered":"2024-04-16T15:53:18.210282+0000","last_unstale":"2024-04-16T15:53:39.414032+0000","last_undegraded":"2024-04-16T15:53:39.414032+0000","last_fullsized":"2024-04-16T15:53:39.414032+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:39.413928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:39.413928+0000","last_clean_scrub_stamp":"2024-04-16T15:53:39.413928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:20.248160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:37.606167+0000","last_change":"2024-04-16T15:53:37.606208+0000","last_active":"2024-04-16T15:53:37.606167+0000","last_peered":"2024-04-16T15:53:37.606167+0000","last_clean":"2024-04-16T15:53:37.606167+0000","last_became_active":"2024-04-16T15:53:19.212239+0000","last_became_peered":"2024-04-16T15:53:19.212239+0000","last_unstale":"2024-04-16T15:53:37.606167+0000","last_undegraded":"2024-04-16T15:53:37.606167+0000","last_fullsized":"2024-04-16T15:53:37.606167+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:37.606062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:37.606062+0000","last_clean_scrub_stamp":"2024-04-16T15:53:37.606062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:12:04.030877+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:39.559541+0000","last_change":"2024-04-16T15:53:39.559576+0000","last_active":"2024-04-16T15:53:39.559541+0000","last_peered":"2024-04-16T15:53:39.559541+0000","last_clean":"2024-04-16T15:53:39.559541+0000","last_became_active":"2024-04-16T15:53:18.208225+0000","last_became_peered":"2024-04-16T15:53:18.208225+0000","last_unstale":"2024-04-16T15:53:39.559541+0000","last_undegraded":"2024-04-16T15:53:39.559541+0000","last_fullsized":"2024-04-16T15:53:39.559541+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:39.559438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:39.559438+0000","last_clean_scrub_stamp":"2024-04-16T15:53:39.559438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:52:12.170534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:42.644677+0000","last_change":"2024-04-16T15:53:42.644704+0000","last_active":"2024-04-16T15:53:42.644677+0000","last_peered":"2024-04-16T15:53:42.644677+0000","last_clean":"2024-04-16T15:53:42.644677+0000","last_became_active":"2024-04-16T15:53:19.215600+0000","last_became_peered":"2024-04-16T15:53:19.215600+0000","last_unstale":"2024-04-16T15:53:42.644677+0000","last_undegraded":"2024-04-16T15:53:42.644677+0000","last_fullsized":"2024-04-16T15:53:42.644677+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:42.644588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:42.644588+0000","last_clean_scrub_stamp":"2024-04-16T15:53:42.644588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:46:14.330438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:38.374970+0000","last_change":"2024-04-16T15:53:38.375021+0000","last_active":"2024-04-16T15:53:38.374970+0000","last_peered":"2024-04-16T15:53:38.374970+0000","last_clean":"2024-04-16T15:53:38.374970+0000","last_became_active":"2024-04-16T15:53:18.209128+0000","last_became_peered":"2024-04-16T15:53:18.209128+0000","last_unstale":"2024-04-16T15:53:38.374970+0000","last_undegraded":"2024-04-16T15:53:38.374970+0000","last_fullsized":"2024-04-16T15:53:38.374970+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:38.374868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:38.374868+0000","last_clean_scrub_stamp":"2024-04-16T15:53:38.374868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:06:37.318201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:45.429797+0000","last_change":"2024-04-16T15:53:45.429821+0000","last_active":"2024-04-16T15:53:45.429797+0000","last_peered":"2024-04-16T15:53:45.429797+0000","last_clean":"2024-04-16T15:53:45.429797+0000","last_became_active":"2024-04-16T15:53:19.217938+0000","last_became_peered":"2024-04-16T15:53:19.217938+0000","last_unstale":"2024-04-16T15:53:45.429797+0000","last_undegraded":"2024-04-16T15:53:45.429797+0000","last_fullsized":"2024-04-16T15:53:45.429797+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:45.429682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:45.429682+0000","last_clean_scrub_stamp":"2024-04-16T15:53:45.429682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:40:23.884437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:35.881286+0000","last_change":"2024-04-16T15:53:35.601689+0000","last_active":"2024-04-16T15:53:35.881286+0000","last_peered":"2024-04-16T15:53:35.881286+0000","last_clean":"2024-04-16T15:53:35.881286+0000","last_became_active":"2024-04-16T15:53:18.212427+0000","last_became_peered":"2024-04-16T15:53:18.212427+0000","last_unstale":"2024-04-16T15:53:35.881286+0000","last_undegraded":"2024-04-16T15:53:35.881286+0000","last_fullsized":"2024-04-16T15:53:35.881286+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:35.601582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:35.601582+0000","last_clean_scrub_stamp":"2024-04-16T15:53:35.601582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:12:43.074518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:47.415405+0000","last_change":"2024-04-16T15:53:47.415429+0000","last_active":"2024-04-16T15:53:47.415405+0000","last_peered":"2024-04-16T15:53:47.415405+0000","last_clean":"2024-04-16T15:53:47.415405+0000","last_became_active":"2024-04-16T15:53:19.223461+0000","last_became_peered":"2024-04-16T15:53:19.223461+0000","last_unstale":"2024-04-16T15:53:47.415405+0000","last_undegraded":"2024-04-16T15:53:47.415405+0000","last_fullsized":"2024-04-16T15:53:47.415405+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:47.415300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:47.415300+0000","last_clean_scrub_stamp":"2024-04-16T15:53:47.415300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:55:04.259525+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:38.888270+0000","last_change":"2024-04-16T15:53:34.650916+0000","last_active":"2024-04-16T15:53:38.888270+0000","last_peered":"2024-04-16T15:53:38.888270+0000","last_clean":"2024-04-16T15:53:38.888270+0000","last_became_active":"2024-04-16T15:53:18.208317+0000","last_became_peered":"2024-04-16T15:53:18.208317+0000","last_unstale":"2024-04-16T15:53:38.888270+0000","last_undegraded":"2024-04-16T15:53:38.888270+0000","last_fullsized":"2024-04-16T15:53:38.888270+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-04-16T15:53:34.650775+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-04-16T15:53:34.650775+0000","last_clean_scrub_stamp":"2024-04-16T15:53:34.650775+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:03:00.048715+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:44.652872+0000","last_change":"2024-04-16T15:53:44.652896+0000","last_active":"2024-04-16T15:53:44.652872+0000","last_peered":"2024-04-16T15:53:44.652872+0000","last_clean":"2024-04-16T15:53:44.652872+0000","last_became_active":"2024-04-16T15:53:19.217805+0000","last_became_peered":"2024-04-16T15:53:19.217805+0000","last_unstale":"2024-04-16T15:53:44.652872+0000","last_undegraded":"2024-04-16T15:53:44.652872+0000","last_fullsized":"2024-04-16T15:53:44.652872+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:44.652769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:44.652769+0000","last_clean_scrub_stamp":"2024-04-16T15:53:44.652769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:23:24.071614+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"35'7","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:38.889427+0000","last_change":"2024-04-16T15:53:34.405324+0000","last_active":"2024-04-16T15:53:38.889427+0000","last_peered":"2024-04-16T15:53:38.889427+0000","last_clean":"2024-04-16T15:53:38.889427+0000","last_became_active":"2024-04-16T15:53:18.206613+0000","last_became_peered":"2024-04-16T15:53:18.206613+0000","last_unstale":"2024-04-16T15:53:38.889427+0000","last_undegraded":"2024-04-16T15:53:38.889427+0000","last_fullsized":"2024-04-16T15:53:38.889427+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-04-16T15:53:34.405173+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-04-16T15:53:34.405173+0000","last_clean_scrub_stamp":"2024-04-16T15:53:34.405173+0000","objects_scrubbed":4,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:36:23.314744+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:44.518596+0000","last_change":"2024-04-16T15:53:44.518622+0000","last_active":"2024-04-16T15:53:44.518596+0000","last_peered":"2024-04-16T15:53:44.518596+0000","last_clean":"2024-04-16T15:53:44.518596+0000","last_became_active":"2024-04-16T15:53:19.221536+0000","last_became_peered":"2024-04-16T15:53:19.221536+0000","last_unstale":"2024-04-16T15:53:44.518596+0000","last_undegraded":"2024-04-16T15:53:44.518596+0000","last_fullsized":"2024-04-16T15:53:44.518596+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:44.518507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:44.518507+0000","last_clean_scrub_stamp":"2024-04-16T15:53:44.518507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:25.352739+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:37.590278+0000","last_change":"2024-04-16T15:53:37.590278+0000","last_active":"2024-04-16T15:53:37.590278+0000","last_peered":"2024-04-16T15:53:37.590278+0000","last_clean":"2024-04-16T15:53:37.590278+0000","last_became_active":"2024-04-16T15:53:18.207445+0000","last_became_peered":"2024-04-16T15:53:18.207445+0000","last_unstale":"2024-04-16T15:53:37.590278+0000","last_undegraded":"2024-04-16T15:53:37.590278+0000","last_fullsized":"2024-04-16T15:53:37.590278+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-04-16T15:53:37.590133+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-04-16T15:53:37.590133+0000","last_clean_scrub_stamp":"2024-04-16T15:53:37.590133+0000","objects_scrubbed":2,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:48:51.135737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:42.401973+0000","last_change":"2024-04-16T15:53:42.401994+0000","last_active":"2024-04-16T15:53:42.401973+0000","last_peered":"2024-04-16T15:53:42.401973+0000","last_clean":"2024-04-16T15:53:42.401973+0000","last_became_active":"2024-04-16T15:53:19.215415+0000","last_became_peered":"2024-04-16T15:53:19.215415+0000","last_unstale":"2024-04-16T15:53:42.401973+0000","last_undegraded":"2024-04-16T15:53:42.401973+0000","last_fullsized":"2024-04-16T15:53:42.401973+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:42.401868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:42.401868+0000","last_clean_scrub_stamp":"2024-04-16T15:53:42.401868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:53:09.890806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:35.880194+0000","last_change":"2024-04-16T15:53:34.692585+0000","last_active":"2024-04-16T15:53:35.880194+0000","last_peered":"2024-04-16T15:53:35.880194+0000","last_clean":"2024-04-16T15:53:35.880194+0000","last_became_active":"2024-04-16T15:53:18.206764+0000","last_became_peered":"2024-04-16T15:53:18.206764+0000","last_unstale":"2024-04-16T15:53:35.880194+0000","last_undegraded":"2024-04-16T15:53:35.880194+0000","last_fullsized":"2024-04-16T15:53:35.880194+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:34.692480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:34.692480+0000","last_clean_scrub_stamp":"2024-04-16T15:53:34.692480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:20:03.669363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:42.201233+0000","last_change":"2024-04-16T15:53:42.201279+0000","last_active":"2024-04-16T15:53:42.201233+0000","last_peered":"2024-04-16T15:53:42.201233+0000","last_clean":"2024-04-16T15:53:42.201233+0000","last_became_active":"2024-04-16T15:53:19.218250+0000","last_became_peered":"2024-04-16T15:53:19.218250+0000","last_unstale":"2024-04-16T15:53:42.201233+0000","last_undegraded":"2024-04-16T15:53:42.201233+0000","last_fullsized":"2024-04-16T15:53:42.201233+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:42.201107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:42.201107+0000","last_clean_scrub_stamp":"2024-04-16T15:53:42.201107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:18:21.900581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:37.393621+0000","last_change":"2024-04-16T15:53:37.393676+0000","last_active":"2024-04-16T15:53:37.393621+0000","last_peered":"2024-04-16T15:53:37.393621+0000","last_clean":"2024-04-16T15:53:37.393621+0000","last_became_active":"2024-04-16T15:53:18.207633+0000","last_became_peered":"2024-04-16T15:53:18.207633+0000","last_unstale":"2024-04-16T15:53:37.393621+0000","last_undegraded":"2024-04-16T15:53:37.393621+0000","last_fullsized":"2024-04-16T15:53:37.393621+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:37.393506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:37.393506+0000","last_clean_scrub_stamp":"2024-04-16T15:53:37.393506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:59:27.466233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:39.488071+0000","last_change":"2024-04-16T15:53:39.488090+0000","last_active":"2024-04-16T15:53:39.488071+0000","last_peered":"2024-04-16T15:53:39.488071+0000","last_clean":"2024-04-16T15:53:39.488071+0000","last_became_active":"2024-04-16T15:53:19.212171+0000","last_became_peered":"2024-04-16T15:53:19.212171+0000","last_unstale":"2024-04-16T15:53:39.488071+0000","last_undegraded":"2024-04-16T15:53:39.488071+0000","last_fullsized":"2024-04-16T15:53:39.488071+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:39.487981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:39.487981+0000","last_clean_scrub_stamp":"2024-04-16T15:53:39.487981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:48:14.567378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:38.893781+0000","last_change":"2024-04-16T15:53:36.414208+0000","last_active":"2024-04-16T15:53:38.893781+0000","last_peered":"2024-04-16T15:53:38.893781+0000","last_clean":"2024-04-16T15:53:38.893781+0000","last_became_active":"2024-04-16T15:53:18.207332+0000","last_became_peered":"2024-04-16T15:53:18.207332+0000","last_unstale":"2024-04-16T15:53:38.893781+0000","last_undegraded":"2024-04-16T15:53:38.893781+0000","last_fullsized":"2024-04-16T15:53:38.893781+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-04-16T15:53:36.414092+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-04-16T15:53:36.414092+0000","last_clean_scrub_stamp":"2024-04-16T15:53:36.414092+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:07:57.777825+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:44.594179+0000","last_change":"2024-04-16T15:53:44.594228+0000","last_active":"2024-04-16T15:53:44.594179+0000","last_peered":"2024-04-16T15:53:44.594179+0000","last_clean":"2024-04-16T15:53:44.594179+0000","last_became_active":"2024-04-16T15:53:19.202414+0000","last_became_peered":"2024-04-16T15:53:19.202414+0000","last_unstale":"2024-04-16T15:53:44.594179+0000","last_undegraded":"2024-04-16T15:53:44.594179+0000","last_fullsized":"2024-04-16T15:53:44.594179+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:44.594058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:44.594058+0000","last_clean_scrub_stamp":"2024-04-16T15:53:44.594058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:27:47.248805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:36.635595+0000","last_change":"2024-04-16T15:53:36.635622+0000","last_active":"2024-04-16T15:53:36.635595+0000","last_peered":"2024-04-16T15:53:36.635595+0000","last_clean":"2024-04-16T15:53:36.635595+0000","last_became_active":"2024-04-16T15:53:18.211709+0000","last_became_peered":"2024-04-16T15:53:18.211709+0000","last_unstale":"2024-04-16T15:53:36.635595+0000","last_undegraded":"2024-04-16T15:53:36.635595+0000","last_fullsized":"2024-04-16T15:53:36.635595+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'1","last_scrub_stamp":"2024-04-16T15:53:36.635514+0000","last_deep_scrub":"33'1","last_deep_scrub_stamp":"2024-04-16T15:53:36.635514+0000","last_clean_scrub_stamp":"2024-04-16T15:53:36.635514+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:52:09.246610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:38.687909+0000","last_change":"2024-04-16T15:53:38.687933+0000","last_active":"2024-04-16T15:53:38.687909+0000","last_peered":"2024-04-16T15:53:38.687909+0000","last_clean":"2024-04-16T15:53:38.687909+0000","last_became_active":"2024-04-16T15:53:19.202530+0000","last_became_peered":"2024-04-16T15:53:19.202530+0000","last_unstale":"2024-04-16T15:53:38.687909+0000","last_undegraded":"2024-04-16T15:53:38.687909+0000","last_fullsized":"2024-04-16T15:53:38.687909+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:38.687816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:38.687816+0000","last_clean_scrub_stamp":"2024-04-16T15:53:38.687816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:59:28.760544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:38.891607+0000","last_change":"2024-04-16T15:53:38.600507+0000","last_active":"2024-04-16T15:53:38.891607+0000","last_peered":"2024-04-16T15:53:38.891607+0000","last_clean":"2024-04-16T15:53:38.891607+0000","last_became_active":"2024-04-16T15:53:18.207596+0000","last_became_peered":"2024-04-16T15:53:18.207596+0000","last_unstale":"2024-04-16T15:53:38.891607+0000","last_undegraded":"2024-04-16T15:53:38.891607+0000","last_fullsized":"2024-04-16T15:53:38.891607+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-04-16T15:53:38.600386+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-04-16T15:53:38.600386+0000","last_clean_scrub_stamp":"2024-04-16T15:53:38.600386+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:15.082143+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:41.565726+0000","last_change":"2024-04-16T15:53:41.565755+0000","last_active":"2024-04-16T15:53:41.565726+0000","last_peered":"2024-04-16T15:53:41.565726+0000","last_clean":"2024-04-16T15:53:41.565726+0000","last_became_active":"2024-04-16T15:53:19.214161+0000","last_became_peered":"2024-04-16T15:53:19.214161+0000","last_unstale":"2024-04-16T15:53:41.565726+0000","last_undegraded":"2024-04-16T15:53:41.565726+0000","last_fullsized":"2024-04-16T15:53:41.565726+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:41.565613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:41.565613+0000","last_clean_scrub_stamp":"2024-04-16T15:53:41.565613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:27:44.220359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:42.606416+0000","last_change":"2024-04-16T15:53:42.606449+0000","last_active":"2024-04-16T15:53:42.606416+0000","last_peered":"2024-04-16T15:53:42.606416+0000","last_clean":"2024-04-16T15:53:42.606416+0000","last_became_active":"2024-04-16T15:53:18.210498+0000","last_became_peered":"2024-04-16T15:53:18.210498+0000","last_unstale":"2024-04-16T15:53:42.606416+0000","last_undegraded":"2024-04-16T15:53:42.606416+0000","last_fullsized":"2024-04-16T15:53:42.606416+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'1","last_scrub_stamp":"2024-04-16T15:53:42.606312+0000","last_deep_scrub":"33'1","last_deep_scrub_stamp":"2024-04-16T15:53:42.606312+0000","last_clean_scrub_stamp":"2024-04-16T15:53:42.606312+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:27:55.303611+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:39.860409+0000","last_change":"2024-04-16T15:53:39.860434+0000","last_active":"2024-04-16T15:53:39.860409+0000","last_peered":"2024-04-16T15:53:39.860409+0000","last_clean":"2024-04-16T15:53:39.860409+0000","last_became_active":"2024-04-16T15:53:19.212661+0000","last_became_peered":"2024-04-16T15:53:19.212661+0000","last_unstale":"2024-04-16T15:53:39.860409+0000","last_undegraded":"2024-04-16T15:53:39.860409+0000","last_fullsized":"2024-04-16T15:53:39.860409+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:39.860323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:39.860323+0000","last_clean_scrub_stamp":"2024-04-16T15:53:39.860323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:12:47.333259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:35.880117+0000","last_change":"2024-04-16T15:53:34.513101+0000","last_active":"2024-04-16T15:53:35.880117+0000","last_peered":"2024-04-16T15:53:35.880117+0000","last_clean":"2024-04-16T15:53:35.880117+0000","last_became_active":"2024-04-16T15:53:18.212434+0000","last_became_peered":"2024-04-16T15:53:18.212434+0000","last_unstale":"2024-04-16T15:53:35.880117+0000","last_undegraded":"2024-04-16T15:53:35.880117+0000","last_fullsized":"2024-04-16T15:53:35.880117+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:34.512975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:34.512975+0000","last_clean_scrub_stamp":"2024-04-16T15:53:34.512975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:40:16.403874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:38.894361+0000","last_change":"2024-04-16T15:53:38.894388+0000","last_active":"2024-04-16T15:53:38.894361+0000","last_peered":"2024-04-16T15:53:38.894361+0000","last_clean":"2024-04-16T15:53:38.894361+0000","last_became_active":"2024-04-16T15:53:19.211842+0000","last_became_peered":"2024-04-16T15:53:19.211842+0000","last_unstale":"2024-04-16T15:53:38.894361+0000","last_undegraded":"2024-04-16T15:53:38.894361+0000","last_fullsized":"2024-04-16T15:53:38.894361+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:38.894247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:38.894247+0000","last_clean_scrub_stamp":"2024-04-16T15:53:38.894247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:28:17.974763+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"35'3","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:35.881492+0000","last_change":"2024-04-16T15:53:34.591949+0000","last_active":"2024-04-16T15:53:35.881492+0000","last_peered":"2024-04-16T15:53:35.881492+0000","last_clean":"2024-04-16T15:53:35.881492+0000","last_became_active":"2024-04-16T15:53:18.210087+0000","last_became_peered":"2024-04-16T15:53:18.210087+0000","last_unstale":"2024-04-16T15:53:35.881492+0000","last_undegraded":"2024-04-16T15:53:35.881492+0000","last_fullsized":"2024-04-16T15:53:35.881492+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-04-16T15:53:34.591849+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-04-16T15:53:34.591849+0000","last_clean_scrub_stamp":"2024-04-16T15:53:34.591849+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:28:13.672366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:35.901942+0000","last_change":"2024-04-16T15:53:35.901319+0000","last_active":"2024-04-16T15:53:35.901942+0000","last_peered":"2024-04-16T15:53:35.901942+0000","last_clean":"2024-04-16T15:53:35.901942+0000","last_became_active":"2024-04-16T15:53:19.206660+0000","last_became_peered":"2024-04-16T15:53:19.206660+0000","last_unstale":"2024-04-16T15:53:35.901942+0000","last_undegraded":"2024-04-16T15:53:35.901942+0000","last_fullsized":"2024-04-16T15:53:35.901942+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:35.901226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:35.901226+0000","last_clean_scrub_stamp":"2024-04-16T15:53:35.901226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:18:23.200586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:35.886706+0000","last_change":"2024-04-16T15:53:35.560432+0000","last_active":"2024-04-16T15:53:35.886706+0000","last_peered":"2024-04-16T15:53:35.886706+0000","last_clean":"2024-04-16T15:53:35.886706+0000","last_became_active":"2024-04-16T15:53:18.209539+0000","last_became_peered":"2024-04-16T15:53:18.209539+0000","last_unstale":"2024-04-16T15:53:35.886706+0000","last_undegraded":"2024-04-16T15:53:35.886706+0000","last_fullsized":"2024-04-16T15:53:35.886706+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:35.560304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:35.560304+0000","last_clean_scrub_stamp":"2024-04-16T15:53:35.560304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:21:50.815887+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:35.901699+0000","last_change":"2024-04-16T15:53:34.895298+0000","last_active":"2024-04-16T15:53:35.901699+0000","last_peered":"2024-04-16T15:53:35.901699+0000","last_clean":"2024-04-16T15:53:35.901699+0000","last_became_active":"2024-04-16T15:53:19.205995+0000","last_became_peered":"2024-04-16T15:53:19.205995+0000","last_unstale":"2024-04-16T15:53:35.901699+0000","last_undegraded":"2024-04-16T15:53:35.901699+0000","last_fullsized":"2024-04-16T15:53:35.901699+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:34.895154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:34.895154+0000","last_clean_scrub_stamp":"2024-04-16T15:53:34.895154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:10:13.922394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:36.554077+0000","last_change":"2024-04-16T15:53:36.554117+0000","last_active":"2024-04-16T15:53:36.554077+0000","last_peered":"2024-04-16T15:53:36.554077+0000","last_clean":"2024-04-16T15:53:36.554077+0000","last_became_active":"2024-04-16T15:53:18.204142+0000","last_became_peered":"2024-04-16T15:53:18.204142+0000","last_unstale":"2024-04-16T15:53:36.554077+0000","last_undegraded":"2024-04-16T15:53:36.554077+0000","last_fullsized":"2024-04-16T15:53:36.554077+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:36.553959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:36.553959+0000","last_clean_scrub_stamp":"2024-04-16T15:53:36.553959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:26:35.614729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:40.174773+0000","last_change":"2024-04-16T15:53:40.174791+0000","last_active":"2024-04-16T15:53:40.174773+0000","last_peered":"2024-04-16T15:53:40.174773+0000","last_clean":"2024-04-16T15:53:40.174773+0000","last_became_active":"2024-04-16T15:53:19.215227+0000","last_became_peered":"2024-04-16T15:53:19.215227+0000","last_unstale":"2024-04-16T15:53:40.174773+0000","last_undegraded":"2024-04-16T15:53:40.174773+0000","last_fullsized":"2024-04-16T15:53:40.174773+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:40.174699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:40.174699+0000","last_clean_scrub_stamp":"2024-04-16T15:53:40.174699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:59:30.247427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:35.878796+0000","last_change":"2024-04-16T15:53:35.685239+0000","last_active":"2024-04-16T15:53:35.878796+0000","last_peered":"2024-04-16T15:53:35.878796+0000","last_clean":"2024-04-16T15:53:35.878796+0000","last_became_active":"2024-04-16T15:53:18.209092+0000","last_became_peered":"2024-04-16T15:53:18.209092+0000","last_unstale":"2024-04-16T15:53:35.878796+0000","last_undegraded":"2024-04-16T15:53:35.878796+0000","last_fullsized":"2024-04-16T15:53:35.878796+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:35.685107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:35.685107+0000","last_clean_scrub_stamp":"2024-04-16T15:53:35.685107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:07:11.244006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:36.904487+0000","last_change":"2024-04-16T15:53:36.904509+0000","last_active":"2024-04-16T15:53:36.904487+0000","last_peered":"2024-04-16T15:53:36.904487+0000","last_clean":"2024-04-16T15:53:36.904487+0000","last_became_active":"2024-04-16T15:53:19.209941+0000","last_became_peered":"2024-04-16T15:53:19.209941+0000","last_unstale":"2024-04-16T15:53:36.904487+0000","last_undegraded":"2024-04-16T15:53:36.904487+0000","last_fullsized":"2024-04-16T15:53:36.904487+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:36.904363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:36.904363+0000","last_clean_scrub_stamp":"2024-04-16T15:53:36.904363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:21:52.159946+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:38.892168+0000","last_change":"2024-04-16T15:53:32.676572+0000","last_active":"2024-04-16T15:53:38.892168+0000","last_peered":"2024-04-16T15:53:38.892168+0000","last_clean":"2024-04-16T15:53:38.892168+0000","last_became_active":"2024-04-16T15:53:18.203960+0000","last_became_peered":"2024-04-16T15:53:18.203960+0000","last_unstale":"2024-04-16T15:53:38.892168+0000","last_undegraded":"2024-04-16T15:53:38.892168+0000","last_fullsized":"2024-04-16T15:53:38.892168+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-04-16T15:53:32.676432+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-04-16T15:53:32.676432+0000","last_clean_scrub_stamp":"2024-04-16T15:53:32.676432+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:48:07.755830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:45.615412+0000","last_change":"2024-04-16T15:53:45.615438+0000","last_active":"2024-04-16T15:53:45.615412+0000","last_peered":"2024-04-16T15:53:45.615412+0000","last_clean":"2024-04-16T15:53:45.615412+0000","last_became_active":"2024-04-16T15:53:19.217646+0000","last_became_peered":"2024-04-16T15:53:19.217646+0000","last_unstale":"2024-04-16T15:53:45.615412+0000","last_undegraded":"2024-04-16T15:53:45.615412+0000","last_fullsized":"2024-04-16T15:53:45.615412+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:45.615328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:45.615328+0000","last_clean_scrub_stamp":"2024-04-16T15:53:45.615328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:20:31.643421+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"35'1","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:35.881371+0000","last_change":"2024-04-16T15:53:33.610736+0000","last_active":"2024-04-16T15:53:35.881371+0000","last_peered":"2024-04-16T15:53:35.881371+0000","last_clean":"2024-04-16T15:53:35.881371+0000","last_became_active":"2024-04-16T15:53:18.208576+0000","last_became_peered":"2024-04-16T15:53:18.208576+0000","last_unstale":"2024-04-16T15:53:35.881371+0000","last_undegraded":"2024-04-16T15:53:35.881371+0000","last_fullsized":"2024-04-16T15:53:35.881371+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:33.610641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:33.610641+0000","last_clean_scrub_stamp":"2024-04-16T15:53:33.610641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:38:28.229506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:40.582271+0000","last_change":"2024-04-16T15:53:40.582296+0000","last_active":"2024-04-16T15:53:40.582271+0000","last_peered":"2024-04-16T15:53:40.582271+0000","last_clean":"2024-04-16T15:53:40.582271+0000","last_became_active":"2024-04-16T15:53:19.218050+0000","last_became_peered":"2024-04-16T15:53:19.218050+0000","last_unstale":"2024-04-16T15:53:40.582271+0000","last_undegraded":"2024-04-16T15:53:40.582271+0000","last_fullsized":"2024-04-16T15:53:40.582271+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:40.582175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:40.582175+0000","last_clean_scrub_stamp":"2024-04-16T15:53:40.582175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:15:53.941261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:35.880421+0000","last_change":"2024-04-16T15:53:35.649967+0000","last_active":"2024-04-16T15:53:35.880421+0000","last_peered":"2024-04-16T15:53:35.880421+0000","last_clean":"2024-04-16T15:53:35.880421+0000","last_became_active":"2024-04-16T15:53:18.211063+0000","last_became_peered":"2024-04-16T15:53:18.211063+0000","last_unstale":"2024-04-16T15:53:35.880421+0000","last_undegraded":"2024-04-16T15:53:35.880421+0000","last_fullsized":"2024-04-16T15:53:35.880421+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:35.649845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:35.649845+0000","last_clean_scrub_stamp":"2024-04-16T15:53:35.649845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:12.131602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:38.521220+0000","last_change":"2024-04-16T15:53:38.521249+0000","last_active":"2024-04-16T15:53:38.521220+0000","last_peered":"2024-04-16T15:53:38.521220+0000","last_clean":"2024-04-16T15:53:38.521220+0000","last_became_active":"2024-04-16T15:53:19.209882+0000","last_became_peered":"2024-04-16T15:53:19.209882+0000","last_unstale":"2024-04-16T15:53:38.521220+0000","last_undegraded":"2024-04-16T15:53:38.521220+0000","last_fullsized":"2024-04-16T15:53:38.521220+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:38.521108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:38.521108+0000","last_clean_scrub_stamp":"2024-04-16T15:53:38.521108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:40.065579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:35.881339+0000","last_change":"2024-04-16T15:53:32.638872+0000","last_active":"2024-04-16T15:53:35.881339+0000","last_peered":"2024-04-16T15:53:35.881339+0000","last_clean":"2024-04-16T15:53:35.881339+0000","last_became_active":"2024-04-16T15:53:18.204054+0000","last_became_peered":"2024-04-16T15:53:18.204054+0000","last_unstale":"2024-04-16T15:53:35.881339+0000","last_undegraded":"2024-04-16T15:53:35.881339+0000","last_fullsized":"2024-04-16T15:53:35.881339+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:32.638732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:32.638732+0000","last_clean_scrub_stamp":"2024-04-16T15:53:32.638732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:21:47.894315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:37.557890+0000","last_change":"2024-04-16T15:53:37.557911+0000","last_active":"2024-04-16T15:53:37.557890+0000","last_peered":"2024-04-16T15:53:37.557890+0000","last_clean":"2024-04-16T15:53:37.557890+0000","last_became_active":"2024-04-16T15:53:19.210969+0000","last_became_peered":"2024-04-16T15:53:19.210969+0000","last_unstale":"2024-04-16T15:53:37.557890+0000","last_undegraded":"2024-04-16T15:53:37.557890+0000","last_fullsized":"2024-04-16T15:53:37.557890+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:37.557805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:37.557805+0000","last_clean_scrub_stamp":"2024-04-16T15:53:37.557805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:09:31.818537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:35.880268+0000","last_change":"2024-04-16T15:53:33.651046+0000","last_active":"2024-04-16T15:53:35.880268+0000","last_peered":"2024-04-16T15:53:35.880268+0000","last_clean":"2024-04-16T15:53:35.880268+0000","last_became_active":"2024-04-16T15:53:18.204031+0000","last_became_peered":"2024-04-16T15:53:18.204031+0000","last_unstale":"2024-04-16T15:53:35.880268+0000","last_undegraded":"2024-04-16T15:53:35.880268+0000","last_fullsized":"2024-04-16T15:53:35.880268+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:33.650923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:33.650923+0000","last_clean_scrub_stamp":"2024-04-16T15:53:33.650923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:55:35.613752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:46.423521+0000","last_change":"2024-04-16T15:53:46.423545+0000","last_active":"2024-04-16T15:53:46.423521+0000","last_peered":"2024-04-16T15:53:46.423521+0000","last_clean":"2024-04-16T15:53:46.423521+0000","last_became_active":"2024-04-16T15:53:19.218474+0000","last_became_peered":"2024-04-16T15:53:19.218474+0000","last_unstale":"2024-04-16T15:53:46.423521+0000","last_undegraded":"2024-04-16T15:53:46.423521+0000","last_fullsized":"2024-04-16T15:53:46.423521+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:46.423428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:46.423428+0000","last_clean_scrub_stamp":"2024-04-16T15:53:46.423428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:38:15.463970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:35.879352+0000","last_change":"2024-04-16T15:53:35.516652+0000","last_active":"2024-04-16T15:53:35.879352+0000","last_peered":"2024-04-16T15:53:35.879352+0000","last_clean":"2024-04-16T15:53:35.879352+0000","last_became_active":"2024-04-16T15:53:18.203790+0000","last_became_peered":"2024-04-16T15:53:18.203790+0000","last_unstale":"2024-04-16T15:53:35.879352+0000","last_undegraded":"2024-04-16T15:53:35.879352+0000","last_fullsized":"2024-04-16T15:53:35.879352+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:35.516530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:35.516530+0000","last_clean_scrub_stamp":"2024-04-16T15:53:35.516530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:09:29.777261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:49.527608+0000","last_change":"2024-04-16T15:53:49.527632+0000","last_active":"2024-04-16T15:53:49.527608+0000","last_peered":"2024-04-16T15:53:49.527608+0000","last_clean":"2024-04-16T15:53:49.527608+0000","last_became_active":"2024-04-16T15:53:19.218379+0000","last_became_peered":"2024-04-16T15:53:19.218379+0000","last_unstale":"2024-04-16T15:53:49.527608+0000","last_undegraded":"2024-04-16T15:53:49.527608+0000","last_fullsized":"2024-04-16T15:53:49.527608+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:49.527453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:49.527453+0000","last_clean_scrub_stamp":"2024-04-16T15:53:49.527453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:46:21.213303+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:40.400718+0000","last_change":"2024-04-16T15:53:40.400739+0000","last_active":"2024-04-16T15:53:40.400718+0000","last_peered":"2024-04-16T15:53:40.400718+0000","last_clean":"2024-04-16T15:53:40.400718+0000","last_became_active":"2024-04-16T15:53:18.211604+0000","last_became_peered":"2024-04-16T15:53:18.211604+0000","last_unstale":"2024-04-16T15:53:40.400718+0000","last_undegraded":"2024-04-16T15:53:40.400718+0000","last_fullsized":"2024-04-16T15:53:40.400718+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:40.400613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:40.400613+0000","last_clean_scrub_stamp":"2024-04-16T15:53:40.400613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:34:14.360798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:38.163399+0000","last_change":"2024-04-16T15:53:38.163463+0000","last_active":"2024-04-16T15:53:38.163399+0000","last_peered":"2024-04-16T15:53:38.163399+0000","last_clean":"2024-04-16T15:53:38.163399+0000","last_became_active":"2024-04-16T15:53:19.212758+0000","last_became_peered":"2024-04-16T15:53:19.212758+0000","last_unstale":"2024-04-16T15:53:38.163399+0000","last_undegraded":"2024-04-16T15:53:38.163399+0000","last_fullsized":"2024-04-16T15:53:38.163399+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:38.163285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:38.163285+0000","last_clean_scrub_stamp":"2024-04-16T15:53:38.163285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:23:04.908174+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:37.516012+0000","last_change":"2024-04-16T15:53:37.516038+0000","last_active":"2024-04-16T15:53:37.516012+0000","last_peered":"2024-04-16T15:53:37.516012+0000","last_clean":"2024-04-16T15:53:37.516012+0000","last_became_active":"2024-04-16T15:53:18.213572+0000","last_became_peered":"2024-04-16T15:53:18.213572+0000","last_unstale":"2024-04-16T15:53:37.516012+0000","last_undegraded":"2024-04-16T15:53:37.516012+0000","last_fullsized":"2024-04-16T15:53:37.516012+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:53:37.515919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:53:37.515919+0000","last_clean_scrub_stamp":"2024-04-16T15:53:37.515919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:32:33.804525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"35'119","reported_seq":209,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-16T15:53:36.161369+0000","last_change":"2024-04-16T15:53:36.161437+0000","last_active":"2024-04-16T15:53:36.161369+0000","last_peered":"2024-04-16T15:53:36.161369+0000","last_clean":"2024-04-16T15:53:36.161369+0000","last_became_active":"2024-04-16T15:52:04.355126+0000","last_became_peered":"2024-04-16T15:52:04.355126+0000","last_unstale":"2024-04-16T15:53:36.161369+0000","last_undegraded":"2024-04-16T15:53:36.161369+0000","last_fullsized":"2024-04-16T15:53:36.161369+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'119","last_scrub_stamp":"2024-04-16T15:53:36.161261+0000","last_deep_scrub":"35'119","last_deep_scrub_stamp":"2024-04-16T15:53:36.161261+0000","last_clean_scrub_stamp":"2024-04-16T15:53:36.161261+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:03:01.559200+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":77,"num_read_kb":80,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":995328,"data_stored":748470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":405504,"data_stored":158628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31572,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340268,"statfs":{"total":96636764160,"available":96604434432,"internally_reserved":0,"allocated":405504,"data_stored":158684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":405504,"data_stored":158116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":413696,"data_stored":159646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":401408,"data_stored":158082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":413696,"data_stored":159646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":991232,"data_stored":748380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T15:53:55.835 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-16T15:53:55.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.971+0000 7fc116288640 1 Processor -- start 2024-04-16T15:53:55.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.971+0000 7fc116288640 1 -- start start 2024-04-16T15:53:55.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.972+0000 7fc116288640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1100b4bb0 0x7fc11006f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:55.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.972+0000 7fc116288640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc11006dfb0 con 0x7fc11015b840 2024-04-16T15:53:55.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.972+0000 7fc116288640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc11006e290 con 0x7fc1100b4750 2024-04-16T15:53:55.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.972+0000 7fc116288640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc11006e570 con 0x7fc1100b4bb0 2024-04-16T15:53:55.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.972+0000 7fc10ffff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fc11015b840 0x7fc1100cef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43322/0 (socket says 172.21.15.132:43322) 2024-04-16T15:53:55.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.972+0000 7fc10ffff640 1 -- 172.21.15.132:0/131740159 learned_addr learned my addr 172.21.15.132:0/131740159 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:53:55.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.972+0000 7fc10effd640 1 -- 172.21.15.132:0/131740159 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1348107126 0 0) 0x7fc11006dfb0 con 0x7fc11015b840 2024-04-16T15:53:55.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.972+0000 7fc114825640 1 --2- 172.21.15.132:0/131740159 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1100b4bb0 0x7fc11006f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:55.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.972+0000 7fc10effd640 1 -- 172.21.15.132:0/131740159 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0f8005730 con 0x7fc11015b840 2024-04-16T15:53:55.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.973+0000 7fc10effd640 1 -- 172.21.15.132:0/131740159 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3107489600 0 0) 0x7fc0f8005730 con 0x7fc11015b840 2024-04-16T15:53:55.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.973+0000 7fc10effd640 1 -- 172.21.15.132:0/131740159 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1100b4bb0 msgr2=0x7fc11006f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:55.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.973+0000 7fc10effd640 1 --2- 172.21.15.132:0/131740159 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1100b4bb0 0x7fc11006f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:55.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.973+0000 7fc10effd640 1 -- 172.21.15.132:0/131740159 >> v1:172.21.15.179:6789/0 conn(0x7fc1100b4750 legacy=0x7fc11006f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:55.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.973+0000 7fc10effd640 1 -- 172.21.15.132:0/131740159 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc11006e850 con 0x7fc11015b840 2024-04-16T15:53:55.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.973+0000 7fc10effd640 1 -- 172.21.15.132:0/131740159 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2803668828 0 0) 0x7fc100001670 con 0x7fc11015b840 2024-04-16T15:53:55.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.973+0000 7fc10effd640 1 -- 172.21.15.132:0/131740159 >> v1:172.21.15.132:6789/0 conn(0x7fc11015b840 legacy=0x7fc1100cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:55.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.973+0000 7fc10effd640 1 --2- 172.21.15.132:0/131740159 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0f8005bf0 0x7fc0f8005fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:55.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.973+0000 7fc10effd640 1 --2- 172.21.15.132:0/131740159 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1100b4bb0 0x7fc0f8006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:55.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.973+0000 7fc10effd640 1 --2- 172.21.15.132:0/131740159 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0f8006f50 0x7fc0f80073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:55.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.973+0000 7fc10effd640 1 -- 172.21.15.132:0/131740159 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fc11006e570 con 0x7fc0f8006f50 2024-04-16T15:53:55.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.973+0000 7fc10effd640 1 -- 172.21.15.132:0/131740159 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc0f800dbd0 con 0x7fc0f8005bf0 2024-04-16T15:53:55.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.973+0000 7fc10effd640 1 -- 172.21.15.132:0/131740159 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc0f800ddd0 con 0x7fc1100b4bb0 2024-04-16T15:53:55.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.973+0000 7fc114825640 1 --2- 172.21.15.132:0/131740159 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0f8006f50 0x7fc0f80073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:55.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.973+0000 7fc10ffff640 1 --2- 172.21.15.132:0/131740159 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0f8005bf0 0x7fc0f8005fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:55.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.973+0000 7fc10f7fe640 1 --2- 172.21.15.132:0/131740159 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1100b4bb0 0x7fc0f8006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:55.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.973+0000 7fc114825640 1 -- 172.21.15.132:0/131740159 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1100b4bb0 msgr2=0x7fc0f8006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:55.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.973+0000 7fc114825640 1 --2- 172.21.15.132:0/131740159 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1100b4bb0 0x7fc0f8006a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:55.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.973+0000 7fc114825640 1 -- 172.21.15.132:0/131740159 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0f8005bf0 msgr2=0x7fc0f8005fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:55.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.973+0000 7fc114825640 1 --2- 172.21.15.132:0/131740159 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0f8005bf0 0x7fc0f8005fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:55.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.973+0000 7fc114825640 1 -- 172.21.15.132:0/131740159 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0f8005730 con 0x7fc0f8006f50 2024-04-16T15:53:55.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.974+0000 7fc114825640 1 --2- 172.21.15.132:0/131740159 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0f8006f50 0x7fc0f80073d0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fc108009fc0 tx=0x7fc0f8007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22b76c29655ee5c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:55.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.974+0000 7fc10effd640 1 -- 172.21.15.132:0/131740159 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc108039070 con 0x7fc0f8006f50 2024-04-16T15:53:55.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.974+0000 7fc10effd640 1 -- 172.21.15.132:0/131740159 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc10802cc20 con 0x7fc0f8006f50 2024-04-16T15:53:55.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.974+0000 7fc10effd640 1 -- 172.21.15.132:0/131740159 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc108009c10 con 0x7fc0f8006f50 2024-04-16T15:53:55.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.974+0000 7fc116288640 1 -- 172.21.15.132:0/131740159 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0f8006f50 msgr2=0x7fc0f80073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:55.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.974+0000 7fc116288640 1 --2- 172.21.15.132:0/131740159 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0f8006f50 0x7fc0f80073d0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fc108009fc0 tx=0x7fc0f8007a40 comp rx=0 tx=0).stop 2024-04-16T15:53:55.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.974+0000 7fc114825640 1 -- 172.21.15.132:0/131740159 reap_dead start 2024-04-16T15:53:55.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.975+0000 7fc116288640 1 -- 172.21.15.132:0/131740159 shutdown_connections 2024-04-16T15:53:55.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.975+0000 7fc116288640 1 -- 172.21.15.132:0/131740159 >> 172.21.15.132:0/131740159 conn(0x7fc1100d0490 msgr2=0x7fc1100d08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:55.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.975+0000 7fc116288640 1 -- 172.21.15.132:0/131740159 shutdown_connections 2024-04-16T15:53:55.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.975+0000 7fc116288640 1 -- 172.21.15.132:0/131740159 wait complete. 2024-04-16T15:53:55.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.976+0000 7fc116288640 1 Processor -- start 2024-04-16T15:53:55.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.976+0000 7fc116288640 1 -- start start 2024-04-16T15:53:55.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.977+0000 7fc116288640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0f8006f50 0x7fc11014cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:55.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.977+0000 7fc116288640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc11015d850 0x7fc11015e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:55.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.977+0000 7fc116288640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc11015dcb0 0x7fc11015e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:55.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.977+0000 7fc116288640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fc1100b5740 con 0x7fc11015d850 2024-04-16T15:53:55.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.977+0000 7fc116288640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc1100b5040 con 0x7fc11015dcb0 2024-04-16T15:53:55.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.977+0000 7fc116288640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc11015bc20 con 0x7fc0f8006f50 2024-04-16T15:53:55.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.977+0000 7fc10f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc11015d850 0x7fc11015e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:55.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.977+0000 7fc10f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc11015d850 0x7fc11015e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38746/0 (socket says 172.21.15.132:38746) 2024-04-16T15:53:55.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.977+0000 7fc10f7fe640 1 -- 172.21.15.132:0/3669502802 learned_addr learned my addr 172.21.15.132:0/3669502802 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:55.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.977+0000 7fc10ffff640 1 --2- 172.21.15.132:0/3669502802 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0f8006f50 0x7fc11014cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:55.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.977+0000 7fc114825640 1 --2- 172.21.15.132:0/3669502802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc11015dcb0 0x7fc11015e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:55.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.977+0000 7fc10f7fe640 1 -- 172.21.15.132:0/3669502802 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0f8006f50 msgr2=0x7fc11014cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:55.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.977+0000 7fc10f7fe640 1 --2- 172.21.15.132:0/3669502802 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0f8006f50 0x7fc11014cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:55.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.977+0000 7fc10f7fe640 1 -- 172.21.15.132:0/3669502802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc11015dcb0 msgr2=0x7fc11015e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:55.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.977+0000 7fc10f7fe640 1 --2- 172.21.15.132:0/3669502802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc11015dcb0 0x7fc11015e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:55.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.977+0000 7fc10f7fe640 1 -- 172.21.15.132:0/3669502802 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc11014e1b0 con 0x7fc11015d850 2024-04-16T15:53:55.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.977+0000 7fc10f7fe640 1 --2- 172.21.15.132:0/3669502802 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc11015d850 0x7fc11015e3c0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc10400f7c0 tx=0x7fc10400fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:55.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.977+0000 7fc10cff9640 1 -- 172.21.15.132:0/3669502802 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1040052e0 con 0x7fc11015d850 2024-04-16T15:53:55.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.977+0000 7fc10cff9640 1 -- 172.21.15.132:0/3669502802 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc104018070 con 0x7fc11015d850 2024-04-16T15:53:55.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.977+0000 7fc116288640 1 -- 172.21.15.132:0/3669502802 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc11014e490 con 0x7fc11015d850 2024-04-16T15:53:55.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.977+0000 7fc10cff9640 1 -- 172.21.15.132:0/3669502802 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc10400d970 con 0x7fc11015d850 2024-04-16T15:53:55.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.977+0000 7fc116288640 1 -- 172.21.15.132:0/3669502802 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc11014ea50 con 0x7fc11015d850 2024-04-16T15:53:55.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.979+0000 7fc116288640 1 -- 172.21.15.132:0/3669502802 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc110075510 con 0x7fc11015d850 2024-04-16T15:53:55.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.979+0000 7fc10cff9640 1 -- 172.21.15.132:0/3669502802 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc10400db10 con 0x7fc11015d850 2024-04-16T15:53:55.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.979+0000 7fc10cff9640 1 --2- 172.21.15.132:0/3669502802 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fc0fc06c8f0 0x7fc0fc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:55.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.979+0000 7fc10cff9640 1 -- 172.21.15.132:0/3669502802 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5795+0+0 (secure 0 0 0) 0x7fc10408bb90 con 0x7fc11015d850 2024-04-16T15:53:55.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.979+0000 7fc10ffff640 1 --2- 172.21.15.132:0/3669502802 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fc0fc06c8f0 0x7fc0fc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:55.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.980+0000 7fc10ffff640 1 --2- 172.21.15.132:0/3669502802 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fc0fc06c8f0 0x7fc0fc06edb0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc100007fd0 tx=0x7fc100009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:55.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:55.984+0000 7fc10cff9640 1 -- 172.21.15.132:0/3669502802 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc10401a310 con 0x7fc11015d850 2024-04-16T15:53:56.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.160+0000 7fc116288640 1 -- 172.21.15.132:0/3669502802 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fc1100cfeb0 con 0x7fc11015d850 2024-04-16T15:53:56.165 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.166+0000 7fc10cff9640 1 -- 172.21.15.132:0/3669502802 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v11)=0 v11) ==== 123+0+0 (secure 0 0 0) 0x7fc104059f60 con 0x7fc11015d850 2024-04-16T15:53:56.166 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.167+0000 7fc10cff9640 1 -- 172.21.15.132:0/3669502802 <== mon.0 v2:172.21.15.132:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc104005480 con 0x7fc11015d850 2024-04-16T15:53:56.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.169+0000 7fc116288640 1 -- 172.21.15.132:0/3669502802 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fc0fc06c8f0 msgr2=0x7fc0fc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:56.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.169+0000 7fc116288640 1 --2- 172.21.15.132:0/3669502802 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fc0fc06c8f0 0x7fc0fc06edb0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc100007fd0 tx=0x7fc100009040 comp rx=0 tx=0).stop 2024-04-16T15:53:56.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.169+0000 7fc116288640 1 -- 172.21.15.132:0/3669502802 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc11015d850 msgr2=0x7fc11015e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:56.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.169+0000 7fc116288640 1 --2- 172.21.15.132:0/3669502802 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc11015d850 0x7fc11015e3c0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc10400f7c0 tx=0x7fc10400fc80 comp rx=0 tx=0).stop 2024-04-16T15:53:56.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.169+0000 7fc116288640 1 -- 172.21.15.132:0/3669502802 shutdown_connections 2024-04-16T15:53:56.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.169+0000 7fc116288640 1 --2- 172.21.15.132:0/3669502802 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7fc0fc06c8f0 0x7fc0fc06edb0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:56.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.169+0000 7fc116288640 1 --2- 172.21.15.132:0/3669502802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc11015dcb0 0x7fc11015e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:56.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.169+0000 7fc116288640 1 --2- 172.21.15.132:0/3669502802 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc11015d850 0x7fc11015e3c0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:56.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.169+0000 7fc116288640 1 --2- 172.21.15.132:0/3669502802 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0f8006f50 0x7fc11014cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:56.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.169+0000 7fc116288640 1 -- 172.21.15.132:0/3669502802 >> 172.21.15.132:0/3669502802 conn(0x7fc1100d0490 msgr2=0x7fc110071e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:56.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.169+0000 7fc116288640 1 -- 172.21.15.132:0/3669502802 shutdown_connections 2024-04-16T15:53:56.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.169+0000 7fc116288640 1 -- 172.21.15.132:0/3669502802 wait complete. 2024-04-16T15:53:56.179 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-16T15:53:56.180 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T15:53:56.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.283+0000 7f533584a640 1 Processor -- start 2024-04-16T15:53:56.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.283+0000 7f533584a640 1 -- start start 2024-04-16T15:53:56.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.284+0000 7f533584a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f533009ad10 0x7f533006cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:56.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.284+0000 7f533584a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f533009b0f0 0x7f533006d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:56.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.284+0000 7f533584a640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f533006dd50 con 0x7f53300b3d90 2024-04-16T15:53:56.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.284+0000 7f532e7fc640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f53300b3d90 0x7f533006d100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43330/0 (socket says 172.21.15.132:43330) 2024-04-16T15:53:56.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.284+0000 7f532e7fc640 1 -- 172.21.15.132:0/4156033443 learned_addr learned my addr 172.21.15.132:0/4156033443 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-16T15:53:56.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.284+0000 7f533584a640 1 -- 172.21.15.132:0/4156033443 --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f533009b7e0 con 0x7f533009ad10 2024-04-16T15:53:56.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.284+0000 7f533584a640 1 -- 172.21.15.132:0/4156033443 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f533009ba30 con 0x7f533009b0f0 2024-04-16T15:53:56.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.285+0000 7f532dffb640 1 -- 172.21.15.132:0/4156033443 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3174184180 0 0) 0x7f533006dd50 con 0x7f53300b3d90 2024-04-16T15:53:56.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.285+0000 7f532dffb640 1 -- 172.21.15.132:0/4156033443 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5318003520 con 0x7f53300b3d90 2024-04-16T15:53:56.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.285+0000 7f532f7fe640 1 --2- 172.21.15.132:0/4156033443 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f533009b0f0 0x7f533006d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:56.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.285+0000 7f532effd640 1 --2- 172.21.15.132:0/4156033443 >> v2:172.21.15.179:3300/0 conn(0x7f533009ad10 0x7f533006cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:56.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.285+0000 7f532dffb640 1 -- 172.21.15.132:0/4156033443 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3697423618 0 0) 0x7f5318003520 con 0x7f53300b3d90 2024-04-16T15:53:56.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.285+0000 7f532dffb640 1 -- 172.21.15.132:0/4156033443 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f533009b0f0 msgr2=0x7f533006d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:56.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.285+0000 7f532dffb640 1 --2- 172.21.15.132:0/4156033443 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f533009b0f0 0x7f533006d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:56.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.285+0000 7f532dffb640 1 -- 172.21.15.132:0/4156033443 >> v2:172.21.15.179:3300/0 conn(0x7f533009ad10 msgr2=0x7f533006cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:56.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.285+0000 7f532dffb640 1 --2- 172.21.15.132:0/4156033443 >> v2:172.21.15.179:3300/0 conn(0x7f533009ad10 0x7f533006cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:56.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.285+0000 7f532dffb640 1 -- 172.21.15.132:0/4156033443 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53300b2d10 con 0x7f53300b3d90 2024-04-16T15:53:56.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.285+0000 7f532dffb640 1 -- 172.21.15.132:0/4156033443 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2803668828 0 0) 0x7f5324001670 con 0x7f53300b3d90 2024-04-16T15:53:56.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.285+0000 7f532dffb640 1 -- 172.21.15.132:0/4156033443 >> v1:172.21.15.132:6789/0 conn(0x7f53300b3d90 legacy=0x7f533006d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:56.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.285+0000 7f532dffb640 1 --2- 172.21.15.132:0/4156033443 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53180039b0 0x7f5318003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:56.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.285+0000 7f532dffb640 1 --2- 172.21.15.132:0/4156033443 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f533009b0f0 0x7f5318004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:56.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.285+0000 7f532dffb640 1 --2- 172.21.15.132:0/4156033443 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5318004d40 0x7f53180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:56.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.285+0000 7f532dffb640 1 -- 172.21.15.132:0/4156033443 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f533009b7e0 con 0x7f5318004d40 2024-04-16T15:53:56.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.285+0000 7f532dffb640 1 -- 172.21.15.132:0/4156033443 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f533009ba30 con 0x7f53180039b0 2024-04-16T15:53:56.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.285+0000 7f532dffb640 1 -- 172.21.15.132:0/4156033443 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f531800b9c0 con 0x7f533009b0f0 2024-04-16T15:53:56.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.285+0000 7f532f7fe640 1 --2- 172.21.15.132:0/4156033443 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5318004d40 0x7f53180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:56.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.285+0000 7f532effd640 1 --2- 172.21.15.132:0/4156033443 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53180039b0 0x7f5318003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:56.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.285+0000 7f532e7fc640 1 --2- 172.21.15.132:0/4156033443 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f533009b0f0 0x7f5318004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:56.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.285+0000 7f532f7fe640 1 -- 172.21.15.132:0/4156033443 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f533009b0f0 msgr2=0x7f5318004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:56.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.285+0000 7f532f7fe640 1 --2- 172.21.15.132:0/4156033443 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f533009b0f0 0x7f5318004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:56.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.285+0000 7f532f7fe640 1 -- 172.21.15.132:0/4156033443 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53180039b0 msgr2=0x7f5318003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:53:56.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.285+0000 7f532f7fe640 1 --2- 172.21.15.132:0/4156033443 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53180039b0 0x7f5318003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:56.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.285+0000 7f532f7fe640 1 -- 172.21.15.132:0/4156033443 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5318003520 con 0x7f5318004d40 2024-04-16T15:53:56.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.286+0000 7f532f7fe640 1 --2- 172.21.15.132:0/4156033443 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5318004d40 0x7f53180051c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f5328009ac0 tx=0x7f5318005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b88c835f3ffecb1 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:56.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.286+0000 7f532dffb640 1 -- 172.21.15.132:0/4156033443 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5328039070 con 0x7f5318004d40 2024-04-16T15:53:56.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.286+0000 7f532dffb640 1 -- 172.21.15.132:0/4156033443 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f532802c680 con 0x7f5318004d40 2024-04-16T15:53:56.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.286+0000 7f532dffb640 1 -- 172.21.15.132:0/4156033443 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5328009690 con 0x7f5318004d40 2024-04-16T15:53:56.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.287+0000 7f533584a640 1 -- 172.21.15.132:0/4156033443 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5318004d40 msgr2=0x7f53180051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:56.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.287+0000 7f533584a640 1 --2- 172.21.15.132:0/4156033443 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5318004d40 0x7f53180051c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f5328009ac0 tx=0x7f5318005830 comp rx=0 tx=0).stop 2024-04-16T15:53:56.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.287+0000 7f532f7fe640 1 -- 172.21.15.132:0/4156033443 reap_dead start 2024-04-16T15:53:56.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.287+0000 7f533584a640 1 -- 172.21.15.132:0/4156033443 shutdown_connections 2024-04-16T15:53:56.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.287+0000 7f533584a640 1 -- 172.21.15.132:0/4156033443 >> 172.21.15.132:0/4156033443 conn(0x7f53300d2740 msgr2=0x7f53300d2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:56.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.287+0000 7f533584a640 1 -- 172.21.15.132:0/4156033443 shutdown_connections 2024-04-16T15:53:56.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.287+0000 7f533584a640 1 -- 172.21.15.132:0/4156033443 wait complete. 2024-04-16T15:53:56.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.288+0000 7f533584a640 1 Processor -- start 2024-04-16T15:53:56.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.288+0000 7f533584a640 1 -- start start 2024-04-16T15:53:56.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.289+0000 7f533584a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5318004d40 0x7f53300cf850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:56.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.289+0000 7f533584a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53300cb510 0x7f5330160d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:56.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.289+0000 7f533584a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f533015d0c0 0x7f533015d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:56.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.289+0000 7f533584a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f53300b3630 con 0x7f5318004d40 2024-04-16T15:53:56.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.289+0000 7f533584a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f53300b34b0 con 0x7f533015d0c0 2024-04-16T15:53:56.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.289+0000 7f533584a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f53300d2240 con 0x7f53300cb510 2024-04-16T15:53:56.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.289+0000 7f532effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5318004d40 0x7f53300cf850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:56.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.289+0000 7f532effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5318004d40 0x7f53300cf850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38758/0 (socket says 172.21.15.132:38758) 2024-04-16T15:53:56.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.289+0000 7f532effd640 1 -- 172.21.15.132:0/3616543699 learned_addr learned my addr 172.21.15.132:0/3616543699 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-16T15:53:56.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.289+0000 7f532e7fc640 1 --2- 172.21.15.132:0/3616543699 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53300cb510 0x7f5330160d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:56.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.289+0000 7f532f7fe640 1 --2- 172.21.15.132:0/3616543699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f533015d0c0 0x7f533015d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:56.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.289+0000 7f532effd640 1 -- 172.21.15.132:0/3616543699 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53300cb510 msgr2=0x7f5330160d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:56.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.289+0000 7f532effd640 1 --2- 172.21.15.132:0/3616543699 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53300cb510 0x7f5330160d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:56.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.289+0000 7f532effd640 1 -- 172.21.15.132:0/3616543699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f533015d0c0 msgr2=0x7f533015d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:56.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.289+0000 7f532effd640 1 --2- 172.21.15.132:0/3616543699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f533015d0c0 0x7f533015d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:56.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.289+0000 7f532effd640 1 -- 172.21.15.132:0/3616543699 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53300cbd00 con 0x7f5318004d40 2024-04-16T15:53:56.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.290+0000 7f532effd640 1 --2- 172.21.15.132:0/3616543699 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5318004d40 0x7f53300cf850 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f5320011e30 tx=0x7f532000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:56.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.290+0000 7f5317fff640 1 -- 172.21.15.132:0/3616543699 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5320015630 con 0x7f5318004d40 2024-04-16T15:53:56.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.290+0000 7f5317fff640 1 -- 172.21.15.132:0/3616543699 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f53200157d0 con 0x7f5318004d40 2024-04-16T15:53:56.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.290+0000 7f533584a640 1 -- 172.21.15.132:0/3616543699 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f533015e550 con 0x7f5318004d40 2024-04-16T15:53:56.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.290+0000 7f5317fff640 1 -- 172.21.15.132:0/3616543699 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5320015bc0 con 0x7f5318004d40 2024-04-16T15:53:56.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.290+0000 7f533584a640 1 -- 172.21.15.132:0/3616543699 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f533015eb10 con 0x7f5318004d40 2024-04-16T15:53:56.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.291+0000 7f533584a640 1 -- 172.21.15.132:0/3616543699 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f533015da80 con 0x7f5318004d40 2024-04-16T15:53:56.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.291+0000 7f5317fff640 1 -- 172.21.15.132:0/3616543699 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f532001d400 con 0x7f5318004d40 2024-04-16T15:53:56.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.292+0000 7f5317fff640 1 --2- 172.21.15.132:0/3616543699 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f531c06c8f0 0x7f531c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:53:56.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.292+0000 7f5317fff640 1 -- 172.21.15.132:0/3616543699 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5795+0+0 (secure 0 0 0) 0x7f532008cf00 con 0x7f5318004d40 2024-04-16T15:53:56.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.292+0000 7f532e7fc640 1 --2- 172.21.15.132:0/3616543699 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f531c06c8f0 0x7f531c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:53:56.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.292+0000 7f532e7fc640 1 --2- 172.21.15.132:0/3616543699 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f531c06c8f0 0x7f531c06edb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5324007fd0 tx=0x7f5324009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:53:56.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.296+0000 7f5317fff640 1 -- 172.21.15.132:0/3616543699 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5320019030 con 0x7f5318004d40 2024-04-16T15:53:56.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.510+0000 7f533584a640 1 -- 172.21.15.132:0/3616543699 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f533006e570 con 0x7f5318004d40 2024-04-16T15:53:56.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.510+0000 7f5317fff640 1 -- 172.21.15.132:0/3616543699 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+4367 (secure 0 0 0) 0x7f5320010040 con 0x7f5318004d40 2024-04-16T15:53:56.510 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-16T15:53:56.510 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/1515313270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1515313270},{"type":"v1","addr":"172.21.15.179:6833","nonce":1515313270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4790,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1873998575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1873998575},{"type":"v1","addr":"172.21.15.179:6835","nonce":1873998575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T15:53:18.546482+0000","modified":"2024-04-16T15:53:38.882153+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5232":{"gid":5232,"name":"c","rank":0,"incarnation":15,"state":"up:active","state_seq":11,"addr":"172.21.15.132:6836/1111207224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1111207224},{"type":"v1","addr":"172.21.15.132:6836","nonce":1111207224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5232,"qdb_cluster":[5232]},"id":2}]} 2024-04-16T15:53:56.511 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 18 2024-04-16T15:53:56.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.513+0000 7f533584a640 1 -- 172.21.15.132:0/3616543699 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f531c06c8f0 msgr2=0x7f531c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:56.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.513+0000 7f533584a640 1 --2- 172.21.15.132:0/3616543699 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f531c06c8f0 0x7f531c06edb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5324007fd0 tx=0x7f5324009040 comp rx=0 tx=0).stop 2024-04-16T15:53:56.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.513+0000 7f533584a640 1 -- 172.21.15.132:0/3616543699 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5318004d40 msgr2=0x7f53300cf850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:53:56.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.513+0000 7f533584a640 1 --2- 172.21.15.132:0/3616543699 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5318004d40 0x7f53300cf850 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f5320011e30 tx=0x7f532000f580 comp rx=0 tx=0).stop 2024-04-16T15:53:56.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.513+0000 7f533584a640 1 -- 172.21.15.132:0/3616543699 shutdown_connections 2024-04-16T15:53:56.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.513+0000 7f533584a640 1 --2- 172.21.15.132:0/3616543699 >> [v2:172.21.15.132:6832/3896387465,v1:172.21.15.132:6833/3896387465] conn(0x7f531c06c8f0 0x7f531c06edb0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:56.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.513+0000 7f533584a640 1 --2- 172.21.15.132:0/3616543699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f533015d0c0 0x7f533015d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:56.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.513+0000 7f533584a640 1 --2- 172.21.15.132:0/3616543699 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53300cb510 0x7f5330160d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:56.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.513+0000 7f533584a640 1 --2- 172.21.15.132:0/3616543699 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5318004d40 0x7f53300cf850 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:53:56.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.513+0000 7f533584a640 1 -- 172.21.15.132:0/3616543699 >> 172.21.15.132:0/3616543699 conn(0x7f53300d2740 msgr2=0x7f53300b79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:53:56.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.513+0000 7f533584a640 1 -- 172.21.15.132:0/3616543699 shutdown_connections 2024-04-16T15:53:56.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-16T15:53:56.513+0000 7f533584a640 1 -- 172.21.15.132:0/3616543699 wait complete. 2024-04-16T15:53:56.526 DEBUG:tasks.cephfs.filesystem:already dead... 2024-04-16T15:53:56.527 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-16T15:53:56.527 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-16T15:53:56.527 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T15:53:56.527 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T15:53:56.528 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi132 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a' 2024-04-16T15:53:56.535 INFO:tasks.ceph.mds.a:Stopped 2024-04-16T15:53:56.536 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-16T15:53:56.536 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T15:53:56.546 INFO:tasks.ceph.mds.c:Stopped 2024-04-16T15:53:56.546 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-16T15:53:56.546 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T15:53:56.559 INFO:tasks.ceph.mds.b:Stopped 2024-04-16T15:53:56.559 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-16T15:53:56.559 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T15:53:56.611 INFO:tasks.ceph.mds.d:Stopped 2024-04-16T15:53:56.611 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-16T15:53:56.611 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-16T15:53:56.612 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T15:53:56.639 INFO:tasks.ceph.osd.0:Stopped 2024-04-16T15:53:56.639 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-16T15:53:56.639 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T15:53:56.712 INFO:tasks.ceph.osd.1:Stopped 2024-04-16T15:53:56.712 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-16T15:53:56.713 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T15:53:56.780 INFO:tasks.ceph.osd.2:Stopped 2024-04-16T15:53:56.781 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-16T15:53:56.781 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T15:53:56.847 INFO:tasks.ceph.osd.3:Stopped 2024-04-16T15:53:56.847 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-16T15:53:56.847 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T15:53:56.877 INFO:tasks.ceph.osd.4:Stopped 2024-04-16T15:53:56.878 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-16T15:53:56.878 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T15:53:56.945 INFO:tasks.ceph.osd.5:Stopped 2024-04-16T15:53:56.946 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-16T15:53:56.946 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T15:53:57.026 INFO:tasks.ceph.osd.6:Stopped 2024-04-16T15:53:57.027 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-16T15:53:57.027 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T15:53:57.093 INFO:tasks.ceph.osd.7:Stopped 2024-04-16T15:53:57.093 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-16T15:53:57.093 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-16T15:53:57.093 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T15:53:57.120 INFO:tasks.ceph.mgr.y:Stopped 2024-04-16T15:53:57.120 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-16T15:53:57.120 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T15:53:57.161 INFO:tasks.ceph.mgr.x:Stopped 2024-04-16T15:53:57.161 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-16T15:53:57.161 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-16T15:53:57.162 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T15:53:57.172 INFO:tasks.ceph.mon.a:Stopped 2024-04-16T15:53:57.173 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-16T15:53:57.173 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T15:53:57.213 INFO:tasks.ceph.mon.b:Stopped 2024-04-16T15:53:57.214 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-16T15:53:57.214 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T15:53:57.267 INFO:tasks.ceph.mon.c:Stopped 2024-04-16T15:53:57.267 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-16T15:53:57.267 DEBUG:teuthology.orchestra.run.smithi132:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'bad backtrace' | egrep -v 'object missing on disk' | egrep -v 'error reading table object' | egrep -v 'error reading sessionmap' | egrep -v 'unmatched fragstat' | egrep -v 'unmatched rstat' | egrep -v 'was unreadable, recreating it now' | egrep -v 'Scrub error on inode' | egrep -v 'Metadata damage detected' | egrep -v 'inconsistent rstat on inode' | egrep -v 'Error recovering journal' | head -n 1 2024-04-16T15:53:57.306 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi132.front.sepia.ceph.com 2024-04-16T15:53:57.307 DEBUG:teuthology.orchestra.run.smithi132:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-16T15:53:57.562 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi132.front.sepia.ceph.com 2024-04-16T15:53:57.562 DEBUG:teuthology.orchestra.run.smithi132:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-16T15:53:57.645 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi132.front.sepia.ceph.com 2024-04-16T15:53:57.645 DEBUG:teuthology.orchestra.run.smithi132:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-16T15:53:57.693 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi132.front.sepia.ceph.com 2024-04-16T15:53:57.693 DEBUG:teuthology.orchestra.run.smithi132:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-16T15:53:57.744 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi179.front.sepia.ceph.com 2024-04-16T15:53:57.744 DEBUG:teuthology.orchestra.run.smithi179:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-16T15:53:57.916 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi179.front.sepia.ceph.com 2024-04-16T15:53:57.916 DEBUG:teuthology.orchestra.run.smithi179:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-16T15:53:57.994 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi179.front.sepia.ceph.com 2024-04-16T15:53:57.995 DEBUG:teuthology.orchestra.run.smithi179:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-16T15:53:58.053 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi179.front.sepia.ceph.com 2024-04-16T15:53:58.053 DEBUG:teuthology.orchestra.run.smithi179:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-16T15:53:58.112 INFO:tasks.ceph:Archiving mon data... 2024-04-16T15:53:58.113 DEBUG:teuthology.misc:Transferring archived files from smithi132:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658194/data/mon.a.tgz 2024-04-16T15:53:58.114 DEBUG:teuthology.orchestra.run.smithi132:> mktemp 2024-04-16T15:53:58.130 INFO:teuthology.orchestra.run.smithi132.stdout:/tmp/tmp.cKPwbgTStv 2024-04-16T15:53:58.131 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.cKPwbgTStv 2024-04-16T15:53:58.264 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 0666 /tmp/tmp.cKPwbgTStv 2024-04-16T15:53:58.351 DEBUG:teuthology.orchestra.remote:smithi132:/tmp/tmp.cKPwbgTStv is 286KB 2024-04-16T15:53:58.445 DEBUG:teuthology.orchestra.run.smithi132:> rm -fr /tmp/tmp.cKPwbgTStv 2024-04-16T15:53:58.461 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658194/data/mon.b.tgz 2024-04-16T15:53:58.461 DEBUG:teuthology.orchestra.run.smithi179:> mktemp 2024-04-16T15:53:58.479 INFO:teuthology.orchestra.run.smithi179.stdout:/tmp/tmp.yHJ2ZHIhl1 2024-04-16T15:53:58.480 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.yHJ2ZHIhl1 2024-04-16T15:53:58.632 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0666 /tmp/tmp.yHJ2ZHIhl1 2024-04-16T15:53:58.721 DEBUG:teuthology.orchestra.remote:smithi179:/tmp/tmp.yHJ2ZHIhl1 is 385KB 2024-04-16T15:53:58.818 DEBUG:teuthology.orchestra.run.smithi179:> rm -fr /tmp/tmp.yHJ2ZHIhl1 2024-04-16T15:53:58.834 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658194/data/mon.c.tgz 2024-04-16T15:53:58.834 DEBUG:teuthology.orchestra.run.smithi179:> mktemp 2024-04-16T15:53:58.889 INFO:teuthology.orchestra.run.smithi179.stdout:/tmp/tmp.7lpHL7YZH8 2024-04-16T15:53:58.889 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.7lpHL7YZH8 2024-04-16T15:53:59.024 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0666 /tmp/tmp.7lpHL7YZH8 2024-04-16T15:53:59.112 DEBUG:teuthology.orchestra.remote:smithi179:/tmp/tmp.7lpHL7YZH8 is 385KB 2024-04-16T15:53:59.208 DEBUG:teuthology.orchestra.run.smithi179:> rm -fr /tmp/tmp.7lpHL7YZH8 2024-04-16T15:53:59.223 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-16T15:53:59.223 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-16T15:53:59.226 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-16T15:53:59.311 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-16T15:53:59.335 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-04-16T15:53:59.347 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-16T15:53:59.348 INFO:tasks.ceph:Archiving crash dumps... 2024-04-16T15:53:59.349 DEBUG:teuthology.misc:Transferring archived files from smithi132:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658194/remote/smithi132/crash 2024-04-16T15:53:59.350 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-16T15:53:59.391 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658194/remote/smithi179/crash 2024-04-16T15:53:59.392 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-16T15:53:59.419 INFO:tasks.ceph:Shutting down logrotate 2024-04-16T15:53:59.419 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T15:53:59.426 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T15:53:59.513 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-16T15:53:59.542 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-16T15:53:59.573 INFO:tasks.ceph:Compressing logs... 2024-04-16T15:53:59.574 DEBUG:teuthology.orchestra.run.smithi132:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-16T15:53:59.585 DEBUG:teuthology.orchestra.run.smithi179:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-16T15:53:59.669 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37381.log 2024-04-16T15:53:59.670 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-16T15:53:59.670 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37261.log 2024-04-16T15:53:59.670 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.37381.log: /var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37541.log 2024-04-16T15:53:59.670 INFO:teuthology.orchestra.run.smithi179.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.37381.log.gz 2024-04-16T15:53:59.670 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.37261.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-16T15:53:59.670 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.37541.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37261.log.gz 2024-04-16T15:53:59.671 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-16T15:53:59.671 INFO:teuthology.orchestra.run.smithi179.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37541.log.gz 2024-04-16T15:53:59.671 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43520.log 2024-04-16T15:53:59.671 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-16T15:53:59.671 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.1.43520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37301.log 2024-04-16T15:53:59.671 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37461.log 2024-04-16T15:53:59.671 INFO:teuthology.orchestra.run.smithi179.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.1.43520.log.gz 2024-04-16T15:53:59.671 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.37301.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-16T15:53:59.671 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37501.log 2024-04-16T15:53:59.672 INFO:teuthology.orchestra.run.smithi179.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37301.log.gz 2024-04-16T15:53:59.672 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.37461.log: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-16T15:53:59.672 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-16T15:53:59.672 INFO:teuthology.orchestra.run.smithi179.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37461.log.gz 2024-04-16T15:53:59.672 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.37501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37421.log 2024-04-16T15:53:59.672 INFO:teuthology.orchestra.run.smithi179.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37501.log.gz 2024-04-16T15:53:59.672 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.43987.log 2024-04-16T15:53:59.672 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.37421.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-16T15:53:59.673 INFO:teuthology.orchestra.run.smithi179.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37421.log.gz 2024-04-16T15:53:59.673 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.3.43987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37341.log 2024-04-16T15:53:59.673 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-16T15:53:59.673 INFO:teuthology.orchestra.run.smithi179.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.3.43987.log.gz 2024-04-16T15:53:59.673 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.37341.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37341.log.gz 2024-04-16T15:53:59.673 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-16T15:53:59.673 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-16T15:53:59.673 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-mon.b.log: 91.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-16T15:53:59.673 INFO:teuthology.orchestra.run.smithi179.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-16T15:53:59.674 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-16T15:53:59.674 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mon.c.log: 91.6% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-16T15:53:59.674 INFO:teuthology.orchestra.run.smithi179.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-16T15:53:59.725 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51127.log 2024-04-16T15:53:59.725 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47702.log 2024-04-16T15:53:59.725 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.51127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51562.log 2024-04-16T15:53:59.725 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-16T15:53:59.725 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.47702.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51127.log.gz 2024-04-16T15:53:59.726 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.51562.log: gzip 89.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.47702.log.gz --verbose 2024-04-16T15:53:59.726 INFO:teuthology.orchestra.run.smithi132.stderr: -- /var/log/ceph/ceph-client.admin.45788.log 2024-04-16T15:53:59.726 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-mon.a.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51562.log.gz 2024-04-16T15:53:59.726 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47492.log 2024-04-16T15:53:59.726 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43582.log 2024-04-16T15:53:59.726 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.45788.log: gzip/var/log/ceph/ceph-client.admin.47492.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.49313.log 2024-04-16T15:53:59.726 INFO:teuthology.orchestra.run.smithi132.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45788.log.gz 2024-04-16T15:53:59.726 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.43582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44330.log 2024-04-16T15:53:59.726 INFO:teuthology.orchestra.run.smithi132.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47492.log.gz 2024-04-16T15:53:59.727 INFO:teuthology.orchestra.run.smithi132.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43582.log.gz 2024-04-16T15:53:59.727 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.49313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49769.log 2024-04-16T15:53:59.727 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.44330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52178.log 2024-04-16T15:53:59.727 INFO:teuthology.orchestra.run.smithi132.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49313.log.gz 2024-04-16T15:53:59.727 INFO:teuthology.orchestra.run.smithi132.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44330.log.gz 2024-04-16T15:53:59.727 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.49769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47996.log 2024-04-16T15:53:59.727 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.52178.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49769.log.gz 2024-04-16T15:53:59.727 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49517.log 2024-04-16T15:53:59.727 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.47996.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52178.log.gz 2024-04-16T15:53:59.728 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44331.log 2024-04-16T15:53:59.728 INFO:teuthology.orchestra.run.smithi132.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47996.log.gz 2024-04-16T15:53:59.728 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.49517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49129.log 2024-04-16T15:53:59.728 INFO:teuthology.orchestra.run.smithi132.stderr: 89.6%/var/log/ceph/ceph-client.admin.44331.log: -- replaced with /var/log/ceph/ceph-client.admin.49517.log.gz 2024-04-16T15:53:59.728 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47744.log 2024-04-16T15:53:59.728 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.49129.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44331.log.gz 2024-04-16T15:53:59.728 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50957.log 2024-04-16T15:53:59.728 INFO:teuthology.orchestra.run.smithi132.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49129.log.gz 2024-04-16T15:53:59.729 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.47744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48151.log 2024-04-16T15:53:59.729 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.50957.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47744.log.gz 2024-04-16T15:53:59.729 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51352.log 2024-04-16T15:53:59.729 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.48151.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50957.log.gz 2024-04-16T15:53:59.729 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45003.log 2024-04-16T15:53:59.729 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.51352.log: 89.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.48151.log.gz 2024-04-16T15:53:59.729 INFO:teuthology.orchestra.run.smithi132.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.48677.log 2024-04-16T15:53:59.729 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.45003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44024.log 2024-04-16T15:53:59.729 INFO:teuthology.orchestra.run.smithi132.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51352.log.gz 2024-04-16T15:53:59.730 INFO:teuthology.orchestra.run.smithi132.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45003.log.gz 2024-04-16T15:53:59.730 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.48677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48515.log 2024-04-16T15:53:59.730 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.44024.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48677.log.gz 2024-04-16T15:53:59.730 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52923.log 2024-04-16T15:53:59.730 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.48515.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44024.log.gz 2024-04-16T15:53:59.730 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45704.log 2024-04-16T15:53:59.730 INFO:teuthology.orchestra.run.smithi132.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48515.log.gz 2024-04-16T15:53:59.730 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.52923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52881.log 2024-04-16T15:53:59.730 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.45704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43248.log 2024-04-16T15:53:59.731 INFO:teuthology.orchestra.run.smithi132.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52923.log.gz 2024-04-16T15:53:59.731 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.52881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48761.log 2024-04-16T15:53:59.731 INFO:teuthology.orchestra.run.smithi132.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45704.log.gz 2024-04-16T15:53:59.731 INFO:teuthology.orchestra.run.smithi132.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52881.log.gz 2024-04-16T15:53:59.731 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.43248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51264.log 2024-04-16T15:53:59.731 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43898.log 2024-04-16T15:53:59.731 INFO:teuthology.orchestra.run.smithi132.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43248.log.gz 2024-04-16T15:53:59.731 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.48761.log: /var/log/ceph/ceph-client.admin.51264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52598.log 2024-04-16T15:53:59.731 INFO:teuthology.orchestra.run.smithi132.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48761.log.gz 2024-04-16T15:53:59.732 INFO:teuthology.orchestra.run.smithi132.stderr: 88.1%/var/log/ceph/ceph-client.admin.43898.log: -- replaced with /var/log/ceph/ceph-client.admin.51264.log.gz 2024-04-16T15:53:59.732 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49397.log 2024-04-16T15:53:59.732 INFO:teuthology.orchestra.run.smithi132.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43898.log.gz 2024-04-16T15:53:59.732 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44661.log 2024-04-16T15:53:59.732 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.52598.log: /var/log/ceph/ceph-client.admin.49397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52304.log 2024-04-16T15:53:59.733 INFO:teuthology.orchestra.run.smithi132.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52598.log.gz 2024-04-16T15:53:59.733 INFO:teuthology.orchestra.run.smithi132.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49397.log.gz 2024-04-16T15:53:59.733 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43626.log 2024-04-16T15:53:59.733 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.44661.log: /var/log/ceph/ceph-client.admin.52304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44332.log 2024-04-16T15:53:59.733 INFO:teuthology.orchestra.run.smithi132.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44661.log.gz 2024-04-16T15:53:59.733 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.43626.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52304.log.gz 2024-04-16T15:53:59.733 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47660.log 2024-04-16T15:53:59.733 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.44332.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43626.log.gz 2024-04-16T15:53:59.733 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48346.log 2024-04-16T15:53:59.734 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.47660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50021.log 2024-04-16T15:53:59.734 INFO:teuthology.orchestra.run.smithi132.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44332.log.gz 2024-04-16T15:53:59.734 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.48346.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47660.log.gz 2024-04-16T15:53:59.734 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47408.log 2024-04-16T15:53:59.734 INFO:teuthology.orchestra.run.smithi132.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48346.log.gz 2024-04-16T15:53:59.734 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.50021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43329.log 2024-04-16T15:53:59.734 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.47408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51646.log 2024-04-16T15:53:59.734 INFO:teuthology.orchestra.run.smithi132.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50021.log.gz 2024-04-16T15:53:59.735 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.43329.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47408.log.gz 2024-04-16T15:53:59.735 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43940.log 2024-04-16T15:53:59.735 INFO:teuthology.orchestra.run.smithi132.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43329.log.gz 2024-04-16T15:53:59.735 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.51646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50231.log 2024-04-16T15:53:59.735 INFO:teuthology.orchestra.run.smithi132.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51646.log.gz 2024-04-16T15:53:59.735 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.43940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46464.log 2024-04-16T15:53:59.735 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.50231.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43940.log.gz 2024-04-16T15:53:59.735 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44656.log 2024-04-16T15:53:59.735 INFO:teuthology.orchestra.run.smithi132.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50231.log.gz 2024-04-16T15:53:59.736 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.46464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47366.log 2024-04-16T15:53:59.736 INFO:teuthology.orchestra.run.smithi132.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46464.log.gz 2024-04-16T15:53:59.736 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.44656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49895.log 2024-04-16T15:53:59.736 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.47366.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44656.log.gz 2024-04-16T15:53:59.736 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49045.log 2024-04-16T15:53:59.736 INFO:teuthology.orchestra.run.smithi132.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47366.log.gz 2024-04-16T15:53:59.736 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.49895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50729.log 2024-04-16T15:53:59.736 INFO:teuthology.orchestra.run.smithi132.stderr: 88.3%/var/log/ceph/ceph-client.admin.49045.log: -- replaced with /var/log/ceph/ceph-client.admin.49895.log.gz 2024-04-16T15:53:59.736 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44328.log 2024-04-16T15:53:59.737 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.50729.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49045.log.gz 2024-04-16T15:53:59.737 INFO:teuthology.orchestra.run.smithi132.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50729.log.gz 2024-04-16T15:53:59.737 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52052.log 2024-04-16T15:53:59.737 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.44328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47450.log 2024-04-16T15:53:59.737 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.52052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44998.log 2024-04-16T15:53:59.737 INFO:teuthology.orchestra.run.smithi132.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44328.log.gz 2024-04-16T15:53:59.737 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.47450.log: gzip 89.1% -5 -- replaced with /var/log/ceph/ceph-client.admin.52052.log.gz 2024-04-16T15:53:59.737 INFO:teuthology.orchestra.run.smithi132.stderr: --verbose -- /var/log/ceph/ceph-client.admin.43814.log 2024-04-16T15:53:59.737 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.44998.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47450.log.gz 2024-04-16T15:53:59.738 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51520.log 2024-04-16T15:53:59.738 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.43814.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44998.log.gz 2024-04-16T15:53:59.738 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48971.log 2024-04-16T15:53:59.738 INFO:teuthology.orchestra.run.smithi132.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43814.log.gz 2024-04-16T15:53:59.738 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.51520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44323.log 2024-04-16T15:53:59.738 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.48971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50771.log 2024-04-16T15:53:59.738 INFO:teuthology.orchestra.run.smithi132.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51520.log.gz 2024-04-16T15:53:59.738 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.44323.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48971.log.gz 2024-04-16T15:53:59.738 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45004.log 2024-04-16T15:53:59.739 INFO:teuthology.orchestra.run.smithi132.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44323.log.gz 2024-04-16T15:53:59.739 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.50771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49979.log 2024-04-16T15:53:59.739 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.45004.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50771.log.gz 2024-04-16T15:53:59.739 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44108.log 2024-04-16T15:53:59.739 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.49979.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45004.log.gz 2024-04-16T15:53:59.739 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45452.log 2024-04-16T15:53:59.740 INFO:teuthology.orchestra.run.smithi132.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49979.log.gz 2024-04-16T15:53:59.740 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.44108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44668.log 2024-04-16T15:53:59.740 INFO:teuthology.orchestra.run.smithi132.stderr: 88.9%/var/log/ceph/ceph-client.admin.45452.log: -- replaced with /var/log/ceph/ceph-client.admin.44108.log.gz 2024-04-16T15:53:59.740 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47954.log 2024-04-16T15:53:59.740 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.44668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50897.log 2024-04-16T15:53:59.740 INFO:teuthology.orchestra.run.smithi132.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45452.log.gz 2024-04-16T15:53:59.740 INFO:teuthology.orchestra.run.smithi132.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44668.log.gz 2024-04-16T15:53:59.740 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.47954.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-16T15:53:59.740 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.50897.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47954.log.gz 2024-04-16T15:53:59.741 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52682.log 2024-04-16T15:53:59.741 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph.audit.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50897.log.gz 2024-04-16T15:53:59.741 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48286.log 2024-04-16T15:53:59.741 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.52682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43414.log 2024-04-16T15:53:59.741 INFO:teuthology.orchestra.run.smithi132.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52682.log.gz 2024-04-16T15:53:59.741 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.48286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51306.log 2024-04-16T15:53:59.741 INFO:teuthology.orchestra.run.smithi132.stderr: 89.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-16T15:53:59.741 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47912.log 2024-04-16T15:53:59.742 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.43414.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48286.log.gz 2024-04-16T15:53:59.742 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.51306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52430.log 2024-04-16T15:53:59.742 INFO:teuthology.orchestra.run.smithi132.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43414.log.gz 2024-04-16T15:53:59.742 INFO:teuthology.orchestra.run.smithi132.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51306.log.gz 2024-04-16T15:53:59.742 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.47912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45662.log 2024-04-16T15:53:59.742 INFO:teuthology.orchestra.run.smithi132.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47912.log.gz 2024-04-16T15:53:59.742 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.52430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50357.log 2024-04-16T15:53:59.742 INFO:teuthology.orchestra.run.smithi132.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52430.log.gz 2024-04-16T15:53:59.742 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.45662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50645.log 2024-04-16T15:53:59.743 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.50357.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45662.log.gz 2024-04-16T15:53:59.743 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51478.log 2024-04-16T15:53:59.743 INFO:teuthology.orchestra.run.smithi132.stderr: 89.2%/var/log/ceph/ceph-client.admin.50645.log: -- replaced with /var/log/ceph/ceph-client.admin.50357.log.gz 2024-04-16T15:53:59.743 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49685.log 2024-04-16T15:53:59.743 INFO:teuthology.orchestra.run.smithi132.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50645.log.gz 2024-04-16T15:53:59.743 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.51478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49601.log 2024-04-16T15:53:59.743 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.49685.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51478.log.gz 2024-04-16T15:53:59.743 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47004.log 2024-04-16T15:53:59.743 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.49601.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49685.log.gz 2024-04-16T15:53:59.744 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50687.log 2024-04-16T15:53:59.744 INFO:teuthology.orchestra.run.smithi132.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49601.log.gz 2024-04-16T15:53:59.744 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.47004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51436.log 2024-04-16T15:53:59.744 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.50687.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47004.log.gz 2024-04-16T15:53:59.744 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45620.log 2024-04-16T15:53:59.744 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.51436.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50687.log.gz 2024-04-16T15:53:59.744 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52556.log 2024-04-16T15:53:59.744 INFO:teuthology.orchestra.run.smithi132.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51436.log.gz 2024-04-16T15:53:59.745 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.45620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44066.log 2024-04-16T15:53:59.745 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.52556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50189.log 2024-04-16T15:53:59.745 INFO:teuthology.orchestra.run.smithi132.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45620.log.gz 2024-04-16T15:53:59.745 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.44066.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52556.log.gz 2024-04-16T15:53:59.745 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52472.log 2024-04-16T15:53:59.745 INFO:teuthology.orchestra.run.smithi132.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44066.log.gz 2024-04-16T15:53:59.745 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.50189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47828.log 2024-04-16T15:53:59.745 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.52472.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50189.log.gz 2024-04-16T15:53:59.745 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44662.log 2024-04-16T15:53:59.745 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.47828.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52472.log.gz 2024-04-16T15:53:59.746 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50063.log 2024-04-16T15:53:59.746 INFO:teuthology.orchestra.run.smithi132.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47828.log.gz 2024-04-16T15:53:59.746 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.44662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47324.log 2024-04-16T15:53:59.746 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.50063.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44662.log.gz 2024-04-16T15:53:59.746 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49559.log 2024-04-16T15:53:59.746 INFO:teuthology.orchestra.run.smithi132.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50063.log.gz 2024-04-16T15:53:59.746 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.47324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48237.log 2024-04-16T15:53:59.746 INFO:teuthology.orchestra.run.smithi132.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47324.log.gz 2024-04-16T15:53:59.747 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.49559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49937.log 2024-04-16T15:53:59.747 INFO:teuthology.orchestra.run.smithi132.stderr: 89.4%/var/log/ceph/ceph-client.admin.48237.log: -- replaced with /var/log/ceph/ceph-client.admin.49559.log.gz 2024-04-16T15:53:59.747 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52841.log 2024-04-16T15:53:59.747 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.49937.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48237.log.gz 2024-04-16T15:53:59.747 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51222.log 2024-04-16T15:53:59.747 INFO:teuthology.orchestra.run.smithi132.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49937.log.gz 2024-04-16T15:53:59.747 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.52841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50105.log 2024-04-16T15:53:59.747 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.51222.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52841.log.gz 2024-04-16T15:53:59.747 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46342.log 2024-04-16T15:53:59.748 INFO:teuthology.orchestra.run.smithi132.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.51222.log.gz 2024-04-16T15:53:59.748 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.50105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50603.log 2024-04-16T15:53:59.748 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.46342.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50105.log.gz 2024-04-16T15:53:59.748 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-16T15:53:59.748 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.50603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50315.log 2024-04-16T15:53:59.748 INFO:teuthology.orchestra.run.smithi132.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50603.log.gz 2024-04-16T15:53:59.748 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44321.log 2024-04-16T15:53:59.748 INFO:teuthology.orchestra.run.smithi132.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.0.46342.log.gz 2024-04-16T15:53:59.748 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49439.log 2024-04-16T15:53:59.749 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.50315.log: /var/log/ceph/ceph-client.admin.44321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49355.log 2024-04-16T15:53:59.749 INFO:teuthology.orchestra.run.smithi132.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50315.log.gz 2024-04-16T15:53:59.749 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.49439.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44321.log.gz 2024-04-16T15:53:59.749 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37461.log 2024-04-16T15:53:59.749 INFO:teuthology.orchestra.run.smithi132.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49439.log.gz 2024-04-16T15:53:59.749 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.49355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50273.log 2024-04-16T15:53:59.749 INFO:teuthology.orchestra.run.smithi132.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49355.log.gz 2024-04-16T15:53:59.749 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43688.log 2024-04-16T15:53:59.750 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.37461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47114.log 2024-04-16T15:53:59.750 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.50273.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37461.log.gz 2024-04-16T15:53:59.750 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.43688.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50273.log.gz 2024-04-16T15:53:59.750 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50399.log 2024-04-16T15:53:59.750 INFO:teuthology.orchestra.run.smithi132.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43688.log.gz 2024-04-16T15:53:59.750 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43456.log 2024-04-16T15:53:59.750 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.47114.log: /var/log/ceph/ceph-client.admin.50399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51394.log 2024-04-16T15:53:59.750 INFO:teuthology.orchestra.run.smithi132.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47114.log.gz 2024-04-16T15:53:59.750 INFO:teuthology.orchestra.run.smithi132.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50399.log.gz 2024-04-16T15:53:59.751 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.43456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45200.log 2024-04-16T15:53:59.751 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44324.log 2024-04-16T15:53:59.751 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.51394.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43456.log.gz 2024-04-16T15:53:59.751 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.45200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48194.log 2024-04-16T15:53:59.751 INFO:teuthology.orchestra.run.smithi132.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.51394.log.gz 2024-04-16T15:53:59.751 INFO:teuthology.orchestra.run.smithi132.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45200.log.gz 2024-04-16T15:53:59.751 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37566.log 2024-04-16T15:53:59.751 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.44324.log: /var/log/ceph/ceph-client.admin.48194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49171.log 2024-04-16T15:53:59.751 INFO:teuthology.orchestra.run.smithi132.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44324.log.gz 2024-04-16T15:53:59.752 INFO:teuthology.orchestra.run.smithi132.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48194.log.gz 2024-04-16T15:53:59.752 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.37566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48091.log 2024-04-16T15:53:59.752 INFO:teuthology.orchestra.run.smithi132.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37566.log.gz 2024-04-16T15:53:59.752 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46962.log 2024-04-16T15:53:59.752 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.49171.log: /var/log/ceph/ceph-client.admin.48091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43060.log 2024-04-16T15:53:59.752 INFO:teuthology.orchestra.run.smithi132.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49171.log.gz 2024-04-16T15:53:59.752 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.46962.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48091.log.gz 2024-04-16T15:53:59.752 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45536.log 2024-04-16T15:53:59.752 INFO:teuthology.orchestra.run.smithi132.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.46962.log.gz 2024-04-16T15:53:59.753 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.43060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52136.log 2024-04-16T15:53:59.753 INFO:teuthology.orchestra.run.smithi132.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43060.log.gz 2024-04-16T15:53:59.753 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44666.log 2024-04-16T15:53:59.753 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.45536.log: /var/log/ceph/ceph-client.admin.52136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47156.log 2024-04-16T15:53:59.753 INFO:teuthology.orchestra.run.smithi132.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45536.log.gz 2024-04-16T15:53:59.753 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.44666.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52136.log.gz 2024-04-16T15:53:59.753 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-16T15:53:59.753 INFO:teuthology.orchestra.run.smithi132.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44666.log.gz 2024-04-16T15:53:59.753 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52262.log 2024-04-16T15:53:59.754 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.47156.log: /var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37208.log 2024-04-16T15:53:59.754 INFO:teuthology.orchestra.run.smithi132.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47156.log.gz 2024-04-16T15:53:59.754 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.52262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47534.log 2024-04-16T15:53:59.754 INFO:teuthology.orchestra.run.smithi132.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52262.log.gz 2024-04-16T15:53:59.754 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.37208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45410.log 2024-04-16T15:53:59.754 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.47534.log: gzip -5 --verbose 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37208.log.gz 2024-04-16T15:53:59.754 INFO:teuthology.orchestra.run.smithi132.stderr: -- /var/log/ceph/ceph-client.admin.51926.log 88.9% 2024-04-16T15:53:59.754 INFO:teuthology.orchestra.run.smithi132.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47534.log.gz 2024-04-16T15:53:59.755 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.45410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52094.log 2024-04-16T15:53:59.755 INFO:teuthology.orchestra.run.smithi132.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.45410.log.gz 2024-04-16T15:53:59.755 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50855.log 2024-04-16T15:53:59.755 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.51926.log: /var/log/ceph/ceph-client.admin.52094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49811.log 2024-04-16T15:53:59.755 INFO:teuthology.orchestra.run.smithi132.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51926.log.gz 2024-04-16T15:53:59.755 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.50855.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52094.log.gz 2024-04-16T15:53:59.755 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45932.log 2024-04-16T15:53:59.755 INFO:teuthology.orchestra.run.smithi132.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.50855.log.gz 2024-04-16T15:53:59.755 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.49811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43982.log 2024-04-16T15:53:59.756 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45242.log 2024-04-16T15:53:59.756 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.45932.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49811.log.gz 2024-04-16T15:53:59.756 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.43982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45368.log 2024-04-16T15:53:59.756 INFO:teuthology.orchestra.run.smithi132.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45932.log.gz 2024-04-16T15:53:59.756 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.45242.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43982.log.gz 2024-04-16T15:53:59.756 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49213.log 2024-04-16T15:53:59.756 INFO:teuthology.orchestra.run.smithi132.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45242.log.gz 2024-04-16T15:53:59.756 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.45368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45746.log 2024-04-16T15:53:59.756 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51041.log 2024-04-16T15:53:59.757 INFO:teuthology.orchestra.run.smithi132.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45368.log.gz 2024-04-16T15:53:59.757 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.49213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44864.log 2024-04-16T15:53:59.757 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.45746.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49213.log.gz 2024-04-16T15:53:59.757 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.51041.log: gzip 88.3% -5 -- replaced with /var/log/ceph/ceph-client.admin.45746.log.gz --verbose 2024-04-16T15:53:59.757 INFO:teuthology.orchestra.run.smithi132.stderr: -- /var/log/ceph/ceph-client.admin.52724.log 2024-04-16T15:53:59.757 INFO:teuthology.orchestra.run.smithi132.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51041.log.gz 2024-04-16T15:53:59.757 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.44864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48635.log 2024-04-16T15:53:59.757 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48389.log 2024-04-16T15:53:59.757 INFO:teuthology.orchestra.run.smithi132.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44864.log.gz 2024-04-16T15:53:59.758 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.52724.log: /var/log/ceph/ceph-client.admin.48635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52640.log 2024-04-16T15:53:59.758 INFO:teuthology.orchestra.run.smithi132.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52724.log.gz 2024-04-16T15:53:59.758 INFO:teuthology.orchestra.run.smithi132.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48635.log.gz 2024-04-16T15:53:59.758 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.48389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44150.log 2024-04-16T15:53:59.758 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44999.log 2024-04-16T15:53:59.758 INFO:teuthology.orchestra.run.smithi132.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48389.log.gz 2024-04-16T15:53:59.758 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.52640.log: /var/log/ceph/ceph-client.admin.44150.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-16T15:53:59.758 INFO:teuthology.orchestra.run.smithi132.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52640.log.gz 2024-04-16T15:53:59.759 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.44999.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44150.log.gz 2024-04-16T15:53:59.759 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45002.log 2024-04-16T15:53:59.759 INFO:teuthology.orchestra.run.smithi132.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44999.log.gz 2024-04-16T15:53:59.759 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47870.log 2024-04-16T15:53:59.759 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43730.log 2024-04-16T15:53:59.759 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.45002.log: /var/log/ceph/ceph-client.admin.47870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43152.log 2024-04-16T15:53:59.759 INFO:teuthology.orchestra.run.smithi132.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45002.log.gz 2024-04-16T15:53:59.759 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.43730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52220.log 2024-04-16T15:53:59.759 INFO:teuthology.orchestra.run.smithi132.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47870.log.gz 2024-04-16T15:53:59.760 INFO:teuthology.orchestra.run.smithi132.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43730.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43540.log 2024-04-16T15:53:59.760 INFO:teuthology.orchestra.run.smithi132.stderr: 2024-04-16T15:53:59.760 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.43152.log: gzip/var/log/ceph/ceph-client.admin.52220.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.47618.log 2024-04-16T15:53:59.760 INFO:teuthology.orchestra.run.smithi132.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43152.log.gz 2024-04-16T15:53:59.760 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.43540.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52220.log.gz 2024-04-16T15:53:59.760 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49271.log 2024-04-16T15:53:59.760 INFO:teuthology.orchestra.run.smithi132.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43540.log.gz 2024-04-16T15:53:59.760 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.47618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44326.log 2024-04-16T15:53:59.760 INFO:teuthology.orchestra.run.smithi132.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47618.log.gz 2024-04-16T15:53:59.761 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.49271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51772.log 2024-04-16T15:53:59.761 INFO:teuthology.orchestra.run.smithi132.stderr:gzip 88.1%/var/log/ceph/ceph-client.admin.44326.log: -- replaced with /var/log/ceph/ceph-client.admin.49271.log.gz 2024-04-16T15:53:59.761 INFO:teuthology.orchestra.run.smithi132.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44660.log 2024-04-16T15:53:59.761 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.51772.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44326.log.gz 2024-04-16T15:53:59.761 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47198.log 2024-04-16T15:53:59.761 INFO:teuthology.orchestra.run.smithi132.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51772.log.gz 2024-04-16T15:53:59.761 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.44660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43498.log 2024-04-16T15:53:59.761 INFO:teuthology.orchestra.run.smithi132.stderr:gzip 88.6% -5 --verbose --/var/log/ceph/ceph-client.admin.47198.log: /var/log/ceph/ceph-client.admin.50147.log 2024-04-16T15:53:59.762 INFO:teuthology.orchestra.run.smithi132.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44660.log.gz 2024-04-16T15:53:59.762 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.43498.log: gzip 88.2% -5 --verbose -- /var/log/ceph/ceph-client.admin.51968.log 2024-04-16T15:53:59.762 INFO:teuthology.orchestra.run.smithi132.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47198.log.gz 2024-04-16T15:53:59.762 INFO:teuthology.orchestra.run.smithi132.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43498.log.gz 2024-04-16T15:53:59.762 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.50147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51730.log 2024-04-16T15:53:59.762 INFO:teuthology.orchestra.run.smithi132.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50147.log.gz 2024-04-16T15:53:59.763 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50999.log 2024-04-16T15:53:59.763 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.51968.log: gzip/var/log/ceph/ceph-client.admin.51730.log: -5 --verbose -- 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51968.log.gz 2024-04-16T15:53:59.763 INFO:teuthology.orchestra.run.smithi132.stderr: /var/log/ceph/ceph-client.admin.44667.log 2024-04-16T15:53:59.763 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.50999.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51730.log.gz 2024-04-16T15:53:59.763 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48431.log 2024-04-16T15:53:59.763 INFO:teuthology.orchestra.run.smithi132.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50999.log.gz 2024-04-16T15:53:59.763 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.44667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44994.log 2024-04-16T15:53:59.763 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.48431.log: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-16T15:53:59.764 INFO:teuthology.orchestra.run.smithi132.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44667.log.gz 2024-04-16T15:53:59.764 INFO:teuthology.orchestra.run.smithi132.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48431.log.gz 2024-04-16T15:53:59.764 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.44994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45284.log 2024-04-16T15:53:59.764 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-osd.0.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44994.log.gz 2024-04-16T15:53:59.764 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43371.log 2024-04-16T15:53:59.764 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.45284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51171.log 2024-04-16T15:53:59.764 INFO:teuthology.orchestra.run.smithi132.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45284.log.gz/var/log/ceph/ceph-client.admin.43371.log: 2024-04-16T15:53:59.764 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51604.log 2024-04-16T15:53:59.764 INFO:teuthology.orchestra.run.smithi132.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43371.log.gz 2024-04-16T15:53:59.765 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47786.log 2024-04-16T15:53:59.765 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.51171.log: /var/log/ceph/ceph-client.admin.51604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52010.log 2024-04-16T15:53:59.765 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.47786.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51171.log.gz 2024-04-16T15:53:59.765 INFO:teuthology.orchestra.run.smithi132.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51604.log.gz 2024-04-16T15:53:59.765 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50483.log 2024-04-16T15:53:59.765 INFO:teuthology.orchestra.run.smithi132.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47786.log.gz 2024-04-16T15:53:59.765 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52346.log 2024-04-16T15:53:59.765 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.52010.log: /var/log/ceph/ceph-client.admin.50483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52514.log 2024-04-16T15:53:59.765 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.52346.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52010.log.gz 2024-04-16T15:53:59.766 INFO:teuthology.orchestra.run.smithi132.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50483.log.gz 2024-04-16T15:53:59.766 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52346.log.gz 2024-04-16T15:53:59.766 INFO:teuthology.orchestra.run.smithi132.stderr: --verbose -- /var/log/ceph/ceph-client.admin.43856.log 2024-04-16T15:53:59.766 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.52514.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-16T15:53:59.766 INFO:teuthology.orchestra.run.smithi132.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52514.log.gz 2024-04-16T15:53:59.766 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.43856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43772.log 2024-04-16T15:53:59.766 INFO:teuthology.orchestra.run.smithi132.stderr: 89.3%/var/log/ceph/ceph.log: -- replaced with /var/log/ceph/ceph-client.admin.43856.log.gz 2024-04-16T15:53:59.766 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45001.log 2024-04-16T15:53:59.766 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-16T15:53:59.767 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.43772.log: 84.3%/var/log/ceph/ceph-client.admin.45001.log: -- replaced with /var/log/ceph/ceph.log.gz 2024-04-16T15:53:59.767 INFO:teuthology.orchestra.run.smithi132.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43772.log.gz 2024-04-16T15:53:59.767 INFO:teuthology.orchestra.run.smithi132.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45001.log.gz 2024-04-16T15:53:59.767 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-16T15:53:59.767 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48929.log 2024-04-16T15:53:59.767 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48845.log 2024-04-16T15:53:59.767 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.48929.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48929.log.gz 2024-04-16T15:53:59.767 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50813.log 2024-04-16T15:53:59.767 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.48845.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.48845.log.gz 2024-04-16T15:53:59.768 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49087.log 2024-04-16T15:53:59.768 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.50813.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50813.log.gz 2024-04-16T15:53:59.768 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49643.log 2024-04-16T15:53:59.768 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.49087.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.49087.log.gz 2024-04-16T15:53:59.768 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49853.log 2024-04-16T15:53:59.768 INFO:teuthology.orchestra.run.smithi132.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-16T15:53:59.768 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.49643.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49643.log.gz 2024-04-16T15:53:59.768 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.46840.log 2024-04-16T15:53:59.768 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48473.log 2024-04-16T15:53:59.769 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.49853.log: /var/log/ceph/ceph-client.2.46840.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49853.log.gz 2024-04-16T15:53:59.769 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48887.log 2024-04-16T15:53:59.769 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.48473.log: 90.8% 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48473.log.gz 2024-04-16T15:53:59.769 INFO:teuthology.orchestra.run.smithi132.stderr: -- replaced with /var/log/ceph/ceph-client.2.46840.log.gz 2024-04-16T15:53:59.769 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51083.log 2024-04-16T15:53:59.769 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50441.log 2024-04-16T15:53:59.769 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.48887.log: /var/log/ceph/ceph-client.admin.51083.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48887.log.gz 2024-04-16T15:53:59.769 INFO:teuthology.orchestra.run.smithi132.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51083.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45494.log 2024-04-16T15:53:59.770 INFO:teuthology.orchestra.run.smithi132.stderr: 2024-04-16T15:53:59.770 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.50441.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50441.log.gz 2024-04-16T15:53:59.770 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44665.log 2024-04-16T15:53:59.770 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48719.log 2024-04-16T15:53:59.770 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.45494.log: /var/log/ceph/ceph-client.admin.44665.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45494.log.gz 2024-04-16T15:53:59.770 INFO:teuthology.orchestra.run.smithi132.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44665.log.gz 2024-04-16T15:53:59.770 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48593.log 2024-04-16T15:53:59.770 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.48719.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48719.log.gz 2024-04-16T15:53:59.770 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.31192.log 2024-04-16T15:53:59.771 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45578.log 2024-04-16T15:53:59.771 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.48593.log: /var/log/ceph/ceph.tmp-client.admin.31192.log: 0.0% 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48593.log.gz 2024-04-16T15:53:59.771 INFO:teuthology.orchestra.run.smithi132.stderr: -- replaced with /var/log/ceph/ceph.tmp-client.admin.31192.log.gz 2024-04-16T15:53:59.771 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49727.log 2024-04-16T15:53:59.771 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47576.log 2024-04-16T15:53:59.771 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.45578.log: /var/log/ceph/ceph-client.admin.49727.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45578.log.gz 2024-04-16T15:53:59.771 INFO:teuthology.orchestra.run.smithi132.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49727.log.gz 2024-04-16T15:53:59.771 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45326.log 2024-04-16T15:53:59.771 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.47576.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47576.log.gz 2024-04-16T15:53:59.772 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47282.log 2024-04-16T15:53:59.772 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45830.log 2024-04-16T15:53:59.772 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.45326.log: /var/log/ceph/ceph-client.admin.47282.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.45326.log.gz 2024-04-16T15:53:59.772 INFO:teuthology.orchestra.run.smithi132.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47282.log.gz 2024-04-16T15:53:59.772 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52388.log 2024-04-16T15:53:59.772 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.45830.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.45830.log.gz 2024-04-16T15:53:59.772 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52766.log 2024-04-16T15:53:59.772 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47240.log 2024-04-16T15:53:59.772 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.52388.log: /var/log/ceph/ceph-client.admin.52766.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52388.log.gz 2024-04-16T15:53:59.773 INFO:teuthology.orchestra.run.smithi132.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52766.log.gz 2024-04-16T15:53:59.773 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-16T15:53:59.773 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.47240.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47240.log.gz 2024-04-16T15:53:59.773 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51688.log 2024-04-16T15:53:59.773 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48803.log 2024-04-16T15:53:59.773 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.51688.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51688.log.gz 2024-04-16T15:53:59.773 INFO:teuthology.orchestra.run.smithi132.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-16T15:53:59.773 INFO:teuthology.orchestra.run.smithi132.stderr: 89.8% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-16T15:53:59.774 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.48803.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48803.log.gz 2024-04-16T15:53:59.775 INFO:teuthology.orchestra.run.smithi132.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-16T15:53:59.775 INFO:teuthology.orchestra.run.smithi132.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-16T15:53:59.775 INFO:teuthology.orchestra.run.smithi132.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-16T15:53:59.775 INFO:teuthology.orchestra.run.smithi132.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-16T15:53:59.776 INFO:teuthology.orchestra.run.smithi179.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-16T15:53:59.776 INFO:teuthology.orchestra.run.smithi179.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-16T15:53:59.776 INFO:teuthology.orchestra.run.smithi179.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-16T15:53:59.776 INFO:teuthology.orchestra.run.smithi179.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-16T15:53:59.776 INFO:teuthology.orchestra.run.smithi179.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-16T15:53:59.802 INFO:teuthology.orchestra.run.smithi179.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-16T15:53:59.803 INFO:teuthology.orchestra.run.smithi179.stderr: 2024-04-16T15:53:59.804 INFO:teuthology.orchestra.run.smithi179.stderr:real 0m0.172s 2024-04-16T15:53:59.804 INFO:teuthology.orchestra.run.smithi179.stderr:user 0m0.662s 2024-04-16T15:53:59.804 INFO:teuthology.orchestra.run.smithi179.stderr:sys 0m0.046s 2024-04-16T15:53:59.815 INFO:teuthology.orchestra.run.smithi132.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-16T15:53:59.815 INFO:teuthology.orchestra.run.smithi132.stderr: 2024-04-16T15:53:59.815 INFO:teuthology.orchestra.run.smithi132.stderr:real 0m0.214s 2024-04-16T15:53:59.815 INFO:teuthology.orchestra.run.smithi132.stderr:user 0m0.751s 2024-04-16T15:53:59.816 INFO:teuthology.orchestra.run.smithi132.stderr:sys 0m0.167s 2024-04-16T15:53:59.816 INFO:tasks.ceph:Archiving logs... 2024-04-16T15:53:59.816 DEBUG:teuthology.misc:Transferring archived files from smithi132:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658194/remote/smithi132/log 2024-04-16T15:53:59.818 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-16T15:54:00.180 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658194/remote/smithi179/log 2024-04-16T15:54:00.181 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-16T15:54:00.330 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-16T15:54:00.340 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-16T15:54:00.341 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-16T15:54:00.343 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-16T15:54:00.439 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-16T15:54:00.449 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-16T15:54:00.450 DEBUG:teuthology.orchestra.run.smithi132:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-16T15:54:00.452 DEBUG:teuthology.orchestra.run.smithi179:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-16T15:54:00.466 INFO:teuthology.orchestra.run.smithi132.stderr:bash: line 1: ntpq: command not found 2024-04-16T15:54:00.468 INFO:teuthology.orchestra.run.smithi179.stderr:bash: line 1: ntpq: command not found 2024-04-16T15:54:00.469 INFO:teuthology.orchestra.run.smithi132.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-16T15:54:00.469 INFO:teuthology.orchestra.run.smithi132.stdout:=============================================================================== 2024-04-16T15:54:00.469 INFO:teuthology.orchestra.run.smithi132.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 18 +2295us[+2295us] +/- 79ms 2024-04-16T15:54:00.469 INFO:teuthology.orchestra.run.smithi132.stdout:^* hv02.front.sepia.ceph.com 3 6 377 19 -1695us[-1690us] +/- 60ms 2024-04-16T15:54:00.469 INFO:teuthology.orchestra.run.smithi132.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 19 -10us[ -10us] +/- 73ms 2024-04-16T15:54:00.469 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T15:54:00.472 INFO:teuthology.orchestra.run.smithi179.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-16T15:54:00.472 INFO:teuthology.orchestra.run.smithi179.stdout:=============================================================================== 2024-04-16T15:54:00.472 INFO:teuthology.orchestra.run.smithi179.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 18 +2279us[+2291us] +/- 80ms 2024-04-16T15:54:00.472 INFO:teuthology.orchestra.run.smithi179.stdout:^* hv02.front.sepia.ceph.com 3 6 377 17 -1699us[-1687us] +/- 60ms 2024-04-16T15:54:00.472 INFO:teuthology.orchestra.run.smithi179.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 18 +3030ns[ +16us] +/- 73ms 2024-04-16T15:54:00.472 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T15:54:00.473 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-16T15:54:00.483 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-16T15:54:00.484 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-16T15:54:00.494 DEBUG:teuthology.orchestra.run.smithi132:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-16T15:54:00.583 DEBUG:teuthology.orchestra.run.smithi179:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-16T15:54:00.653 DEBUG:teuthology.orchestra.run.smithi132:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-16T15:54:00.685 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T15:54:00.686 DEBUG:teuthology.orchestra.run.smithi179:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-16T15:54:00.716 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T15:54:00.717 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-16T15:54:00.729 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-16T15:54:00.740 INFO:teuthology.task.internal:Duration was 547.672757 seconds 2024-04-16T15:54:00.741 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-16T15:54:00.751 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-16T15:54:00.752 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-16T15:54:00.756 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-16T15:54:00.799 INFO:teuthology.orchestra.run.smithi132.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-16T15:54:00.802 INFO:teuthology.orchestra.run.smithi179.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-16T15:54:01.091 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-16T15:54:01.091 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi132.front.sepia.ceph.com 2024-04-16T15:54:01.091 DEBUG:teuthology.orchestra.run.smithi132:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-16T15:54:01.111 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi179.front.sepia.ceph.com 2024-04-16T15:54:01.112 DEBUG:teuthology.orchestra.run.smithi179:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-16T15:54:01.135 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-16T15:54:01.136 DEBUG:teuthology.orchestra.run.smithi132:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-16T15:54:01.154 DEBUG:teuthology.orchestra.run.smithi179:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-16T15:54:01.207 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-16T15:54:01.207 DEBUG:teuthology.orchestra.run.smithi132:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-16T15:54:01.225 DEBUG:teuthology.orchestra.run.smithi179:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-16T15:54:01.348 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-16T15:54:01.358 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-16T15:54:01.359 DEBUG:teuthology.orchestra.run.smithi132:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-16T15:54:01.388 DEBUG:teuthology.orchestra.run.smithi179:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-16T15:54:01.417 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-16T15:54:01.428 DEBUG:teuthology.orchestra.run.smithi132:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-16T15:54:01.434 DEBUG:teuthology.orchestra.run.smithi179:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-16T15:54:01.455 INFO:teuthology.orchestra.run.smithi132.stdout:kernel.core_pattern = core 2024-04-16T15:54:01.484 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern = core 2024-04-16T15:54:01.518 DEBUG:teuthology.orchestra.run.smithi132:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-16T15:54:01.533 WARNING:teuthology.task.internal:Found coredumps on ubuntu@smithi132.front.sepia.ceph.com, flagging run as failed 2024-04-16T15:54:01.534 DEBUG:teuthology.orchestra.run.smithi179:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-16T15:54:01.572 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T15:54:01.574 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-16T15:54:01.586 INFO:teuthology.task.internal:Transferring archived files... 2024-04-16T15:54:01.588 DEBUG:teuthology.misc:Transferring archived files from smithi132:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658194/remote/smithi132 2024-04-16T15:54:01.588 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-16T15:54:09.931 INFO:teuthology.task.internal:Transferring binaries for coredumps... 2024-04-16T15:54:10.307 INFO:teuthology.task.internal: core looks like: /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658194/remote/smithi132/coredump/1713282800.50544.core.gz: gzip compressed data, was "1713282800.50544.core", last modified: Tue Apr 16 15:54:01 2024, max compression, original size modulo 2^32 266985472 2024-04-16T15:54:10.308 INFO:teuthology.task.internal:core is compressed, try accessing gzip file ... 2024-04-16T15:54:11.427 INFO:teuthology.task.internal: core looks like: /tmp/tmpk0p2bcvi: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i a', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mds', platform: 'x86_64' 2024-04-16T15:54:11.457 INFO:teuthology.task.internal: dump_program: ceph-mds -f --cluster ceph -i a 2024-04-16T15:54:11.458 DEBUG:teuthology.orchestra.run.smithi132:> which 'ceph-mds -f --cluster ceph -i a' 2024-04-16T15:54:11.477 INFO:teuthology.orchestra.run.smithi132.stderr:/usr/bin/which: invalid option -- 'f' 2024-04-16T15:54:11.478 INFO:teuthology.orchestra.run.smithi132.stderr:/usr/bin/which: unrecognized option '--cluster' 2024-04-16T15:54:11.478 INFO:teuthology.orchestra.run.smithi132.stderr:/usr/bin/which: no a in (/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin) 2024-04-16T15:54:11.479 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T15:54:11.479 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/bin/ceph-mds 2024-04-16T15:54:11.479 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/bin/ceph 2024-04-16T15:54:11.480 ERROR:teuthology.run_tasks:Manager failed: internal.archive Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 420, in archive fetch_binaries_for_coredumps(path, rem) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 345, in fetch_binaries_for_coredumps remote_path = remote.sh(['which', dump_program]).rstrip() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 97, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi132 with status 1: "which 'ceph-mds -f --cluster ceph -i a'" 2024-04-16T15:54:11.494 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-16T15:54:11.504 INFO:teuthology.task.internal:Not uploading archives. 2024-04-16T15:54:11.505 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-16T15:54:11.518 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-16T15:54:11.518 DEBUG:teuthology.orchestra.run.smithi132:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-16T15:54:11.524 DEBUG:teuthology.orchestra.run.smithi179:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-16T15:54:11.540 INFO:teuthology.orchestra.run.smithi132.stdout: 265581 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Apr 16 15:54 /home/ubuntu/cephtest 2024-04-16T15:54:11.540 INFO:teuthology.orchestra.run.smithi132.stdout: 265589 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Apr 16 15:54 /home/ubuntu/cephtest/archive 2024-04-16T15:54:11.540 INFO:teuthology.orchestra.run.smithi132.stdout: 265597 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 16 15:54 /home/ubuntu/cephtest/archive/syslog 2024-04-16T15:54:11.540 INFO:teuthology.orchestra.run.smithi132.stdout: 265425 4 -rw-rw-rw- 1 ubuntu ubuntu 29 Apr 16 15:44 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2024-04-16T15:54:11.541 INFO:teuthology.orchestra.run.smithi132.stdout: 265427 4 -rw-rw-rw- 1 ubuntu ubuntu 29 Apr 16 15:44 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2024-04-16T15:54:11.541 INFO:teuthology.orchestra.run.smithi132.stdout: 265428 188 -rw-r--r-- 1 ubuntu ubuntu 188659 Apr 16 15:54 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-16T15:54:11.541 INFO:teuthology.orchestra.run.smithi132.stdout: 265408 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 16 15:54 /home/ubuntu/cephtest/archive/audit 2024-04-16T15:54:11.541 INFO:teuthology.orchestra.run.smithi132.stdout: 265426 144 -rw------- 1 ubuntu ubuntu 143809 Apr 16 15:54 /home/ubuntu/cephtest/archive/audit/audit.log.gz 2024-04-16T15:54:11.541 INFO:teuthology.orchestra.run.smithi132.stdout: 265596 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 16 15:53 /home/ubuntu/cephtest/archive/coredump 2024-04-16T15:54:11.541 INFO:teuthology.orchestra.run.smithi132.stdout: 267156 21160 -rw------- 1 root root 266985472 Apr 16 15:53 /home/ubuntu/cephtest/archive/coredump/1713282800.50544.core 2024-04-16T15:54:11.542 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T15:54:11.542 INFO:teuthology.orchestra.run.smithi132.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-04-16T15:54:11.543 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 420, in archive fetch_binaries_for_coredumps(path, rem) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 345, in fetch_binaries_for_coredumps remote_path = remote.sh(['which', dump_program]).rstrip() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 97, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi132 with status 1: "which 'ceph-mds -f --cluster ceph -i a'" During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi132 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-04-16T15:54:11.554 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-16T15:54:11.567 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-16T15:54:11.578 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi132 with status 1: "which 'ceph-mds -f --cluster ceph -i a'" 2024-04-16T15:54:11.578 INFO:teuthology.nuke:Checking targets against current locks 2024-04-16T15:54:11.586 INFO:teuthology.orchestra.run.smithi179.stdout: 266033 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Apr 16 15:54 /home/ubuntu/cephtest 2024-04-16T15:54:11.587 INFO:teuthology.orchestra.run.smithi179.stdout: 266034 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Apr 16 15:54 /home/ubuntu/cephtest/archive 2024-04-16T15:54:11.587 INFO:teuthology.orchestra.run.smithi179.stdout: 266043 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 16 15:54 /home/ubuntu/cephtest/archive/syslog 2024-04-16T15:54:11.587 INFO:teuthology.orchestra.run.smithi179.stdout: 265408 4 -rw-rw-rw- 1 ubuntu ubuntu 29 Apr 16 15:44 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2024-04-16T15:54:11.587 INFO:teuthology.orchestra.run.smithi179.stdout: 265421 4 -rw-rw-rw- 1 ubuntu ubuntu 29 Apr 16 15:44 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2024-04-16T15:54:11.587 INFO:teuthology.orchestra.run.smithi179.stdout: 265422 184 -rw-r--r-- 1 ubuntu ubuntu 186293 Apr 16 15:54 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-16T15:54:11.587 INFO:teuthology.orchestra.run.smithi179.stdout: 393219 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 16 15:54 /home/ubuntu/cephtest/archive/audit 2024-04-16T15:54:11.587 INFO:teuthology.orchestra.run.smithi179.stdout: 393502 128 -rw------- 1 ubuntu ubuntu 128272 Apr 16 15:54 /home/ubuntu/cephtest/archive/audit/audit.log.gz 2024-04-16T15:54:11.588 INFO:teuthology.orchestra.run.smithi179.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-04-16T15:54:11.608 DEBUG:teuthology.nuke:shortname: smithi132 2024-04-16T15:54:11.608 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-16T15:54:11.635 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi132.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658194', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-16 15:36:49.190889', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAGj1FBv5Iz75YFDuKEeyyv9NisIeN5NXdeIU6xePcTbrrspfcfZHUhQoySDhYSrWiff4Iq9J99v+k6vPUzdFKs='} 2024-04-16T15:54:11.640 DEBUG:teuthology.nuke:shortname: smithi179 2024-04-16T15:54:11.640 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-16T15:54:11.663 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi179.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658194', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-16 15:36:49.189330', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHGVpO59jxMDWCP3+d0/e01NXo1IE7S+xrBA/n/ovpbSdnwveoUOXumEksFbgCLNGQEvKpCY6McCzibhsq/UleA='} 2024-04-16T15:54:11.694 INFO:teuthology.orchestra.console.smithi132:Power off 2024-04-16T15:54:11.695 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-16T15:54:11.719 DEBUG:teuthology.orchestra.console.smithi132:power off output: Chassis Power Control: Down/Off 2024-04-16T15:54:11.719 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T15:54:11.738 INFO:teuthology.orchestra.console.smithi179:Power off 2024-04-16T15:54:11.738 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-16T15:54:11.751 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2024-04-16T15:54:11.762 DEBUG:teuthology.orchestra.console.smithi179:power off output: Chassis Power Control: Down/Off 2024-04-16T15:54:11.762 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T15:54:11.786 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2024-04-16T15:54:15.752 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T15:54:15.788 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T15:54:15.864 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2024-04-16T15:54:15.899 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2024-04-16T15:54:19.866 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T15:54:19.900 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T15:54:19.979 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2024-04-16T15:54:20.014 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2024-04-16T15:54:20.081 INFO:teuthology.orchestra.console.smithi132:Power off completed 2024-04-16T15:54:20.117 INFO:teuthology.orchestra.console.smithi179:Power off completed 2024-04-16T15:54:20.222 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/data-scan} duration: 547.6727573871613 failure_reason: 'Test failure: test_extra_data_pool_rebuild_few_files (tasks.cephfs.test_data_scan.TestDataScan)' flavor: default owner: scheduled_leonidus@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=92dd9784ee38472bbeb3a710cd436c0d status: fail success: false 2024-04-16T15:54:20.222 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-16T15:54:20.312 INFO:teuthology.run:FAIL